May 28 00:54:28.040838 np0000001577 systemd[1]: Started devstack@n-cpu.service - Devstack devstack@n-cpu.service.
May 28 00:54:29.679047 np0000001577 nova-compute[98319]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=98319) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}}
May 28 00:54:29.679676 np0000001577 nova-compute[98319]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=98319) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}}
May 28 00:54:29.679676 np0000001577 nova-compute[98319]: INFO os_vif [-] Loaded VIF plugins: noop, ovs
May 28 00:54:29.809645 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:54:29.819844 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.010s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:54:29.977683 np0000001577 nova-compute[98319]: INFO oslo_service.periodic_task [-] Skipping periodic task _heal_instance_info_cache because its interval is negative
May 28 00:54:30.731368 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] In native threading mode the number of concurrent builds, and snapshots should be limited to the same number. The current configuration has differing limits: max_concurrent_builds: 10, max_concurrent_snapshots: 5. Nova will use a single, overall limit of 10 for these tasks.
May 28 00:54:30.731656 np0000001577 nova-compute[98319]: INFO nova.utils [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] The long task thread pool MainProcess.long_task is initialized
May 28 00:54:30.731836 np0000001577 nova-compute[98319]: INFO nova.virt.driver [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Loading compute driver 'libvirt.LibvirtDriver'
May 28 00:54:30.821230 np0000001577 nova-compute[98319]: INFO nova.compute.provider_config [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
May 28 00:54:31.323732 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Acquiring lock "singleton_lock" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:54:31.323732 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Acquired lock "singleton_lock" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:54:31.324035 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Releasing lock "singleton_lock" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:54:31.324236 np0000001577 nova-compute[98319]: WARNING oslo_service.backend._threading.service [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] no_fork=True: running service in main process
May 28 00:54:31.325600 np0000001577 nova-compute[98319]: INFO nova.service [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Starting compute node (version 33.1.0)
May 28 00:54:31.827990 np0000001577 nova-compute[98319]: INFO nova.utils [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] The default thread pool MainProcess.default is initialized
May 28 00:54:31.828526 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:54:31.828754 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Starting event thread {{(pid=98319) start /opt/stack/nova/nova/virt/libvirt/host.py:252}}
May 28 00:54:31.829157 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Starting connection event dispatch thread {{(pid=98319) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:553}}
May 28 00:54:31.829777 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Connecting to libvirt: qemu:///system {{(pid=98319) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:558}}
May 28 00:54:32.658470 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7c988f95f800> {{(pid=98319) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:564}}
May 28 00:54:32.661018 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7c988f95f800> {{(pid=98319) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:585}}
May 28 00:54:32.661783 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Connection event '1' reason 'None'
May 28 00:54:33.165362 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Cannot update service status on host "np0000001577" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000001577 could not be found.
May 28 00:54:33.165914 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.mount [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Initialising _HostMountState generation 0 {{(pid=98319) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
May 28 00:54:43.207814 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host capabilities <capabilities>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:   <host>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:     <uuid>ad940602-9daf-4235-b826-3c8c653263e3</uuid>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:     <cpu>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <arch>x86_64</arch>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <model>EPYC-Milan</model>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <vendor>AMD</vendor>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <microcode version='16777317'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <signature family='25' model='1' stepping='1'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <topology sockets='12' dies='1' cores='1' threads='1'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <maxphysaddr mode='emulate' bits='40'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <feature name='x2apic'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <feature name='tsc-deadline'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <feature name='osxsave'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <feature name='hypervisor'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <feature name='tsc_adjust'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <feature name='ospke'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <feature name='vaes'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <feature name='vpclmulqdq'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <feature name='spec-ctrl'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <feature name='stibp'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <feature name='arch-capabilities'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <feature name='ssbd'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <feature name='cmp_legacy'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <feature name='topoext'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <feature name='stibp-always-on'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <feature name='virt-ssbd'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <feature name='amd-psfd'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <feature name='lbrv'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <feature name='tsc-scale'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <feature name='vmcb-clean'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <feature name='flushbyasid'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <feature name='pause-filter'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <feature name='pfthreshold'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <feature name='v-vmsave-vmload'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <feature name='vgif'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <feature name='no-nested-data-bp'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <feature name='lfence-always-serializing'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <feature name='null-sel-clr-base'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <feature name='rdctl-no'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <feature name='skip-l1dfl-vmentry'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <feature name='mds-no'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <feature name='pschange-mc-no'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <feature name='gds-no'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <pages unit='KiB' size='4'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <pages unit='KiB' size='2048'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <pages unit='KiB' size='1048576'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:     </cpu>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:     <power_management/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:     <iommu support='no'/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:     <migration_features>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <live/>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       <uri_transports>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:         <uri_transport>tcp</uri_transport>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:         <uri_transport>rdma</uri_transport>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:       </uri_transports>
May 28 00:54:43.207814 np0000001577 nova-compute[98319]:     </migration_features>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:     <topology>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:       <cells num='1'>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:         <cell id='0'>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:           <memory unit='KiB'>24607192</memory>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:           <pages unit='KiB' size='4'>6151798</pages>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:           <pages unit='KiB' size='2048'>0</pages>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:           <pages unit='KiB' size='1048576'>0</pages>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:           <distances>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:             <sibling id='0' value='10'/>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:           </distances>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:           <cpus num='12'>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:             <cpu id='1' socket_id='1' die_id='1' core_id='0' siblings='1'/>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:             <cpu id='2' socket_id='2' die_id='2' core_id='0' siblings='2'/>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:             <cpu id='3' socket_id='3' die_id='3' core_id='0' siblings='3'/>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:             <cpu id='4' socket_id='4' die_id='4' core_id='0' siblings='4'/>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:             <cpu id='5' socket_id='5' die_id='5' core_id='0' siblings='5'/>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:             <cpu id='6' socket_id='6' die_id='6' core_id='0' siblings='6'/>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:             <cpu id='7' socket_id='7' die_id='7' core_id='0' siblings='7'/>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:             <cpu id='8' socket_id='8' die_id='8' core_id='0' siblings='8'/>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:             <cpu id='9' socket_id='9' die_id='9' core_id='0' siblings='9'/>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:             <cpu id='10' socket_id='10' die_id='10' core_id='0' siblings='10'/>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:             <cpu id='11' socket_id='11' die_id='11' core_id='0' siblings='11'/>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:           </cpus>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:         </cell>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:       </cells>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:     </topology>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:     <cache>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:       <bank id='0' level='3' type='both' size='32' unit='MiB' cpus='0'/>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:       <bank id='1' level='3' type='both' size='32' unit='MiB' cpus='1'/>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:       <bank id='2' level='3' type='both' size='32' unit='MiB' cpus='2'/>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:       <bank id='3' level='3' type='both' size='32' unit='MiB' cpus='3'/>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:       <bank id='4' level='3' type='both' size='32' unit='MiB' cpus='4'/>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:       <bank id='5' level='3' type='both' size='32' unit='MiB' cpus='5'/>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:       <bank id='6' level='3' type='both' size='32' unit='MiB' cpus='6'/>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:       <bank id='7' level='3' type='both' size='32' unit='MiB' cpus='7'/>
May 28 00:54:43.210103 np0000001577 nova-compute[98319]:       <bank id='8' level='3' type='both' size='32' unit='MiB' cpus='8'/>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <bank id='9' level='3' type='both' size='32' unit='MiB' cpus='9'/>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <bank id='10' level='3' type='both' size='32' unit='MiB' cpus='10'/>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <bank id='11' level='3' type='both' size='32' unit='MiB' cpus='11'/>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:     </cache>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:     <secmodel>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <model>apparmor</model>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <doi>0</doi>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:     </secmodel>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:     <secmodel>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <model>dac</model>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <doi>0</doi>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <baselabel type='kvm'>+64055:+993</baselabel>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <baselabel type='qemu'>+64055:+993</baselabel>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:     </secmodel>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:   </host>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:   <guest>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:     <os_type>hvm</os_type>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:     <arch name='alpha'>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <wordsize>64</wordsize>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>clipper</machine>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <domain type='qemu'/>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:     </arch>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:     <features>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <cpuselection/>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <deviceboot/>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <externalSnapshot/>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:     </features>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:   </guest>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:   <guest>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:     <os_type>hvm</os_type>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:     <arch name='armv6l'>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <wordsize>32</wordsize>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-arm</emulator>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-8.2</machine>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>mori-bmc</machine>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>ast2600-evb</machine>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>borzoi</machine>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>spitz</machine>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>virt-2.7</machine>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>nuri</machine>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>romulus-bmc</machine>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-3.0</machine>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-5.0</machine>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>npcm750-evb</machine>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>virt-2.10</machine>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>rainier-bmc</machine>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>mps3-an547</machine>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>musca-b1</machine>
May 28 00:54:43.211271 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>versatileab</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>kzm</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>virt-2.8</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>fby35-bmc</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>musca-a</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-3.1</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-5.1</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>smdkc210</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>sx1</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>virt-2.11</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>imx25-pdk</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>virt-2.9</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>orangepi-pc</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>z2</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-5.2</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>tosa</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>mps2-an500</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>virt-2.12</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>mps2-an521</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>sabrelite</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>mps2-an511</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>canon-a1100</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>realview-eb</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-7.0</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-4.0</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>raspi1ap</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>sx1-v1</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>n810</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>g220a-bmc</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>n800</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-7.1</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 28 00:54:43.213120 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-4.1</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>quanta-gsj</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>versatilepb</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>terrier</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>mainstone</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>integratorcp</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-7.2</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-4.2</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>mps3-an524</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>kudo-bmc</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>vexpress-a9</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>midway</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>musicpal</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>lm3s811evb</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>microbit</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='3'>fby35</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>mps2-an505</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>mps2-an385</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-6.0</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-8.0</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>cubieboard</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>ast1030-evb</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>verdex</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>bpim2u</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>netduino2</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>mps2-an386</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-6.1</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-8.1</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>raspi2b</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>vexpress-a15</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>fuji-bmc</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-6.2</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>cheetah</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>virt-2.6</machine>
May 28 00:54:43.214464 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>ast2500-evb</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>highbank</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>akita</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>connex</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>netduinoplus2</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>collie</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>raspi0</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <domain type='qemu'/>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:     </arch>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:     <features>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <cpuselection/>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <deviceboot/>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <externalSnapshot/>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:     </features>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:   </guest>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:   <guest>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:     <os_type>hvm</os_type>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:     <arch name='armv7l'>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <wordsize>32</wordsize>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-arm</emulator>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-8.2</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>mori-bmc</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>ast2600-evb</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>borzoi</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>spitz</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>virt-2.7</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>nuri</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>romulus-bmc</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-3.0</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-5.0</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>npcm750-evb</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>virt-2.10</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>rainier-bmc</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>mps3-an547</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>musca-b1</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>versatileab</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>kzm</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>virt-2.8</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>fby35-bmc</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>musca-a</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-3.1</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 28 00:54:43.215791 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-5.1</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>smdkc210</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>sx1</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>virt-2.11</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>imx25-pdk</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>virt-2.9</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>orangepi-pc</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>z2</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-5.2</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>tosa</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>mps2-an500</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>virt-2.12</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>mps2-an521</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>sabrelite</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>mps2-an511</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>canon-a1100</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>realview-eb</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-7.0</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-4.0</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>raspi1ap</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>sx1-v1</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>n810</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>g220a-bmc</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>n800</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-7.1</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-4.1</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>quanta-gsj</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>versatilepb</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>terrier</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>mainstone</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>integratorcp</machine>
May 28 00:54:43.217243 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-7.2</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-4.2</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>mps3-an524</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>kudo-bmc</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>vexpress-a9</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>midway</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>musicpal</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>lm3s811evb</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>microbit</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='3'>fby35</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>mps2-an505</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>mps2-an385</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-6.0</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-8.0</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>cubieboard</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>ast1030-evb</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>verdex</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>bpim2u</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>netduino2</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>mps2-an386</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-6.1</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-8.1</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>raspi2b</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>vexpress-a15</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>fuji-bmc</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-6.2</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>cheetah</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>virt-2.6</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>ast2500-evb</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>highbank</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>akita</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>connex</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>netduinoplus2</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>collie</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>raspi0</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 28 00:54:43.218458 np0000001577 nova-compute[98319]:       <domain type='qemu'/>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:     </arch>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:     <features>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <cpuselection/>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <deviceboot/>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <externalSnapshot/>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:     </features>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:   </guest>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:   <guest>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:     <os_type>hvm</os_type>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:     <arch name='aarch64'>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <wordsize>64</wordsize>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-8.2</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>mori-bmc</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>ast2600-evb</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>borzoi</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>spitz</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>virt-2.7</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>nuri</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>romulus-bmc</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-3.0</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-5.0</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>npcm750-evb</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>virt-2.10</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>rainier-bmc</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>mps3-an547</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>virt-2.8</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>musca-b1</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>versatileab</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>kzm</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>fby35-bmc</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>musca-a</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-3.1</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-5.1</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>smdkc210</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>sx1</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>virt-2.11</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>imx25-pdk</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>virt-2.9</machine>
May 28 00:54:43.219928 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>orangepi-pc</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>z2</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-5.2</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='6'>xlnx-zcu102</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>tosa</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>mps2-an500</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>virt-2.12</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>mps2-an521</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>sabrelite</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>mps2-an511</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>canon-a1100</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>realview-eb</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>sbsa-ref</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-7.0</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-4.0</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>raspi1ap</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>sx1-v1</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>n810</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>g220a-bmc</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>n800</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-7.1</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-4.1</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>quanta-gsj</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>versatilepb</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>terrier</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>mainstone</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>integratorcp</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-7.2</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-4.2</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 28 00:54:43.221316 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>mps3-an524</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>kudo-bmc</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>vexpress-a9</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>midway</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>musicpal</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>lm3s811evb</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>microbit</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='3'>fby35</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>mps2-an505</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>mps2-an385</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-6.0</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-8.0</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>raspi3ap</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>cubieboard</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>ast1030-evb</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>verdex</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>bpim2u</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>netduino2</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>xlnx-versal-virt</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>mps2-an386</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-6.1</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-8.1</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>raspi3b</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>raspi2b</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>vexpress-a15</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='2'>fuji-bmc</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt-6.2</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>cheetah</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>virt-2.6</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>ast2500-evb</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>highbank</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>akita</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>connex</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>netduinoplus2</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>collie</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>raspi0</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <domain type='qemu'/>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:     </arch>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:     <features>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <acpi default='on' toggle='yes'/>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <cpuselection/>
May 28 00:54:43.222616 np0000001577 nova-compute[98319]:       <deviceboot/>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <externalSnapshot/>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:     </features>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:   </guest>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:   <guest>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:     <os_type>hvm</os_type>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:     <arch name='cris'>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <wordsize>32</wordsize>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-cris</emulator>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>axis-dev88</machine>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <domain type='qemu'/>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:     </arch>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:     <features>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <cpuselection/>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <deviceboot/>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <externalSnapshot/>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:     </features>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:   </guest>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:   <guest>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:     <os_type>hvm</os_type>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:     <arch name='i686'>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <wordsize>32</wordsize>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-i386</emulator>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-noble-v2</machine>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <machine canonical='pc-i440fx-noble-v2' maxCpus='255'>ubuntu</machine>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-mantic</machine>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-5.2</machine>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-lunar-hpb</machine>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-mantic</machine>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.0</machine>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-kinetic</machine>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-4.2</machine>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-mantic-maxcpus</machine>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-q35-xenial</machine>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-q35-2.7</machine>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
May 28 00:54:43.224024 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-groovy</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-lunar</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='1024'>pc-q35-mantic-hpb-maxcpus</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-7.1</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-artful</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-trusty</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.2</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='1024'>pc-q35-8.1</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='1024'>pc-q35-jammy-maxcpus</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-mantic-hpb</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-8.1</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-6.1</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-kinetic</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='1024'>pc-i440fx-jammy-maxcpus</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-q35-2.4</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-7.1</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-2.10</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>x-remote</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-5.1</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-2.9</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb-maxcpus</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-3.1</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-4.1</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-jammy</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
May 28 00:54:43.225521 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-eoan</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-lunar</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>isapc</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-q35-2.6</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='1024'>pc-q35-mantic-maxcpus</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-bionic</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-2.12</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-kinetic-hpb</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-7.0</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='1024'>pc-q35-noble-v2</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine canonical='pc-q35-noble-v2' maxCpus='1024'>ubuntu-q35</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-lunar-hpb</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-disco</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='1024'>pc-q35-noble</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine canonical='pc-q35-noble' maxCpus='1024'>q35</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.1</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-8.0</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-impish</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-8.0</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-6.0</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
May 28 00:54:43.226805 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-7.0</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-5.0</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-2.8</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-3.0</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-zesty</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-7.2</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-4.0</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-focal</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>microvm</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.3</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine maxCpus='1024'>pc-q35-jammy-hpb-maxcpus</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine maxCpus='1024'>pc-q35-8.2</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine canonical='pc-q35-8.2' maxCpus='1024'>q35</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-kinetic-hpb</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-noble</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine canonical='pc-i440fx-noble' maxCpus='255'>pc</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-8.2</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine canonical='pc-i440fx-8.2' maxCpus='255'>pc</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-6.2</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-q35-2.5</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
May 28 00:54:43.227944 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb-maxcpus</machine>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-7.2</machine>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-2.11</machine>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <domain type='qemu'/>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <domain type='kvm'/>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:     </arch>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:     <features>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <pae/>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <nonpae/>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <acpi default='on' toggle='yes'/>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <apic default='on' toggle='no'/>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <cpuselection/>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <deviceboot/>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <externalSnapshot/>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:     </features>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:   </guest>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:   <guest>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:     <os_type>hvm</os_type>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:     <arch name='m68k'>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <wordsize>32</wordsize>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>mcf5208evb</machine>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>virt-7.0</machine>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>an5206</machine>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>virt-6.0</machine>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>q800</machine>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>virt-8.1</machine>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>virt-7.2</machine>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>virt-6.2</machine>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>virt-8.0</machine>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>next-cube</machine>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>virt-7.1</machine>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>virt-6.1</machine>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>virt-8.2</machine>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <machine canonical='virt-8.2' maxCpus='1'>virt</machine>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <domain type='qemu'/>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:     </arch>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:     <features>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <cpuselection/>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <deviceboot/>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <externalSnapshot/>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:     </features>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:   </guest>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:   <guest>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:     <os_type>hvm</os_type>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:     <arch name='microblaze'>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <wordsize>32</wordsize>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>petalogix-ml605</machine>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <domain type='qemu'/>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:     </arch>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:     <features>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <cpuselection/>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <deviceboot/>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <externalSnapshot/>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:     </features>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:   </guest>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:   <guest>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:     <os_type>hvm</os_type>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:     <arch name='microblazeel'>
May 28 00:54:43.229152 np0000001577 nova-compute[98319]:       <wordsize>32</wordsize>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>petalogix-ml605</machine>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <domain type='qemu'/>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:     </arch>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:     <features>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <cpuselection/>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <deviceboot/>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <externalSnapshot/>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:     </features>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:   </guest>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:   <guest>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:     <os_type>hvm</os_type>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:     <arch name='mips'>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <wordsize>32</wordsize>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-mips</emulator>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <machine maxCpus='16'>malta</machine>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>mipssim</machine>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <domain type='qemu'/>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:     </arch>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:     <features>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <cpuselection/>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <deviceboot/>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <externalSnapshot/>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:     </features>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:   </guest>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:   <guest>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:     <os_type>hvm</os_type>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:     <arch name='mipsel'>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <wordsize>32</wordsize>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <machine maxCpus='16'>malta</machine>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>mipssim</machine>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <domain type='qemu'/>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:     </arch>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:     <features>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <cpuselection/>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <deviceboot/>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <externalSnapshot/>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:     </features>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:   </guest>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:   <guest>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:     <os_type>hvm</os_type>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:     <arch name='mips64'>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <wordsize>64</wordsize>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <machine maxCpus='16'>malta</machine>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>mipssim</machine>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>pica61</machine>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>magnum</machine>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <domain type='qemu'/>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:     </arch>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:     <features>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <cpuselection/>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <deviceboot/>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <externalSnapshot/>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:     </features>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:   </guest>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:   <guest>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:     <os_type>hvm</os_type>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:     <arch name='mips64el'>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <wordsize>64</wordsize>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
May 28 00:54:43.231107 np0000001577 nova-compute[98319]:       <machine maxCpus='16'>malta</machine>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <machine maxCpus='16'>loongson3-virt</machine>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>mipssim</machine>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>pica61</machine>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>magnum</machine>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <machine maxCpus='16'>boston</machine>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>fuloong2e</machine>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <domain type='qemu'/>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:     </arch>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:     <features>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <cpuselection/>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <deviceboot/>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <externalSnapshot/>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:     </features>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:   </guest>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:   <guest>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:     <os_type>hvm</os_type>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:     <arch name='ppc'>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <wordsize>32</wordsize>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>g3beige</machine>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>amigaone</machine>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>virtex-ml507</machine>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>mac99</machine>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <machine maxCpus='32'>ppce500</machine>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>sam460ex</machine>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>pegasos2</machine>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>bamboo</machine>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>40p</machine>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>ref405ep</machine>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <machine maxCpus='15'>mpc8544ds</machine>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <domain type='qemu'/>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:     </arch>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:     <features>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <cpuselection/>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <deviceboot/>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <externalSnapshot/>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:     </features>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:   </guest>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:   <guest>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:     <os_type>hvm</os_type>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:     <arch name='ppc64'>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <wordsize>64</wordsize>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-noble</machine>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <machine canonical='pseries-noble' maxCpus='4096'>pseries</machine>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>amigaone</machine>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <machine maxCpus='2048'>powernv9</machine>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-4.1</machine>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <machine maxCpus='15'>mpc8544ds</machine>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-6.1</machine>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.5</machine>
May 28 00:54:43.232539 np0000001577 nova-compute[98319]:       <machine maxCpus='2048'>powernv10</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-xenial</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-4.2</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-6.2</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-yakkety</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.6</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='32'>ppce500</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-bionic-sxxm</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.7</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-3.0</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-8.0</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-5.0</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>40p</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-lunar</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.8</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>pegasos2</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-hirsute</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-3.1</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-8.1</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-5.1</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-eoan</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.9</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-zesty</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>bamboo</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-groovy</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-focal</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>g3beige</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-8.2</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-5.2</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-disco</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.12-sxxm</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-mantic</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-kinetic</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.10</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-7.0</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>virtex-ml507</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.11</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.1</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-7.1</machine>
May 28 00:54:43.233611 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-cosmic</machine>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-bionic</machine>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.12</machine>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.2</machine>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-7.2</machine>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>mac99</machine>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-impish</machine>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-jammy</machine>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-artful</machine>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>sam460ex</machine>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>ref405ep</machine>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.3</machine>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <machine maxCpus='2048'>powernv8</machine>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-4.0</machine>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-6.0</machine>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.4</machine>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <domain type='qemu'/>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:     </arch>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:     <features>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <cpuselection/>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <deviceboot/>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <externalSnapshot/>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:     </features>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:   </guest>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:   <guest>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:     <os_type>hvm</os_type>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:     <arch name='ppc64le'>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <wordsize>64</wordsize>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-noble</machine>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <machine canonical='pseries-noble' maxCpus='4096'>pseries</machine>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>amigaone</machine>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <machine maxCpus='2048'>powernv9</machine>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-4.1</machine>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <machine maxCpus='15'>mpc8544ds</machine>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-6.1</machine>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.5</machine>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <machine maxCpus='2048'>powernv10</machine>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-xenial</machine>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-4.2</machine>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-6.2</machine>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-yakkety</machine>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.6</machine>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <machine maxCpus='32'>ppce500</machine>
May 28 00:54:43.234361 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-bionic-sxxm</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.7</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-3.0</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-8.0</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-5.0</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>40p</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-lunar</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.8</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>pegasos2</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-hirsute</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-3.1</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-8.1</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-5.1</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-eoan</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.9</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-zesty</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>bamboo</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-groovy</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-focal</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>g3beige</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-8.2</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-5.2</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-disco</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.12-sxxm</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-mantic</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-kinetic</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.10</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-7.0</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>virtex-ml507</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.11</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.1</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-7.1</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-cosmic</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-bionic</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.12</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.2</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-7.2</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>mac99</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-impish</machine>
May 28 00:54:43.235297 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-jammy</machine>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-artful</machine>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>sam460ex</machine>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>ref405ep</machine>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.3</machine>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <machine maxCpus='2048'>powernv8</machine>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-4.0</machine>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-6.0</machine>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.4</machine>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <domain type='qemu'/>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:     </arch>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:     <features>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <cpuselection/>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <deviceboot/>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <externalSnapshot/>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:     </features>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:   </guest>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:   <guest>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:     <os_type>hvm</os_type>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:     <arch name='riscv32'>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <wordsize>32</wordsize>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt</machine>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <machine maxCpus='8'>spike</machine>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>opentitan</machine>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <machine maxCpus='5'>sifive_u</machine>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>sifive_e</machine>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <domain type='qemu'/>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:     </arch>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:     <features>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <cpuselection/>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <deviceboot/>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <externalSnapshot/>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:     </features>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:   </guest>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:   <guest>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:     <os_type>hvm</os_type>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:     <arch name='riscv64'>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <wordsize>64</wordsize>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <machine maxCpus='512'>virt</machine>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <machine maxCpus='8'>spike</machine>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <machine maxCpus='5'>sifive_u</machine>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>shakti_c</machine>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>sifive_e</machine>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <domain type='qemu'/>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:     </arch>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:     <features>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <cpuselection/>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <deviceboot/>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <externalSnapshot/>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:     </features>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:   </guest>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:   <guest>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:     <os_type>hvm</os_type>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:     <arch name='s390x'>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <wordsize>64</wordsize>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
May 28 00:54:43.236129 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-noble</machine>
May 28 00:54:43.237382 np0000001577 nova-compute[98319]:       <machine canonical='s390-ccw-virtio-noble' maxCpus='248'>s390-ccw-virtio</machine>
May 28 00:54:43.237382 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-8.0</machine>
May 28 00:54:43.237382 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
May 28 00:54:43.237382 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
May 28 00:54:43.237382 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
May 28 00:54:43.237382 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-7.0</machine>
May 28 00:54:43.237382 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-mantic</machine>
May 28 00:54:43.237382 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
May 28 00:54:43.237382 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
May 28 00:54:43.237382 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
May 28 00:54:43.237382 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
May 28 00:54:43.237382 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
May 28 00:54:43.237382 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
May 28 00:54:43.237382 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-8.2</machine>
May 28 00:54:43.237382 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
May 28 00:54:43.237382 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
May 28 00:54:43.237382 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
May 28 00:54:43.237382 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
May 28 00:54:43.237382 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-7.2</machine>
May 28 00:54:43.237382 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
May 28 00:54:43.237382 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
May 28 00:54:43.237382 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
May 28 00:54:43.237382 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
May 28 00:54:43.237382 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
May 28 00:54:43.237382 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
May 28 00:54:43.237382 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-lunar</machine>
May 28 00:54:43.237382 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
May 28 00:54:43.237382 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-kinetic</machine>
May 28 00:54:43.237382 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-8.1</machine>
May 28 00:54:43.237382 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
May 28 00:54:43.237382 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
May 28 00:54:43.237382 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
May 28 00:54:43.237382 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-7.1</machine>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <domain type='qemu'/>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:     </arch>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:     <features>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <cpuselection/>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <deviceboot/>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <externalSnapshot/>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:     </features>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:   </guest>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:   <guest>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:     <os_type>hvm</os_type>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:     <arch name='sh4'>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <wordsize>32</wordsize>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>shix</machine>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>r2d</machine>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <domain type='qemu'/>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:     </arch>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:     <features>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <cpuselection/>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <deviceboot/>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <externalSnapshot/>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:     </features>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:   </guest>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:   <guest>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:     <os_type>hvm</os_type>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:     <arch name='sh4eb'>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <wordsize>64</wordsize>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>shix</machine>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>r2d</machine>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <domain type='qemu'/>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:     </arch>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:     <features>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <cpuselection/>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <deviceboot/>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <externalSnapshot/>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:     </features>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:   </guest>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:   <guest>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:     <os_type>hvm</os_type>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:     <arch name='sparc'>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <wordsize>32</wordsize>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>SS-5</machine>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>SS-20</machine>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>LX</machine>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>SPARCClassic</machine>
May 28 00:54:43.238202 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>leon3_generic</machine>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>SPARCbook</machine>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>SS-4</machine>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>SS-600MP</machine>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>SS-10</machine>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>Voyager</machine>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <domain type='qemu'/>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:     </arch>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:     <features>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <cpuselection/>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <deviceboot/>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <externalSnapshot/>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:     </features>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:   </guest>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:   <guest>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:     <os_type>hvm</os_type>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:     <arch name='sparc64'>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <wordsize>64</wordsize>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>sun4u</machine>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>niagara</machine>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>sun4v</machine>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <domain type='qemu'/>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:     </arch>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:     <features>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <cpuselection/>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <deviceboot/>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <externalSnapshot/>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:     </features>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:   </guest>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:   <guest>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:     <os_type>hvm</os_type>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:     <arch name='x86_64'>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <wordsize>64</wordsize>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-noble-v2</machine>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <machine canonical='pc-i440fx-noble-v2' maxCpus='255'>ubuntu</machine>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-mantic</machine>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-5.2</machine>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-lunar-hpb</machine>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-mantic</machine>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.0</machine>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-kinetic</machine>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-4.2</machine>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-mantic-maxcpus</machine>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
May 28 00:54:43.239347 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-q35-xenial</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-q35-2.7</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-groovy</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-lunar</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='1024'>pc-q35-mantic-hpb-maxcpus</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-7.1</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-artful</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-trusty</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.2</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='1024'>pc-q35-8.1</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='1024'>pc-q35-jammy-maxcpus</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-mantic-hpb</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-8.1</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-6.1</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-kinetic</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='1024'>pc-i440fx-jammy-maxcpus</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-q35-2.4</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-7.1</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-2.10</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>x-remote</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-5.1</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-2.9</machine>
May 28 00:54:43.240428 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb-maxcpus</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-3.1</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-4.1</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-jammy</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-eoan</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-lunar</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='1'>isapc</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-q35-2.6</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='1024'>pc-q35-mantic-maxcpus</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-bionic</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-2.12</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-kinetic-hpb</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-7.0</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='1024'>pc-q35-noble-v2</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine canonical='pc-q35-noble-v2' maxCpus='1024'>ubuntu-q35</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-lunar-hpb</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-disco</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.1</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='1024'>pc-q35-noble</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine canonical='pc-q35-noble' maxCpus='1024'>q35</machine>
May 28 00:54:43.241432 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-8.0</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-impish</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-8.0</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-6.0</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-7.0</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-5.0</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-2.8</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-3.0</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-zesty</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-7.2</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-4.0</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-focal</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>microvm</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.3</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine maxCpus='1024'>pc-q35-jammy-hpb-maxcpus</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-kinetic-hpb</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-noble</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine canonical='pc-i440fx-noble' maxCpus='255'>pc</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine maxCpus='1024'>pc-q35-8.2</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine canonical='pc-q35-8.2' maxCpus='1024'>q35</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-8.2</machine>
May 28 00:54:43.242158 np0000001577 nova-compute[98319]:       <machine canonical='pc-i440fx-8.2' maxCpus='255'>pc</machine>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-6.2</machine>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-q35-2.5</machine>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb-maxcpus</machine>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-7.2</machine>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-2.11</machine>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <domain type='qemu'/>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <domain type='kvm'/>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:     </arch>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:     <features>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <acpi default='on' toggle='yes'/>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <apic default='on' toggle='no'/>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <cpuselection/>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <deviceboot/>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <externalSnapshot/>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:     </features>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:   </guest>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:   <guest>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:     <os_type>hvm</os_type>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:     <arch name='xtensa'>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <wordsize>32</wordsize>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>sim</machine>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <machine maxCpus='32'>kc705</machine>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <machine maxCpus='32'>ml605</machine>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <machine maxCpus='32'>ml605-nommu</machine>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <machine maxCpus='32'>virt</machine>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <machine maxCpus='32'>lx60-nommu</machine>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <machine maxCpus='32'>lx200</machine>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <machine maxCpus='32'>lx200-nommu</machine>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <machine maxCpus='32'>lx60</machine>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <machine maxCpus='32'>kc705-nommu</machine>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <domain type='qemu'/>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:     </arch>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:     <features>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <cpuselection/>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <deviceboot/>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <externalSnapshot/>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:     </features>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:   </guest>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:   <guest>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:     <os_type>hvm</os_type>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:     <arch name='xtensaeb'>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <wordsize>32</wordsize>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <machine maxCpus='4'>sim</machine>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <machine maxCpus='32'>kc705</machine>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <machine maxCpus='32'>ml605</machine>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <machine maxCpus='32'>ml605-nommu</machine>
May 28 00:54:43.242829 np0000001577 nova-compute[98319]:       <machine maxCpus='32'>virt</machine>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:       <machine maxCpus='32'>lx60-nommu</machine>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:       <machine maxCpus='32'>lx200</machine>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:       <machine maxCpus='32'>lx200-nommu</machine>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:       <machine maxCpus='32'>lx60</machine>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:       <machine maxCpus='32'>kc705-nommu</machine>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:       <domain type='qemu'/>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:     </arch>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:     <features>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:       <cpuselection/>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:       <deviceboot/>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:       <externalSnapshot/>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:     </features>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:   </guest>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]: </capabilities>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]: 
May 28 00:54:43.243887 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 00:54:43.243887 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=alpha and machine_type=None:
May 28 00:54:43.243887 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-alpha</path>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:   <machine>clipper</machine>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:   <arch>alpha</arch>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:   <vcpu max='4'/>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:     <enum name='firmware'/>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.243887 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>sata</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>vga</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>cirrus</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>bochs</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>virtiofs</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:     <tpm supported='no'/>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:     <redirdev supported='yes'>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.245051 np0000001577 nova-compute[98319]:     </redirdev>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:     <gic supported='no'/>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:     <genid supported='no'/>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.246589 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 00:54:43.246589 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=None:
May 28 00:54:43.246589 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-arm</path>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:   <machine>virt-8.2</machine>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:   <arch>armv6l</arch>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:   <vcpu max='512'/>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:     <enum name='firmware'/>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.246589 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='yes'>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:       <enum name='maximumMigratable'>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:         <value>on</value>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:         <value>off</value>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>max</model>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 28 00:54:43.247911 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:         <value>sata</value>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:         <value>vga</value>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:         <value>cirrus</value>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:         <value>bochs</value>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:         <value>ramfb</value>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.248616 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:         <value>virtiofs</value>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:     <tpm supported='yes'>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:         <value>tpm-tis</value>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:         <value>passthrough</value>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:         <value>emulator</value>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:         <value>external</value>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:       <enum name='backendVersion'>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:         <value>1.2</value>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:         <value>2.0</value>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:     </tpm>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:     <redirdev supported='yes'>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:     </redirdev>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:     <gic supported='yes'>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:       <enum name='version'>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:         <value>2</value>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:         <value>3</value>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:     </gic>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='yes'/>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:     <genid supported='no'/>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.249906 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.251461 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=virt:
May 28 00:54:43.251461 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-arm</path>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:   <machine>virt-8.2</machine>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:   <arch>armv6l</arch>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:   <vcpu max='512'/>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:     <enum name='firmware'/>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='yes'>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:       <enum name='maximumMigratable'>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:         <value>on</value>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:         <value>off</value>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 28 00:54:43.251461 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>max</model>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.252371 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>sata</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>vga</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>cirrus</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>bochs</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>ramfb</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>virtiofs</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:     <tpm supported='yes'>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>tpm-tis</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>passthrough</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>emulator</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>external</value>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:       <enum name='backendVersion'>
May 28 00:54:43.253232 np0000001577 nova-compute[98319]:         <value>1.2</value>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:         <value>2.0</value>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:     </tpm>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:     <redirdev supported='yes'>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:     </redirdev>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:     <gic supported='yes'>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:       <enum name='version'>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:         <value>2</value>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:         <value>3</value>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:     </gic>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='yes'/>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:     <genid supported='no'/>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.254609 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 00:54:43.254609 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=armv7l and machine_type=virt:
May 28 00:54:43.254609 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-arm</path>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:   <machine>virt-8.2</machine>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:   <arch>armv7l</arch>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:   <vcpu max='512'/>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:     <enum name='firmware'>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:       <value>efi</value>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.254609 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='yes'>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:       <enum name='maximumMigratable'>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:         <value>on</value>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:         <value>off</value>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 28 00:54:43.255871 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>max</model>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:         <value>sata</value>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:         <value>vga</value>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:         <value>cirrus</value>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:         <value>bochs</value>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:         <value>ramfb</value>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.256655 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:         <value>virtiofs</value>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:     <tpm supported='yes'>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:         <value>tpm-tis</value>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:         <value>passthrough</value>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:         <value>emulator</value>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:         <value>external</value>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:       <enum name='backendVersion'>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:         <value>1.2</value>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:         <value>2.0</value>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:     </tpm>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:     <redirdev supported='yes'>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:     </redirdev>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:     <gic supported='yes'>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:       <enum name='version'>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:         <value>2</value>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:         <value>3</value>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.257764 np0000001577 nova-compute[98319]:     </gic>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='yes'/>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:     <genid supported='no'/>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.259218 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 00:54:43.259218 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=aarch64 and machine_type=virt:
May 28 00:54:43.259218 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-aarch64</path>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:   <machine>virt-8.2</machine>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:   <arch>aarch64</arch>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:   <vcpu max='512'/>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:     <enum name='firmware'>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:       <value>efi</value>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.ms.fd</value>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.secboot.fd</value>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.no-secboot.fd</value>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='yes'>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:       <enum name='maximumMigratable'>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:         <value>on</value>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:         <value>off</value>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>neoverse-n2</model>
May 28 00:54:43.259218 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 28 00:54:43.260279 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 28 00:54:43.260279 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 28 00:54:43.260279 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a57</model>
May 28 00:54:43.260279 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 28 00:54:43.260279 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 28 00:54:43.260279 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 28 00:54:43.260279 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 28 00:54:43.260279 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 28 00:54:43.260279 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 28 00:54:43.260279 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a76</model>
May 28 00:54:43.260279 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>a64fx</model>
May 28 00:54:43.260279 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 28 00:54:43.260279 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>neoverse-v1</model>
May 28 00:54:43.260279 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 28 00:54:43.260279 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 28 00:54:43.260279 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 28 00:54:43.260279 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 28 00:54:43.260279 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 28 00:54:43.260279 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 28 00:54:43.260279 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 28 00:54:43.260279 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 28 00:54:43.260279 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 28 00:54:43.260279 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 28 00:54:43.260279 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 28 00:54:43.260279 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 28 00:54:43.260279 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a710</model>
May 28 00:54:43.260279 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 28 00:54:43.260279 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 28 00:54:43.260279 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 28 00:54:43.260279 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>max</model>
May 28 00:54:43.260279 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a53</model>
May 28 00:54:43.260279 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a72</model>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a55</model>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>neoverse-n1</model>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a35</model>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:         <value>sata</value>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:         <value>vga</value>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:         <value>cirrus</value>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:         <value>bochs</value>
May 28 00:54:43.260876 np0000001577 nova-compute[98319]:         <value>ramfb</value>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:         <value>virtiofs</value>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:     <tpm supported='yes'>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:         <value>tpm-tis</value>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:         <value>passthrough</value>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:         <value>emulator</value>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:         <value>external</value>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:       <enum name='backendVersion'>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:         <value>1.2</value>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:         <value>2.0</value>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:     </tpm>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:     <redirdev supported='yes'>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:     </redirdev>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:     <gic supported='yes'>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:       <enum name='version'>
May 28 00:54:43.261906 np0000001577 nova-compute[98319]:         <value>2</value>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:         <value>3</value>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:     </gic>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='yes'/>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:     <genid supported='no'/>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.263307 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 00:54:43.263307 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=cris and machine_type=None:
May 28 00:54:43.263307 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-cris</path>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:   <machine>axis-dev88</machine>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:   <arch>cris</arch>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:   <vcpu max='1'/>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:     <enum name='firmware'/>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.263307 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:       <enum name='model'/>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:     <tpm supported='no'/>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:     <redirdev supported='no'/>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:       <enum name='model'/>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:     <gic supported='no'/>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:     <genid supported='no'/>
May 28 00:54:43.264359 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.265781 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu', 'pc', 'ubuntu-q35'} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 00:54:43.265781 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
May 28 00:54:43.265781 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-i386</path>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:   <machine>pc-q35-noble</machine>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:   <arch>i686</arch>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:   <vcpu max='1024'/>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:     <enum name='firmware'/>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='yes'>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:       <enum name='maximumMigratable'>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:         <value>on</value>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:         <value>off</value>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='yes'>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:       <model fallback='forbid'>EPYC</model>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:       <vendor>AMD</vendor>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:       <feature policy='require' name='acpi'/>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:       <feature policy='require' name='ss'/>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:       <feature policy='require' name='monitor'/>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:       <feature policy='require' name='hypervisor'/>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:       <feature policy='require' name='erms'/>
May 28 00:54:43.265781 np0000001577 nova-compute[98319]:       <feature policy='require' name='mpx'/>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <feature policy='require' name='pcommit'/>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <feature policy='require' name='clwb'/>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <feature policy='require' name='umip'/>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <feature policy='require' name='pku'/>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <feature policy='require' name='vaes'/>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <feature policy='require' name='la57'/>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <feature policy='require' name='rdpid'/>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <feature policy='require' name='pks'/>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <feature policy='require' name='fsrm'/>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <feature policy='require' name='fzrm'/>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <feature policy='require' name='fsrs'/>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <feature policy='require' name='fsrc'/>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <feature policy='require' name='3dnowext'/>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <feature policy='require' name='3dnow'/>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <feature policy='require' name='xsaveerptr'/>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <feature policy='require' name='wbnoinvd'/>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <feature policy='require' name='npt'/>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <feature policy='require' name='vgif'/>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <feature policy='require' name='svme-addr-chk'/>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <feature policy='disable' name='vme'/>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <feature policy='disable' name='xsavec'/>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <feature policy='disable' name='fxsr_opt'/>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <feature policy='disable' name='lm'/>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <feature policy='disable' name='misalignsse'/>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <feature policy='disable' name='osvw'/>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <feature policy='disable' name='topoext'/>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <feature policy='disable' name='nrip-save'/>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <model usable='no' vendor='unknown'>qemu64</model>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <model usable='no' vendor='unknown'>kvm64</model>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>core2duo</model>
May 28 00:54:43.266722 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 00:54:43.267619 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 00:54:43.267619 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Westmere</model>
May 28 00:54:43.267619 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 00:54:43.267619 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 00:54:43.267619 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 00:54:43.267619 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 00:54:43.267619 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 00:54:43.267619 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 00:54:43.267619 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 00:54:43.267619 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 00:54:43.267619 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 00:54:43.267619 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 00:54:43.267619 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Penryn</model>
May 28 00:54:43.267619 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 00:54:43.267619 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 00:54:43.267619 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 00:54:43.267619 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 28 00:54:43.267619 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 28 00:54:43.267619 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 00:54:43.267619 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 28 00:54:43.267619 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 00:54:43.267619 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 00:54:43.267619 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 00:54:43.267619 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 00:54:43.267619 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 00:54:43.267619 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 00:54:43.267619 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 00:54:43.267619 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 00:54:43.267619 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 00:54:43.267619 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 00:54:43.267619 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 00:54:43.267619 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 00:54:43.267619 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Conroe</model>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>486</model>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:         <value>sata</value>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:         <value>vga</value>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:         <value>cirrus</value>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:         <value>vmvga</value>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:         <value>qxl</value>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:         <value>bochs</value>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:         <value>ramfb</value>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.268228 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:         <value>virtiofs</value>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:     <tpm supported='yes'>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:         <value>tpm-tis</value>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:         <value>tpm-crb</value>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:         <value>passthrough</value>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:         <value>emulator</value>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:         <value>external</value>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:       <enum name='backendVersion'>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:         <value>1.2</value>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:         <value>2.0</value>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:     </tpm>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:     <redirdev supported='yes'>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:     </redirdev>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:     <gic supported='no'/>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='yes'/>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:     <genid supported='yes'/>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.269418 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:     <hyperv supported='yes'>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:       <enum name='features'>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:         <value>relaxed</value>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:         <value>vapic</value>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:         <value>spinlocks</value>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:         <value>vpindex</value>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:         <value>runtime</value>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:         <value>synic</value>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:         <value>stimer</value>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:         <value>reset</value>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:         <value>vendor_id</value>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:         <value>frequencies</value>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:         <value>reenlightenment</value>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:         <value>tlbflush</value>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:         <value>ipi</value>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:         <value>avic</value>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:     </hyperv>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.270767 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
May 28 00:54:43.270767 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-i386</path>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:   <machine>pc-i440fx-noble-v2</machine>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:   <arch>i686</arch>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:   <vcpu max='255'/>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:     <enum name='firmware'/>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='yes'>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:       <enum name='maximumMigratable'>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:         <value>on</value>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:         <value>off</value>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='yes'>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:       <model fallback='forbid'>EPYC</model>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:       <vendor>AMD</vendor>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:       <feature policy='require' name='acpi'/>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:       <feature policy='require' name='ss'/>
May 28 00:54:43.270767 np0000001577 nova-compute[98319]:       <feature policy='require' name='monitor'/>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <feature policy='require' name='hypervisor'/>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <feature policy='require' name='erms'/>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <feature policy='require' name='mpx'/>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <feature policy='require' name='pcommit'/>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <feature policy='require' name='clwb'/>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <feature policy='require' name='umip'/>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <feature policy='require' name='pku'/>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <feature policy='require' name='vaes'/>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <feature policy='require' name='la57'/>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <feature policy='require' name='rdpid'/>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <feature policy='require' name='pks'/>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <feature policy='require' name='fsrm'/>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <feature policy='require' name='fzrm'/>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <feature policy='require' name='fsrs'/>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <feature policy='require' name='fsrc'/>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <feature policy='require' name='3dnowext'/>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <feature policy='require' name='3dnow'/>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <feature policy='require' name='xsaveerptr'/>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <feature policy='require' name='wbnoinvd'/>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <feature policy='require' name='npt'/>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <feature policy='require' name='vgif'/>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <feature policy='require' name='svme-addr-chk'/>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <feature policy='disable' name='vme'/>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <feature policy='disable' name='xsavec'/>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <feature policy='disable' name='fxsr_opt'/>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <feature policy='disable' name='lm'/>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <feature policy='disable' name='misalignsse'/>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <feature policy='disable' name='osvw'/>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <feature policy='disable' name='topoext'/>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <feature policy='disable' name='nrip-save'/>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <model usable='no' vendor='unknown'>qemu64</model>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <model usable='no' vendor='unknown'>kvm64</model>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 00:54:43.271876 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 00:54:43.272586 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>core2duo</model>
May 28 00:54:43.272586 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 00:54:43.272586 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 00:54:43.272586 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Westmere</model>
May 28 00:54:43.272586 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 00:54:43.272586 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 00:54:43.272586 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 00:54:43.272586 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 00:54:43.272586 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 00:54:43.272586 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 00:54:43.272586 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 00:54:43.272586 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 00:54:43.272586 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 00:54:43.272586 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 00:54:43.272586 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Penryn</model>
May 28 00:54:43.272586 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 00:54:43.272586 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 00:54:43.272586 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 00:54:43.272586 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 28 00:54:43.272586 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 28 00:54:43.272586 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 00:54:43.272586 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 28 00:54:43.272586 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 00:54:43.272586 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 00:54:43.272586 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 00:54:43.272586 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 00:54:43.272586 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 00:54:43.272586 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 00:54:43.272586 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 00:54:43.272586 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 00:54:43.272586 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 00:54:43.272586 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 00:54:43.272586 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Conroe</model>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>486</model>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:         <value>ide</value>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:         <value>sata</value>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:         <value>vga</value>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:         <value>cirrus</value>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:         <value>vmvga</value>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:         <value>qxl</value>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:         <value>bochs</value>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:         <value>ramfb</value>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.273187 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:         <value>virtiofs</value>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:     <tpm supported='yes'>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:         <value>tpm-tis</value>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:         <value>tpm-crb</value>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:         <value>passthrough</value>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:         <value>emulator</value>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:         <value>external</value>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:       <enum name='backendVersion'>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:         <value>1.2</value>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:         <value>2.0</value>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:     </tpm>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:     <redirdev supported='yes'>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:     </redirdev>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:     <gic supported='no'/>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='yes'/>
May 28 00:54:43.274532 np0000001577 nova-compute[98319]:     <genid supported='yes'/>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:     <hyperv supported='yes'>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:       <enum name='features'>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:         <value>relaxed</value>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:         <value>vapic</value>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:         <value>spinlocks</value>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:         <value>vpindex</value>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:         <value>runtime</value>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:         <value>synic</value>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:         <value>stimer</value>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:         <value>reset</value>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:         <value>vendor_id</value>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:         <value>frequencies</value>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:         <value>reenlightenment</value>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:         <value>tlbflush</value>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:         <value>ipi</value>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:         <value>avic</value>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:     </hyperv>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.275909 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
May 28 00:54:43.275909 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-i386</path>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:   <machine>pc-i440fx-noble</machine>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:   <arch>i686</arch>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:   <vcpu max='255'/>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:     <enum name='firmware'/>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='yes'>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:       <enum name='maximumMigratable'>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:         <value>on</value>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:         <value>off</value>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='yes'>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:       <model fallback='forbid'>EPYC</model>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:       <vendor>AMD</vendor>
May 28 00:54:43.275909 np0000001577 nova-compute[98319]:       <feature policy='require' name='acpi'/>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <feature policy='require' name='ss'/>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <feature policy='require' name='monitor'/>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <feature policy='require' name='hypervisor'/>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <feature policy='require' name='erms'/>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <feature policy='require' name='mpx'/>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <feature policy='require' name='pcommit'/>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <feature policy='require' name='clwb'/>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <feature policy='require' name='umip'/>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <feature policy='require' name='pku'/>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <feature policy='require' name='vaes'/>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <feature policy='require' name='la57'/>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <feature policy='require' name='rdpid'/>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <feature policy='require' name='pks'/>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <feature policy='require' name='fsrm'/>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <feature policy='require' name='fzrm'/>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <feature policy='require' name='fsrs'/>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <feature policy='require' name='fsrc'/>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <feature policy='require' name='3dnowext'/>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <feature policy='require' name='3dnow'/>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <feature policy='require' name='xsaveerptr'/>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <feature policy='require' name='wbnoinvd'/>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <feature policy='require' name='npt'/>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <feature policy='require' name='vgif'/>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <feature policy='require' name='svme-addr-chk'/>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <feature policy='disable' name='vme'/>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <feature policy='disable' name='xsavec'/>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <feature policy='disable' name='fxsr_opt'/>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <feature policy='disable' name='lm'/>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <feature policy='disable' name='misalignsse'/>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <feature policy='disable' name='osvw'/>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <feature policy='disable' name='topoext'/>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <feature policy='disable' name='nrip-save'/>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <model usable='no' vendor='unknown'>qemu64</model>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 00:54:43.277021 np0000001577 nova-compute[98319]:       <model usable='no' vendor='unknown'>kvm64</model>
May 28 00:54:43.278042 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 00:54:43.278042 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 00:54:43.278042 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>core2duo</model>
May 28 00:54:43.278042 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 00:54:43.278042 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 00:54:43.278042 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Westmere</model>
May 28 00:54:43.278042 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 00:54:43.278042 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 00:54:43.278042 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 00:54:43.278042 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 00:54:43.278042 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 00:54:43.278042 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 00:54:43.278042 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 00:54:43.278042 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 00:54:43.278042 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 00:54:43.278042 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 00:54:43.278042 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Penryn</model>
May 28 00:54:43.278042 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 00:54:43.278042 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 00:54:43.278042 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 00:54:43.278042 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 28 00:54:43.278042 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 28 00:54:43.278042 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 00:54:43.278042 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 28 00:54:43.278042 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 00:54:43.278042 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 00:54:43.278042 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 00:54:43.278042 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 00:54:43.278042 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 00:54:43.278042 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 00:54:43.278042 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 00:54:43.278042 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 00:54:43.278042 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Conroe</model>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>486</model>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:         <value>ide</value>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:         <value>sata</value>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:         <value>vga</value>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:         <value>cirrus</value>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:         <value>vmvga</value>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:         <value>qxl</value>
May 28 00:54:43.278691 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>bochs</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>ramfb</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>virtiofs</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:     <tpm supported='yes'>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>tpm-tis</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>tpm-crb</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>passthrough</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>emulator</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>external</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:       <enum name='backendVersion'>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>1.2</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>2.0</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:     </tpm>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:     <redirdev supported='yes'>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:     </redirdev>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.279845 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:     <gic supported='no'/>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='yes'/>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:     <genid supported='yes'/>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:     <hyperv supported='yes'>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:       <enum name='features'>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:         <value>relaxed</value>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:         <value>vapic</value>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:         <value>spinlocks</value>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:         <value>vpindex</value>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:         <value>runtime</value>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:         <value>synic</value>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:         <value>stimer</value>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:         <value>reset</value>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:         <value>vendor_id</value>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:         <value>frequencies</value>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:         <value>reenlightenment</value>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:         <value>tlbflush</value>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:         <value>ipi</value>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:         <value>avic</value>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:     </hyperv>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.281264 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
May 28 00:54:43.281264 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-i386</path>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:   <machine>pc-q35-noble-v2</machine>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:   <arch>i686</arch>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:   <vcpu max='1024'/>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:     <enum name='firmware'/>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='yes'>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:       <enum name='maximumMigratable'>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:         <value>on</value>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:         <value>off</value>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.281264 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='yes'>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <model fallback='forbid'>EPYC</model>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <vendor>AMD</vendor>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <feature policy='require' name='acpi'/>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <feature policy='require' name='ss'/>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <feature policy='require' name='monitor'/>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <feature policy='require' name='hypervisor'/>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <feature policy='require' name='erms'/>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <feature policy='require' name='mpx'/>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <feature policy='require' name='pcommit'/>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <feature policy='require' name='clwb'/>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <feature policy='require' name='umip'/>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <feature policy='require' name='pku'/>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <feature policy='require' name='vaes'/>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <feature policy='require' name='la57'/>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <feature policy='require' name='rdpid'/>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <feature policy='require' name='pks'/>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <feature policy='require' name='fsrm'/>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <feature policy='require' name='fzrm'/>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <feature policy='require' name='fsrs'/>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <feature policy='require' name='fsrc'/>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <feature policy='require' name='3dnowext'/>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <feature policy='require' name='3dnow'/>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <feature policy='require' name='xsaveerptr'/>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <feature policy='require' name='wbnoinvd'/>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <feature policy='require' name='npt'/>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <feature policy='require' name='vgif'/>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <feature policy='require' name='svme-addr-chk'/>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <feature policy='disable' name='vme'/>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <feature policy='disable' name='xsavec'/>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <feature policy='disable' name='fxsr_opt'/>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <feature policy='disable' name='lm'/>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <feature policy='disable' name='misalignsse'/>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <feature policy='disable' name='osvw'/>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <feature policy='disable' name='topoext'/>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <feature policy='disable' name='nrip-save'/>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <model usable='no' vendor='unknown'>qemu64</model>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 00:54:43.282356 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 00:54:43.283142 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 00:54:43.283142 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 00:54:43.283142 np0000001577 nova-compute[98319]:       <model usable='no' vendor='unknown'>kvm64</model>
May 28 00:54:43.283142 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 00:54:43.283142 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 00:54:43.283142 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>core2duo</model>
May 28 00:54:43.283142 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 00:54:43.283142 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 00:54:43.283142 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Westmere</model>
May 28 00:54:43.283142 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 00:54:43.283142 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 00:54:43.283142 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 00:54:43.283142 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 00:54:43.283142 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 00:54:43.283142 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 00:54:43.283142 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 00:54:43.283142 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 00:54:43.283142 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 00:54:43.283142 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 00:54:43.283142 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Penryn</model>
May 28 00:54:43.283142 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 00:54:43.283142 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 00:54:43.283142 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 00:54:43.283142 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 28 00:54:43.283142 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 28 00:54:43.283142 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 00:54:43.283142 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 28 00:54:43.283142 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 00:54:43.283142 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 00:54:43.283142 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 00:54:43.283142 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 00:54:43.283142 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 00:54:43.283142 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Conroe</model>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>486</model>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:         <value>sata</value>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.283689 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>vga</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>cirrus</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>vmvga</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>qxl</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>bochs</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>ramfb</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>virtiofs</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:     <tpm supported='yes'>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>tpm-tis</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>tpm-crb</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>passthrough</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>emulator</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>external</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:       <enum name='backendVersion'>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>1.2</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>2.0</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:     </tpm>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:     <redirdev supported='yes'>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:     </redirdev>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.284736 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:     <gic supported='no'/>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='yes'/>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:     <genid supported='yes'/>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:     <hyperv supported='yes'>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:       <enum name='features'>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:         <value>relaxed</value>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:         <value>vapic</value>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:         <value>spinlocks</value>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:         <value>vpindex</value>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:         <value>runtime</value>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:         <value>synic</value>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:         <value>stimer</value>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:         <value>reset</value>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:         <value>vendor_id</value>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:         <value>frequencies</value>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:         <value>reenlightenment</value>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:         <value>tlbflush</value>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:         <value>ipi</value>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:         <value>avic</value>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:     </hyperv>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.286117 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 00:54:43.286117 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=None:
May 28 00:54:43.286117 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-m68k</path>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:   <machine>mcf5208evb</machine>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:   <arch>m68k</arch>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:   <vcpu max='1'/>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:     <enum name='firmware'/>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.286117 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.287108 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:         <value>virtiofs</value>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:     <tpm supported='no'/>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:     <redirdev supported='no'/>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:     <gic supported='no'/>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:     <genid supported='no'/>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.288402 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=virt:
May 28 00:54:43.288402 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-m68k</path>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:   <machine>virt-8.2</machine>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:   <arch>m68k</arch>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:   <vcpu max='1'/>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:     <enum name='firmware'/>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 28 00:54:43.288402 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:         <value>virtiofs</value>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:     <tpm supported='no'/>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:     <redirdev supported='no'/>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.289677 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:     <gic supported='no'/>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:     <genid supported='no'/>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.290990 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 00:54:43.290990 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=microblaze and machine_type=None:
May 28 00:54:43.290990 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-microblaze</path>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:   <machine>petalogix-s3adsp1800</machine>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:   <arch>microblaze</arch>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:   <vcpu max='1'/>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:     <enum name='firmware'/>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.290990 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:       <enum name='model'/>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:     <tpm supported='no'/>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:     <redirdev supported='no'/>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.291986 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:       <enum name='model'/>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:     <gic supported='no'/>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:     <genid supported='no'/>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.293374 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 00:54:43.293374 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=microblazeel and machine_type=None:
May 28 00:54:43.293374 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-microblazeel</path>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:   <machine>petalogix-s3adsp1800</machine>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:   <arch>microblazeel</arch>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:   <vcpu max='1'/>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:     <enum name='firmware'/>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.293374 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:       <enum name='model'/>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:     <tpm supported='no'/>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:     <redirdev supported='no'/>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:       <enum name='model'/>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.294335 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:     <gic supported='no'/>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:     <genid supported='no'/>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.295807 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 00:54:43.295807 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=mips and machine_type=None:
May 28 00:54:43.295807 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-mips</path>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:   <machine>malta</machine>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:   <arch>mips</arch>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:   <vcpu max='16'/>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:     <enum name='firmware'/>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.295807 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>ide</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>sata</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>vga</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>cirrus</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>vmvga</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>bochs</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:         <value>virtiofs</value>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.296860 np0000001577 nova-compute[98319]:     <tpm supported='no'/>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:     <redirdev supported='yes'>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:     </redirdev>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:     <gic supported='no'/>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:     <genid supported='no'/>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.298137 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 00:54:43.298137 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=mipsel and machine_type=None:
May 28 00:54:43.298137 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-mipsel</path>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:   <machine>malta</machine>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:   <arch>mipsel</arch>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:   <vcpu max='16'/>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:     <enum name='firmware'/>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.298137 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:         <value>ide</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:         <value>sata</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:         <value>vga</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:         <value>cirrus</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:         <value>vmvga</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:         <value>bochs</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.299223 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:         <value>virtiofs</value>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:     <tpm supported='no'/>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:     <redirdev supported='yes'>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:     </redirdev>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:     <gic supported='no'/>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:     <genid supported='no'/>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.300454 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 00:54:43.300454 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=mips64 and machine_type=None:
May 28 00:54:43.300454 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-mips64</path>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:   <machine>malta</machine>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:   <arch>mips64</arch>
May 28 00:54:43.300454 np0000001577 nova-compute[98319]:   <vcpu max='16'/>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:     <enum name='firmware'/>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:         <value>ide</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:         <value>sata</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:         <value>vga</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:         <value>cirrus</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:         <value>vmvga</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:         <value>bochs</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.301644 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:         <value>virtiofs</value>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:     <tpm supported='no'/>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:     <redirdev supported='yes'>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:     </redirdev>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:     <gic supported='no'/>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:     <genid supported='no'/>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.302935 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.304185 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 00:54:43.304185 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=mips64el and machine_type=None:
May 28 00:54:43.304185 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-mips64el</path>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:   <machine>malta</machine>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:   <arch>mips64el</arch>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:   <vcpu max='16'/>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:     <enum name='firmware'/>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:         <value>ide</value>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:         <value>sata</value>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.304185 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>vga</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>cirrus</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>vmvga</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>bochs</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>virtiofs</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:     <tpm supported='no'/>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:     <redirdev supported='yes'>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:     </redirdev>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.305269 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:     <gic supported='no'/>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:     <genid supported='no'/>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.306616 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 00:54:43.306616 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=ppc and machine_type=None:
May 28 00:54:43.306616 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-ppc</path>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:   <machine>g3beige</machine>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:   <arch>ppc</arch>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:   <vcpu max='1'/>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:     <enum name='firmware'/>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.306616 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>ide</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>sata</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>vga</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>cirrus</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>bochs</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>virtiofs</value>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:     <tpm supported='no'/>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:     <redirdev supported='yes'>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.307678 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:     </redirdev>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:     <gic supported='no'/>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:     <genid supported='no'/>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.309066 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Getting domain capabilities for ppc64 via machine types: {None, 'pseries', 'powernv'} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 00:54:43.309066 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=None:
May 28 00:54:43.309066 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-ppc64</path>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:   <machine>pseries-noble</machine>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:   <arch>ppc64</arch>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:   <vcpu max='4096'/>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:     <enum name='firmware'/>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.309066 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:         <value>sata</value>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:         <value>vga</value>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:         <value>cirrus</value>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:         <value>bochs</value>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.310103 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:         <value>virtiofs</value>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:     <tpm supported='yes'>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:         <value>tpm-spapr</value>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:         <value>spapr-tpm-proxy</value>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:         <value>passthrough</value>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:         <value>emulator</value>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:         <value>external</value>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:       <enum name='backendVersion'>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:         <value>1.2</value>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:         <value>2.0</value>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:     </tpm>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:     <redirdev supported='yes'>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:     </redirdev>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:     <gic supported='no'/>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:     <genid supported='no'/>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.311319 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.312468 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=pseries:
May 28 00:54:43.312468 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-ppc64</path>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:   <machine>pseries-noble</machine>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:   <arch>ppc64</arch>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:   <vcpu max='4096'/>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:     <enum name='firmware'/>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:         <value>sata</value>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.312468 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>vga</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>cirrus</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>bochs</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>virtiofs</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:     <tpm supported='yes'>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>tpm-spapr</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>spapr-tpm-proxy</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>passthrough</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>emulator</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>external</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:       <enum name='backendVersion'>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>1.2</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>2.0</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:     </tpm>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:     <redirdev supported='yes'>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:     </redirdev>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.313663 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:     <gic supported='no'/>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:     <genid supported='no'/>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.314920 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=powernv:
May 28 00:54:43.314920 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-ppc64</path>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:   <machine>powernv9</machine>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:   <arch>ppc64</arch>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:   <vcpu max='2048'/>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:     <enum name='firmware'/>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.314920 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>sata</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>vga</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>cirrus</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>bochs</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.315962 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:         <value>virtiofs</value>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:     <tpm supported='yes'>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:         <value>tpm-spapr</value>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:         <value>spapr-tpm-proxy</value>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:         <value>passthrough</value>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:         <value>emulator</value>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:         <value>external</value>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:       <enum name='backendVersion'>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:         <value>1.2</value>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:         <value>2.0</value>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:     </tpm>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:     <redirdev supported='yes'>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:     </redirdev>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:     <gic supported='no'/>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:     <genid supported='no'/>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.317289 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 00:54:43.317289 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=pseries:
May 28 00:54:43.317289 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-ppc64le</path>
May 28 00:54:43.317289 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:   <machine>pseries-noble</machine>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:   <arch>ppc64le</arch>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:   <vcpu max='4096'/>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:     <enum name='firmware'/>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:         <value>sata</value>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:         <value>vga</value>
May 28 00:54:43.318322 np0000001577 nova-compute[98319]:         <value>cirrus</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>bochs</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>virtiofs</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:     <tpm supported='yes'>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>tpm-spapr</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>spapr-tpm-proxy</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>passthrough</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>emulator</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>external</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:       <enum name='backendVersion'>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>1.2</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>2.0</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:     </tpm>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:     <redirdev supported='yes'>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:     </redirdev>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.319587 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:     <gic supported='no'/>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:     <genid supported='no'/>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.321025 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=powernv:
May 28 00:54:43.321025 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-ppc64le</path>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:   <machine>powernv9</machine>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:   <arch>ppc64le</arch>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:   <vcpu max='2048'/>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:     <enum name='firmware'/>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.321025 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>sata</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>vga</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>cirrus</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>bochs</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>virtiofs</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:     <tpm supported='yes'>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>tpm-spapr</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:         <value>spapr-tpm-proxy</value>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.322148 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:         <value>passthrough</value>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:         <value>emulator</value>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:         <value>external</value>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:       <enum name='backendVersion'>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:         <value>1.2</value>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:         <value>2.0</value>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:     </tpm>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:     <redirdev supported='yes'>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:     </redirdev>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:     <gic supported='no'/>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:     <genid supported='no'/>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.323460 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 00:54:43.323460 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=riscv32 and machine_type=None:
May 28 00:54:43.323460 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-riscv32</path>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:   <machine>virt</machine>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:   <arch>riscv32</arch>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:   <vcpu max='512'/>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:     <enum name='firmware'/>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 00:54:43.323460 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='yes'>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:       <enum name='maximumMigratable'>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>on</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>off</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>sata</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>vga</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>cirrus</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>bochs</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>ramfb</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.324487 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:         <value>virtiofs</value>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:     <tpm supported='yes'>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:         <value>tpm-tis</value>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:         <value>passthrough</value>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:         <value>emulator</value>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:         <value>external</value>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:       <enum name='backendVersion'>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:         <value>1.2</value>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:         <value>2.0</value>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:     </tpm>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:     <redirdev supported='yes'>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:     </redirdev>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:     <gic supported='no'/>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='yes'/>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:     <genid supported='no'/>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.325839 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.327238 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 00:54:43.327238 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=riscv64 and machine_type=None:
May 28 00:54:43.327238 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-riscv64</path>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:   <machine>virt</machine>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:   <arch>riscv64</arch>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:   <vcpu max='512'/>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:     <enum name='firmware'/>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='yes'>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:       <enum name='maximumMigratable'>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:         <value>on</value>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:         <value>off</value>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>rv64</model>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>sifive-e51</model>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>any</model>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>x-rv128</model>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>shakti-c</model>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>max</model>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>thead-c906</model>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>sifive-u54</model>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>veyron-v1</model>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.327238 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>sata</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>vga</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>cirrus</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>bochs</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>ramfb</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.328101 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:         <value>virtiofs</value>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:     <tpm supported='yes'>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:         <value>tpm-tis</value>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:         <value>passthrough</value>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:         <value>emulator</value>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:         <value>external</value>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:       <enum name='backendVersion'>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:         <value>1.2</value>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:         <value>2.0</value>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:     </tpm>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:     <redirdev supported='yes'>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:     </redirdev>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:     <gic supported='no'/>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='yes'/>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:     <genid supported='no'/>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.329413 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 00:54:43.329413 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=s390x and machine_type=s390-ccw-virtio:
May 28 00:54:43.329413 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-s390x</path>
May 28 00:54:43.329413 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:   <machine>s390-ccw-virtio-noble</machine>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:   <arch>s390x</arch>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:   <vcpu max='248'/>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:     <enum name='firmware'/>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='yes'>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:       <enum name='maximumMigratable'>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:         <value>on</value>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:         <value>off</value>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z13</model>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z990.3</model>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z13-base</model>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z990.2</model>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z196.2-base</model>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z14</model>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z14.2-base</model>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z990.4</model>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z196</model>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z10BC.2-base</model>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z114-base</model>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>gen16b</model>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z890.3-base</model>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>gen16a</model>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z990.5</model>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z196.2</model>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>zEC12</model>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>zEC12.2</model>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z9EC.2</model>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z9BC</model>
May 28 00:54:43.330408 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z9EC.3-base</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='IBM'>z800-base</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z14ZR1-base</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z890</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z990.4-base</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z9EC.3</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z13.2</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z10BC.2</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>gen15a-base</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z14.2</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>zBC12-base</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>gen16a-base</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='IBM'>z900.3</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z196-base</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z990</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z14-base</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='IBM'>z900.2</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='IBM'>z800</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z10EC</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z14ZR1</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='IBM'>z900</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z10EC.2</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z10EC.2-base</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='IBM'>z900.2-base</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='IBM'>z900-base</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z10EC.3</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z990.5-base</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>max</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>gen15b</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z9BC.2-base</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>gen15a</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z990.2-base</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z10EC-base</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>gen16b-base</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z114</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z9EC-base</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z13s</model>
May 28 00:54:43.331401 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>qemu</model>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>gen15b-base</model>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>zEC12-base</model>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z890.3</model>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z10EC.3-base</model>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z890.2-base</model>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z890.2</model>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z10BC-base</model>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>zEC12.2-base</model>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z890-base</model>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z9BC-base</model>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z10BC</model>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z9EC</model>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z9EC.2-base</model>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z13.2-base</model>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='IBM'>z900.3-base</model>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z990.3-base</model>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z13s-base</model>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>zBC12</model>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z990-base</model>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:       <model usable='no' vendor='IBM'>z9BC.2</model>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.332118 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:         <value>virtiofs</value>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:     <tpm supported='no'/>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:     <redirdev supported='yes'>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:     </redirdev>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:     <gic supported='no'/>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:     <genid supported='no'/>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:     <s390-pv supported='no'/>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.333151 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.334503 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 00:54:43.334503 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=sh4 and machine_type=None:
May 28 00:54:43.334503 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-sh4</path>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:   <machine>shix</machine>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:   <arch>sh4</arch>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:   <vcpu max='1'/>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:     <enum name='firmware'/>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:         <value>sata</value>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.334503 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>vga</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>cirrus</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>bochs</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>virtiofs</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:     <tpm supported='no'/>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:     <redirdev supported='yes'>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:     </redirdev>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.335641 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:     <gic supported='no'/>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:     <genid supported='no'/>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.337131 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 00:54:43.337131 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=sh4eb and machine_type=None:
May 28 00:54:43.337131 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-sh4eb</path>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:   <machine>shix</machine>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:   <arch>sh4eb</arch>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:   <vcpu max='1'/>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:     <enum name='firmware'/>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.337131 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>sata</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>vga</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>cirrus</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>bochs</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:         <value>virtiofs</value>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:     <tpm supported='no'/>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:     <redirdev supported='yes'>
May 28 00:54:43.338150 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:     </redirdev>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:     <gic supported='no'/>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:     <genid supported='no'/>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.339661 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 00:54:43.339661 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=sparc and machine_type=None:
May 28 00:54:43.339661 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-sparc</path>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:   <machine>SS-5</machine>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:   <arch>sparc</arch>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:   <vcpu max='1'/>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:     <enum name='firmware'/>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.339661 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:       <enum name='model'/>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:     <tpm supported='no'/>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:     <redirdev supported='no'/>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.340749 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:       <enum name='model'/>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:     <gic supported='no'/>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:     <genid supported='no'/>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.342098 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 00:54:43.342098 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=sparc64 and machine_type=None:
May 28 00:54:43.342098 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-sparc64</path>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:   <machine>sun4u</machine>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:   <arch>sparc64</arch>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:   <vcpu max='1'/>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:     <enum name='firmware'/>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 28 00:54:43.342098 np0000001577 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>ide</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>sata</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>vga</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>cirrus</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>bochs</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.343162 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:         <value>virtiofs</value>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:     <tpm supported='no'/>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:     <redirdev supported='yes'>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:     </redirdev>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:     <gic supported='no'/>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:     <genid supported='no'/>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.344482 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu', 'pc', 'ubuntu-q35'} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 00:54:43.344482 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
May 28 00:54:43.344482 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-x86_64</path>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:   <machine>pc-q35-noble</machine>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:   <arch>x86_64</arch>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:   <vcpu max='1024'/>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:     <enum name='firmware'>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:       <value>efi</value>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.344482 np0000001577 nova-compute[98319]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <value>/usr/share/ovmf/OVMF.amdsev.fd</value>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='yes'>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <enum name='maximumMigratable'>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:         <value>on</value>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:         <value>off</value>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='yes'>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <model fallback='forbid'>EPYC</model>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <vendor>AMD</vendor>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <feature policy='require' name='acpi'/>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <feature policy='require' name='ss'/>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <feature policy='require' name='monitor'/>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <feature policy='require' name='hypervisor'/>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <feature policy='require' name='erms'/>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <feature policy='require' name='mpx'/>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <feature policy='require' name='pcommit'/>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <feature policy='require' name='clwb'/>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <feature policy='require' name='umip'/>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <feature policy='require' name='pku'/>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <feature policy='require' name='vaes'/>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <feature policy='require' name='la57'/>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <feature policy='require' name='rdpid'/>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <feature policy='require' name='pks'/>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <feature policy='require' name='fsrm'/>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <feature policy='require' name='fzrm'/>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <feature policy='require' name='fsrs'/>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <feature policy='require' name='fsrc'/>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <feature policy='require' name='3dnowext'/>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <feature policy='require' name='3dnow'/>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <feature policy='require' name='xsaveerptr'/>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <feature policy='require' name='wbnoinvd'/>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <feature policy='require' name='npt'/>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <feature policy='require' name='vgif'/>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <feature policy='require' name='svme-addr-chk'/>
May 28 00:54:43.345614 np0000001577 nova-compute[98319]:       <feature policy='disable' name='vme'/>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <feature policy='disable' name='xsavec'/>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <feature policy='disable' name='fxsr_opt'/>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <feature policy='disable' name='misalignsse'/>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <feature policy='disable' name='osvw'/>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <feature policy='disable' name='topoext'/>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <feature policy='disable' name='nrip-save'/>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 00:54:43.346540 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>486</model>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.347259 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>sata</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>vga</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>cirrus</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>vmvga</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>qxl</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>bochs</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>ramfb</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>virtiofs</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:     <tpm supported='yes'>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>tpm-tis</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:         <value>tpm-crb</value>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.348048 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:         <value>passthrough</value>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:         <value>emulator</value>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:         <value>external</value>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:       <enum name='backendVersion'>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:         <value>1.2</value>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:         <value>2.0</value>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:     </tpm>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:     <redirdev supported='yes'>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:     </redirdev>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:     <gic supported='no'/>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='yes'/>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:     <genid supported='yes'/>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:     <hyperv supported='yes'>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:       <enum name='features'>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:         <value>relaxed</value>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:         <value>vapic</value>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:         <value>spinlocks</value>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:         <value>vpindex</value>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:         <value>runtime</value>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:         <value>synic</value>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:         <value>stimer</value>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:         <value>reset</value>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:         <value>vendor_id</value>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:         <value>frequencies</value>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:         <value>reenlightenment</value>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:         <value>tlbflush</value>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:         <value>ipi</value>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:         <value>avic</value>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:     </hyperv>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.349371 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
May 28 00:54:43.349371 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-x86_64</path>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:   <machine>pc-i440fx-noble-v2</machine>
May 28 00:54:43.349371 np0000001577 nova-compute[98319]:   <arch>x86_64</arch>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:   <vcpu max='255'/>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:     <enum name='firmware'>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       <value>efi</value>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='yes'>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       <enum name='maximumMigratable'>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:         <value>on</value>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:         <value>off</value>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='yes'>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       <model fallback='forbid'>EPYC</model>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       <vendor>AMD</vendor>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       <feature policy='require' name='acpi'/>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       <feature policy='require' name='ss'/>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       <feature policy='require' name='monitor'/>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       <feature policy='require' name='hypervisor'/>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       <feature policy='require' name='erms'/>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       <feature policy='require' name='mpx'/>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       <feature policy='require' name='pcommit'/>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       <feature policy='require' name='clwb'/>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       <feature policy='require' name='umip'/>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       <feature policy='require' name='pku'/>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       <feature policy='require' name='vaes'/>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       <feature policy='require' name='la57'/>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       <feature policy='require' name='rdpid'/>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       <feature policy='require' name='pks'/>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       <feature policy='require' name='fsrm'/>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       <feature policy='require' name='fzrm'/>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       <feature policy='require' name='fsrs'/>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       <feature policy='require' name='fsrc'/>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       <feature policy='require' name='3dnowext'/>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       <feature policy='require' name='3dnow'/>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       <feature policy='require' name='xsaveerptr'/>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       <feature policy='require' name='wbnoinvd'/>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       <feature policy='require' name='npt'/>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       <feature policy='require' name='vgif'/>
May 28 00:54:43.350642 np0000001577 nova-compute[98319]:       <feature policy='require' name='svme-addr-chk'/>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <feature policy='disable' name='vme'/>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <feature policy='disable' name='xsavec'/>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <feature policy='disable' name='fxsr_opt'/>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <feature policy='disable' name='misalignsse'/>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <feature policy='disable' name='osvw'/>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <feature policy='disable' name='topoext'/>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <feature policy='disable' name='nrip-save'/>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 00:54:43.351753 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>486</model>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.352341 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>ide</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>sata</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>vga</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>cirrus</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>vmvga</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>qxl</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>bochs</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>ramfb</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>virtiofs</value>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:     <tpm supported='yes'>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.353149 np0000001577 nova-compute[98319]:         <value>tpm-tis</value>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:         <value>tpm-crb</value>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:         <value>passthrough</value>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:         <value>emulator</value>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:         <value>external</value>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:       <enum name='backendVersion'>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:         <value>1.2</value>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:         <value>2.0</value>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:     </tpm>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:     <redirdev supported='yes'>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:     </redirdev>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:     <gic supported='no'/>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='yes'/>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:     <genid supported='yes'/>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:     <hyperv supported='yes'>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:       <enum name='features'>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:         <value>relaxed</value>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:         <value>vapic</value>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:         <value>spinlocks</value>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:         <value>vpindex</value>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:         <value>runtime</value>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:         <value>synic</value>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:         <value>stimer</value>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:         <value>reset</value>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:         <value>vendor_id</value>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:         <value>frequencies</value>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:         <value>reenlightenment</value>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:         <value>tlbflush</value>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:         <value>ipi</value>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:         <value>avic</value>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:     </hyperv>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.354458 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
May 28 00:54:43.354458 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.354458 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-x86_64</path>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:   <machine>pc-i440fx-noble</machine>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:   <arch>x86_64</arch>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:   <vcpu max='255'/>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:     <enum name='firmware'>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       <value>efi</value>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='yes'>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       <enum name='maximumMigratable'>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:         <value>on</value>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:         <value>off</value>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='yes'>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       <model fallback='forbid'>EPYC</model>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       <vendor>AMD</vendor>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       <feature policy='require' name='acpi'/>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       <feature policy='require' name='ss'/>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       <feature policy='require' name='monitor'/>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       <feature policy='require' name='hypervisor'/>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       <feature policy='require' name='erms'/>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       <feature policy='require' name='mpx'/>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       <feature policy='require' name='pcommit'/>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       <feature policy='require' name='clwb'/>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       <feature policy='require' name='umip'/>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       <feature policy='require' name='pku'/>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       <feature policy='require' name='vaes'/>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       <feature policy='require' name='la57'/>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       <feature policy='require' name='rdpid'/>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       <feature policy='require' name='pks'/>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       <feature policy='require' name='fsrm'/>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       <feature policy='require' name='fzrm'/>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       <feature policy='require' name='fsrs'/>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       <feature policy='require' name='fsrc'/>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       <feature policy='require' name='3dnowext'/>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       <feature policy='require' name='3dnow'/>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       <feature policy='require' name='xsaveerptr'/>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       <feature policy='require' name='wbnoinvd'/>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       <feature policy='require' name='npt'/>
May 28 00:54:43.355689 np0000001577 nova-compute[98319]:       <feature policy='require' name='vgif'/>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <feature policy='require' name='svme-addr-chk'/>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <feature policy='disable' name='vme'/>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <feature policy='disable' name='xsavec'/>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <feature policy='disable' name='fxsr_opt'/>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <feature policy='disable' name='misalignsse'/>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <feature policy='disable' name='osvw'/>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <feature policy='disable' name='topoext'/>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <feature policy='disable' name='nrip-save'/>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 28 00:54:43.356744 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>486</model>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.357373 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>ide</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>sata</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>vga</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>cirrus</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>vmvga</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>qxl</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>bochs</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>ramfb</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:         <value>virtiofs</value>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.358114 np0000001577 nova-compute[98319]:     <tpm supported='yes'>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:         <value>tpm-tis</value>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:         <value>tpm-crb</value>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:         <value>passthrough</value>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:         <value>emulator</value>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:         <value>external</value>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:       <enum name='backendVersion'>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:         <value>1.2</value>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:         <value>2.0</value>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:     </tpm>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:     <redirdev supported='yes'>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:     </redirdev>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:     <gic supported='no'/>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='yes'/>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:     <genid supported='yes'/>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:     <hyperv supported='yes'>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:       <enum name='features'>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:         <value>relaxed</value>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:         <value>vapic</value>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:         <value>spinlocks</value>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:         <value>vpindex</value>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:         <value>runtime</value>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:         <value>synic</value>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:         <value>stimer</value>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:         <value>reset</value>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:         <value>vendor_id</value>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:         <value>frequencies</value>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:         <value>reenlightenment</value>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:         <value>tlbflush</value>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:         <value>ipi</value>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:         <value>avic</value>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:     </hyperv>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.359487 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.359487 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
May 28 00:54:43.360825 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-x86_64</path>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:   <machine>pc-q35-noble-v2</machine>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:   <arch>x86_64</arch>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:   <vcpu max='1024'/>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:     <enum name='firmware'>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:       <value>efi</value>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:       <value>/usr/share/ovmf/OVMF.amdsev.fd</value>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='yes'>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:       <enum name='maximumMigratable'>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:         <value>on</value>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:         <value>off</value>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='yes'>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:       <model fallback='forbid'>EPYC</model>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:       <vendor>AMD</vendor>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:       <feature policy='require' name='acpi'/>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:       <feature policy='require' name='ss'/>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:       <feature policy='require' name='monitor'/>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:       <feature policy='require' name='hypervisor'/>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:       <feature policy='require' name='erms'/>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:       <feature policy='require' name='mpx'/>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:       <feature policy='require' name='pcommit'/>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:       <feature policy='require' name='clwb'/>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:       <feature policy='require' name='umip'/>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:       <feature policy='require' name='pku'/>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:       <feature policy='require' name='vaes'/>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:       <feature policy='require' name='la57'/>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:       <feature policy='require' name='rdpid'/>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:       <feature policy='require' name='pks'/>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:       <feature policy='require' name='fsrm'/>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:       <feature policy='require' name='fzrm'/>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:       <feature policy='require' name='fsrs'/>
May 28 00:54:43.360825 np0000001577 nova-compute[98319]:       <feature policy='require' name='fsrc'/>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <feature policy='require' name='3dnowext'/>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <feature policy='require' name='3dnow'/>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <feature policy='require' name='xsaveerptr'/>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <feature policy='require' name='wbnoinvd'/>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <feature policy='require' name='npt'/>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <feature policy='require' name='vgif'/>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <feature policy='require' name='svme-addr-chk'/>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <feature policy='disable' name='vme'/>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <feature policy='disable' name='xsavec'/>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <feature policy='disable' name='fxsr_opt'/>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <feature policy='disable' name='misalignsse'/>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <feature policy='disable' name='osvw'/>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <feature policy='disable' name='topoext'/>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <feature policy='disable' name='nrip-save'/>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 00:54:43.361841 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 00:54:43.362427 np0000001577 nova-compute[98319]:       <model usable='yes' vendor='unknown'>486</model>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:     </mode>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>sata</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>vga</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>cirrus</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>vmvga</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>qxl</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>bochs</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>ramfb</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.363071 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:         <value>virtiofs</value>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:     <tpm supported='yes'>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:         <value>tpm-tis</value>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:         <value>tpm-crb</value>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:         <value>passthrough</value>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:         <value>emulator</value>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:         <value>external</value>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:       <enum name='backendVersion'>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:         <value>1.2</value>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:         <value>2.0</value>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:     </tpm>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:     <redirdev supported='yes'>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:     </redirdev>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:     <gic supported='no'/>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='yes'/>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:     <genid supported='yes'/>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:     <hyperv supported='yes'>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:       <enum name='features'>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:         <value>relaxed</value>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:         <value>vapic</value>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:         <value>spinlocks</value>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:         <value>vpindex</value>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:         <value>runtime</value>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:         <value>synic</value>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:         <value>stimer</value>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:         <value>reset</value>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:         <value>vendor_id</value>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:         <value>frequencies</value>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:         <value>reenlightenment</value>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:         <value>tlbflush</value>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:         <value>ipi</value>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:         <value>avic</value>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:     </hyperv>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.364484 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.365827 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 00:54:43.365827 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=xtensa and machine_type=None:
May 28 00:54:43.365827 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-xtensa</path>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:   <machine>sim</machine>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:   <arch>xtensa</arch>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:   <vcpu max='4'/>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:     <enum name='firmware'/>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:         <value>sata</value>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.365827 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>vga</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>cirrus</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>bochs</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>virtiofs</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:     <tpm supported='no'/>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:     <redirdev supported='yes'>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:     </redirdev>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.366946 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:     <gic supported='no'/>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:     <genid supported='no'/>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.368294 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 00:54:43.368294 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt host hypervisor capabilities for arch=xtensaeb and machine_type=None:
May 28 00:54:43.368294 np0000001577 nova-compute[98319]: <domainCapabilities>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:   <path>/usr/bin/qemu-system-xtensaeb</path>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:   <domain>qemu</domain>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:   <machine>sim</machine>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:   <arch>xtensaeb</arch>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:   <vcpu max='4'/>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:   <iothreads supported='yes'/>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:   <os supported='yes'>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:     <enum name='firmware'/>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:     <loader supported='yes'>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:         <value>rom</value>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:         <value>pflash</value>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:       <enum name='readonly'>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:         <value>yes</value>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:       <enum name='secure'>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:         <value>no</value>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:     </loader>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:   </os>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:   <cpu>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:   <memoryBacking supported='yes'>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:     <enum name='sourceType'>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:       <value>file</value>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:       <value>anonymous</value>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:       <value>memfd</value>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:     </enum>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:   </memoryBacking>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:   <devices>
May 28 00:54:43.368294 np0000001577 nova-compute[98319]:     <disk supported='yes'>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:       <enum name='diskDevice'>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>disk</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>cdrom</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>floppy</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>lun</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>fdc</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>sata</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:     </disk>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:     <graphics supported='yes'>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>sdl</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>vnc</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>spice</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>egl-headless</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>dbus</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:     <video supported='yes'>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:       <enum name='modelType'>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>vga</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>cirrus</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>none</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>bochs</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:     </video>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:     <hostdev supported='yes'>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:       <enum name='mode'>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>subsystem</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:       <enum name='startupPolicy'>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>default</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>mandatory</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>requisite</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>optional</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:       <enum name='subsysType'>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>pci</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>scsi</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:       <enum name='capsType'/>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:       <enum name='pciBackend'/>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:     </hostdev>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:     <rng supported='yes'>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>virtio-transitional</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>random</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>egd</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:     </rng>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:     <filesystem supported='yes'>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:       <enum name='driverType'>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>path</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>handle</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:         <value>virtiofs</value>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:     </filesystem>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:     <tpm supported='no'/>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:     <redirdev supported='yes'>
May 28 00:54:43.369411 np0000001577 nova-compute[98319]:       <enum name='bus'>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]:         <value>usb</value>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]:     </redirdev>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]:     <channel supported='yes'>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]:         <value>pty</value>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]:         <value>unix</value>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]:         <value>spicevmc</value>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]:     </channel>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]:     <crypto supported='yes'>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]:       <enum name='model'>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]:         <value>virtio</value>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]:       <enum name='type'>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]:         <value>qemu</value>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]:       <enum name='backendModel'>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]:         <value>builtin</value>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]:       </enum>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]:     </crypto>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]:   </devices>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]:   <features>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]:     <gic supported='no'/>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]:     <genid supported='no'/>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]:     <backup supported='yes'/>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]:     <async-teardown supported='yes'/>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]:     <sev supported='no'/>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]:     <sgx supported='no'/>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]:   </features>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]: </domainCapabilities>
May 28 00:54:43.370698 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 00:54:43.370698 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Checking secure boot support for host arch (x86_64) {{(pid=98319) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 28 00:54:43.370698 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Secure Boot support detected
May 28 00:54:43.812916 np0000001577 nova-compute[98319]: INFO nova.virt.node [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Generated node identity 78eed366-a2f0-4ead-b3a1-1ceb637e76c2
May 28 00:54:43.813130 np0000001577 nova-compute[98319]: INFO nova.virt.node [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Wrote node identity 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 to /opt/stack/data/nova/compute_id
May 28 00:54:44.315257 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Compute nodes ['78eed366-a2f0-4ead-b3a1-1ceb637e76c2'] for host np0000001577 were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
May 28 00:54:45.318878 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
May 28 00:54:46.323567 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] No compute node record found for host np0000001577. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000001577 could not be found.
May 28 00:54:46.324020 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:54:46.324020 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:54:46.324178 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:54:46.324232 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Auditing locally available compute resources for np0000001577 (node: np0000001577) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 00:54:46.385499 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 00:54:46.386279 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:54:46.404264 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] CMD "env LANG=C uptime" returned: 0 in 0.018s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:54:46.404501 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Hypervisor/Node resource view: name=np0000001577 free_ram=16580MB free_disk=75.18527221679688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 00:54:46.404685 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:54:46.404889 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:54:46.907559 np0000001577 nova-compute[98319]: WARNING nova.compute.resource_tracker [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] No compute node record for np0000001577:78eed366-a2f0-4ead-b3a1-1ceb637e76c2: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 could not be found.
May 28 00:54:47.411557 np0000001577 nova-compute[98319]: INFO nova.compute.resource_tracker [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Compute node record created for np0000001577:np0000001577 with uuid: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2
May 28 00:54:48.918178 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 00:54:48.918618 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Final resource view: name=np0000001577 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 00:54:46 up 26 min,  2 users,  load average: 1.91, 1.42, 0.74\n'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 00:54:49.355359 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] [req-05e2de07-518d-40f6-8e0d-1731cdf6dd0e] Created resource provider record via placement API for resource provider with UUID 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 and name np0000001577.
May 28 00:54:49.403233 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] /sys/module/kvm_amd/parameters/sev contains [N
May 28 00:54:49.403233 np0000001577 nova-compute[98319]: ] {{(pid=98319) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:2038}}
May 28 00:54:49.403351 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.host [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] kernel doesn't support AMD SEV
May 28 00:54:49.403517 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:54:49.403685 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Updating inventory in ProviderTree for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 with inventory: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 00:54:49.403952 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 00:54:49.407813 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Libvirt baseline CPU <cpu>
May 28 00:54:49.407813 np0000001577 nova-compute[98319]:   <arch>x86_64</arch>
May 28 00:54:49.407813 np0000001577 nova-compute[98319]:   <model>Nehalem</model>
May 28 00:54:49.407813 np0000001577 nova-compute[98319]:   <vendor>AMD</vendor>
May 28 00:54:49.407813 np0000001577 nova-compute[98319]:   <topology sockets="12" cores="1" threads="1"/>
May 28 00:54:49.407813 np0000001577 nova-compute[98319]:   <maxphysaddr mode="emulate" bits="40"/>
May 28 00:54:49.407813 np0000001577 nova-compute[98319]: </cpu>
May 28 00:54:49.407813 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:13740}}
May 28 00:54:49.972654 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Updated inventory for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:975}}
May 28 00:54:49.973174 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Updating resource provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 generation from 0 to 1 during operation: update_inventory {{(pid=98319) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
May 28 00:54:49.973174 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Updating inventory in ProviderTree for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 with inventory: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 00:54:50.104245 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Updating resource provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 generation from 1 to 2 during operation: update_traits {{(pid=98319) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
May 28 00:54:50.612738 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Compute_service record updated for np0000001577:np0000001577 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 00:54:50.612881 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.208s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:54:50.613091 np0000001577 nova-compute[98319]: DEBUG nova.service [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Creating RPC server for service: nova-compute on topic: compute {{(pid=98319) start /opt/stack/nova/nova/service.py:195}}
May 28 00:54:50.630432 np0000001577 nova-compute[98319]: DEBUG nova.service [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Creating 2nd RPC server for service: nova-compute on topic: compute-alt {{(pid=98319) start /opt/stack/nova/nova/service.py:211}}
May 28 00:54:50.648585 np0000001577 nova-compute[98319]: DEBUG nova.service [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] Join ServiceGroup membership for this service compute {{(pid=98319) start /opt/stack/nova/nova/service.py:221}}
May 28 00:54:50.648698 np0000001577 nova-compute[98319]: DEBUG nova.servicegroup.drivers.db [None req-171b031e-42d0-49d5-bf39-f7c5ff560287 None None] DB_Driver: join new ServiceGroup member np0000001577 to the compute group, service = <Service: host=np0000001577, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=98319) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
May 28 00:54:56.153011 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 00:55:05.651039 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:55:06.153863 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:55:06.154816 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 23.82 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 00:55:29.979078 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:55:29.979734 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:55:29.980143 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:55:29.980143 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:55:29.980358 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:55:29.980641 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:55:29.981077 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:55:29.981077 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 00:55:29.981317 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:55:30.485303 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:55:30.485303 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:55:30.485303 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:55:30.485303 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Auditing locally available compute resources for np0000001577 (node: np0000001577) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 00:55:30.493107 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 00:55:30.496563 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:55:30.510507 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "env LANG=C uptime" returned: 0 in 0.016s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:55:30.511207 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Hypervisor/Node resource view: name=np0000001577 free_ram=16280MB free_disk=75.05868530273438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 00:55:30.511915 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:55:30.512182 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:55:31.568401 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 00:55:31.568837 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Final resource view: name=np0000001577 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 00:55:30 up 27 min,  2 users,  load average: 1.50, 1.38, 0.76\n'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 00:55:31.613003 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:55:31.613181 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:55:32.115630 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:55:32.621515 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Compute_service record updated for np0000001577:np0000001577 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 00:55:32.622052 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.109s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:55:32.622052 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 59.99 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 00:56:32.616249 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:56:32.616686 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:56:32.616686 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:56:32.616858 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:56:32.617073 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:56:32.617177 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:56:32.617386 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:56:32.617599 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:56:32.617711 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 00:56:32.618055 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:56:33.121237 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:56:33.121414 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:56:33.121587 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:56:33.121745 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Auditing locally available compute resources for np0000001577 (node: np0000001577) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 00:56:33.129817 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 00:56:33.130833 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:56:33.149498 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "env LANG=C uptime" returned: 0 in 0.018s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:56:33.149963 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Hypervisor/Node resource view: name=np0000001577 free_ram=15861MB free_disk=74.91105651855469GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 00:56:33.150191 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:56:33.150469 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:56:34.209662 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 00:56:34.210096 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Final resource view: name=np0000001577 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 00:56:33 up 28 min,  2 users,  load average: 1.51, 1.37, 0.80\n'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 00:56:34.250404 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:56:34.250626 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:56:34.754237 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:56:35.262769 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Compute_service record updated for np0000001577:np0000001577 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 00:56:35.263139 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.112s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:56:35.263188 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 00:56:56.157093 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 00:57:07.696737 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Acquiring lock "8783a79a-1374-43cf-8f20-81f1a156a315" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:07.696737 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "8783a79a-1374-43cf-8f20-81f1a156a315" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:07.904256 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Acquiring lock "b1380963-8254-4ad0-95bb-91d24cea00f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:07.904400 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "b1380963-8254-4ad0-95bb-91d24cea00f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:08.201696 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 00:57:08.409181 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 00:57:08.761061 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:08.761534 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:08.764022 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 00:57:08.764575 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Claim successful on node np0000001577
May 28 00:57:08.968862 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:09.752727 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquiring lock "0928917f-0c8c-4019-aef4-083ba8224ce0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:09.752727 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "0928917f-0c8c-4019-aef4-083ba8224ce0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:09.752727 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquiring lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:09.752727 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:10.057966 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:57:10.058344 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:57:10.200292 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 00:57:10.236366 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 00:57:10.561252 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:57:10.750142 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:10.784050 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:11.069274 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.306s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:11.069274 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 00:57:11.070815 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.102s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:11.073819 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 00:57:11.073949 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Claim successful on node np0000001577
May 28 00:57:11.574823 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 00:57:11.575923 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 00:57:11.576976 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:11.578229 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:11.824583 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Acquiring lock "a84e49f5-0bde-41ee-866e-6b434748077f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:11.825885 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Lock "a84e49f5-0bde-41ee-866e-6b434748077f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:12.076263 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
May 28 00:57:12.261072 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6f43ede1febc4364810902b8b6fb3ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2baedfd7036c444caea4b26edc31c870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 00:57:12.327914 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 00:57:12.389104 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:57:12.389348 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:57:12.579494 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 00:57:12.892785 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:57:12.898788 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:12.904753 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Successfully created port: 510c8fcb-a3ae-4a4b-b064-145dea29c584 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 00:57:13.399900 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.329s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:13.400610 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.650s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:13.400743 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 00:57:13.405127 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 00:57:13.405216 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Claim successful on node np0000001577
May 28 00:57:13.590622 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 00:57:13.591585 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 00:57:13.591805 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Creating image(s)
May 28 00:57:13.592275 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Acquiring lock "/opt/stack/data/nova/instances/8783a79a-1374-43cf-8f20-81f1a156a315/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:13.592413 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "/opt/stack/data/nova/instances/8783a79a-1374-43cf-8f20-81f1a156a315/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:13.594738 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "/opt/stack/data/nova/instances/8783a79a-1374-43cf-8f20-81f1a156a315/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:13.595041 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Acquiring lock "cdbcad77b8af0132c35393d03b565f67778cb06b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:13.595384 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "cdbcad77b8af0132c35393d03b565f67778cb06b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:13.891294 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Successfully updated port: 510c8fcb-a3ae-4a4b-b064-145dea29c584 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 00:57:13.917249 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 00:57:13.917450 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 00:57:13.917941 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:13.918134 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:14.103215 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b4ab7230b24d4ebf9090a752493983fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355551e9b29346059ddbe389bc51efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 00:57:14.394293 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Acquiring lock "refresh_cache-8783a79a-1374-43cf-8f20-81f1a156a315" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:57:14.394429 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Acquired lock "refresh_cache-8783a79a-1374-43cf-8f20-81f1a156a315" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:57:14.395085 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 00:57:14.421496 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 00:57:14.442856 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:57:14.452254 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:57:14.453156 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdbcad77b8af0132c35393d03b565f67778cb06b.part --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:14.466334 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-99f9d1a2-a029-4542-9ade-43851a5ffdee req-0232b834-07ef-4d27-b725-159ac67d6064 service nova] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Received event network-changed-510c8fcb-a3ae-4a4b-b064-145dea29c584 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:14.467350 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-99f9d1a2-a029-4542-9ade-43851a5ffdee req-0232b834-07ef-4d27-b725-159ac67d6064 service nova] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Refreshing instance network info cache due to event network-changed-510c8fcb-a3ae-4a4b-b064-145dea29c584. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:57:14.468902 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-99f9d1a2-a029-4542-9ade-43851a5ffdee req-0232b834-07ef-4d27-b725-159ac67d6064 service nova] Acquiring lock "refresh_cache-8783a79a-1374-43cf-8f20-81f1a156a315" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:57:14.516985 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdbcad77b8af0132c35393d03b565f67778cb06b.part --force-share --output=json" returned: 0 in 0.064s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:14.518086 np0000001577 nova-compute[98319]: DEBUG nova.virt.images [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] ac1895ec-fe7d-4daa-a504-820cce8782b9 was qcow2, converting to raw {{(pid=98319) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 00:57:14.519065 np0000001577 nova-compute[98319]: DEBUG nova.privsep.utils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 00:57:14.519324 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cdbcad77b8af0132c35393d03b565f67778cb06b.part /opt/stack/data/nova/instances/_base/cdbcad77b8af0132c35393d03b565f67778cb06b.converted {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:14.657961 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cdbcad77b8af0132c35393d03b565f67778cb06b.part /opt/stack/data/nova/instances/_base/cdbcad77b8af0132c35393d03b565f67778cb06b.converted" returned: 0 in 0.138s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:14.664933 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdbcad77b8af0132c35393d03b565f67778cb06b.converted --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:14.704008 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:57:14.704403 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:57:14.730985 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdbcad77b8af0132c35393d03b565f67778cb06b.converted --force-share --output=json" returned: 0 in 0.066s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:14.731485 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "cdbcad77b8af0132c35393d03b565f67778cb06b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.136s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:14.731929 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:57:14.734754 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:57:14.737033 np0000001577 nova-compute[98319]: INFO oslo.privsep.daemon [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmps15brj7i/privsep.sock']
May 28 00:57:14.745480 np0000001577 sudo[109981]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmps15brj7i/privsep.sock
May 28 00:57:14.746270 np0000001577 sudo[109981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 28 00:57:14.931610 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 00:57:14.974510 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 28 00:57:14.974510 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 28 00:57:14.974510 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 28 00:57:14.974510 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 00:57:14.974510 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 28 00:57:14.974510 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 28 00:57:14.974510 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 28 00:57:14.974510 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 00:57:14.974510 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 28 00:57:15.158791 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:57:15.211160 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:57:15.279465 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Successfully created port: 5dc9c0c0-6ee4-4266-8024-0f8313319a2c {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 00:57:15.298972 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 28 00:57:15.299097 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 28 00:57:15.299143 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 28 00:57:15.299248 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 00:57:15.299336 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 28 00:57:15.300611 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 28 00:57:15.300611 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 28 00:57:15.300611 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 00:57:15.300611 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 28 00:57:15.573937 np0000001577 sudo[109981]: pam_unix(sudo:session): session closed for user root
May 28 00:57:15.575704 np0000001577 nova-compute[98319]: INFO oslo.privsep.daemon [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Spawned new privsep daemon via rootwrap
May 28 00:57:15.577833 np0000001577 nova-compute[98319]: INFO oslo.privsep.daemon [-] privsep daemon starting
May 28 00:57:15.577833 np0000001577 nova-compute[98319]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
May 28 00:57:15.577986 np0000001577 nova-compute[98319]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
May 28 00:57:15.577986 np0000001577 nova-compute[98319]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109986
May 28 00:57:15.639640 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:15.642609 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdbcad77b8af0132c35393d03b565f67778cb06b --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:15.701346 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdbcad77b8af0132c35393d03b565f67778cb06b --force-share --output=json" returned: 0 in 0.059s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:15.704632 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Acquiring lock "cdbcad77b8af0132c35393d03b565f67778cb06b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:15.704632 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "cdbcad77b8af0132c35393d03b565f67778cb06b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:15.704632 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:57:15.705362 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:57:15.706991 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdbcad77b8af0132c35393d03b565f67778cb06b --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:15.721606 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.321s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:15.724577 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.938s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:15.724850 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 00:57:15.730682 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 00:57:15.730917 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Claim successful on node np0000001577
May 28 00:57:15.782239 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdbcad77b8af0132c35393d03b565f67778cb06b --force-share --output=json" returned: 0 in 0.075s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:15.783408 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cdbcad77b8af0132c35393d03b565f67778cb06b,backing_fmt=raw /opt/stack/data/nova/instances/8783a79a-1374-43cf-8f20-81f1a156a315/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:15.817284 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cdbcad77b8af0132c35393d03b565f67778cb06b,backing_fmt=raw /opt/stack/data/nova/instances/8783a79a-1374-43cf-8f20-81f1a156a315/disk 1073741824" returned: 0 in 0.034s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:15.817854 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "cdbcad77b8af0132c35393d03b565f67778cb06b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.116s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:15.818258 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdbcad77b8af0132c35393d03b565f67778cb06b --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:15.898358 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Updating instance_info_cache with network_info: [{"id": "510c8fcb-a3ae-4a4b-b064-145dea29c584", "address": "fa:16:3e:2c:d2:b6", "network": {"id": "a3d13ae7-524a-4a4d-ac9b-3b364b3e2832", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-408863509-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2baedfd7036c444caea4b26edc31c870", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap510c8fcb-a3", "ovs_interfaceid": "510c8fcb-a3ae-4a4b-b064-145dea29c584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:57:15.900781 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdbcad77b8af0132c35393d03b565f67778cb06b --force-share --output=json" returned: 0 in 0.082s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:15.902200 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8783a79a-1374-43cf-8f20-81f1a156a315/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 00:57:15.902200 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8783a79a-1374-43cf-8f20-81f1a156a315/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:15.948572 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 00:57:15.948572 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 00:57:15.948572 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Creating image(s)
May 28 00:57:15.948923 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:15.949284 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "/opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:15.949845 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "/opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:15.950142 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:15.950488 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:15.964972 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8783a79a-1374-43cf-8f20-81f1a156a315/disk --force-share --output=json" returned: 0 in 0.063s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:15.965836 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Cannot resize image /opt/stack/data/nova/instances/8783a79a-1374-43cf-8f20-81f1a156a315/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 00:57:15.966227 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 00:57:15.966359 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Ensure instance console log exists: /opt/stack/data/nova/instances/8783a79a-1374-43cf-8f20-81f1a156a315/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 00:57:15.966610 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:15.966774 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:15.966886 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:16.226717 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Successfully updated port: 5dc9c0c0-6ee4-4266-8024-0f8313319a2c {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 00:57:16.234417 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 00:57:16.234607 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 00:57:16.234896 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:16.235103 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:16.300451 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:57:16.301477 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:57:16.301780 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884.part --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:16.354345 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '027d659157ce49c7b674d0e5d41adf07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df45e1c2b903482aa7e61c55b1f3f45b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 00:57:16.361055 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884.part --force-share --output=json" returned: 0 in 0.059s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:16.361837 np0000001577 nova-compute[98319]: DEBUG nova.virt.images [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] ddb82a83-20d7-4efa-9145-29669d8920b6 was qcow2, converting to raw {{(pid=98319) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 00:57:16.362501 np0000001577 nova-compute[98319]: DEBUG nova.privsep.utils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 00:57:16.362858 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884.part /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884.converted {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:16.404016 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Releasing lock "refresh_cache-8783a79a-1374-43cf-8f20-81f1a156a315" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:57:16.404464 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Instance network_info: |[{"id": "510c8fcb-a3ae-4a4b-b064-145dea29c584", "address": "fa:16:3e:2c:d2:b6", "network": {"id": "a3d13ae7-524a-4a4d-ac9b-3b364b3e2832", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-408863509-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2baedfd7036c444caea4b26edc31c870", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap510c8fcb-a3", "ovs_interfaceid": "510c8fcb-a3ae-4a4b-b064-145dea29c584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 00:57:16.406168 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-99f9d1a2-a029-4542-9ade-43851a5ffdee req-0232b834-07ef-4d27-b725-159ac67d6064 service nova] Acquired lock "refresh_cache-8783a79a-1374-43cf-8f20-81f1a156a315" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:57:16.406415 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-99f9d1a2-a029-4542-9ade-43851a5ffdee req-0232b834-07ef-4d27-b725-159ac67d6064 service nova] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Refreshing network info cache for port 510c8fcb-a3ae-4a4b-b064-145dea29c584 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:57:16.410906 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Start _get_guest_xml network_info=[{"id": "510c8fcb-a3ae-4a4b-b064-145dea29c584", "address": "fa:16:3e:2c:d2:b6", "network": {"id": "a3d13ae7-524a-4a4d-ac9b-3b364b3e2832", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-408863509-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2baedfd7036c444caea4b26edc31c870", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap510c8fcb-a3", "ovs_interfaceid": "510c8fcb-a3ae-4a4b-b064-145dea29c584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:56:55Z,direct_url=<?>,disk_format='qcow2',id=ac1895ec-fe7d-4daa-a504-820cce8782b9,min_disk=0,min_ram=0,name='',owner='0c3cff598ac2492aa974763db010d91d',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:56:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/sda', 'encrypted': False, 'disk_bus': 'scsi', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ac1895ec-fe7d-4daa-a504-820cce8782b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 00:57:16.414399 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 00:57:16.421311 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ac1895ec-fe7d-4daa-a504-820cce8782b9', instance_meta=NovaInstanceMeta(name='tempest-AttachSCSIVolumeTestJSON-server-2067469200', uuid='8783a79a-1374-43cf-8f20-81f1a156a315'), owner=OwnerMeta(userid='6f43ede1febc4364810902b8b6fb3ebb', username='tempest-AttachSCSIVolumeTestJSON-1126953535-project-member', projectid='2baedfd7036c444caea4b26edc31c870', projectname='tempest-AttachSCSIVolumeTestJSON-1126953535'), image=ImageMeta(id='ac1895ec-fe7d-4daa-a504-820cce8782b9', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'scsi', 'hw_disk_bus': 'scsi', 'hw_scsi_model': 'virtio-scsi'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "510c8fcb-a3ae-4a4b-b064-145dea29c584", "address": "fa:16:3e:2c:d2:b6", "network": {"id": "a3d13ae7-524a-4a4d-ac9b-3b364b3e2832", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-408863509-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2baedfd7036c444caea4b26edc31c870", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap510c8fcb-a3", "ovs_interfaceid": "510c8fcb-a3ae-4a4b-b064-145dea29c584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779929836.4202585) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 00:57:16.422385 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 00:57:16.422820 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 00:57:16.426397 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 00:57:16.426973 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 00:57:16.428241 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 00:57:16.428537 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:56:55Z,direct_url=<?>,disk_format='qcow2',id=ac1895ec-fe7d-4daa-a504-820cce8782b9,min_disk=0,min_ram=0,name='',owner='0c3cff598ac2492aa974763db010d91d',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:56:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 00:57:16.428702 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 00:57:16.429750 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 00:57:16.429929 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 00:57:16.430009 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 00:57:16.430125 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 00:57:16.430359 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 00:57:16.430476 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 00:57:16.430828 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 00:57:16.430951 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 00:57:16.431078 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 00:57:16.444954 np0000001577 nova-compute[98319]: DEBUG nova.privsep.utils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 00:57:16.446126 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2067469200',display_name='tempest-AttachSCSIVolumeTestJSON-server-2067469200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachscsivolumetestjson-server-2067469200',id=1,image_ref='ac1895ec-fe7d-4daa-a504-820cce8782b9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKESDRQL/lrq2YjNFEEjSyExoIkPgrzVv3INO31LyP/mNcVKvbL2WLese1271skeIZVqvkqvGayeH7V23cyCCPsTOXGe6H0qXAJagTvjPCiVcyZ0kwSIgKpv6dpgX/AS6A==',key_name='tempest-keypair-912573267',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2baedfd7036c444caea4b26edc31c870',ramdisk_id='',reservation_id='r-5omvsmsc',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ac1895ec-fe7d-4daa-a504-820cce8782b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1126953535',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1126953535-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:57:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f43ede1febc4364810902b8b6fb3ebb',uuid=8783a79a-1374-43cf-8f20-81f1a156a315,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "510c8fcb-a3ae-4a4b-b064-145dea29c584", "address": "fa:16:3e:2c:d2:b6", "network": {"id": "a3d13ae7-524a-4a4d-ac9b-3b364b3e2832", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-408863509-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2baedfd7036c444caea4b26edc31c870", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap510c8fcb-a3", "ovs_interfaceid": "510c8fcb-a3ae-4a4b-b064-145dea29c584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 00:57:16.446126 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Converting VIF {"id": "510c8fcb-a3ae-4a4b-b064-145dea29c584", "address": "fa:16:3e:2c:d2:b6", "network": {"id": "a3d13ae7-524a-4a4d-ac9b-3b364b3e2832", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-408863509-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2baedfd7036c444caea4b26edc31c870", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap510c8fcb-a3", "ovs_interfaceid": "510c8fcb-a3ae-4a4b-b064-145dea29c584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:57:16.449063 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:d2:b6,bridge_name='br-int',has_traffic_filtering=True,id=510c8fcb-a3ae-4a4b-b064-145dea29c584,network=Network(a3d13ae7-524a-4a4d-ac9b-3b364b3e2832),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap510c8fcb-a3') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:57:16.451503 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lazy-loading 'pci_devices' on Instance uuid 8783a79a-1374-43cf-8f20-81f1a156a315 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:57:16.533057 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884.part /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884.converted" returned: 0 in 0.170s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:16.539752 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884.converted --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:16.616794 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884.converted --force-share --output=json" returned: 0 in 0.075s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:16.616794 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.665s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:16.616794 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:57:16.621135 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:57:16.622579 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:16.698669 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.076s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:16.699243 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:16.700144 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:16.700393 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:57:16.704219 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:57:16.704629 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:16.720186 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c9a02aea-28d5-4138-ac8e-d3088049fb1a req-91f0c380-5eb8-4ab7-bd67-b30e74e5cc5f service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Received event network-changed-5dc9c0c0-6ee4-4266-8024-0f8313319a2c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:16.721675 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c9a02aea-28d5-4138-ac8e-d3088049fb1a req-91f0c380-5eb8-4ab7-bd67-b30e74e5cc5f service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Refreshing instance network info cache due to event network-changed-5dc9c0c0-6ee4-4266-8024-0f8313319a2c. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:57:16.721956 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c9a02aea-28d5-4138-ac8e-d3088049fb1a req-91f0c380-5eb8-4ab7-bd67-b30e74e5cc5f service nova] Acquiring lock "refresh_cache-b1380963-8254-4ad0-95bb-91d24cea00f9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:57:16.722706 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c9a02aea-28d5-4138-ac8e-d3088049fb1a req-91f0c380-5eb8-4ab7-bd67-b30e74e5cc5f service nova] Acquired lock "refresh_cache-b1380963-8254-4ad0-95bb-91d24cea00f9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:57:16.724481 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-c9a02aea-28d5-4138-ac8e-d3088049fb1a req-91f0c380-5eb8-4ab7-bd67-b30e74e5cc5f service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Refreshing network info cache for port 5dc9c0c0-6ee4-4266-8024-0f8313319a2c {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:57:16.732208 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Acquiring lock "refresh_cache-b1380963-8254-4ad0-95bb-91d24cea00f9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:57:16.741565 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 00:57:16.777676 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.072s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:16.779942 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:16.811163 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/disk 1073741824" returned: 0 in 0.031s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:16.811770 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.112s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:16.812115 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:16.891360 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.079s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:16.892397 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 00:57:16.892650 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:16.913717 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-99f9d1a2-a029-4542-9ade-43851a5ffdee req-0232b834-07ef-4d27-b725-159ac67d6064 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:16.956530 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] End _get_guest_xml xml=<domain type="qemu">
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:   <uuid>8783a79a-1374-43cf-8f20-81f1a156a315</uuid>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:   <name>instance-00000001</name>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:   <metadata>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-2067469200</nova:name>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 00:57:16</nova:creationTime>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       <nova:image uuid="ac1895ec-fe7d-4daa-a504-820cce8782b9">
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">scsi</nova:property>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:           <nova:property name="hw_disk_bus">scsi</nova:property>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:           <nova:property name="hw_scsi_model">virtio-scsi</nova:property>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       </nova:image>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:         <nova:user uuid="6f43ede1febc4364810902b8b6fb3ebb">tempest-AttachSCSIVolumeTestJSON-1126953535-project-member</nova:user>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:         <nova:project uuid="2baedfd7036c444caea4b26edc31c870">tempest-AttachSCSIVolumeTestJSON-1126953535</nova:project>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ac1895ec-fe7d-4daa-a504-820cce8782b9"/>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:         <nova:port uuid="510c8fcb-a3ae-4a4b-b064-145dea29c584">
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:         </nova:port>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:   </metadata>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:     <system>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       <entry name="serial">8783a79a-1374-43cf-8f20-81f1a156a315</entry>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       <entry name="uuid">8783a79a-1374-43cf-8f20-81f1a156a315</entry>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:     </system>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:   <os>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:   </os>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:   <features>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:     <acpi/>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:     <tcg>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:     </tcg>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:   </features>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:   <devices>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/8783a79a-1374-43cf-8f20-81f1a156a315/disk"/>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       <target dev="sda" bus="scsi"/>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       <address type="drive" controller="0" unit="0"/>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:     </disk>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/8783a79a-1374-43cf-8f20-81f1a156a315/disk.config"/>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       <target dev="sdb" bus="scsi"/>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       <address type="drive" controller="0" unit="1"/>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:     </disk>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:     <controller type="scsi" index="0" model="virtio-scsi"/>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:2c:d2:b6"/>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       <target dev="tap510c8fcb-a3"/>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:     </interface>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/8783a79a-1374-43cf-8f20-81f1a156a315/console.log" append="off"/>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:     </serial>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:     <video>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:     </video>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:     </rng>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:     </memballoon>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:   </devices>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]: </domain>
May 28 00:57:16.956530 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 00:57:16.958339 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Preparing to wait for external event network-vif-plugged-510c8fcb-a3ae-4a4b-b064-145dea29c584 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 00:57:16.958339 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Acquiring lock "8783a79a-1374-43cf-8f20-81f1a156a315-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:16.958339 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "8783a79a-1374-43cf-8f20-81f1a156a315-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:16.958339 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "8783a79a-1374-43cf-8f20-81f1a156a315-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:16.958339 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2067469200',display_name='tempest-AttachSCSIVolumeTestJSON-server-2067469200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachscsivolumetestjson-server-2067469200',id=1,image_ref='ac1895ec-fe7d-4daa-a504-820cce8782b9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKESDRQL/lrq2YjNFEEjSyExoIkPgrzVv3INO31LyP/mNcVKvbL2WLese1271skeIZVqvkqvGayeH7V23cyCCPsTOXGe6H0qXAJagTvjPCiVcyZ0kwSIgKpv6dpgX/AS6A==',key_name='tempest-keypair-912573267',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2baedfd7036c444caea4b26edc31c870',ramdisk_id='',reservation_id='r-5omvsmsc',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ac1895ec-fe7d-4daa-a504-820cce8782b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1126953535',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1126953535-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:57:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f43ede1febc4364810902b8b6fb3ebb',uuid=8783a79a-1374-43cf-8f20-81f1a156a315,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "510c8fcb-a3ae-4a4b-b064-145dea29c584", "address": "fa:16:3e:2c:d2:b6", "network": {"id": "a3d13ae7-524a-4a4d-ac9b-3b364b3e2832", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-408863509-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2baedfd7036c444caea4b26edc31c870", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap510c8fcb-a3", "ovs_interfaceid": "510c8fcb-a3ae-4a4b-b064-145dea29c584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 00:57:16.958679 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Converting VIF {"id": "510c8fcb-a3ae-4a4b-b064-145dea29c584", "address": "fa:16:3e:2c:d2:b6", "network": {"id": "a3d13ae7-524a-4a4d-ac9b-3b364b3e2832", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-408863509-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2baedfd7036c444caea4b26edc31c870", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap510c8fcb-a3", "ovs_interfaceid": "510c8fcb-a3ae-4a4b-b064-145dea29c584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:57:16.959409 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:d2:b6,bridge_name='br-int',has_traffic_filtering=True,id=510c8fcb-a3ae-4a4b-b064-145dea29c584,network=Network(a3d13ae7-524a-4a4d-ac9b-3b364b3e2832),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap510c8fcb-a3') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:57:16.959680 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:d2:b6,bridge_name='br-int',has_traffic_filtering=True,id=510c8fcb-a3ae-4a4b-b064-145dea29c584,network=Network(a3d13ae7-524a-4a4d-ac9b-3b364b3e2832),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap510c8fcb-a3') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 00:57:16.965153 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/disk --force-share --output=json" returned: 0 in 0.072s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:16.965493 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Cannot resize image /opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 00:57:16.966578 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 00:57:16.966781 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Ensure instance console log exists: /opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 00:57:16.968968 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:16.968968 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:16.968968 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:17.009760 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Created schema index Interface.name {{(pid=98319) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 28 00:57:17.009890 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Created schema index Port.name {{(pid=98319) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 28 00:57:17.009988 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Created schema index Bridge.name {{(pid=98319) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 28 00:57:17.010369 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=98319) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 00:57:17.010454 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [POLLOUT] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:17.010544 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98319) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 00:57:17.010938 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:17.012351 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:17.028277 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:17.045187 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:17.045408 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:17.045741 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 00:57:17.046460 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:17.046693 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67ff80d5-5f43-5f34-add9-d91aa9c89a69', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:17.048967 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:57:17.049727 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:17.051031 np0000001577 nova-compute[98319]: INFO oslo.privsep.daemon [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpyt4mog4z/privsep.sock']
May 28 00:57:17.059827 np0000001577 sudo[110055]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpyt4mog4z/privsep.sock
May 28 00:57:17.060660 np0000001577 sudo[110055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 28 00:57:17.134835 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:57:17.138748 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:57:17.229802 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-c9a02aea-28d5-4138-ac8e-d3088049fb1a req-91f0c380-5eb8-4ab7-bd67-b30e74e5cc5f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:17.259285 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 00:57:17.291779 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:17.318166 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Successfully created port: 16d9022a-b978-4e59-80a0-34d8d6da6b87 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 00:57:17.318166 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 28 00:57:17.318166 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 28 00:57:17.318166 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 28 00:57:17.318166 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 00:57:17.318166 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 28 00:57:17.318166 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 28 00:57:17.318166 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 28 00:57:17.318166 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 00:57:17.319009 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 28 00:57:17.479694 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-c9a02aea-28d5-4138-ac8e-d3088049fb1a req-91f0c380-5eb8-4ab7-bd67-b30e74e5cc5f service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:57:17.612025 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 28 00:57:17.612130 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 28 00:57:17.612158 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 28 00:57:17.612277 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 00:57:17.612277 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 28 00:57:17.612333 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 28 00:57:17.612388 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 28 00:57:17.612458 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 00:57:17.612530 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 28 00:57:17.641305 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:57:17.699702 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-3aa638e3-7de8-473e-8a65-eff787c3949c req-1ed28bee-e533-4efb-943d-af108534cd8e service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Received event network-vif-unplugged-5dc9c0c0-6ee4-4266-8024-0f8313319a2c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:17.699907 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3aa638e3-7de8-473e-8a65-eff787c3949c req-1ed28bee-e533-4efb-943d-af108534cd8e service nova] Acquiring lock "b1380963-8254-4ad0-95bb-91d24cea00f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:17.700201 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3aa638e3-7de8-473e-8a65-eff787c3949c req-1ed28bee-e533-4efb-943d-af108534cd8e service nova] Lock "b1380963-8254-4ad0-95bb-91d24cea00f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:17.700250 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3aa638e3-7de8-473e-8a65-eff787c3949c req-1ed28bee-e533-4efb-943d-af108534cd8e service nova] Lock "b1380963-8254-4ad0-95bb-91d24cea00f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:17.700522 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-3aa638e3-7de8-473e-8a65-eff787c3949c req-1ed28bee-e533-4efb-943d-af108534cd8e service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] No waiting events found dispatching network-vif-unplugged-5dc9c0c0-6ee4-4266-8024-0f8313319a2c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:57:17.700947 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-3aa638e3-7de8-473e-8a65-eff787c3949c req-1ed28bee-e533-4efb-943d-af108534cd8e service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Received unexpected event network-vif-unplugged-5dc9c0c0-6ee4-4266-8024-0f8313319a2c for instance with vm_state building and task_state spawning.
May 28 00:57:17.854634 np0000001577 sudo[110055]: pam_unix(sudo:session): session closed for user root
May 28 00:57:17.857927 np0000001577 nova-compute[98319]: INFO oslo.privsep.daemon [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Spawned new privsep daemon via rootwrap
May 28 00:57:17.859717 np0000001577 nova-compute[98319]: INFO oslo.privsep.daemon [-] privsep daemon starting
May 28 00:57:17.859717 np0000001577 nova-compute[98319]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
May 28 00:57:17.859717 np0000001577 nova-compute[98319]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
May 28 00:57:17.859717 np0000001577 nova-compute[98319]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 110070
May 28 00:57:17.947368 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-c9a02aea-28d5-4138-ac8e-d3088049fb1a req-91f0c380-5eb8-4ab7-bd67-b30e74e5cc5f service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:57:18.029442 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Successfully updated port: 16d9022a-b978-4e59-80a0-34d8d6da6b87 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 00:57:18.077211 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-99f9d1a2-a029-4542-9ade-43851a5ffdee req-0232b834-07ef-4d27-b725-159ac67d6064 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:18.149735 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:18.149735 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap510c8fcb-a3, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:18.150042 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap510c8fcb-a3, col_values=(('qos', UUID('ff0fe67a-1cd8-4bc6-ac8e-8ca421e004d7')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:18.150984 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap510c8fcb-a3, col_values=(('external_ids', {'iface-id': '510c8fcb-a3ae-4a4b-b064-145dea29c584', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:d2:b6', 'vm-uuid': '8783a79a-1374-43cf-8f20-81f1a156a315'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:18.152470 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.431s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:18.152992 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 00:57:18.155531 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 5.257s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:18.159435 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:57:18.161864 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 00:57:18.161974 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Claim successful on node np0000001577
May 28 00:57:18.164377 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:18.166484 np0000001577 nova-compute[98319]: INFO os_vif [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:d2:b6,bridge_name='br-int',has_traffic_filtering=True,id=510c8fcb-a3ae-4a4b-b064-145dea29c584,network=Network(a3d13ae7-524a-4a4d-ac9b-3b364b3e2832),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap510c8fcb-a3')
May 28 00:57:18.243889 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-99f9d1a2-a029-4542-9ade-43851a5ffdee req-0232b834-07ef-4d27-b725-159ac67d6064 service nova] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Updated VIF entry in instance network info cache for port 510c8fcb-a3ae-4a4b-b064-145dea29c584. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 00:57:18.244124 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-99f9d1a2-a029-4542-9ade-43851a5ffdee req-0232b834-07ef-4d27-b725-159ac67d6064 service nova] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Updating instance_info_cache with network_info: [{"id": "510c8fcb-a3ae-4a4b-b064-145dea29c584", "address": "fa:16:3e:2c:d2:b6", "network": {"id": "a3d13ae7-524a-4a4d-ac9b-3b364b3e2832", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-408863509-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2baedfd7036c444caea4b26edc31c870", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap510c8fcb-a3", "ovs_interfaceid": "510c8fcb-a3ae-4a4b-b064-145dea29c584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:57:18.266688 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 00:57:18.267935 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 00:57:18.267935 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Creating image(s)
May 28 00:57:18.268343 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquiring lock "/opt/stack/data/nova/instances/0928917f-0c8c-4019-aef4-083ba8224ce0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:18.268460 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "/opt/stack/data/nova/instances/0928917f-0c8c-4019-aef4-083ba8224ce0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:18.268927 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "/opt/stack/data/nova/instances/0928917f-0c8c-4019-aef4-083ba8224ce0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:18.269423 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:57:18.272047 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:57:18.273037 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:18.349078 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.076s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:18.349572 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:18.350186 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:18.351279 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:57:18.353864 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:57:18.354138 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:18.412820 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.058s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:18.413372 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/0928917f-0c8c-4019-aef4-083ba8224ce0/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:18.440332 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/0928917f-0c8c-4019-aef4-083ba8224ce0/disk 1073741824" returned: 0 in 0.027s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:18.441160 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.090s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:18.441160 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:18.450858 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c9a02aea-28d5-4138-ac8e-d3088049fb1a req-91f0c380-5eb8-4ab7-bd67-b30e74e5cc5f service nova] Releasing lock "refresh_cache-b1380963-8254-4ad0-95bb-91d24cea00f9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:57:18.451728 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Acquired lock "refresh_cache-b1380963-8254-4ad0-95bb-91d24cea00f9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:57:18.451960 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 00:57:18.505645 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.064s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:18.505645 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0928917f-0c8c-4019-aef4-083ba8224ce0/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 00:57:18.505899 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0928917f-0c8c-4019-aef4-083ba8224ce0/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:18.532018 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquiring lock "refresh_cache-0928917f-0c8c-4019-aef4-083ba8224ce0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:57:18.532661 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquired lock "refresh_cache-0928917f-0c8c-4019-aef4-083ba8224ce0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:57:18.532661 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 00:57:18.577533 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0928917f-0c8c-4019-aef4-083ba8224ce0/disk --force-share --output=json" returned: 0 in 0.072s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:18.578172 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Cannot resize image /opt/stack/data/nova/instances/0928917f-0c8c-4019-aef4-083ba8224ce0/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 00:57:18.578572 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 00:57:18.578714 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Ensure instance console log exists: /opt/stack/data/nova/instances/0928917f-0c8c-4019-aef4-083ba8224ce0/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 00:57:18.579229 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:18.579384 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:18.580192 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:18.658967 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 00:57:18.660101 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 00:57:18.661097 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:18.662058 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:18.747126 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-99f9d1a2-a029-4542-9ade-43851a5ffdee req-0232b834-07ef-4d27-b725-159ac67d6064 service nova] Releasing lock "refresh_cache-8783a79a-1374-43cf-8f20-81f1a156a315" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:57:18.751625 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '027d659157ce49c7b674d0e5d41adf07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df45e1c2b903482aa7e61c55b1f3f45b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 00:57:18.789968 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-055fc28d-af0d-4ac6-bd10-ee9325bee5cd req-d575be3c-c38c-4eb0-9e65-6302fbcaaa3e service nova] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Received event network-changed-16d9022a-b978-4e59-80a0-34d8d6da6b87 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:18.790676 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-055fc28d-af0d-4ac6-bd10-ee9325bee5cd req-d575be3c-c38c-4eb0-9e65-6302fbcaaa3e service nova] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Refreshing instance network info cache due to event network-changed-16d9022a-b978-4e59-80a0-34d8d6da6b87. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:57:18.790851 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-055fc28d-af0d-4ac6-bd10-ee9325bee5cd req-d575be3c-c38c-4eb0-9e65-6302fbcaaa3e service nova] Acquiring lock "refresh_cache-0928917f-0c8c-4019-aef4-083ba8224ce0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:57:19.088261 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:57:19.163668 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 00:57:19.305124 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Successfully created port: 9f8ec3b0-780e-4a36-ad3f-4664a6829868 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 00:57:19.340524 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:57:19.475123 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:57:19.475317 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:57:19.664688 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 00:57:19.690630 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] No BDM found with device name sda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:57:19.690630 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:57:19.690630 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] No VIF found with MAC fa:16:3e:2c:d2:b6, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 00:57:19.690933 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Using config drive
May 28 00:57:19.912563 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Successfully updated port: 9f8ec3b0-780e-4a36-ad3f-4664a6829868 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 00:57:19.977770 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:57:19.994577 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:20.051515 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:20.053121 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:20.060149 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-98e4b69b-15ac-4355-89cd-1d46561e8316 req-8417746c-056d-49a3-9cb2-dff32b3cb71d service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Received event network-changed-9f8ec3b0-780e-4a36-ad3f-4664a6829868 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:20.060149 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-98e4b69b-15ac-4355-89cd-1d46561e8316 req-8417746c-056d-49a3-9cb2-dff32b3cb71d service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Refreshing instance network info cache due to event network-changed-9f8ec3b0-780e-4a36-ad3f-4664a6829868. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:57:20.060149 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-98e4b69b-15ac-4355-89cd-1d46561e8316 req-8417746c-056d-49a3-9cb2-dff32b3cb71d service nova] Acquiring lock "refresh_cache-7fdf336e-65c1-4180-92eb-5f8ca0ebc526" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:57:20.060149 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-98e4b69b-15ac-4355-89cd-1d46561e8316 req-8417746c-056d-49a3-9cb2-dff32b3cb71d service nova] Acquired lock "refresh_cache-7fdf336e-65c1-4180-92eb-5f8ca0ebc526" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:57:20.060149 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-98e4b69b-15ac-4355-89cd-1d46561e8316 req-8417746c-056d-49a3-9cb2-dff32b3cb71d service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Refreshing network info cache for port 9f8ec3b0-780e-4a36-ad3f-4664a6829868 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:57:20.196869 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:20.313508 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Updating instance_info_cache with network_info: [{"id": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "address": "fa:16:3e:3a:fe:3d", "network": {"id": "3ceee21d-d4b4-4c77-8ac9-f2338f96e022", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-960987788-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "355551e9b29346059ddbe389bc51efa8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc9c0c0-6e", "ovs_interfaceid": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:57:20.417034 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquiring lock "refresh_cache-7fdf336e-65c1-4180-92eb-5f8ca0ebc526" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:57:20.465555 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Updating instance_info_cache with network_info: [{"id": "16d9022a-b978-4e59-80a0-34d8d6da6b87", "address": "fa:16:3e:89:ef:d4", "network": {"id": "e43128b4-a829-486a-a380-4b92728ed2c5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-655543488-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df45e1c2b903482aa7e61c55b1f3f45b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d9022a-b9", "ovs_interfaceid": "16d9022a-b978-4e59-80a0-34d8d6da6b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:57:20.487119 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.332s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:20.489671 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 00:57:20.562183 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-98e4b69b-15ac-4355-89cd-1d46561e8316 req-8417746c-056d-49a3-9cb2-dff32b3cb71d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:20.675669 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 00:57:20.677441 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 00:57:20.677874 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Creating image(s)
May 28 00:57:20.678468 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquiring lock "/opt/stack/data/nova/instances/7fdf336e-65c1-4180-92eb-5f8ca0ebc526/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:20.678688 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "/opt/stack/data/nova/instances/7fdf336e-65c1-4180-92eb-5f8ca0ebc526/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:20.679197 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "/opt/stack/data/nova/instances/7fdf336e-65c1-4180-92eb-5f8ca0ebc526/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:20.679711 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:57:20.683432 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:57:20.684855 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:20.754220 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.069s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:20.755810 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:20.756395 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:20.756968 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:57:20.760834 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:57:20.761316 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:20.769967 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:20.809562 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Releasing lock "refresh_cache-b1380963-8254-4ad0-95bb-91d24cea00f9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:57:20.810040 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Instance network_info: |[{"id": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "address": "fa:16:3e:3a:fe:3d", "network": {"id": "3ceee21d-d4b4-4c77-8ac9-f2338f96e022", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-960987788-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "355551e9b29346059ddbe389bc51efa8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc9c0c0-6e", "ovs_interfaceid": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 00:57:20.812021 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Start _get_guest_xml network_info=[{"id": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "address": "fa:16:3e:3a:fe:3d", "network": {"id": "3ceee21d-d4b4-4c77-8ac9-f2338f96e022", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-960987788-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "355551e9b29346059ddbe389bc51efa8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc9c0c0-6e", "ovs_interfaceid": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 00:57:20.814039 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 00:57:20.815313 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1446893669', uuid='b1380963-8254-4ad0-95bb-91d24cea00f9'), owner=OwnerMeta(userid='b4ab7230b24d4ebf9090a752493983fb', username='tempest-TaggedAttachmentsTest-585237783-project-member', projectid='355551e9b29346059ddbe389bc51efa8', projectname='tempest-TaggedAttachmentsTest-585237783'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "address": "fa:16:3e:3a:fe:3d", "network": {"id": "3ceee21d-d4b4-4c77-8ac9-f2338f96e022", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-960987788-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "355551e9b29346059ddbe389bc51efa8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc9c0c0-6e", "ovs_interfaceid": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779929840.8149583) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 00:57:20.816175 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 00:57:20.816480 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 00:57:20.817251 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 00:57:20.817423 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 00:57:20.818369 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 00:57:20.818699 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 00:57:20.818832 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 00:57:20.818926 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 00:57:20.819041 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 00:57:20.819110 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 00:57:20.819196 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 00:57:20.819385 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 00:57:20.819569 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 00:57:20.819643 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 00:57:20.819690 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 00:57:20.819807 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 00:57:20.830069 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1446893669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1446893669',id=2,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgdSzXGUKNMMeuA2Cyvm6EZFtiJzxD7NWnlARJicpzFqN2FImWG3sU3198MgahdHOMaJqdmKUE8nRVq4d1z2/aQ8GRY/yfj1gslPX4PwbxVdsepP0DFICVmWgbQsQGwKA==',key_name='tempest-keypair-1022143858',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='355551e9b29346059ddbe389bc51efa8',ramdisk_id='',reservation_id='r-nlwfuhg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-585237783',owner_user_name='tempest-TaggedAttachmentsTest-585237783-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:57:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4ab7230b24d4ebf9090a752493983fb',uuid=b1380963-8254-4ad0-95bb-91d24cea00f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "address": "fa:16:3e:3a:fe:3d", "network": {"id": "3ceee21d-d4b4-4c77-8ac9-f2338f96e022", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-960987788-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "355551e9b29346059ddbe389bc51efa8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc9c0c0-6e", "ovs_interfaceid": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 00:57:20.830298 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Converting VIF {"id": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "address": "fa:16:3e:3a:fe:3d", "network": {"id": "3ceee21d-d4b4-4c77-8ac9-f2338f96e022", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-960987788-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "355551e9b29346059ddbe389bc51efa8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc9c0c0-6e", "ovs_interfaceid": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:57:20.830824 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:fe:3d,bridge_name='br-int',has_traffic_filtering=True,id=5dc9c0c0-6ee4-4266-8024-0f8313319a2c,network=Network(3ceee21d-d4b4-4c77-8ac9-f2338f96e022),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dc9c0c0-6e') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:57:20.831435 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lazy-loading 'pci_devices' on Instance uuid b1380963-8254-4ad0-95bb-91d24cea00f9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:57:20.833298 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.072s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:20.833495 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/7fdf336e-65c1-4180-92eb-5f8ca0ebc526/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:20.865093 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/7fdf336e-65c1-4180-92eb-5f8ca0ebc526/disk 1073741824" returned: 0 in 0.031s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:20.865956 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.109s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:20.866330 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:20.913410 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Creating config drive at /opt/stack/data/nova/instances/8783a79a-1374-43cf-8f20-81f1a156a315/disk.config
May 28 00:57:20.917521 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8783a79a-1374-43cf-8f20-81f1a156a315/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp48v4vlpa {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:20.941796 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.075s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:20.942241 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7fdf336e-65c1-4180-92eb-5f8ca0ebc526/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 00:57:20.942487 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fdf336e-65c1-4180-92eb-5f8ca0ebc526/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:20.951908 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8783a79a-1374-43cf-8f20-81f1a156a315/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp48v4vlpa" returned: 0 in 0.033s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:20.968872 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Releasing lock "refresh_cache-0928917f-0c8c-4019-aef4-083ba8224ce0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:57:20.970159 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Instance network_info: |[{"id": "16d9022a-b978-4e59-80a0-34d8d6da6b87", "address": "fa:16:3e:89:ef:d4", "network": {"id": "e43128b4-a829-486a-a380-4b92728ed2c5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-655543488-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df45e1c2b903482aa7e61c55b1f3f45b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d9022a-b9", "ovs_interfaceid": "16d9022a-b978-4e59-80a0-34d8d6da6b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 00:57:20.971599 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-055fc28d-af0d-4ac6-bd10-ee9325bee5cd req-d575be3c-c38c-4eb0-9e65-6302fbcaaa3e service nova] Acquired lock "refresh_cache-0928917f-0c8c-4019-aef4-083ba8224ce0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:57:20.971837 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-055fc28d-af0d-4ac6-bd10-ee9325bee5cd req-d575be3c-c38c-4eb0-9e65-6302fbcaaa3e service nova] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Refreshing network info cache for port 16d9022a-b978-4e59-80a0-34d8d6da6b87 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:57:20.973718 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Start _get_guest_xml network_info=[{"id": "16d9022a-b978-4e59-80a0-34d8d6da6b87", "address": "fa:16:3e:89:ef:d4", "network": {"id": "e43128b4-a829-486a-a380-4b92728ed2c5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-655543488-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df45e1c2b903482aa7e61c55b1f3f45b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d9022a-b9", "ovs_interfaceid": "16d9022a-b978-4e59-80a0-34d8d6da6b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 00:57:20.976567 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 00:57:20.977973 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-1923104158-1', uuid='0928917f-0c8c-4019-aef4-083ba8224ce0'), owner=OwnerMeta(userid='027d659157ce49c7b674d0e5d41adf07', username='tempest-TestMultiAttachVolumeSwap-196235525-project-member', projectid='df45e1c2b903482aa7e61c55b1f3f45b', projectname='tempest-TestMultiAttachVolumeSwap-196235525'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "16d9022a-b978-4e59-80a0-34d8d6da6b87", "address": "fa:16:3e:89:ef:d4", "network": {"id": "e43128b4-a829-486a-a380-4b92728ed2c5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-655543488-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df45e1c2b903482aa7e61c55b1f3f45b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d9022a-b9", "ovs_interfaceid": "16d9022a-b978-4e59-80a0-34d8d6da6b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779929840.9771163) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 00:57:20.979115 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 00:57:20.979490 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 00:57:20.980566 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 00:57:20.980566 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 00:57:20.981870 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 00:57:20.982190 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 00:57:20.982317 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 00:57:20.982405 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 00:57:20.982673 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 00:57:20.983291 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 00:57:20.983423 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 00:57:20.983648 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 00:57:20.983789 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 00:57:20.983921 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 00:57:20.984055 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 00:57:20.984196 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 00:57:20.996839 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 00:57:20.997112 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 00:57:20.997597 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:20.997920 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:21.004327 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T00:57:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1923104158-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testmultiattachvolumeswap-server-1923104158-1',id=3,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTrx4V3NNTvIO0v6e0UgrxyebG5bgkKISVc5kT+2xHSKFNJBCRuY+HWML8VJbZLvrlhGev6Ue1eO9Ec7vV8o3QKseEptwtOMBb5jUqsNTaO/QaEwQKXDgtt4TsHfOVLJQ==',key_name='tempest-keypair-1571596048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df45e1c2b903482aa7e61c55b1f3f45b',ramdisk_id='',reservation_id='r-ka660b6i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-196235525',owner_user_name='tempest-TestMultiAttachVolumeSwap-196235525-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:57:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='027d659157ce49c7b674d0e5d41adf07',uuid=0928917f-0c8c-4019-aef4-083ba8224ce0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16d9022a-b978-4e59-80a0-34d8d6da6b87", "address": "fa:16:3e:89:ef:d4", "network": {"id": "e43128b4-a829-486a-a380-4b92728ed2c5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-655543488-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df45e1c2b903482aa7e61c55b1f3f45b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d9022a-b9", "ovs_interfaceid": "16d9022a-b978-4e59-80a0-34d8d6da6b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 00:57:21.004327 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Converting VIF {"id": "16d9022a-b978-4e59-80a0-34d8d6da6b87", "address": "fa:16:3e:89:ef:d4", "network": {"id": "e43128b4-a829-486a-a380-4b92728ed2c5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-655543488-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df45e1c2b903482aa7e61c55b1f3f45b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d9022a-b9", "ovs_interfaceid": "16d9022a-b978-4e59-80a0-34d8d6da6b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:57:21.004867 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:ef:d4,bridge_name='br-int',has_traffic_filtering=True,id=16d9022a-b978-4e59-80a0-34d8d6da6b87,network=Network(e43128b4-a829-486a-a380-4b92728ed2c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d9022a-b9') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:57:21.005703 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lazy-loading 'pci_devices' on Instance uuid 0928917f-0c8c-4019-aef4-083ba8224ce0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:57:21.042023 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fdf336e-65c1-4180-92eb-5f8ca0ebc526/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:21.045275 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Cannot resize image /opt/stack/data/nova/instances/7fdf336e-65c1-4180-92eb-5f8ca0ebc526/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 00:57:21.045275 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 00:57:21.045275 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Ensure instance console log exists: /opt/stack/data/nova/instances/7fdf336e-65c1-4180-92eb-5f8ca0ebc526/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 00:57:21.045275 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:21.045275 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:21.045275 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:21.301914 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-98e4b69b-15ac-4355-89cd-1d46561e8316 req-8417746c-056d-49a3-9cb2-dff32b3cb71d service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:57:21.336244 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] End _get_guest_xml xml=<domain type="qemu">
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:   <uuid>b1380963-8254-4ad0-95bb-91d24cea00f9</uuid>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:   <name>instance-00000002</name>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:   <metadata>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       <nova:name>tempest-device-tagging-server-1446893669</nova:name>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 00:57:20</nova:creationTime>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       </nova:image>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:         <nova:user uuid="b4ab7230b24d4ebf9090a752493983fb">tempest-TaggedAttachmentsTest-585237783-project-member</nova:user>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:         <nova:project uuid="355551e9b29346059ddbe389bc51efa8">tempest-TaggedAttachmentsTest-585237783</nova:project>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:         <nova:port uuid="5dc9c0c0-6ee4-4266-8024-0f8313319a2c">
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:         </nova:port>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:   </metadata>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:     <system>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       <entry name="serial">b1380963-8254-4ad0-95bb-91d24cea00f9</entry>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       <entry name="uuid">b1380963-8254-4ad0-95bb-91d24cea00f9</entry>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:     </system>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:   <os>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:   </os>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:   <features>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:     <acpi/>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:     <tcg>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:     </tcg>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:   </features>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:   <devices>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/disk"/>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:     </disk>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/disk.config"/>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:     </disk>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:3a:fe:3d"/>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       <target dev="tap5dc9c0c0-6e"/>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:     </interface>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/console.log" append="off"/>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:     </serial>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:     <video>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:     </video>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:     </rng>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:     </memballoon>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:   </devices>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]: </domain>
May 28 00:57:21.336244 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 00:57:21.340455 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Preparing to wait for external event network-vif-plugged-5dc9c0c0-6ee4-4266-8024-0f8313319a2c {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 00:57:21.340455 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Acquiring lock "b1380963-8254-4ad0-95bb-91d24cea00f9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:21.340455 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "b1380963-8254-4ad0-95bb-91d24cea00f9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:21.340455 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "b1380963-8254-4ad0-95bb-91d24cea00f9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:21.340455 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1446893669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1446893669',id=2,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgdSzXGUKNMMeuA2Cyvm6EZFtiJzxD7NWnlARJicpzFqN2FImWG3sU3198MgahdHOMaJqdmKUE8nRVq4d1z2/aQ8GRY/yfj1gslPX4PwbxVdsepP0DFICVmWgbQsQGwKA==',key_name='tempest-keypair-1022143858',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='355551e9b29346059ddbe389bc51efa8',ramdisk_id='',reservation_id='r-nlwfuhg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-585237783',owner_user_name='tempest-TaggedAttachmentsTest-585237783-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:57:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4ab7230b24d4ebf9090a752493983fb',uuid=b1380963-8254-4ad0-95bb-91d24cea00f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "address": "fa:16:3e:3a:fe:3d", "network": {"id": "3ceee21d-d4b4-4c77-8ac9-f2338f96e022", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-960987788-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "355551e9b29346059ddbe389bc51efa8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc9c0c0-6e", "ovs_interfaceid": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 00:57:21.340720 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Converting VIF {"id": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "address": "fa:16:3e:3a:fe:3d", "network": {"id": "3ceee21d-d4b4-4c77-8ac9-f2338f96e022", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-960987788-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "355551e9b29346059ddbe389bc51efa8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc9c0c0-6e", "ovs_interfaceid": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:57:21.340788 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:fe:3d,bridge_name='br-int',has_traffic_filtering=True,id=5dc9c0c0-6ee4-4266-8024-0f8313319a2c,network=Network(3ceee21d-d4b4-4c77-8ac9-f2338f96e022),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dc9c0c0-6e') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:57:21.341062 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:fe:3d,bridge_name='br-int',has_traffic_filtering=True,id=5dc9c0c0-6ee4-4266-8024-0f8313319a2c,network=Network(3ceee21d-d4b4-4c77-8ac9-f2338f96e022),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dc9c0c0-6e') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 00:57:21.341566 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:21.341736 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:21.342047 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 00:57:21.346124 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:21.346328 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f637437-e393-59cf-b78e-8e36e8796e04', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:21.347116 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:21.348283 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:57:21.355426 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:21.358040 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:21.358040 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5dc9c0c0-6e, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:21.358319 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5dc9c0c0-6e, col_values=(('qos', UUID('816bc893-1b44-46a7-8b48-be489c25fb89')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:21.358493 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5dc9c0c0-6e, col_values=(('external_ids', {'iface-id': '5dc9c0c0-6ee4-4266-8024-0f8313319a2c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:fe:3d', 'vm-uuid': 'b1380963-8254-4ad0-95bb-91d24cea00f9'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:21.359380 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:21.362108 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:57:21.370563 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:21.371686 np0000001577 nova-compute[98319]: INFO os_vif [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:fe:3d,bridge_name='br-int',has_traffic_filtering=True,id=5dc9c0c0-6ee4-4266-8024-0f8313319a2c,network=Network(3ceee21d-d4b4-4c77-8ac9-f2338f96e022),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dc9c0c0-6e')
May 28 00:57:21.400128 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:21.425560 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:21.444621 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '32c3fd5d3b604c77b6ccc0284ea33a11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '365a56f393cf409d8d1562e6be8318fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 00:57:21.476253 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-055fc28d-af0d-4ac6-bd10-ee9325bee5cd req-d575be3c-c38c-4eb0-9e65-6302fbcaaa3e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:21.501345 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 00:57:21.511689 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] End _get_guest_xml xml=<domain type="qemu">
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:   <uuid>0928917f-0c8c-4019-aef4-083ba8224ce0</uuid>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:   <name>instance-00000003</name>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:   <metadata>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestMultiAttachVolumeSwap-server-1923104158-1</nova:name>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 00:57:20</nova:creationTime>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       </nova:image>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:         <nova:user uuid="027d659157ce49c7b674d0e5d41adf07">tempest-TestMultiAttachVolumeSwap-196235525-project-member</nova:user>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:         <nova:project uuid="df45e1c2b903482aa7e61c55b1f3f45b">tempest-TestMultiAttachVolumeSwap-196235525</nova:project>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:         <nova:port uuid="16d9022a-b978-4e59-80a0-34d8d6da6b87">
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:         </nova:port>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:   </metadata>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:     <system>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       <entry name="serial">0928917f-0c8c-4019-aef4-083ba8224ce0</entry>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       <entry name="uuid">0928917f-0c8c-4019-aef4-083ba8224ce0</entry>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:     </system>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:   <os>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:   </os>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:   <features>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:     <acpi/>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:     <tcg>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:     </tcg>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:   </features>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:   <devices>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/0928917f-0c8c-4019-aef4-083ba8224ce0/disk"/>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:     </disk>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/0928917f-0c8c-4019-aef4-083ba8224ce0/disk.config"/>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:     </disk>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:89:ef:d4"/>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       <target dev="tap16d9022a-b9"/>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:     </interface>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/0928917f-0c8c-4019-aef4-083ba8224ce0/console.log" append="off"/>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:     </serial>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:     <video>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:     </video>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:     </rng>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:     </memballoon>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:   </devices>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]: </domain>
May 28 00:57:21.511689 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 00:57:21.513923 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Preparing to wait for external event network-vif-plugged-16d9022a-b978-4e59-80a0-34d8d6da6b87 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 00:57:21.513923 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquiring lock "0928917f-0c8c-4019-aef4-083ba8224ce0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:21.513923 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "0928917f-0c8c-4019-aef4-083ba8224ce0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:21.513923 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "0928917f-0c8c-4019-aef4-083ba8224ce0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:21.513923 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T00:57:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1923104158-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testmultiattachvolumeswap-server-1923104158-1',id=3,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTrx4V3NNTvIO0v6e0UgrxyebG5bgkKISVc5kT+2xHSKFNJBCRuY+HWML8VJbZLvrlhGev6Ue1eO9Ec7vV8o3QKseEptwtOMBb5jUqsNTaO/QaEwQKXDgtt4TsHfOVLJQ==',key_name='tempest-keypair-1571596048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df45e1c2b903482aa7e61c55b1f3f45b',ramdisk_id='',reservation_id='r-ka660b6i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-196235525',owner_user_name='tempest-TestMultiAttachVolumeSwap-196235525-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:57:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='027d659157ce49c7b674d0e5d41adf07',uuid=0928917f-0c8c-4019-aef4-083ba8224ce0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16d9022a-b978-4e59-80a0-34d8d6da6b87", "address": "fa:16:3e:89:ef:d4", "network": {"id": "e43128b4-a829-486a-a380-4b92728ed2c5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-655543488-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df45e1c2b903482aa7e61c55b1f3f45b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d9022a-b9", "ovs_interfaceid": "16d9022a-b978-4e59-80a0-34d8d6da6b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 00:57:21.514129 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Converting VIF {"id": "16d9022a-b978-4e59-80a0-34d8d6da6b87", "address": "fa:16:3e:89:ef:d4", "network": {"id": "e43128b4-a829-486a-a380-4b92728ed2c5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-655543488-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df45e1c2b903482aa7e61c55b1f3f45b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d9022a-b9", "ovs_interfaceid": "16d9022a-b978-4e59-80a0-34d8d6da6b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:57:21.514129 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:ef:d4,bridge_name='br-int',has_traffic_filtering=True,id=16d9022a-b978-4e59-80a0-34d8d6da6b87,network=Network(e43128b4-a829-486a-a380-4b92728ed2c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d9022a-b9') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:57:21.514129 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:ef:d4,bridge_name='br-int',has_traffic_filtering=True,id=16d9022a-b978-4e59-80a0-34d8d6da6b87,network=Network(e43128b4-a829-486a-a380-4b92728ed2c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d9022a-b9') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 00:57:21.514704 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:21.514817 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:21.514957 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 00:57:21.516511 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:21.516768 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f71ade88-d0a9-5882-87e7-07493aaa4c7f', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:21.517438 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:21.518174 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:57:21.525387 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:21.531838 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:21.532233 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16d9022a-b9, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:21.532684 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap16d9022a-b9, col_values=(('qos', UUID('086c0b16-9f12-4fa8-bffd-25ae32747895')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:21.532853 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap16d9022a-b9, col_values=(('external_ids', {'iface-id': '16d9022a-b978-4e59-80a0-34d8d6da6b87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:ef:d4', 'vm-uuid': '0928917f-0c8c-4019-aef4-083ba8224ce0'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:21.533581 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:21.534668 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:57:21.543151 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:21.544230 np0000001577 nova-compute[98319]: INFO os_vif [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:ef:d4,bridge_name='br-int',has_traffic_filtering=True,id=16d9022a-b978-4e59-80a0-34d8d6da6b87,network=Network(e43128b4-a829-486a-a380-4b92728ed2c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d9022a-b9')
May 28 00:57:21.794166 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:21.947707 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-98e4b69b-15ac-4355-89cd-1d46561e8316 req-8417746c-056d-49a3-9cb2-dff32b3cb71d service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:57:22.007229 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 00:57:22.229801 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1779929842.2294495, 8783a79a-1374-43cf-8f20-81f1a156a315 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:57:22.230041 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] VM Started (Lifecycle Event)
May 28 00:57:22.278954 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-055fc28d-af0d-4ac6-bd10-ee9325bee5cd req-d575be3c-c38c-4eb0-9e65-6302fbcaaa3e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:22.364573 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:22.387655 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:22.387876 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:22.419288 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Successfully created port: 68c38c36-a152-4495-aa91-3a05281c5da6 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 00:57:22.449754 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-98e4b69b-15ac-4355-89cd-1d46561e8316 req-8417746c-056d-49a3-9cb2-dff32b3cb71d service nova] Releasing lock "refresh_cache-7fdf336e-65c1-4180-92eb-5f8ca0ebc526" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:57:22.450165 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquired lock "refresh_cache-7fdf336e-65c1-4180-92eb-5f8ca0ebc526" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:57:22.451070 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 00:57:22.497131 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-055fc28d-af0d-4ac6-bd10-ee9325bee5cd req-d575be3c-c38c-4eb0-9e65-6302fbcaaa3e service nova] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Updated VIF entry in instance network info cache for port 16d9022a-b978-4e59-80a0-34d8d6da6b87. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 00:57:22.497424 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-055fc28d-af0d-4ac6-bd10-ee9325bee5cd req-d575be3c-c38c-4eb0-9e65-6302fbcaaa3e service nova] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Updating instance_info_cache with network_info: [{"id": "16d9022a-b978-4e59-80a0-34d8d6da6b87", "address": "fa:16:3e:89:ef:d4", "network": {"id": "e43128b4-a829-486a-a380-4b92728ed2c5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-655543488-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df45e1c2b903482aa7e61c55b1f3f45b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d9022a-b9", "ovs_interfaceid": "16d9022a-b978-4e59-80a0-34d8d6da6b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:57:22.733131 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:57:22.737022 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929842.7366686, 8783a79a-1374-43cf-8f20-81f1a156a315 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:57:22.737218 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] VM Paused (Lifecycle Event)
May 28 00:57:22.895658 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 00:57:22.900328 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:57:22.900328 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:57:22.900328 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] No VIF found with MAC fa:16:3e:3a:fe:3d, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 00:57:22.901076 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Using config drive
May 28 00:57:22.933494 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Successfully updated port: 68c38c36-a152-4495-aa91-3a05281c5da6 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 00:57:23.000615 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-055fc28d-af0d-4ac6-bd10-ee9325bee5cd req-d575be3c-c38c-4eb0-9e65-6302fbcaaa3e service nova] Releasing lock "refresh_cache-0928917f-0c8c-4019-aef4-083ba8224ce0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:57:23.020963 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 00:57:23.022522 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 00:57:23.022522 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Creating image(s)
May 28 00:57:23.022522 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Acquiring lock "/opt/stack/data/nova/instances/a84e49f5-0bde-41ee-866e-6b434748077f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:23.022522 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Lock "/opt/stack/data/nova/instances/a84e49f5-0bde-41ee-866e-6b434748077f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:23.022972 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Lock "/opt/stack/data/nova/instances/a84e49f5-0bde-41ee-866e-6b434748077f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:23.023530 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:57:23.032369 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:57:23.036433 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:57:23.036858 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:23.068513 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:57:23.068846 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:57:23.070361 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] No VIF found with MAC fa:16:3e:89:ef:d4, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 00:57:23.070866 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Using config drive
May 28 00:57:23.117722 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.080s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:23.118670 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:23.120082 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:23.120568 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:57:23.123650 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:57:23.124131 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:23.135770 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4fcea557-8b5e-475a-afc2-8148371ad3b2 req-6447461f-8678-4fbb-a965-1be1cd204eba service nova] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Received event network-changed-68c38c36-a152-4495-aa91-3a05281c5da6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:23.136113 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4fcea557-8b5e-475a-afc2-8148371ad3b2 req-6447461f-8678-4fbb-a965-1be1cd204eba service nova] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Refreshing instance network info cache due to event network-changed-68c38c36-a152-4495-aa91-3a05281c5da6. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:57:23.136266 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4fcea557-8b5e-475a-afc2-8148371ad3b2 req-6447461f-8678-4fbb-a965-1be1cd204eba service nova] Acquiring lock "refresh_cache-a84e49f5-0bde-41ee-866e-6b434748077f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:57:23.136369 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4fcea557-8b5e-475a-afc2-8148371ad3b2 req-6447461f-8678-4fbb-a965-1be1cd204eba service nova] Acquired lock "refresh_cache-a84e49f5-0bde-41ee-866e-6b434748077f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:57:23.136564 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-4fcea557-8b5e-475a-afc2-8148371ad3b2 req-6447461f-8678-4fbb-a965-1be1cd204eba service nova] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Refreshing network info cache for port 68c38c36-a152-4495-aa91-3a05281c5da6 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:57:23.192556 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.068s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:23.193517 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/a84e49f5-0bde-41ee-866e-6b434748077f/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:23.232147 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/a84e49f5-0bde-41ee-866e-6b434748077f/disk 1073741824" returned: 0 in 0.039s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:23.232678 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.113s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:23.232968 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:23.242740 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:57:23.247101 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:57:23.305366 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.072s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:23.305756 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a84e49f5-0bde-41ee-866e-6b434748077f/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 00:57:23.305984 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84e49f5-0bde-41ee-866e-6b434748077f/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:23.374220 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84e49f5-0bde-41ee-866e-6b434748077f/disk --force-share --output=json" returned: 0 in 0.068s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:23.374691 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Cannot resize image /opt/stack/data/nova/instances/a84e49f5-0bde-41ee-866e-6b434748077f/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 00:57:23.375165 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 00:57:23.375368 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Ensure instance console log exists: /opt/stack/data/nova/instances/a84e49f5-0bde-41ee-866e-6b434748077f/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 00:57:23.375731 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:23.376015 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:23.376210 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:23.407729 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:23.436212 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Acquiring lock "refresh_cache-a84e49f5-0bde-41ee-866e-6b434748077f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:57:23.473334 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:23.473944 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:23.478830 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 00:57:23.478983 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Claim successful on node np0000001577
May 28 00:57:23.576952 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:23.641667 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-4fcea557-8b5e-475a-afc2-8148371ad3b2 req-6447461f-8678-4fbb-a965-1be1cd204eba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:23.750349 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 00:57:23.805375 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-4fcea557-8b5e-475a-afc2-8148371ad3b2 req-6447461f-8678-4fbb-a965-1be1cd204eba service nova] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:57:23.854461 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Creating config drive at /opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/disk.config
May 28 00:57:23.860482 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzgm6enic {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:23.900460 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzgm6enic" returned: 0 in 0.039s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:23.938815 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Creating config drive at /opt/stack/data/nova/instances/0928917f-0c8c-4019-aef4-083ba8224ce0/disk.config
May 28 00:57:23.945875 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0928917f-0c8c-4019-aef4-083ba8224ce0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsw2crxbv {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:23.964417 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:23.974526 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0928917f-0c8c-4019-aef4-083ba8224ce0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsw2crxbv" returned: 0 in 0.028s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:24.089757 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:24.103023 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:24.108910 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:24.132359 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:24.143435 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:24.205857 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:24.310353 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Updating instance_info_cache with network_info: [{"id": "9f8ec3b0-780e-4a36-ad3f-4664a6829868", "address": "fa:16:3e:a7:28:21", "network": {"id": "e43128b4-a829-486a-a380-4b92728ed2c5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-655543488-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df45e1c2b903482aa7e61c55b1f3f45b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8ec3b0-78", "ovs_interfaceid": "9f8ec3b0-780e-4a36-ad3f-4664a6829868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:57:24.363520 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-4fcea557-8b5e-475a-afc2-8148371ad3b2 req-6447461f-8678-4fbb-a965-1be1cd204eba service nova] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:57:24.719908 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:24.748471 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:24.813433 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Releasing lock "refresh_cache-7fdf336e-65c1-4180-92eb-5f8ca0ebc526" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:57:24.813792 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Instance network_info: |[{"id": "9f8ec3b0-780e-4a36-ad3f-4664a6829868", "address": "fa:16:3e:a7:28:21", "network": {"id": "e43128b4-a829-486a-a380-4b92728ed2c5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-655543488-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df45e1c2b903482aa7e61c55b1f3f45b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8ec3b0-78", "ovs_interfaceid": "9f8ec3b0-780e-4a36-ad3f-4664a6829868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 00:57:24.815318 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Start _get_guest_xml network_info=[{"id": "9f8ec3b0-780e-4a36-ad3f-4664a6829868", "address": "fa:16:3e:a7:28:21", "network": {"id": "e43128b4-a829-486a-a380-4b92728ed2c5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-655543488-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df45e1c2b903482aa7e61c55b1f3f45b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8ec3b0-78", "ovs_interfaceid": "9f8ec3b0-780e-4a36-ad3f-4664a6829868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 00:57:24.825138 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 00:57:24.825717 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-1923104158-2', uuid='7fdf336e-65c1-4180-92eb-5f8ca0ebc526'), owner=OwnerMeta(userid='027d659157ce49c7b674d0e5d41adf07', username='tempest-TestMultiAttachVolumeSwap-196235525-project-member', projectid='df45e1c2b903482aa7e61c55b1f3f45b', projectname='tempest-TestMultiAttachVolumeSwap-196235525'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9f8ec3b0-780e-4a36-ad3f-4664a6829868", "address": "fa:16:3e:a7:28:21", "network": {"id": "e43128b4-a829-486a-a380-4b92728ed2c5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-655543488-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df45e1c2b903482aa7e61c55b1f3f45b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8ec3b0-78", "ovs_interfaceid": "9f8ec3b0-780e-4a36-ad3f-4664a6829868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779929844.8252487) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 00:57:24.830627 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 00:57:24.830838 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 00:57:24.834407 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 00:57:24.834465 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 00:57:24.835448 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 00:57:24.835771 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 00:57:24.835924 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 00:57:24.836019 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 00:57:24.836132 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 00:57:24.836215 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 00:57:24.836332 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 00:57:24.836474 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 00:57:24.836601 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 00:57:24.836729 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 00:57:24.836835 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 00:57:24.836973 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 00:57:24.853911 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T00:57:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1923104158-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testmultiattachvolumeswap-server-1923104158-2',id=4,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTrx4V3NNTvIO0v6e0UgrxyebG5bgkKISVc5kT+2xHSKFNJBCRuY+HWML8VJbZLvrlhGev6Ue1eO9Ec7vV8o3QKseEptwtOMBb5jUqsNTaO/QaEwQKXDgtt4TsHfOVLJQ==',key_name='tempest-keypair-1571596048',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df45e1c2b903482aa7e61c55b1f3f45b',ramdisk_id='',reservation_id='r-ka660b6i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-196235525',owner_user_name='tempest-TestMultiAttachVolumeSwap-196235525-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:57:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='027d659157ce49c7b674d0e5d41adf07',uuid=7fdf336e-65c1-4180-92eb-5f8ca0ebc526,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f8ec3b0-780e-4a36-ad3f-4664a6829868", "address": "fa:16:3e:a7:28:21", "network": {"id": "e43128b4-a829-486a-a380-4b92728ed2c5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-655543488-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df45e1c2b903482aa7e61c55b1f3f45b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8ec3b0-78", "ovs_interfaceid": "9f8ec3b0-780e-4a36-ad3f-4664a6829868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 00:57:24.854064 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Converting VIF {"id": "9f8ec3b0-780e-4a36-ad3f-4664a6829868", "address": "fa:16:3e:a7:28:21", "network": {"id": "e43128b4-a829-486a-a380-4b92728ed2c5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-655543488-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df45e1c2b903482aa7e61c55b1f3f45b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8ec3b0-78", "ovs_interfaceid": "9f8ec3b0-780e-4a36-ad3f-4664a6829868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:57:24.857628 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:28:21,bridge_name='br-int',has_traffic_filtering=True,id=9f8ec3b0-780e-4a36-ad3f-4664a6829868,network=Network(e43128b4-a829-486a-a380-4b92728ed2c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f8ec3b0-78') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:57:24.858276 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lazy-loading 'pci_devices' on Instance uuid 7fdf336e-65c1-4180-92eb-5f8ca0ebc526 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:57:24.864864 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:24.871671 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4fcea557-8b5e-475a-afc2-8148371ad3b2 req-6447461f-8678-4fbb-a965-1be1cd204eba service nova] Releasing lock "refresh_cache-a84e49f5-0bde-41ee-866e-6b434748077f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:57:24.871671 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Acquired lock "refresh_cache-a84e49f5-0bde-41ee-866e-6b434748077f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:57:24.872293 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 00:57:24.881396 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:57:24.881631 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:57:24.891134 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:24.893174 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:24.985226 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:25.098061 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:25.099869 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:25.102866 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:25.106307 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:25.127570 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:25.362649 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] End _get_guest_xml xml=<domain type="qemu">
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:   <uuid>7fdf336e-65c1-4180-92eb-5f8ca0ebc526</uuid>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:   <name>instance-00000004</name>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:   <metadata>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestMultiAttachVolumeSwap-server-1923104158-2</nova:name>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 00:57:24</nova:creationTime>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       </nova:image>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:         <nova:user uuid="027d659157ce49c7b674d0e5d41adf07">tempest-TestMultiAttachVolumeSwap-196235525-project-member</nova:user>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:         <nova:project uuid="df45e1c2b903482aa7e61c55b1f3f45b">tempest-TestMultiAttachVolumeSwap-196235525</nova:project>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:         <nova:port uuid="9f8ec3b0-780e-4a36-ad3f-4664a6829868">
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:         </nova:port>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:   </metadata>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:     <system>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       <entry name="serial">7fdf336e-65c1-4180-92eb-5f8ca0ebc526</entry>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       <entry name="uuid">7fdf336e-65c1-4180-92eb-5f8ca0ebc526</entry>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:     </system>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:   <os>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:   </os>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:   <features>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:     <acpi/>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:     <tcg>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:     </tcg>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:   </features>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:   <devices>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/7fdf336e-65c1-4180-92eb-5f8ca0ebc526/disk"/>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:     </disk>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/7fdf336e-65c1-4180-92eb-5f8ca0ebc526/disk.config"/>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:     </disk>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:a7:28:21"/>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       <target dev="tap9f8ec3b0-78"/>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:     </interface>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/7fdf336e-65c1-4180-92eb-5f8ca0ebc526/console.log" append="off"/>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:     </serial>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:     <video>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:     </video>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:     </rng>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:     </memballoon>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:   </devices>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]: </domain>
May 28 00:57:25.362649 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 00:57:25.362649 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Preparing to wait for external event network-vif-plugged-9f8ec3b0-780e-4a36-ad3f-4664a6829868 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 00:57:25.362649 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquiring lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:25.369582 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:25.369582 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:25.369582 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T00:57:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1923104158-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testmultiattachvolumeswap-server-1923104158-2',id=4,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTrx4V3NNTvIO0v6e0UgrxyebG5bgkKISVc5kT+2xHSKFNJBCRuY+HWML8VJbZLvrlhGev6Ue1eO9Ec7vV8o3QKseEptwtOMBb5jUqsNTaO/QaEwQKXDgtt4TsHfOVLJQ==',key_name='tempest-keypair-1571596048',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df45e1c2b903482aa7e61c55b1f3f45b',ramdisk_id='',reservation_id='r-ka660b6i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-196235525',owner_user_name='tempest-TestMultiAttachVolumeSwap-196235525-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:57:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='027d659157ce49c7b674d0e5d41adf07',uuid=7fdf336e-65c1-4180-92eb-5f8ca0ebc526,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f8ec3b0-780e-4a36-ad3f-4664a6829868", "address": "fa:16:3e:a7:28:21", "network": {"id": "e43128b4-a829-486a-a380-4b92728ed2c5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-655543488-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df45e1c2b903482aa7e61c55b1f3f45b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8ec3b0-78", "ovs_interfaceid": "9f8ec3b0-780e-4a36-ad3f-4664a6829868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 00:57:25.371174 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Converting VIF {"id": "9f8ec3b0-780e-4a36-ad3f-4664a6829868", "address": "fa:16:3e:a7:28:21", "network": {"id": "e43128b4-a829-486a-a380-4b92728ed2c5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-655543488-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df45e1c2b903482aa7e61c55b1f3f45b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8ec3b0-78", "ovs_interfaceid": "9f8ec3b0-780e-4a36-ad3f-4664a6829868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:57:25.371174 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:28:21,bridge_name='br-int',has_traffic_filtering=True,id=9f8ec3b0-780e-4a36-ad3f-4664a6829868,network=Network(e43128b4-a829-486a-a380-4b92728ed2c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f8ec3b0-78') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:57:25.371174 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:28:21,bridge_name='br-int',has_traffic_filtering=True,id=9f8ec3b0-780e-4a36-ad3f-4664a6829868,network=Network(e43128b4-a829-486a-a380-4b92728ed2c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f8ec3b0-78') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 00:57:25.371174 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:25.371174 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:25.371174 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 00:57:25.371174 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:25.371174 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45b644a7-e6bc-55ab-8d89-64bb80837a9d', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:25.373110 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:25.373110 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:57:25.375311 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-71a8fc1f-c0f9-40ee-9382-6f7c85fc05da req-86c9152d-5862-4441-9347-becb8770e6b5 service nova] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Received event network-vif-unplugged-16d9022a-b978-4e59-80a0-34d8d6da6b87 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:25.375888 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-71a8fc1f-c0f9-40ee-9382-6f7c85fc05da req-86c9152d-5862-4441-9347-becb8770e6b5 service nova] Acquiring lock "0928917f-0c8c-4019-aef4-083ba8224ce0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:25.375888 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-71a8fc1f-c0f9-40ee-9382-6f7c85fc05da req-86c9152d-5862-4441-9347-becb8770e6b5 service nova] Lock "0928917f-0c8c-4019-aef4-083ba8224ce0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:25.376621 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-71a8fc1f-c0f9-40ee-9382-6f7c85fc05da req-86c9152d-5862-4441-9347-becb8770e6b5 service nova] Lock "0928917f-0c8c-4019-aef4-083ba8224ce0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:25.377029 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-71a8fc1f-c0f9-40ee-9382-6f7c85fc05da req-86c9152d-5862-4441-9347-becb8770e6b5 service nova] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] No event matching network-vif-unplugged-16d9022a-b978-4e59-80a0-34d8d6da6b87 in dict_keys([('network-vif-plugged', '16d9022a-b978-4e59-80a0-34d8d6da6b87')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 00:57:25.378600 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-71a8fc1f-c0f9-40ee-9382-6f7c85fc05da req-86c9152d-5862-4441-9347-becb8770e6b5 service nova] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Received unexpected event network-vif-unplugged-16d9022a-b978-4e59-80a0-34d8d6da6b87 for instance with vm_state building and task_state spawning.
May 28 00:57:25.380695 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:25.384037 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:25.384037 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f8ec3b0-78, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:25.384156 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9f8ec3b0-78, col_values=(('qos', UUID('1cd0a9c3-c31c-4e6a-81f3-d2fa407580fe')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:25.384334 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9f8ec3b0-78, col_values=(('external_ids', {'iface-id': '9f8ec3b0-780e-4a36-ad3f-4664a6829868', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:28:21', 'vm-uuid': '7fdf336e-65c1-4180-92eb-5f8ca0ebc526'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:25.387199 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:57:25.396071 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:57:25.403360 np0000001577 nova-compute[98319]: INFO os_vif [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:28:21,bridge_name='br-int',has_traffic_filtering=True,id=9f8ec3b0-780e-4a36-ad3f-4664a6829868,network=Network(e43128b4-a829-486a-a380-4b92728ed2c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f8ec3b0-78')
May 28 00:57:25.410178 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e7deed74-ed07-4027-ada2-44107eaac005 req-4f89a27a-be34-4f6a-8b6a-a8f553ceba5e service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Received event network-vif-plugged-5dc9c0c0-6ee4-4266-8024-0f8313319a2c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:25.410178 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e7deed74-ed07-4027-ada2-44107eaac005 req-4f89a27a-be34-4f6a-8b6a-a8f553ceba5e service nova] Acquiring lock "b1380963-8254-4ad0-95bb-91d24cea00f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:25.410178 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e7deed74-ed07-4027-ada2-44107eaac005 req-4f89a27a-be34-4f6a-8b6a-a8f553ceba5e service nova] Lock "b1380963-8254-4ad0-95bb-91d24cea00f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:25.410320 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e7deed74-ed07-4027-ada2-44107eaac005 req-4f89a27a-be34-4f6a-8b6a-a8f553ceba5e service nova] Lock "b1380963-8254-4ad0-95bb-91d24cea00f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:25.410902 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e7deed74-ed07-4027-ada2-44107eaac005 req-4f89a27a-be34-4f6a-8b6a-a8f553ceba5e service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Processing event network-vif-plugged-5dc9c0c0-6ee4-4266-8024-0f8313319a2c {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 00:57:25.481677 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:57:25.562532 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:25.570605 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:25.573847 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:25.594816 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:25.600758 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:25.656082 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:25.791428 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:25.887013 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929845.886636, b1380963-8254-4ad0-95bb-91d24cea00f9 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:57:25.889330 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] VM Started (Lifecycle Event)
May 28 00:57:25.890829 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Updating instance_info_cache with network_info: [{"id": "68c38c36-a152-4495-aa91-3a05281c5da6", "address": "fa:16:3e:0c:bd:d9", "network": {"id": "51c8a614-2632-4bfd-802a-f2e7e95980dc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-624499010-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "365a56f393cf409d8d1562e6be8318fa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap68c38c36-a1", "ovs_interfaceid": "68c38c36-a152-4495-aa91-3a05281c5da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:57:25.892723 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 00:57:25.896390 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 00:57:25.900919 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Instance spawned successfully.
May 28 00:57:25.901998 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 00:57:25.908402 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.435s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:25.908623 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 00:57:26.328424 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Acquiring lock "bd459d7f-74cf-42ac-8409-db592190cd52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:26.329120 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Lock "bd459d7f-74cf-42ac-8409-db592190cd52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:26.392666 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Releasing lock "refresh_cache-a84e49f5-0bde-41ee-866e-6b434748077f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:57:26.393841 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:57:26.393841 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Instance network_info: |[{"id": "68c38c36-a152-4495-aa91-3a05281c5da6", "address": "fa:16:3e:0c:bd:d9", "network": {"id": "51c8a614-2632-4bfd-802a-f2e7e95980dc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-624499010-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "365a56f393cf409d8d1562e6be8318fa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap68c38c36-a1", "ovs_interfaceid": "68c38c36-a152-4495-aa91-3a05281c5da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 00:57:26.396376 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Start _get_guest_xml network_info=[{"id": "68c38c36-a152-4495-aa91-3a05281c5da6", "address": "fa:16:3e:0c:bd:d9", "network": {"id": "51c8a614-2632-4bfd-802a-f2e7e95980dc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-624499010-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "365a56f393cf409d8d1562e6be8318fa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap68c38c36-a1", "ovs_interfaceid": "68c38c36-a152-4495-aa91-3a05281c5da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 00:57:26.397983 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:57:26.399336 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 00:57:26.400845 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-VolumesAssistedSnapshotsTest-server-1241877714', uuid='a84e49f5-0bde-41ee-866e-6b434748077f'), owner=OwnerMeta(userid='32c3fd5d3b604c77b6ccc0284ea33a11', username='tempest-VolumesAssistedSnapshotsTest-926722075-project-member', projectid='365a56f393cf409d8d1562e6be8318fa', projectname='tempest-VolumesAssistedSnapshotsTest-926722075'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "68c38c36-a152-4495-aa91-3a05281c5da6", "address": "fa:16:3e:0c:bd:d9", "network": {"id": "51c8a614-2632-4bfd-802a-f2e7e95980dc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-624499010-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "365a56f393cf409d8d1562e6be8318fa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap68c38c36-a1", "ovs_interfaceid": "68c38c36-a152-4495-aa91-3a05281c5da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779929846.4004555) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 00:57:26.401778 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 00:57:26.402111 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 00:57:26.402844 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 00:57:26.403078 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 00:57:26.404201 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 00:57:26.406001 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 00:57:26.406356 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 00:57:26.406356 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 00:57:26.406475 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 00:57:26.406858 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 00:57:26.407093 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 00:57:26.407354 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 00:57:26.407621 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 00:57:26.409381 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 00:57:26.409381 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 00:57:26.409381 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 00:57:26.421693 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 00:57:26.421831 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 00:57:26.422150 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:26.422347 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:26.426625 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:26.426832 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:26.427201 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:26.431677 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:26.432812 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:26.432812 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:26.449635 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T00:57:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1241877714',display_name='tempest-VolumesAssistedSnapshotsTest-server-1241877714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumesassistedsnapshotstest-server-1241877714',id=5,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKoi45xQqSLL/Mm3DQ42vdrhoIMB95QcjFwohXwAr3szxbrD+5sdQF/lw7VYI8BvM1lLn6wg2cO9HmwptoTke77g8/9Al5VWqGtUWy1fHnak/nxZoPU3a1p9TR44DqOsw==',key_name='tempest-keypair-2048352764',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='365a56f393cf409d8d1562e6be8318fa',ramdisk_id='',reservation_id='r-acywytrp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-926722075',owner_user_name='tempest-VolumesAssistedSnapshotsTest-926722075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:57:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32c3fd5d3b604c77b6ccc0284ea33a11',uuid=a84e49f5-0bde-41ee-866e-6b434748077f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68c38c36-a152-4495-aa91-3a05281c5da6", "address": "fa:16:3e:0c:bd:d9", "network": {"id": "51c8a614-2632-4bfd-802a-f2e7e95980dc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-624499010-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "365a56f393cf409d8d1562e6be8318fa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap68c38c36-a1", "ovs_interfaceid": "68c38c36-a152-4495-aa91-3a05281c5da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 00:57:26.452282 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Converting VIF {"id": "68c38c36-a152-4495-aa91-3a05281c5da6", "address": "fa:16:3e:0c:bd:d9", "network": {"id": "51c8a614-2632-4bfd-802a-f2e7e95980dc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-624499010-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "365a56f393cf409d8d1562e6be8318fa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap68c38c36-a1", "ovs_interfaceid": "68c38c36-a152-4495-aa91-3a05281c5da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:57:26.452601 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:bd:d9,bridge_name='br-int',has_traffic_filtering=True,id=68c38c36-a152-4495-aa91-3a05281c5da6,network=Network(51c8a614-2632-4bfd-802a-f2e7e95980dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68c38c36-a1') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:57:26.453230 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Lazy-loading 'pci_devices' on Instance uuid a84e49f5-0bde-41ee-866e-6b434748077f {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:57:26.674753 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c58dcd3aae234c4dbc1260fbeb278f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9278238dfa4e86ad7904a4a76caf6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 00:57:26.831979 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 00:57:26.901729 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 00:57:26.903437 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929846.9020035, b1380963-8254-4ad0-95bb-91d24cea00f9 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:57:26.903437 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] VM Paused (Lifecycle Event)
May 28 00:57:26.928656 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 00:57:26.935235 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:57:26.935359 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:57:26.935471 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] No VIF found with MAC fa:16:3e:a7:28:21, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 00:57:26.936992 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Using config drive
May 28 00:57:26.947191 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Took 11.00 seconds to spawn the instance on the hypervisor.
May 28 00:57:26.947448 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:57:26.955606 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] End _get_guest_xml xml=<domain type="qemu">
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:   <uuid>a84e49f5-0bde-41ee-866e-6b434748077f</uuid>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:   <name>instance-00000005</name>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:   <metadata>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1241877714</nova:name>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 00:57:26</nova:creationTime>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       </nova:image>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:         <nova:user uuid="32c3fd5d3b604c77b6ccc0284ea33a11">tempest-VolumesAssistedSnapshotsTest-926722075-project-member</nova:user>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:         <nova:project uuid="365a56f393cf409d8d1562e6be8318fa">tempest-VolumesAssistedSnapshotsTest-926722075</nova:project>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:         <nova:port uuid="68c38c36-a152-4495-aa91-3a05281c5da6">
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:         </nova:port>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:   </metadata>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:     <system>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       <entry name="serial">a84e49f5-0bde-41ee-866e-6b434748077f</entry>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       <entry name="uuid">a84e49f5-0bde-41ee-866e-6b434748077f</entry>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:     </system>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:   <os>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:   </os>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:   <features>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:     <acpi/>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:     <tcg>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:     </tcg>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:   </features>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:   <devices>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/a84e49f5-0bde-41ee-866e-6b434748077f/disk"/>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:     </disk>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/a84e49f5-0bde-41ee-866e-6b434748077f/disk.config"/>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:     </disk>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:0c:bd:d9"/>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       <target dev="tap68c38c36-a1"/>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:     </interface>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/a84e49f5-0bde-41ee-866e-6b434748077f/console.log" append="off"/>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:     </serial>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:     <video>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:     </video>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:     </rng>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:     </memballoon>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:   </devices>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]: </domain>
May 28 00:57:26.955606 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 00:57:26.957971 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Preparing to wait for external event network-vif-plugged-68c38c36-a152-4495-aa91-3a05281c5da6 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 00:57:26.957971 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Acquiring lock "a84e49f5-0bde-41ee-866e-6b434748077f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:26.957971 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Lock "a84e49f5-0bde-41ee-866e-6b434748077f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:26.957971 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Lock "a84e49f5-0bde-41ee-866e-6b434748077f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:26.957971 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T00:57:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1241877714',display_name='tempest-VolumesAssistedSnapshotsTest-server-1241877714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumesassistedsnapshotstest-server-1241877714',id=5,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKoi45xQqSLL/Mm3DQ42vdrhoIMB95QcjFwohXwAr3szxbrD+5sdQF/lw7VYI8BvM1lLn6wg2cO9HmwptoTke77g8/9Al5VWqGtUWy1fHnak/nxZoPU3a1p9TR44DqOsw==',key_name='tempest-keypair-2048352764',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='365a56f393cf409d8d1562e6be8318fa',ramdisk_id='',reservation_id='r-acywytrp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-926722075',owner_user_name='tempest-VolumesAssistedSnapshotsTest-926722075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:57:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32c3fd5d3b604c77b6ccc0284ea33a11',uuid=a84e49f5-0bde-41ee-866e-6b434748077f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68c38c36-a152-4495-aa91-3a05281c5da6", "address": "fa:16:3e:0c:bd:d9", "network": {"id": "51c8a614-2632-4bfd-802a-f2e7e95980dc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-624499010-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "365a56f393cf409d8d1562e6be8318fa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap68c38c36-a1", "ovs_interfaceid": "68c38c36-a152-4495-aa91-3a05281c5da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 00:57:26.958209 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Converting VIF {"id": "68c38c36-a152-4495-aa91-3a05281c5da6", "address": "fa:16:3e:0c:bd:d9", "network": {"id": "51c8a614-2632-4bfd-802a-f2e7e95980dc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-624499010-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "365a56f393cf409d8d1562e6be8318fa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap68c38c36-a1", "ovs_interfaceid": "68c38c36-a152-4495-aa91-3a05281c5da6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:57:26.958209 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:bd:d9,bridge_name='br-int',has_traffic_filtering=True,id=68c38c36-a152-4495-aa91-3a05281c5da6,network=Network(51c8a614-2632-4bfd-802a-f2e7e95980dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68c38c36-a1') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:57:26.958209 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:bd:d9,bridge_name='br-int',has_traffic_filtering=True,id=68c38c36-a152-4495-aa91-3a05281c5da6,network=Network(51c8a614-2632-4bfd-802a-f2e7e95980dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68c38c36-a1') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 00:57:26.961405 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:26.961611 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:26.961785 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 00:57:26.962320 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:26.962438 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0746014-2317-5ea0-92fb-4a026d2318b0', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:26.965033 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:26.965742 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:57:26.970889 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:26.978497 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:26.978707 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68c38c36-a1, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:26.979014 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap68c38c36-a1, col_values=(('qos', UUID('1a9ecffa-53e5-4e31-920b-433e2538d470')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:26.979142 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap68c38c36-a1, col_values=(('external_ids', {'iface-id': '68c38c36-a152-4495-aa91-3a05281c5da6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:bd:d9', 'vm-uuid': 'a84e49f5-0bde-41ee-866e-6b434748077f'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:26.980429 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:26.981484 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:57:26.991361 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:26.992197 np0000001577 nova-compute[98319]: INFO os_vif [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:bd:d9,bridge_name='br-int',has_traffic_filtering=True,id=68c38c36-a152-4495-aa91-3a05281c5da6,network=Network(51c8a614-2632-4bfd-802a-f2e7e95980dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68c38c36-a1')
May 28 00:57:27.103259 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Successfully created port: 97517937-1acb-4d47-93fb-fd89085e4f62 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 00:57:27.404885 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:27.405205 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:27.408837 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 00:57:27.408962 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Claim successful on node np0000001577
May 28 00:57:27.412376 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:57:27.416741 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929847.4165637, b1380963-8254-4ad0-95bb-91d24cea00f9 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:57:27.416880 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] VM Resumed (Lifecycle Event)
May 28 00:57:27.444216 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:27.457419 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Took 18.55 seconds to build instance.
May 28 00:57:27.475698 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-fb504250-85fe-47f5-ab40-1c03781c8c2d req-64058775-c42b-451a-ad71-0925e290a906 service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Received event network-vif-plugged-5dc9c0c0-6ee4-4266-8024-0f8313319a2c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:27.476092 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fb504250-85fe-47f5-ab40-1c03781c8c2d req-64058775-c42b-451a-ad71-0925e290a906 service nova] Acquiring lock "b1380963-8254-4ad0-95bb-91d24cea00f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:27.476821 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fb504250-85fe-47f5-ab40-1c03781c8c2d req-64058775-c42b-451a-ad71-0925e290a906 service nova] Lock "b1380963-8254-4ad0-95bb-91d24cea00f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:27.476821 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fb504250-85fe-47f5-ab40-1c03781c8c2d req-64058775-c42b-451a-ad71-0925e290a906 service nova] Lock "b1380963-8254-4ad0-95bb-91d24cea00f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:27.476821 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-fb504250-85fe-47f5-ab40-1c03781c8c2d req-64058775-c42b-451a-ad71-0925e290a906 service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] No waiting events found dispatching network-vif-plugged-5dc9c0c0-6ee4-4266-8024-0f8313319a2c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:57:27.477333 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-fb504250-85fe-47f5-ab40-1c03781c8c2d req-64058775-c42b-451a-ad71-0925e290a906 service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Received unexpected event network-vif-plugged-5dc9c0c0-6ee4-4266-8024-0f8313319a2c for instance with vm_state active and task_state None.
May 28 00:57:27.559331 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Successfully created port: ee97d14e-f88b-4516-a3a7-c7e4f7ae6483 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 00:57:27.825807 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:27.853430 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Creating config drive at /opt/stack/data/nova/instances/7fdf336e-65c1-4180-92eb-5f8ca0ebc526/disk.config
May 28 00:57:27.858254 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7fdf336e-65c1-4180-92eb-5f8ca0ebc526/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplcmtzhw2 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:27.898261 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7fdf336e-65c1-4180-92eb-5f8ca0ebc526/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplcmtzhw2" returned: 0 in 0.039s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:27.919957 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:57:27.926132 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:57:27.959276 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4772ee86-53ff-4633-a4fc-f6cad4f6407a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "b1380963-8254-4ad0-95bb-91d24cea00f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.055s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:27.984970 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Successfully created port: ea9f7c06-6d37-45ce-b730-7abdf1004095 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 00:57:28.382367 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:28.409472 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:28.411314 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:28.429541 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929848.4292812, 0928917f-0c8c-4019-aef4-083ba8224ce0 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:57:28.430349 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] VM Started (Lifecycle Event)
May 28 00:57:28.442916 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 00:57:28.464147 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Successfully created port: 232f9df8-2737-4ab4-9028-7ba9060284c4 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 00:57:28.511756 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:28.516257 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:57:28.516257 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:57:28.516384 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] No VIF found with MAC fa:16:3e:0c:bd:d9, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 00:57:28.517685 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Using config drive
May 28 00:57:28.571904 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:28.854465 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:57:28.854719 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:57:28.900380 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Successfully created port: 43668618-5b61-4949-9f06-e291b8f68cce {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 00:57:28.934355 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:57:28.940325 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929848.9400232, 0928917f-0c8c-4019-aef4-083ba8224ce0 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:57:28.940501 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] VM Paused (Lifecycle Event)
May 28 00:57:28.952247 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Booting with volume a7a0275e-e153-4b68-b49f-8ca9266df098 at /dev/vda
May 28 00:57:29.021198 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:57:29.024400 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:29.026011 np0000001577 nova-compute[98319]: INFO oslo.privsep.daemon [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmph5wc5rqf/privsep.sock']
May 28 00:57:29.040256 np0000001577 sudo[110954]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmph5wc5rqf/privsep.sock
May 28 00:57:29.041359 np0000001577 sudo[110954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 28 00:57:29.183681 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Creating config drive at /opt/stack/data/nova/instances/a84e49f5-0bde-41ee-866e-6b434748077f/disk.config
May 28 00:57:29.188786 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a84e49f5-0bde-41ee-866e-6b434748077f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbqqup8it {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:29.234396 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a84e49f5-0bde-41ee-866e-6b434748077f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbqqup8it" returned: 0 in 0.045s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:29.263710 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-cd3c14bb-9691-4b8c-adc2-bd671d6ce72c req-106f3200-47d9-4737-a5a1-1e8bd6a3cd9a service nova] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Received event network-vif-unplugged-510c8fcb-a3ae-4a4b-b064-145dea29c584 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:29.263915 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cd3c14bb-9691-4b8c-adc2-bd671d6ce72c req-106f3200-47d9-4737-a5a1-1e8bd6a3cd9a service nova] Acquiring lock "8783a79a-1374-43cf-8f20-81f1a156a315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:29.264072 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cd3c14bb-9691-4b8c-adc2-bd671d6ce72c req-106f3200-47d9-4737-a5a1-1e8bd6a3cd9a service nova] Lock "8783a79a-1374-43cf-8f20-81f1a156a315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:29.264178 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cd3c14bb-9691-4b8c-adc2-bd671d6ce72c req-106f3200-47d9-4737-a5a1-1e8bd6a3cd9a service nova] Lock "8783a79a-1374-43cf-8f20-81f1a156a315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:29.264303 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-cd3c14bb-9691-4b8c-adc2-bd671d6ce72c req-106f3200-47d9-4737-a5a1-1e8bd6a3cd9a service nova] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] No event matching network-vif-unplugged-510c8fcb-a3ae-4a4b-b064-145dea29c584 in dict_keys([('network-vif-plugged', '510c8fcb-a3ae-4a4b-b064-145dea29c584')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 00:57:29.264411 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-cd3c14bb-9691-4b8c-adc2-bd671d6ce72c req-106f3200-47d9-4737-a5a1-1e8bd6a3cd9a service nova] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Received unexpected event network-vif-unplugged-510c8fcb-a3ae-4a4b-b064-145dea29c584 for instance with vm_state building and task_state spawning.
May 28 00:57:29.331157 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 28 00:57:29.331245 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 28 00:57:29.331292 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 28 00:57:29.331349 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 00:57:29.331433 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 28 00:57:29.331523 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 28 00:57:29.331523 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 28 00:57:29.331656 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 00:57:29.331710 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 28 00:57:29.357992 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:57:29.444411 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:57:29.447387 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:57:29.574539 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Successfully updated port: 97517937-1acb-4d47-93fb-fd89085e4f62 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 00:57:29.641599 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-538734b2-4870-4875-bf1b-dff3f72f7a89 req-085c0659-9e89-4833-b05d-b6e59af7be89 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-changed-97517937-1acb-4d47-93fb-fd89085e4f62 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:29.643928 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-538734b2-4870-4875-bf1b-dff3f72f7a89 req-085c0659-9e89-4833-b05d-b6e59af7be89 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Refreshing instance network info cache due to event network-changed-97517937-1acb-4d47-93fb-fd89085e4f62. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:57:29.644125 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-538734b2-4870-4875-bf1b-dff3f72f7a89 req-085c0659-9e89-4833-b05d-b6e59af7be89 service nova] Acquiring lock "refresh_cache-9d7f874a-9bd5-4e26-abda-5978493313cf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:57:29.644259 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-538734b2-4870-4875-bf1b-dff3f72f7a89 req-085c0659-9e89-4833-b05d-b6e59af7be89 service nova] Acquired lock "refresh_cache-9d7f874a-9bd5-4e26-abda-5978493313cf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:57:29.644410 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-538734b2-4870-4875-bf1b-dff3f72f7a89 req-085c0659-9e89-4833-b05d-b6e59af7be89 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Refreshing network info cache for port 97517937-1acb-4d47-93fb-fd89085e4f62 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:57:29.647517 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 28 00:57:29.647624 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 28 00:57:29.647667 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 28 00:57:29.647704 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 00:57:29.648325 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 28 00:57:29.648325 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 28 00:57:29.648325 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 28 00:57:29.648325 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 00:57:29.648325 np0000001577 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 28 00:57:29.676380 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:29.699396 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:29.792316 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:29.869920 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.464s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:29.870671 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 00:57:29.884935 np0000001577 sudo[110954]: pam_unix(sudo:session): session closed for user root
May 28 00:57:29.889435 np0000001577 nova-compute[98319]: INFO oslo.privsep.daemon [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Spawned new privsep daemon via rootwrap
May 28 00:57:29.953008 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 00:57:29.953100 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929849.9528992, 7fdf336e-65c1-4180-92eb-5f8ca0ebc526 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:57:29.953144 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] VM Started (Lifecycle Event)
May 28 00:57:29.973739 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 00:57:29.973739 np0000001577 nova-compute[98319]: WARNING os_brick.initiator.connectors.nvmeof [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
May 28 00:57:29.997717 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:30.011514 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:30.022988 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 00:57:30.023669 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 00:57:30.032084 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:30.035921 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 00:57:30.040740 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe2c:d2b6', 'fe80::1c4b:31ff:fe4e:7f0', 'fe80::fc16:3eff:fe3a:fe3d', 'fe80::709d:70ff:fe70:893c', 'fe80::fc16:3eff:fe89:efd4', 'fe80::5801:aff:fe37:eba3', 'fe80::fc16:3eff:fea7:2821', 'fe80::fc16:3eff:fe0c:bdd9', 'fe80::fc11:9dff:fe9e:8235'] 
May 28 00:57:30.040740 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 00:57:30.040740 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 00:57:30.040740 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] <== get_connector_properties: return (1014ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:57:30.040740 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Updating existing volume attachment record: 22608340-88bc-41c4-b3b8-fa0ef9352307 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 00:57:30.147070 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-538734b2-4870-4875-bf1b-dff3f72f7a89 req-085c0659-9e89-4833-b05d-b6e59af7be89 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:30.254459 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-538734b2-4870-4875-bf1b-dff3f72f7a89 req-085c0659-9e89-4833-b05d-b6e59af7be89 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:57:30.380029 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 00:57:30.380213 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 00:57:30.380477 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:30.380728 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:30.417221 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-538734b2-4870-4875-bf1b-dff3f72f7a89 req-085c0659-9e89-4833-b05d-b6e59af7be89 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:57:30.458332 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:57:30.459514 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc245730881946049e5b165f63e063e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3a934d83cfd4c36aec672eb707031f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 00:57:30.461782 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929850.461378, 7fdf336e-65c1-4180-92eb-5f8ca0ebc526 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:57:30.462033 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] VM Paused (Lifecycle Event)
May 28 00:57:30.794656 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:30.854988 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Successfully created port: 2a41ea61-9f86-4e35-8d94-573d2294fcea {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 00:57:30.883243 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 00:57:30.920063 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-538734b2-4870-4875-bf1b-dff3f72f7a89 req-085c0659-9e89-4833-b05d-b6e59af7be89 service nova] Releasing lock "refresh_cache-9d7f874a-9bd5-4e26-abda-5978493313cf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:57:30.964711 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:57:30.967960 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:57:31.015214 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Successfully updated port: 61af54f4-c2a8-49db-8074-3f601131d7e3 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 00:57:31.350579 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8bb7efb2-6ae9-486e-be18-7ca4ab8947bb req-a9a0e253-2638-4ea4-bc06-cd0ae73177a2 service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Received event network-changed-5dc9c0c0-6ee4-4266-8024-0f8313319a2c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:31.350862 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8bb7efb2-6ae9-486e-be18-7ca4ab8947bb req-a9a0e253-2638-4ea4-bc06-cd0ae73177a2 service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Refreshing instance network info cache due to event network-changed-5dc9c0c0-6ee4-4266-8024-0f8313319a2c. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:57:31.351021 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8bb7efb2-6ae9-486e-be18-7ca4ab8947bb req-a9a0e253-2638-4ea4-bc06-cd0ae73177a2 service nova] Acquiring lock "refresh_cache-b1380963-8254-4ad0-95bb-91d24cea00f9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:57:31.351114 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8bb7efb2-6ae9-486e-be18-7ca4ab8947bb req-a9a0e253-2638-4ea4-bc06-cd0ae73177a2 service nova] Acquired lock "refresh_cache-b1380963-8254-4ad0-95bb-91d24cea00f9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:57:31.351294 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-8bb7efb2-6ae9-486e-be18-7ca4ab8947bb req-a9a0e253-2638-4ea4-bc06-cd0ae73177a2 service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Refreshing network info cache for port 5dc9c0c0-6ee4-4266-8024-0f8313319a2c {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:57:31.391804 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 00:57:31.415047 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Successfully updated port: 2a41ea61-9f86-4e35-8d94-573d2294fcea {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 00:57:31.465468 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4c5c2d72-2afd-42e7-843c-3bc95edcd5f2 req-b34f368b-8e94-46cc-ab57-9000ce7a4b0e service nova] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Received event network-changed-2a41ea61-9f86-4e35-8d94-573d2294fcea {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:31.467233 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4c5c2d72-2afd-42e7-843c-3bc95edcd5f2 req-b34f368b-8e94-46cc-ab57-9000ce7a4b0e service nova] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Refreshing instance network info cache due to event network-changed-2a41ea61-9f86-4e35-8d94-573d2294fcea. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:57:31.467399 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4c5c2d72-2afd-42e7-843c-3bc95edcd5f2 req-b34f368b-8e94-46cc-ab57-9000ce7a4b0e service nova] Acquiring lock "refresh_cache-bd459d7f-74cf-42ac-8409-db592190cd52" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:57:31.467497 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4c5c2d72-2afd-42e7-843c-3bc95edcd5f2 req-b34f368b-8e94-46cc-ab57-9000ce7a4b0e service nova] Acquired lock "refresh_cache-bd459d7f-74cf-42ac-8409-db592190cd52" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:57:31.467690 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-4c5c2d72-2afd-42e7-843c-3bc95edcd5f2 req-b34f368b-8e94-46cc-ab57-9000ce7a4b0e service nova] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Refreshing network info cache for port 2a41ea61-9f86-4e35-8d94-573d2294fcea {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:57:31.470674 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 00:57:31.472432 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929851.4710307, a84e49f5-0bde-41ee-866e-6b434748077f => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:57:31.472432 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] VM Started (Lifecycle Event)
May 28 00:57:31.688261 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Booting with volume 143fa2be-a5e9-4162-804b-8146030f3bce at /dev/vdb
May 28 00:57:31.736764 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:57:31.746172 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 00:57:31.766007 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:31.783319 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 00:57:31.783684 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 00:57:31.790131 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 00:57:31.791464 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe2c:d2b6', 'fe80::1c4b:31ff:fe4e:7f0', 'fe80::fc16:3eff:fe3a:fe3d', 'fe80::709d:70ff:fe70:893c', 'fe80::fc16:3eff:fe89:efd4', 'fe80::5801:aff:fe37:eba3', 'fe80::fc16:3eff:fea7:2821', 'fe80::fc16:3eff:fe0c:bdd9', 'fe80::fc11:9dff:fe9e:8235'] 
May 28 00:57:31.791661 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 00:57:31.791821 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 00:57:31.792139 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] <== get_connector_properties: return (55ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:57:31.792405 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Updating existing volume attachment record: 633af68d-3f0d-4b93-b1a1-3a2ba9a0d2e6 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 00:57:31.853745 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-8bb7efb2-6ae9-486e-be18-7ca4ab8947bb req-a9a0e253-2638-4ea4-bc06-cd0ae73177a2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:31.919600 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Acquiring lock "refresh_cache-bd459d7f-74cf-42ac-8409-db592190cd52" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:57:31.974218 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-4c5c2d72-2afd-42e7-843c-3bc95edcd5f2 req-b34f368b-8e94-46cc-ab57-9000ce7a4b0e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:31.976457 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:57:31.978519 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929851.9783103, a84e49f5-0bde-41ee-866e-6b434748077f => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:57:31.978693 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] VM Paused (Lifecycle Event)
May 28 00:57:31.991610 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:32.068933 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-4c5c2d72-2afd-42e7-843c-3bc95edcd5f2 req-b34f368b-8e94-46cc-ab57-9000ce7a4b0e service nova] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:57:32.376457 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:32.400031 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 00:57:32.402512 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 00:57:32.402799 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Creating image(s)
May 28 00:57:32.403302 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd459d7f-74cf-42ac-8409-db592190cd52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:32.403502 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Lock "/opt/stack/data/nova/instances/bd459d7f-74cf-42ac-8409-db592190cd52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:32.403993 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Lock "/opt/stack/data/nova/instances/bd459d7f-74cf-42ac-8409-db592190cd52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:32.404521 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:57:32.408066 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:57:32.409356 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:32.468745 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Successfully updated port: 8eb6e856-e081-4dd7-b047-d48fd42c12f3 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 00:57:32.481231 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:57:32.482832 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.073s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:32.483363 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:32.483838 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:32.484250 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:57:32.487410 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:57:32.488081 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:32.499437 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:57:32.539177 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-8bb7efb2-6ae9-486e-be18-7ca4ab8947bb req-a9a0e253-2638-4ea4-bc06-cd0ae73177a2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:32.554197 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.066s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:32.554564 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/bd459d7f-74cf-42ac-8409-db592190cd52/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:32.583522 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/bd459d7f-74cf-42ac-8409-db592190cd52/disk 1073741824" returned: 0 in 0.029s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:32.583963 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.100s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:32.584260 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:32.656161 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.071s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:32.656996 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd459d7f-74cf-42ac-8409-db592190cd52/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 00:57:32.656996 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd459d7f-74cf-42ac-8409-db592190cd52/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:32.717884 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-8bb7efb2-6ae9-486e-be18-7ca4ab8947bb req-a9a0e253-2638-4ea4-bc06-cd0ae73177a2 service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Updated VIF entry in instance network info cache for port 5dc9c0c0-6ee4-4266-8024-0f8313319a2c. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 00:57:32.718269 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-8bb7efb2-6ae9-486e-be18-7ca4ab8947bb req-a9a0e253-2638-4ea4-bc06-cd0ae73177a2 service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Updating instance_info_cache with network_info: [{"id": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "address": "fa:16:3e:3a:fe:3d", "network": {"id": "3ceee21d-d4b4-4c77-8ac9-f2338f96e022", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-960987788-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "355551e9b29346059ddbe389bc51efa8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc9c0c0-6e", "ovs_interfaceid": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:57:32.728396 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd459d7f-74cf-42ac-8409-db592190cd52/disk --force-share --output=json" returned: 0 in 0.070s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:32.728396 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Cannot resize image /opt/stack/data/nova/instances/bd459d7f-74cf-42ac-8409-db592190cd52/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 00:57:32.728396 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 00:57:32.728396 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Ensure instance console log exists: /opt/stack/data/nova/instances/bd459d7f-74cf-42ac-8409-db592190cd52/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 00:57:32.728396 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:32.728898 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:32.728898 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:32.786536 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-4c5c2d72-2afd-42e7-843c-3bc95edcd5f2 req-b34f368b-8e94-46cc-ab57-9000ce7a4b0e service nova] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:57:33.003686 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 00:57:33.222058 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8bb7efb2-6ae9-486e-be18-7ca4ab8947bb req-a9a0e253-2638-4ea4-bc06-cd0ae73177a2 service nova] Releasing lock "refresh_cache-b1380963-8254-4ad0-95bb-91d24cea00f9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:57:33.222270 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8bb7efb2-6ae9-486e-be18-7ca4ab8947bb req-a9a0e253-2638-4ea4-bc06-cd0ae73177a2 service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Received event network-vif-unplugged-9f8ec3b0-780e-4a36-ad3f-4664a6829868 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:33.222398 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8bb7efb2-6ae9-486e-be18-7ca4ab8947bb req-a9a0e253-2638-4ea4-bc06-cd0ae73177a2 service nova] Acquiring lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:33.222526 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8bb7efb2-6ae9-486e-be18-7ca4ab8947bb req-a9a0e253-2638-4ea4-bc06-cd0ae73177a2 service nova] Lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:33.222654 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8bb7efb2-6ae9-486e-be18-7ca4ab8947bb req-a9a0e253-2638-4ea4-bc06-cd0ae73177a2 service nova] Lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:33.222777 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8bb7efb2-6ae9-486e-be18-7ca4ab8947bb req-a9a0e253-2638-4ea4-bc06-cd0ae73177a2 service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] No event matching network-vif-unplugged-9f8ec3b0-780e-4a36-ad3f-4664a6829868 in dict_keys([('network-vif-plugged', '9f8ec3b0-780e-4a36-ad3f-4664a6829868')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 00:57:33.222889 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-8bb7efb2-6ae9-486e-be18-7ca4ab8947bb req-a9a0e253-2638-4ea4-bc06-cd0ae73177a2 service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Received unexpected event network-vif-unplugged-9f8ec3b0-780e-4a36-ad3f-4664a6829868 for instance with vm_state building and task_state spawning.
May 28 00:57:33.222990 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8bb7efb2-6ae9-486e-be18-7ca4ab8947bb req-a9a0e253-2638-4ea4-bc06-cd0ae73177a2 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-changed-61af54f4-c2a8-49db-8074-3f601131d7e3 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:33.223220 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8bb7efb2-6ae9-486e-be18-7ca4ab8947bb req-a9a0e253-2638-4ea4-bc06-cd0ae73177a2 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Refreshing instance network info cache due to event network-changed-61af54f4-c2a8-49db-8074-3f601131d7e3. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:57:33.223220 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8bb7efb2-6ae9-486e-be18-7ca4ab8947bb req-a9a0e253-2638-4ea4-bc06-cd0ae73177a2 service nova] Acquiring lock "refresh_cache-9d7f874a-9bd5-4e26-abda-5978493313cf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:57:33.223304 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8bb7efb2-6ae9-486e-be18-7ca4ab8947bb req-a9a0e253-2638-4ea4-bc06-cd0ae73177a2 service nova] Acquired lock "refresh_cache-9d7f874a-9bd5-4e26-abda-5978493313cf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:57:33.223423 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-8bb7efb2-6ae9-486e-be18-7ca4ab8947bb req-a9a0e253-2638-4ea4-bc06-cd0ae73177a2 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Refreshing network info cache for port 61af54f4-c2a8-49db-8074-3f601131d7e3 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:57:33.289295 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4c5c2d72-2afd-42e7-843c-3bc95edcd5f2 req-b34f368b-8e94-46cc-ab57-9000ce7a4b0e service nova] Releasing lock "refresh_cache-bd459d7f-74cf-42ac-8409-db592190cd52" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:57:33.289623 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Acquired lock "refresh_cache-bd459d7f-74cf-42ac-8409-db592190cd52" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:57:33.289783 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 00:57:33.402404 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Booting with volume 54210675-051f-4f9e-83c6-97577ccdf884 at /dev/vdc
May 28 00:57:33.439407 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:57:33.447801 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 00:57:33.463719 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:33.484340 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 00:57:33.484766 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 00:57:33.492607 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 00:57:33.493964 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe2c:d2b6', 'fe80::1c4b:31ff:fe4e:7f0', 'fe80::fc16:3eff:fe3a:fe3d', 'fe80::709d:70ff:fe70:893c', 'fe80::fc16:3eff:fe89:efd4', 'fe80::5801:aff:fe37:eba3', 'fe80::fc16:3eff:fea7:2821', 'fe80::fc16:3eff:fe0c:bdd9', 'fe80::fc11:9dff:fe9e:8235'] 
May 28 00:57:33.494087 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 00:57:33.494205 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 00:57:33.494407 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] <== get_connector_properties: return (54ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:57:33.494690 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Updating existing volume attachment record: 71b47828-680a-4a2f-8742-7c78708da929 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 00:57:33.538316 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d0ded5f3-6a0c-4237-bdc4-6f1c7ad5f800 req-78cf88c9-6e97-4a6e-a151-2e2104845870 service nova] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Received event network-vif-plugged-16d9022a-b978-4e59-80a0-34d8d6da6b87 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:33.538951 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d0ded5f3-6a0c-4237-bdc4-6f1c7ad5f800 req-78cf88c9-6e97-4a6e-a151-2e2104845870 service nova] Acquiring lock "0928917f-0c8c-4019-aef4-083ba8224ce0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:33.539365 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d0ded5f3-6a0c-4237-bdc4-6f1c7ad5f800 req-78cf88c9-6e97-4a6e-a151-2e2104845870 service nova] Lock "0928917f-0c8c-4019-aef4-083ba8224ce0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:33.539421 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d0ded5f3-6a0c-4237-bdc4-6f1c7ad5f800 req-78cf88c9-6e97-4a6e-a151-2e2104845870 service nova] Lock "0928917f-0c8c-4019-aef4-083ba8224ce0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:33.539659 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d0ded5f3-6a0c-4237-bdc4-6f1c7ad5f800 req-78cf88c9-6e97-4a6e-a151-2e2104845870 service nova] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Processing event network-vif-plugged-16d9022a-b978-4e59-80a0-34d8d6da6b87 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 00:57:33.539881 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d0ded5f3-6a0c-4237-bdc4-6f1c7ad5f800 req-78cf88c9-6e97-4a6e-a151-2e2104845870 service nova] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Received event network-vif-plugged-16d9022a-b978-4e59-80a0-34d8d6da6b87 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:33.540072 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d0ded5f3-6a0c-4237-bdc4-6f1c7ad5f800 req-78cf88c9-6e97-4a6e-a151-2e2104845870 service nova] Acquiring lock "0928917f-0c8c-4019-aef4-083ba8224ce0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:33.540684 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Instance event wait completed in 7 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 00:57:33.541107 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d0ded5f3-6a0c-4237-bdc4-6f1c7ad5f800 req-78cf88c9-6e97-4a6e-a151-2e2104845870 service nova] Lock "0928917f-0c8c-4019-aef4-083ba8224ce0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:33.541412 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d0ded5f3-6a0c-4237-bdc4-6f1c7ad5f800 req-78cf88c9-6e97-4a6e-a151-2e2104845870 service nova] Lock "0928917f-0c8c-4019-aef4-083ba8224ce0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:33.541464 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d0ded5f3-6a0c-4237-bdc4-6f1c7ad5f800 req-78cf88c9-6e97-4a6e-a151-2e2104845870 service nova] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] No waiting events found dispatching network-vif-plugged-16d9022a-b978-4e59-80a0-34d8d6da6b87 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:57:33.541711 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-d0ded5f3-6a0c-4237-bdc4-6f1c7ad5f800 req-78cf88c9-6e97-4a6e-a151-2e2104845870 service nova] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Received unexpected event network-vif-plugged-16d9022a-b978-4e59-80a0-34d8d6da6b87 for instance with vm_state building and task_state spawning.
May 28 00:57:33.541859 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d0ded5f3-6a0c-4237-bdc4-6f1c7ad5f800 req-78cf88c9-6e97-4a6e-a151-2e2104845870 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-changed-8eb6e856-e081-4dd7-b047-d48fd42c12f3 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:33.542168 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d0ded5f3-6a0c-4237-bdc4-6f1c7ad5f800 req-78cf88c9-6e97-4a6e-a151-2e2104845870 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Refreshing instance network info cache due to event network-changed-8eb6e856-e081-4dd7-b047-d48fd42c12f3. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:57:33.542168 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d0ded5f3-6a0c-4237-bdc4-6f1c7ad5f800 req-78cf88c9-6e97-4a6e-a151-2e2104845870 service nova] Acquiring lock "refresh_cache-9d7f874a-9bd5-4e26-abda-5978493313cf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:57:33.544573 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 00:57:33.545731 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929853.545325, 0928917f-0c8c-4019-aef4-083ba8224ce0 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:57:33.546000 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] VM Resumed (Lifecycle Event)
May 28 00:57:33.548999 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Instance spawned successfully.
May 28 00:57:33.550820 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 00:57:33.727424 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-8bb7efb2-6ae9-486e-be18-7ca4ab8947bb req-a9a0e253-2638-4ea4-bc06-cd0ae73177a2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:33.844101 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Successfully updated port: ee97d14e-f88b-4516-a3a7-c7e4f7ae6483 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 00:57:33.901586 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-8bb7efb2-6ae9-486e-be18-7ca4ab8947bb req-a9a0e253-2638-4ea4-bc06-cd0ae73177a2 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:57:33.920971 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:34.006884 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:57:34.056905 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:57:34.062858 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:34.063171 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:34.063544 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:34.064033 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:34.064128 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:34.064423 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:34.067970 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:57:34.160034 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-8bb7efb2-6ae9-486e-be18-7ca4ab8947bb req-a9a0e253-2638-4ea4-bc06-cd0ae73177a2 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:57:34.249771 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:34.322587 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1771c4b9-aaf4-49b1-9713-24468843bd31 req-f5f1ed96-f6f6-45f1-b46c-5302e61cc8ef service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-changed-ee97d14e-f88b-4516-a3a7-c7e4f7ae6483 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:34.322587 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1771c4b9-aaf4-49b1-9713-24468843bd31 req-f5f1ed96-f6f6-45f1-b46c-5302e61cc8ef service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Refreshing instance network info cache due to event network-changed-ee97d14e-f88b-4516-a3a7-c7e4f7ae6483. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:57:34.322587 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1771c4b9-aaf4-49b1-9713-24468843bd31 req-f5f1ed96-f6f6-45f1-b46c-5302e61cc8ef service nova] Acquiring lock "refresh_cache-9d7f874a-9bd5-4e26-abda-5978493313cf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:57:34.381649 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Updating instance_info_cache with network_info: [{"id": "2a41ea61-9f86-4e35-8d94-573d2294fcea", "address": "fa:16:3e:ec:eb:f5", "network": {"id": "88fd116a-f16a-4dde-897a-75a4ca63b20c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-452512207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3a934d83cfd4c36aec672eb707031f8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a41ea61-9f", "ovs_interfaceid": "2a41ea61-9f86-4e35-8d94-573d2294fcea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:57:34.570535 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Took 16.30 seconds to spawn the instance on the hypervisor.
May 28 00:57:34.571025 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:57:34.571071 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 00:57:34.661964 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8bb7efb2-6ae9-486e-be18-7ca4ab8947bb req-a9a0e253-2638-4ea4-bc06-cd0ae73177a2 service nova] Releasing lock "refresh_cache-9d7f874a-9bd5-4e26-abda-5978493313cf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:57:34.662569 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d0ded5f3-6a0c-4237-bdc4-6f1c7ad5f800 req-78cf88c9-6e97-4a6e-a151-2e2104845870 service nova] Acquired lock "refresh_cache-9d7f874a-9bd5-4e26-abda-5978493313cf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:57:34.662791 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-d0ded5f3-6a0c-4237-bdc4-6f1c7ad5f800 req-78cf88c9-6e97-4a6e-a151-2e2104845870 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Refreshing network info cache for port 8eb6e856-e081-4dd7-b047-d48fd42c12f3 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:57:34.883863 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Releasing lock "refresh_cache-bd459d7f-74cf-42ac-8409-db592190cd52" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:57:34.884090 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Instance network_info: |[{"id": "2a41ea61-9f86-4e35-8d94-573d2294fcea", "address": "fa:16:3e:ec:eb:f5", "network": {"id": "88fd116a-f16a-4dde-897a-75a4ca63b20c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-452512207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3a934d83cfd4c36aec672eb707031f8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a41ea61-9f", "ovs_interfaceid": "2a41ea61-9f86-4e35-8d94-573d2294fcea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 00:57:34.886425 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Start _get_guest_xml network_info=[{"id": "2a41ea61-9f86-4e35-8d94-573d2294fcea", "address": "fa:16:3e:ec:eb:f5", "network": {"id": "88fd116a-f16a-4dde-897a-75a4ca63b20c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-452512207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3a934d83cfd4c36aec672eb707031f8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a41ea61-9f", "ovs_interfaceid": "2a41ea61-9f86-4e35-8d94-573d2294fcea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 00:57:34.890364 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 00:57:34.893518 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-58167990', uuid='bd459d7f-74cf-42ac-8409-db592190cd52'), owner=OwnerMeta(userid='cc245730881946049e5b165f63e063e6', username='tempest-VolumesActionsTest-1937639427-project-member', projectid='e3a934d83cfd4c36aec672eb707031f8', projectname='tempest-VolumesActionsTest-1937639427'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2a41ea61-9f86-4e35-8d94-573d2294fcea", "address": "fa:16:3e:ec:eb:f5", "network": {"id": "88fd116a-f16a-4dde-897a-75a4ca63b20c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-452512207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3a934d83cfd4c36aec672eb707031f8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a41ea61-9f", "ovs_interfaceid": "2a41ea61-9f86-4e35-8d94-573d2294fcea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779929854.8914623) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 00:57:34.893518 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 00:57:34.893518 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 00:57:34.894135 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 00:57:34.894380 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 00:57:34.895492 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 00:57:34.895920 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 00:57:34.896113 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 00:57:34.896250 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 00:57:34.896446 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 00:57:34.896609 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 00:57:34.896755 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 00:57:34.896963 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 00:57:34.897110 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 00:57:34.897266 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 00:57:34.897636 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 00:57:34.897817 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 00:57:34.913475 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T00:57:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-58167990',display_name='tempest-VolumesActionsTest-instance-58167990',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumesactionstest-instance-58167990',id=7,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3a934d83cfd4c36aec672eb707031f8',ramdisk_id='',reservation_id='r-5et70l3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1937639427',owner_user_name='tempest-VolumesActionsTest-1937639427-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:57:31Z,user_data=None,user_id='cc245730881946049e5b165f63e063e6',uuid=bd459d7f-74cf-42ac-8409-db592190cd52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a41ea61-9f86-4e35-8d94-573d2294fcea", "address": "fa:16:3e:ec:eb:f5", "network": {"id": "88fd116a-f16a-4dde-897a-75a4ca63b20c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-452512207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3a934d83cfd4c36aec672eb707031f8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a41ea61-9f", "ovs_interfaceid": "2a41ea61-9f86-4e35-8d94-573d2294fcea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 00:57:34.913475 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Converting VIF {"id": "2a41ea61-9f86-4e35-8d94-573d2294fcea", "address": "fa:16:3e:ec:eb:f5", "network": {"id": "88fd116a-f16a-4dde-897a-75a4ca63b20c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-452512207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3a934d83cfd4c36aec672eb707031f8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a41ea61-9f", "ovs_interfaceid": "2a41ea61-9f86-4e35-8d94-573d2294fcea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:57:34.914098 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:eb:f5,bridge_name='br-int',has_traffic_filtering=True,id=2a41ea61-9f86-4e35-8d94-573d2294fcea,network=Network(88fd116a-f16a-4dde-897a-75a4ca63b20c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a41ea61-9f') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:57:34.914479 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Lazy-loading 'pci_devices' on Instance uuid bd459d7f-74cf-42ac-8409-db592190cd52 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:57:34.932665 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Successfully updated port: ea9f7c06-6d37-45ce-b730-7abdf1004095 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 00:57:34.995323 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6790eca3-dfd3-43a6-8694-2b3c142919f1 req-20e40aca-df89-4dba-8997-2f8cbe0d9c45 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-changed-ea9f7c06-6d37-45ce-b730-7abdf1004095 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:34.995585 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6790eca3-dfd3-43a6-8694-2b3c142919f1 req-20e40aca-df89-4dba-8997-2f8cbe0d9c45 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Refreshing instance network info cache due to event network-changed-ea9f7c06-6d37-45ce-b730-7abdf1004095. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:57:34.995665 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6790eca3-dfd3-43a6-8694-2b3c142919f1 req-20e40aca-df89-4dba-8997-2f8cbe0d9c45 service nova] Acquiring lock "refresh_cache-9d7f874a-9bd5-4e26-abda-5978493313cf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:57:35.080709 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Took 24.38 seconds to build instance.
May 28 00:57:35.167576 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-d0ded5f3-6a0c-4237-bdc4-6f1c7ad5f800 req-78cf88c9-6e97-4a6e-a151-2e2104845870 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:35.263881 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:57:35.264227 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:57:35.264532 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:57:35.265991 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:57:35.266966 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:57:35.267161 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:57:35.267384 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:57:35.267584 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 00:57:35.267765 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:57:35.306000 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-d0ded5f3-6a0c-4237-bdc4-6f1c7ad5f800 req-78cf88c9-6e97-4a6e-a151-2e2104845870 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:57:35.419752 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] End _get_guest_xml xml=<domain type="qemu">
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:   <uuid>bd459d7f-74cf-42ac-8409-db592190cd52</uuid>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:   <name>instance-00000007</name>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:   <metadata>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       <nova:name>tempest-VolumesActionsTest-instance-58167990</nova:name>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 00:57:34</nova:creationTime>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       </nova:image>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:         <nova:user uuid="cc245730881946049e5b165f63e063e6">tempest-VolumesActionsTest-1937639427-project-member</nova:user>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:         <nova:project uuid="e3a934d83cfd4c36aec672eb707031f8">tempest-VolumesActionsTest-1937639427</nova:project>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:         <nova:port uuid="2a41ea61-9f86-4e35-8d94-573d2294fcea">
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:         </nova:port>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:   </metadata>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:     <system>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       <entry name="serial">bd459d7f-74cf-42ac-8409-db592190cd52</entry>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       <entry name="uuid">bd459d7f-74cf-42ac-8409-db592190cd52</entry>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:     </system>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:   <os>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:   </os>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:   <features>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:     <acpi/>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:     <tcg>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:     </tcg>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:   </features>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:   <devices>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/bd459d7f-74cf-42ac-8409-db592190cd52/disk"/>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:     </disk>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/bd459d7f-74cf-42ac-8409-db592190cd52/disk.config"/>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:     </disk>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:ec:eb:f5"/>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       <target dev="tap2a41ea61-9f"/>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:     </interface>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/bd459d7f-74cf-42ac-8409-db592190cd52/console.log" append="off"/>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:     </serial>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:     <video>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:     </video>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:     </rng>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:     </memballoon>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:   </devices>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]: </domain>
May 28 00:57:35.419752 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 00:57:35.419752 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Preparing to wait for external event network-vif-plugged-2a41ea61-9f86-4e35-8d94-573d2294fcea {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 00:57:35.419752 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Acquiring lock "bd459d7f-74cf-42ac-8409-db592190cd52-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:35.419752 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Lock "bd459d7f-74cf-42ac-8409-db592190cd52-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:35.419752 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Lock "bd459d7f-74cf-42ac-8409-db592190cd52-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:35.421856 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T00:57:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-58167990',display_name='tempest-VolumesActionsTest-instance-58167990',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumesactionstest-instance-58167990',id=7,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3a934d83cfd4c36aec672eb707031f8',ramdisk_id='',reservation_id='r-5et70l3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1937639427',owner_user_name='tempest-VolumesActionsTest-1937639427-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:57:31Z,user_data=None,user_id='cc245730881946049e5b165f63e063e6',uuid=bd459d7f-74cf-42ac-8409-db592190cd52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a41ea61-9f86-4e35-8d94-573d2294fcea", "address": "fa:16:3e:ec:eb:f5", "network": {"id": "88fd116a-f16a-4dde-897a-75a4ca63b20c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-452512207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3a934d83cfd4c36aec672eb707031f8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a41ea61-9f", "ovs_interfaceid": "2a41ea61-9f86-4e35-8d94-573d2294fcea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 00:57:35.421856 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Converting VIF {"id": "2a41ea61-9f86-4e35-8d94-573d2294fcea", "address": "fa:16:3e:ec:eb:f5", "network": {"id": "88fd116a-f16a-4dde-897a-75a4ca63b20c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-452512207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3a934d83cfd4c36aec672eb707031f8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a41ea61-9f", "ovs_interfaceid": "2a41ea61-9f86-4e35-8d94-573d2294fcea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:57:35.421856 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:eb:f5,bridge_name='br-int',has_traffic_filtering=True,id=2a41ea61-9f86-4e35-8d94-573d2294fcea,network=Network(88fd116a-f16a-4dde-897a-75a4ca63b20c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a41ea61-9f') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:57:35.421856 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:eb:f5,bridge_name='br-int',has_traffic_filtering=True,id=2a41ea61-9f86-4e35-8d94-573d2294fcea,network=Network(88fd116a-f16a-4dde-897a-75a4ca63b20c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a41ea61-9f') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 00:57:35.422044 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:35.422044 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:35.422044 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 00:57:35.422044 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:35.422044 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'df1b6b02-c9a3-5c6a-82f3-caff9b9d2093', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:35.440579 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:35.440579 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:57:35.442011 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:35.442259 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a41ea61-9f, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:35.442846 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a41ea61-9f, col_values=(('qos', UUID('658a9ab5-9451-4841-adca-64e8297ccd00')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:35.443055 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a41ea61-9f, col_values=(('external_ids', {'iface-id': '2a41ea61-9f86-4e35-8d94-573d2294fcea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:eb:f5', 'vm-uuid': 'bd459d7f-74cf-42ac-8409-db592190cd52'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:35.443919 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:35.445431 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:57:35.452089 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:35.454676 np0000001577 nova-compute[98319]: INFO os_vif [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:eb:f5,bridge_name='br-int',has_traffic_filtering=True,id=2a41ea61-9f86-4e35-8d94-573d2294fcea,network=Network(88fd116a-f16a-4dde-897a-75a4ca63b20c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a41ea61-9f')
May 28 00:57:35.503624 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-d0ded5f3-6a0c-4237-bdc4-6f1c7ad5f800 req-78cf88c9-6e97-4a6e-a151-2e2104845870 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:57:35.581957 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "0928917f-0c8c-4019-aef4-083ba8224ce0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.885s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:35.611627 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 00:57:35.612447 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 00:57:35.612689 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Creating image(s)
May 28 00:57:35.612927 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 00:57:35.613037 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Ensure instance console log exists: /opt/stack/data/nova/instances/9d7f874a-9bd5-4e26-abda-5978493313cf/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 00:57:35.613251 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:35.613373 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:35.613475 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:35.775030 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:35.775164 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:35.775593 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:35.775593 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Auditing locally available compute resources for np0000001577 (node: np0000001577) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 00:57:35.795804 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:35.864040 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Acquiring lock "6942ebd1-823e-499a-a819-0f0125eb9fad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:35.864195 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Lock "6942ebd1-823e-499a-a819-0f0125eb9fad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:35.883332 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Successfully updated port: 232f9df8-2737-4ab4-9028-7ba9060284c4 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 00:57:36.006863 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d0ded5f3-6a0c-4237-bdc4-6f1c7ad5f800 req-78cf88c9-6e97-4a6e-a151-2e2104845870 service nova] Releasing lock "refresh_cache-9d7f874a-9bd5-4e26-abda-5978493313cf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:57:36.006863 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d0ded5f3-6a0c-4237-bdc4-6f1c7ad5f800 req-78cf88c9-6e97-4a6e-a151-2e2104845870 service nova] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Received event network-vif-unplugged-2a41ea61-9f86-4e35-8d94-573d2294fcea {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:36.006863 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d0ded5f3-6a0c-4237-bdc4-6f1c7ad5f800 req-78cf88c9-6e97-4a6e-a151-2e2104845870 service nova] Acquiring lock "bd459d7f-74cf-42ac-8409-db592190cd52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:36.006863 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d0ded5f3-6a0c-4237-bdc4-6f1c7ad5f800 req-78cf88c9-6e97-4a6e-a151-2e2104845870 service nova] Lock "bd459d7f-74cf-42ac-8409-db592190cd52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:36.006863 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d0ded5f3-6a0c-4237-bdc4-6f1c7ad5f800 req-78cf88c9-6e97-4a6e-a151-2e2104845870 service nova] Lock "bd459d7f-74cf-42ac-8409-db592190cd52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:36.006863 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d0ded5f3-6a0c-4237-bdc4-6f1c7ad5f800 req-78cf88c9-6e97-4a6e-a151-2e2104845870 service nova] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] No event matching network-vif-unplugged-2a41ea61-9f86-4e35-8d94-573d2294fcea in dict_keys([('network-vif-plugged', '2a41ea61-9f86-4e35-8d94-573d2294fcea')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 00:57:36.006863 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-d0ded5f3-6a0c-4237-bdc4-6f1c7ad5f800 req-78cf88c9-6e97-4a6e-a151-2e2104845870 service nova] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Received unexpected event network-vif-unplugged-2a41ea61-9f86-4e35-8d94-573d2294fcea for instance with vm_state building and task_state spawning.
May 28 00:57:36.007447 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1771c4b9-aaf4-49b1-9713-24468843bd31 req-f5f1ed96-f6f6-45f1-b46c-5302e61cc8ef service nova] Acquired lock "refresh_cache-9d7f874a-9bd5-4e26-abda-5978493313cf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:57:36.007447 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-1771c4b9-aaf4-49b1-9713-24468843bd31 req-f5f1ed96-f6f6-45f1-b46c-5302e61cc8ef service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Refreshing network info cache for port ee97d14e-f88b-4516-a3a7-c7e4f7ae6483 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:57:36.365960 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 00:57:36.484574 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-72407ab3-a375-4bca-a9e7-96c975dea05a req-55c00ca3-c562-4983-84df-fe3bd80c2ef6 service nova] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Received event network-vif-plugged-510c8fcb-a3ae-4a4b-b064-145dea29c584 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:36.484574 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-72407ab3-a375-4bca-a9e7-96c975dea05a req-55c00ca3-c562-4983-84df-fe3bd80c2ef6 service nova] Acquiring lock "8783a79a-1374-43cf-8f20-81f1a156a315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:36.484753 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-72407ab3-a375-4bca-a9e7-96c975dea05a req-55c00ca3-c562-4983-84df-fe3bd80c2ef6 service nova] Lock "8783a79a-1374-43cf-8f20-81f1a156a315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:36.484868 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-72407ab3-a375-4bca-a9e7-96c975dea05a req-55c00ca3-c562-4983-84df-fe3bd80c2ef6 service nova] Lock "8783a79a-1374-43cf-8f20-81f1a156a315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:36.484989 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-72407ab3-a375-4bca-a9e7-96c975dea05a req-55c00ca3-c562-4983-84df-fe3bd80c2ef6 service nova] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Processing event network-vif-plugged-510c8fcb-a3ae-4a4b-b064-145dea29c584 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 00:57:36.485158 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-72407ab3-a375-4bca-a9e7-96c975dea05a req-55c00ca3-c562-4983-84df-fe3bd80c2ef6 service nova] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Received event network-vif-plugged-510c8fcb-a3ae-4a4b-b064-145dea29c584 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:36.485324 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-72407ab3-a375-4bca-a9e7-96c975dea05a req-55c00ca3-c562-4983-84df-fe3bd80c2ef6 service nova] Acquiring lock "8783a79a-1374-43cf-8f20-81f1a156a315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:36.485501 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-72407ab3-a375-4bca-a9e7-96c975dea05a req-55c00ca3-c562-4983-84df-fe3bd80c2ef6 service nova] Lock "8783a79a-1374-43cf-8f20-81f1a156a315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:36.485672 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-72407ab3-a375-4bca-a9e7-96c975dea05a req-55c00ca3-c562-4983-84df-fe3bd80c2ef6 service nova] Lock "8783a79a-1374-43cf-8f20-81f1a156a315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:36.485818 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-72407ab3-a375-4bca-a9e7-96c975dea05a req-55c00ca3-c562-4983-84df-fe3bd80c2ef6 service nova] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] No waiting events found dispatching network-vif-plugged-510c8fcb-a3ae-4a4b-b064-145dea29c584 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:57:36.485973 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-72407ab3-a375-4bca-a9e7-96c975dea05a req-55c00ca3-c562-4983-84df-fe3bd80c2ef6 service nova] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Received unexpected event network-vif-plugged-510c8fcb-a3ae-4a4b-b064-145dea29c584 for instance with vm_state building and task_state spawning.
May 28 00:57:36.486120 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-72407ab3-a375-4bca-a9e7-96c975dea05a req-55c00ca3-c562-4983-84df-fe3bd80c2ef6 service nova] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Received event network-vif-unplugged-68c38c36-a152-4495-aa91-3a05281c5da6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:36.486269 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-72407ab3-a375-4bca-a9e7-96c975dea05a req-55c00ca3-c562-4983-84df-fe3bd80c2ef6 service nova] Acquiring lock "a84e49f5-0bde-41ee-866e-6b434748077f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:36.486604 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-72407ab3-a375-4bca-a9e7-96c975dea05a req-55c00ca3-c562-4983-84df-fe3bd80c2ef6 service nova] Lock "a84e49f5-0bde-41ee-866e-6b434748077f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:36.486604 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-72407ab3-a375-4bca-a9e7-96c975dea05a req-55c00ca3-c562-4983-84df-fe3bd80c2ef6 service nova] Lock "a84e49f5-0bde-41ee-866e-6b434748077f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:36.486910 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-72407ab3-a375-4bca-a9e7-96c975dea05a req-55c00ca3-c562-4983-84df-fe3bd80c2ef6 service nova] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] No event matching network-vif-unplugged-68c38c36-a152-4495-aa91-3a05281c5da6 in dict_keys([('network-vif-plugged', '68c38c36-a152-4495-aa91-3a05281c5da6')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 00:57:36.487266 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-72407ab3-a375-4bca-a9e7-96c975dea05a req-55c00ca3-c562-4983-84df-fe3bd80c2ef6 service nova] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Received unexpected event network-vif-unplugged-68c38c36-a152-4495-aa91-3a05281c5da6 for instance with vm_state building and task_state spawning.
May 28 00:57:36.487987 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Instance event wait completed in 14 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 00:57:36.491947 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929856.4916668, 8783a79a-1374-43cf-8f20-81f1a156a315 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:57:36.492125 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] VM Resumed (Lifecycle Event)
May 28 00:57:36.493131 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 00:57:36.497403 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Instance spawned successfully.
May 28 00:57:36.498954 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 00:57:36.501177 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:36.501636 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:36.502524 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:36.502524 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:36.509595 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-1771c4b9-aaf4-49b1-9713-24468843bd31 req-f5f1ed96-f6f6-45f1-b46c-5302e61cc8ef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:36.668194 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-1771c4b9-aaf4-49b1-9713-24468843bd31 req-f5f1ed96-f6f6-45f1-b46c-5302e61cc8ef service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:57:36.805906 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8783a79a-1374-43cf-8f20-81f1a156a315/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:36.886974 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8783a79a-1374-43cf-8f20-81f1a156a315/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:36.887354 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8783a79a-1374-43cf-8f20-81f1a156a315/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:36.958626 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:36.958776 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:36.963043 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 00:57:36.963043 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Claim successful on node np0000001577
May 28 00:57:36.966928 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8783a79a-1374-43cf-8f20-81f1a156a315/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:36.970948 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd459d7f-74cf-42ac-8409-db592190cd52/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:36.988785 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:57:36.989128 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:57:36.989228 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] No VIF found with MAC fa:16:3e:ec:eb:f5, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 00:57:36.990302 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Using config drive
May 28 00:57:36.999827 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:57:37.002236 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Successfully updated port: 43668618-5b61-4949-9f06-e291b8f68cce {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 00:57:37.005858 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:57:37.016821 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Took 23.42 seconds to spawn the instance on the hypervisor.
May 28 00:57:37.018265 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:57:37.040339 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-1771c4b9-aaf4-49b1-9713-24468843bd31 req-f5f1ed96-f6f6-45f1-b46c-5302e61cc8ef service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:57:37.049634 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd459d7f-74cf-42ac-8409-db592190cd52/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:37.051830 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd459d7f-74cf-42ac-8409-db592190cd52/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:37.086841 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-cd84ca10-d131-4e55-a129-f136bd9e59ca req-90ae2811-0455-466e-924c-5a7daf14c56e service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-changed-232f9df8-2737-4ab4-9028-7ba9060284c4 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:37.087050 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-cd84ca10-d131-4e55-a129-f136bd9e59ca req-90ae2811-0455-466e-924c-5a7daf14c56e service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Refreshing instance network info cache due to event network-changed-232f9df8-2737-4ab4-9028-7ba9060284c4. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:57:37.089729 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cd84ca10-d131-4e55-a129-f136bd9e59ca req-90ae2811-0455-466e-924c-5a7daf14c56e service nova] Acquiring lock "refresh_cache-9d7f874a-9bd5-4e26-abda-5978493313cf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:57:37.134508 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd459d7f-74cf-42ac-8409-db592190cd52/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:37.135337 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Periodic task is updating the host stat, it is trying to get disk instance-00000007, but disk file was removed by concurrent operations such as resize.: FileNotFoundError: [Errno 2] No such file or directory: '/opt/stack/data/nova/instances/bd459d7f-74cf-42ac-8409-db592190cd52/disk.config'
May 28 00:57:37.137686 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:37.216901 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:37.217493 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:37.290987 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/disk --force-share --output=json" returned: 0 in 0.073s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:37.293309 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0928917f-0c8c-4019-aef4-083ba8224ce0/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:37.372430 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0928917f-0c8c-4019-aef4-083ba8224ce0/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:37.372940 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0928917f-0c8c-4019-aef4-083ba8224ce0/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:37.438059 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0928917f-0c8c-4019-aef4-083ba8224ce0/disk --force-share --output=json" returned: 0 in 0.065s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:37.440766 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fdf336e-65c1-4180-92eb-5f8ca0ebc526/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:37.500131 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:37.512369 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Acquiring lock "refresh_cache-9d7f874a-9bd5-4e26-abda-5978493313cf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:57:37.513826 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fdf336e-65c1-4180-92eb-5f8ca0ebc526/disk --force-share --output=json" returned: 0 in 0.072s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:37.515835 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fdf336e-65c1-4180-92eb-5f8ca0ebc526/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:37.539673 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 00:57:37.543503 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Took 28.84 seconds to build instance.
May 28 00:57:37.544248 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1771c4b9-aaf4-49b1-9713-24468843bd31 req-f5f1ed96-f6f6-45f1-b46c-5302e61cc8ef service nova] Releasing lock "refresh_cache-9d7f874a-9bd5-4e26-abda-5978493313cf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:57:37.545910 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6790eca3-dfd3-43a6-8694-2b3c142919f1 req-20e40aca-df89-4dba-8997-2f8cbe0d9c45 service nova] Acquired lock "refresh_cache-9d7f874a-9bd5-4e26-abda-5978493313cf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:57:37.546132 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-6790eca3-dfd3-43a6-8694-2b3c142919f1 req-20e40aca-df89-4dba-8997-2f8cbe0d9c45 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Refreshing network info cache for port ea9f7c06-6d37-45ce-b730-7abdf1004095 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:57:37.601704 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fdf336e-65c1-4180-92eb-5f8ca0ebc526/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:37.606677 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84e49f5-0bde-41ee-866e-6b434748077f/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:37.683635 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Creating config drive at /opt/stack/data/nova/instances/bd459d7f-74cf-42ac-8409-db592190cd52/disk.config
May 28 00:57:37.687867 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bd459d7f-74cf-42ac-8409-db592190cd52/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphw_epda4 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:37.705902 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84e49f5-0bde-41ee-866e-6b434748077f/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:37.706511 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84e49f5-0bde-41ee-866e-6b434748077f/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:37.751595 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bd459d7f-74cf-42ac-8409-db592190cd52/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphw_epda4" returned: 0 in 0.063s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:37.782578 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84e49f5-0bde-41ee-866e-6b434748077f/disk --force-share --output=json" returned: 0 in 0.076s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:37.789629 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 00:57:37.789629 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:37.812833 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "env LANG=C uptime" returned: 0 in 0.024s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:37.813216 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Hypervisor/Node resource view: name=np0000001577 free_ram=14172MB free_disk=74.71653366088867GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 00:57:37.813358 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:38.047914 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f4df5e2e-b1eb-4dc1-9465-8e603e29bc16 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "8783a79a-1374-43cf-8f20-81f1a156a315" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.352s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:38.051430 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-6790eca3-dfd3-43a6-8694-2b3c142919f1 req-20e40aca-df89-4dba-8997-2f8cbe0d9c45 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:38.188397 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-6790eca3-dfd3-43a6-8694-2b3c142919f1 req-20e40aca-df89-4dba-8997-2f8cbe0d9c45 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:57:38.224270 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:38.255105 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:38.363328 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:38.449384 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-322888cd-4046-4cc2-a261-b9e6fffec9e2 req-1f0aeb90-7751-4e91-bf27-097d623aefa9 service nova] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Received event network-vif-plugged-2a41ea61-9f86-4e35-8d94-573d2294fcea {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:38.449736 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-322888cd-4046-4cc2-a261-b9e6fffec9e2 req-1f0aeb90-7751-4e91-bf27-097d623aefa9 service nova] Acquiring lock "bd459d7f-74cf-42ac-8409-db592190cd52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:38.449951 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-322888cd-4046-4cc2-a261-b9e6fffec9e2 req-1f0aeb90-7751-4e91-bf27-097d623aefa9 service nova] Lock "bd459d7f-74cf-42ac-8409-db592190cd52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:38.450251 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-322888cd-4046-4cc2-a261-b9e6fffec9e2 req-1f0aeb90-7751-4e91-bf27-097d623aefa9 service nova] Lock "bd459d7f-74cf-42ac-8409-db592190cd52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:38.451487 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-322888cd-4046-4cc2-a261-b9e6fffec9e2 req-1f0aeb90-7751-4e91-bf27-097d623aefa9 service nova] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Processing event network-vif-plugged-2a41ea61-9f86-4e35-8d94-573d2294fcea {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 00:57:38.485095 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-6790eca3-dfd3-43a6-8694-2b3c142919f1 req-20e40aca-df89-4dba-8997-2f8cbe0d9c45 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:57:38.583768 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0a618b96-587a-413e-9582-c78e81e64b1b req-cc224f71-b46e-4c5a-a0fb-6df833a92388 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-unplugged-97517937-1acb-4d47-93fb-fd89085e4f62 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:38.583768 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0a618b96-587a-413e-9582-c78e81e64b1b req-cc224f71-b46e-4c5a-a0fb-6df833a92388 service nova] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:38.584756 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0a618b96-587a-413e-9582-c78e81e64b1b req-cc224f71-b46e-4c5a-a0fb-6df833a92388 service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:38.585013 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0a618b96-587a-413e-9582-c78e81e64b1b req-cc224f71-b46e-4c5a-a0fb-6df833a92388 service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:38.585169 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0a618b96-587a-413e-9582-c78e81e64b1b req-cc224f71-b46e-4c5a-a0fb-6df833a92388 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] No waiting events found dispatching network-vif-unplugged-97517937-1acb-4d47-93fb-fd89085e4f62 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:57:38.585370 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-0a618b96-587a-413e-9582-c78e81e64b1b req-cc224f71-b46e-4c5a-a0fb-6df833a92388 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received unexpected event network-vif-unplugged-97517937-1acb-4d47-93fb-fd89085e4f62 for instance with vm_state building and task_state spawning.
May 28 00:57:38.621385 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:57:38.621724 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:57:38.648178 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:38.651198 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:38.670475 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:38.988376 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6790eca3-dfd3-43a6-8694-2b3c142919f1 req-20e40aca-df89-4dba-8997-2f8cbe0d9c45 service nova] Releasing lock "refresh_cache-9d7f874a-9bd5-4e26-abda-5978493313cf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:57:38.989648 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cd84ca10-d131-4e55-a129-f136bd9e59ca req-90ae2811-0455-466e-924c-5a7daf14c56e service nova] Acquired lock "refresh_cache-9d7f874a-9bd5-4e26-abda-5978493313cf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:57:38.990697 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-cd84ca10-d131-4e55-a129-f136bd9e59ca req-90ae2811-0455-466e-924c-5a7daf14c56e service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Refreshing network info cache for port 232f9df8-2737-4ab4-9028-7ba9060284c4 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:57:39.116268 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 00:57:39.116893 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929859.1164136, bd459d7f-74cf-42ac-8409-db592190cd52 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:57:39.117024 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] VM Started (Lifecycle Event)
May 28 00:57:39.119473 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 00:57:39.123586 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Instance spawned successfully.
May 28 00:57:39.124840 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 00:57:39.125703 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:57:39.154990 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ce7167d7-ccde-497f-8d21-0b59f6133f82 req-52ae7fe0-df30-4757-86f8-277ec3a5511f service nova] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Received event network-changed-510c8fcb-a3ae-4a4b-b064-145dea29c584 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:39.155121 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ce7167d7-ccde-497f-8d21-0b59f6133f82 req-52ae7fe0-df30-4757-86f8-277ec3a5511f service nova] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Refreshing instance network info cache due to event network-changed-510c8fcb-a3ae-4a4b-b064-145dea29c584. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:57:39.155321 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ce7167d7-ccde-497f-8d21-0b59f6133f82 req-52ae7fe0-df30-4757-86f8-277ec3a5511f service nova] Acquiring lock "refresh_cache-8783a79a-1374-43cf-8f20-81f1a156a315" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:57:39.155321 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ce7167d7-ccde-497f-8d21-0b59f6133f82 req-52ae7fe0-df30-4757-86f8-277ec3a5511f service nova] Acquired lock "refresh_cache-8783a79a-1374-43cf-8f20-81f1a156a315" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:57:39.155418 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-ce7167d7-ccde-497f-8d21-0b59f6133f82 req-52ae7fe0-df30-4757-86f8-277ec3a5511f service nova] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Refreshing network info cache for port 510c8fcb-a3ae-4a4b-b064-145dea29c584 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:57:39.491745 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-cd84ca10-d131-4e55-a129-f136bd9e59ca req-90ae2811-0455-466e-924c-5a7daf14c56e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:39.614619 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-cd84ca10-d131-4e55-a129-f136bd9e59ca req-90ae2811-0455-466e-924c-5a7daf14c56e service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:57:39.619640 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:57:39.621509 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:57:39.638590 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.678s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:39.638957 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 00:57:39.643688 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.830s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:39.647725 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:39.650562 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:39.650562 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:39.650562 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:39.650562 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:39.650562 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:39.657810 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-ce7167d7-ccde-497f-8d21-0b59f6133f82 req-52ae7fe0-df30-4757-86f8-277ec3a5511f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:39.779041 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-cd84ca10-d131-4e55-a129-f136bd9e59ca req-90ae2811-0455-466e-924c-5a7daf14c56e service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:57:39.964929 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-ce7167d7-ccde-497f-8d21-0b59f6133f82 req-52ae7fe0-df30-4757-86f8-277ec3a5511f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:40.094781 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-ce7167d7-ccde-497f-8d21-0b59f6133f82 req-52ae7fe0-df30-4757-86f8-277ec3a5511f service nova] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Updated VIF entry in instance network info cache for port 510c8fcb-a3ae-4a4b-b064-145dea29c584. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 00:57:40.096343 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-ce7167d7-ccde-497f-8d21-0b59f6133f82 req-52ae7fe0-df30-4757-86f8-277ec3a5511f service nova] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Updating instance_info_cache with network_info: [{"id": "510c8fcb-a3ae-4a4b-b064-145dea29c584", "address": "fa:16:3e:2c:d2:b6", "network": {"id": "a3d13ae7-524a-4a4d-ac9b-3b364b3e2832", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-408863509-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2baedfd7036c444caea4b26edc31c870", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap510c8fcb-a3", "ovs_interfaceid": "510c8fcb-a3ae-4a4b-b064-145dea29c584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:57:40.124032 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 00:57:40.124368 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929860.1241965, bd459d7f-74cf-42ac-8409-db592190cd52 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:57:40.124472 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] VM Paused (Lifecycle Event)
May 28 00:57:40.156743 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 00:57:40.156912 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 00:57:40.157173 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:40.157381 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:40.162102 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Took 7.76 seconds to spawn the instance on the hypervisor.
May 28 00:57:40.165368 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:57:40.263587 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aed2d10997a8409bb838d9992238169d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34789ca811e44d7585580cf10432be2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 00:57:40.281987 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cd84ca10-d131-4e55-a129-f136bd9e59ca req-90ae2811-0455-466e-924c-5a7daf14c56e service nova] Releasing lock "refresh_cache-9d7f874a-9bd5-4e26-abda-5978493313cf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:57:40.282206 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-cd84ca10-d131-4e55-a129-f136bd9e59ca req-90ae2811-0455-466e-924c-5a7daf14c56e service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-changed-43668618-5b61-4949-9f06-e291b8f68cce {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:40.282352 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-cd84ca10-d131-4e55-a129-f136bd9e59ca req-90ae2811-0455-466e-924c-5a7daf14c56e service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Refreshing instance network info cache due to event network-changed-43668618-5b61-4949-9f06-e291b8f68cce. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:57:40.282514 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cd84ca10-d131-4e55-a129-f136bd9e59ca req-90ae2811-0455-466e-924c-5a7daf14c56e service nova] Acquiring lock "refresh_cache-9d7f874a-9bd5-4e26-abda-5978493313cf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:57:40.282686 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cd84ca10-d131-4e55-a129-f136bd9e59ca req-90ae2811-0455-466e-924c-5a7daf14c56e service nova] Acquired lock "refresh_cache-9d7f874a-9bd5-4e26-abda-5978493313cf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:57:40.282832 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-cd84ca10-d131-4e55-a129-f136bd9e59ca req-90ae2811-0455-466e-924c-5a7daf14c56e service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Refreshing network info cache for port 43668618-5b61-4949-9f06-e291b8f68cce {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:57:40.445196 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:40.596808 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ce7167d7-ccde-497f-8d21-0b59f6133f82 req-52ae7fe0-df30-4757-86f8-277ec3a5511f service nova] Releasing lock "refresh_cache-8783a79a-1374-43cf-8f20-81f1a156a315" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:57:40.626897 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:57:40.628564 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929860.6282468, bd459d7f-74cf-42ac-8409-db592190cd52 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:57:40.628696 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] VM Resumed (Lifecycle Event)
May 28 00:57:40.646275 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9aad7511-52c6-4b33-b9c2-353f64208e94 req-71e7e155-8073-487a-b5a0-eecea0a7663e service nova] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Received event network-vif-plugged-2a41ea61-9f86-4e35-8d94-573d2294fcea {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:40.646275 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9aad7511-52c6-4b33-b9c2-353f64208e94 req-71e7e155-8073-487a-b5a0-eecea0a7663e service nova] Acquiring lock "bd459d7f-74cf-42ac-8409-db592190cd52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:40.646472 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9aad7511-52c6-4b33-b9c2-353f64208e94 req-71e7e155-8073-487a-b5a0-eecea0a7663e service nova] Lock "bd459d7f-74cf-42ac-8409-db592190cd52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:40.648691 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9aad7511-52c6-4b33-b9c2-353f64208e94 req-71e7e155-8073-487a-b5a0-eecea0a7663e service nova] Lock "bd459d7f-74cf-42ac-8409-db592190cd52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:40.649991 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9aad7511-52c6-4b33-b9c2-353f64208e94 req-71e7e155-8073-487a-b5a0-eecea0a7663e service nova] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] No waiting events found dispatching network-vif-plugged-2a41ea61-9f86-4e35-8d94-573d2294fcea {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:57:40.649991 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-9aad7511-52c6-4b33-b9c2-353f64208e94 req-71e7e155-8073-487a-b5a0-eecea0a7663e service nova] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Received unexpected event network-vif-plugged-2a41ea61-9f86-4e35-8d94-573d2294fcea for instance with vm_state active and task_state None.
May 28 00:57:40.668572 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 00:57:40.680199 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Took 13.34 seconds to build instance.
May 28 00:57:40.727521 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 8783a79a-1374-43cf-8f20-81f1a156a315 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 00:57:40.727673 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance b1380963-8254-4ad0-95bb-91d24cea00f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 00:57:40.728005 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 0928917f-0c8c-4019-aef4-083ba8224ce0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 00:57:40.728005 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 7fdf336e-65c1-4180-92eb-5f8ca0ebc526 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 00:57:40.728005 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance a84e49f5-0bde-41ee-866e-6b434748077f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 00:57:40.728005 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 9d7f874a-9bd5-4e26-abda-5978493313cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 00:57:40.728296 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance bd459d7f-74cf-42ac-8409-db592190cd52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 00:57:40.728296 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 6942ebd1-823e-499a-a819-0f0125eb9fad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 00:57:40.728296 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 00:57:40.728394 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Final resource view: name=np0000001577 phys_ram=24030MB used_ram=2048MB phys_disk=95GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 00:57:37 up 29 min,  2 users,  load average: 5.98, 2.67, 1.29\n', 'num_instances': '8', 'num_vm_active': '3', 'num_task_None': '4', 'num_os_type_None': '8', 'num_proj_2baedfd7036c444caea4b26edc31c870': '1', 'io_workload': '5', 'num_proj_355551e9b29346059ddbe389bc51efa8': '1', 'num_proj_df45e1c2b903482aa7e61c55b1f3f45b': '2', 'num_vm_building': '5', 'num_task_spawning': '4', 'num_proj_365a56f393cf409d8d1562e6be8318fa': '1', 'num_proj_3b9278238dfa4e86ad7904a4a76caf6b': '1', 'num_proj_e3a934d83cfd4c36aec672eb707031f8': '1', 'num_proj_34789ca811e44d7585580cf10432be2d': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 00:57:40.748091 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Successfully created port: 05fbeb54-faea-42cf-9128-480f9da03c72 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 00:57:40.786768 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-cd84ca10-d131-4e55-a129-f136bd9e59ca req-90ae2811-0455-466e-924c-5a7daf14c56e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:40.802024 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:40.895451 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-cd84ca10-d131-4e55-a129-f136bd9e59ca req-90ae2811-0455-466e-924c-5a7daf14c56e service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:57:41.105179 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-cd84ca10-d131-4e55-a129-f136bd9e59ca req-90ae2811-0455-466e-924c-5a7daf14c56e service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:57:41.130928 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:57:41.133744 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:57:41.170559 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 00:57:41.181729 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c675c13-46b4-4044-9073-5bccf80c71d3 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Lock "bd459d7f-74cf-42ac-8409-db592190cd52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.853s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:41.283449 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:57:41.283750 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:57:41.327723 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Successfully updated port: 05fbeb54-faea-42cf-9128-480f9da03c72 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 00:57:41.607709 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cd84ca10-d131-4e55-a129-f136bd9e59ca req-90ae2811-0455-466e-924c-5a7daf14c56e service nova] Releasing lock "refresh_cache-9d7f874a-9bd5-4e26-abda-5978493313cf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:57:41.608299 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Acquired lock "refresh_cache-9d7f874a-9bd5-4e26-abda-5978493313cf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:57:41.608458 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 00:57:41.787167 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:57:41.831574 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Acquiring lock "refresh_cache-6942ebd1-823e-499a-a819-0f0125eb9fad" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:57:41.834757 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Acquired lock "refresh_cache-6942ebd1-823e-499a-a819-0f0125eb9fad" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:57:41.834949 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 00:57:42.178941 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 00:57:42.179824 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 00:57:42.180019 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Creating image(s)
May 28 00:57:42.180423 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Acquiring lock "/opt/stack/data/nova/instances/6942ebd1-823e-499a-a819-0f0125eb9fad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:42.180587 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Lock "/opt/stack/data/nova/instances/6942ebd1-823e-499a-a819-0f0125eb9fad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:42.181043 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Lock "/opt/stack/data/nova/instances/6942ebd1-823e-499a-a819-0f0125eb9fad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:42.181514 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:57:42.184094 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:57:42.185116 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:42.197770 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:57:42.255954 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.071s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:42.256333 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:42.256770 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:42.257149 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:57:42.259831 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:57:42.260121 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:42.298880 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Compute_service record updated for np0000001577:np0000001577 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 00:57:42.299883 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.656s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:42.299883 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 54.71 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 00:57:42.328352 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.068s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:42.328978 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/6942ebd1-823e-499a-a819-0f0125eb9fad/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:42.369931 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/6942ebd1-823e-499a-a819-0f0125eb9fad/disk 1073741824" returned: 0 in 0.040s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:42.370489 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.114s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:42.370935 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:42.412150 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:42.435345 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:57:42.450474 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.079s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:42.450952 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6942ebd1-823e-499a-a819-0f0125eb9fad/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 00:57:42.451231 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6942ebd1-823e-499a-a819-0f0125eb9fad/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:42.540603 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6942ebd1-823e-499a-a819-0f0125eb9fad/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:42.541057 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Cannot resize image /opt/stack/data/nova/instances/6942ebd1-823e-499a-a819-0f0125eb9fad/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 00:57:42.541484 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 00:57:42.541731 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Ensure instance console log exists: /opt/stack/data/nova/instances/6942ebd1-823e-499a-a819-0f0125eb9fad/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 00:57:42.542036 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:42.542309 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:42.542492 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:42.645042 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:42.730098 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a7cb3b9e-1fa8-4e96-bb01-5d42004ae50c req-5df91615-ad00-439f-941e-4e731974d222 service nova] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Received event network-changed-05fbeb54-faea-42cf-9128-480f9da03c72 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:42.730269 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a7cb3b9e-1fa8-4e96-bb01-5d42004ae50c req-5df91615-ad00-439f-941e-4e731974d222 service nova] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Refreshing instance network info cache due to event network-changed-05fbeb54-faea-42cf-9128-480f9da03c72. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:57:42.730633 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a7cb3b9e-1fa8-4e96-bb01-5d42004ae50c req-5df91615-ad00-439f-941e-4e731974d222 service nova] Acquiring lock "refresh_cache-6942ebd1-823e-499a-a819-0f0125eb9fad" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:57:42.790183 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:42.796773 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Updating instance_info_cache with network_info: [{"id": "05fbeb54-faea-42cf-9128-480f9da03c72", "address": "fa:16:3e:4c:28:9f", "network": {"id": "5f23bf1b-ea03-4634-8add-2e0c56c8cd6f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-460992786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "34789ca811e44d7585580cf10432be2d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05fbeb54-fa", "ovs_interfaceid": "05fbeb54-faea-42cf-9128-480f9da03c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:57:43.111956 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e05c485b-40d6-4b66-8630-f24ecc9cfdd3 req-c677eb30-349d-46f6-9868-4308e1e72361 service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Received event network-vif-plugged-9f8ec3b0-780e-4a36-ad3f-4664a6829868 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:43.113261 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e05c485b-40d6-4b66-8630-f24ecc9cfdd3 req-c677eb30-349d-46f6-9868-4308e1e72361 service nova] Acquiring lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:43.113465 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e05c485b-40d6-4b66-8630-f24ecc9cfdd3 req-c677eb30-349d-46f6-9868-4308e1e72361 service nova] Lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:43.113671 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e05c485b-40d6-4b66-8630-f24ecc9cfdd3 req-c677eb30-349d-46f6-9868-4308e1e72361 service nova] Lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:43.113845 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e05c485b-40d6-4b66-8630-f24ecc9cfdd3 req-c677eb30-349d-46f6-9868-4308e1e72361 service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Processing event network-vif-plugged-9f8ec3b0-780e-4a36-ad3f-4664a6829868 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 00:57:43.114465 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Instance event wait completed in 13 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 00:57:43.118269 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929863.1178584, 7fdf336e-65c1-4180-92eb-5f8ca0ebc526 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:57:43.118473 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] VM Resumed (Lifecycle Event)
May 28 00:57:43.120496 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 00:57:43.126112 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Instance spawned successfully.
May 28 00:57:43.128626 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 00:57:43.181450 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:43.299614 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Releasing lock "refresh_cache-6942ebd1-823e-499a-a819-0f0125eb9fad" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:57:43.299878 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Instance network_info: |[{"id": "05fbeb54-faea-42cf-9128-480f9da03c72", "address": "fa:16:3e:4c:28:9f", "network": {"id": "5f23bf1b-ea03-4634-8add-2e0c56c8cd6f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-460992786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "34789ca811e44d7585580cf10432be2d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05fbeb54-fa", "ovs_interfaceid": "05fbeb54-faea-42cf-9128-480f9da03c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 00:57:43.303991 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Start _get_guest_xml network_info=[{"id": "05fbeb54-faea-42cf-9128-480f9da03c72", "address": "fa:16:3e:4c:28:9f", "network": {"id": "5f23bf1b-ea03-4634-8add-2e0c56c8cd6f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-460992786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "34789ca811e44d7585580cf10432be2d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05fbeb54-fa", "ovs_interfaceid": "05fbeb54-faea-42cf-9128-480f9da03c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 00:57:43.303991 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a7cb3b9e-1fa8-4e96-bb01-5d42004ae50c req-5df91615-ad00-439f-941e-4e731974d222 service nova] Acquired lock "refresh_cache-6942ebd1-823e-499a-a819-0f0125eb9fad" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:57:43.303991 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-a7cb3b9e-1fa8-4e96-bb01-5d42004ae50c req-5df91615-ad00-439f-941e-4e731974d222 service nova] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Refreshing network info cache for port 05fbeb54-faea-42cf-9128-480f9da03c72 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:57:43.307085 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 00:57:43.308972 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-VolumesAdminNegativeTest-server-680486143', uuid='6942ebd1-823e-499a-a819-0f0125eb9fad'), owner=OwnerMeta(userid='aed2d10997a8409bb838d9992238169d', username='tempest-VolumesAdminNegativeTest-1882149120-project-member', projectid='34789ca811e44d7585580cf10432be2d', projectname='tempest-VolumesAdminNegativeTest-1882149120'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "05fbeb54-faea-42cf-9128-480f9da03c72", "address": "fa:16:3e:4c:28:9f", "network": {"id": "5f23bf1b-ea03-4634-8add-2e0c56c8cd6f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-460992786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "34789ca811e44d7585580cf10432be2d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05fbeb54-fa", "ovs_interfaceid": "05fbeb54-faea-42cf-9128-480f9da03c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779929863.3083513) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 00:57:43.311718 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 00:57:43.312231 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 00:57:43.313071 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 00:57:43.313317 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 00:57:43.316352 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 00:57:43.316775 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 00:57:43.316934 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 00:57:43.317193 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 00:57:43.317298 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 00:57:43.317849 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 00:57:43.318109 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 00:57:43.318320 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 00:57:43.318320 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 00:57:43.318733 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 00:57:43.318733 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 00:57:43.319119 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 00:57:43.338462 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T00:57:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-680486143',display_name='tempest-VolumesAdminNegativeTest-server-680486143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumesadminnegativetest-server-680486143',id=8,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34789ca811e44d7585580cf10432be2d',ramdisk_id='',reservation_id='r-yuirvewo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1882149120',owner_user_name='tempest-VolumesAdminNegativeTest-1882149120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:57:41Z,user_data=None,user_id='aed2d10997a8409bb838d9992238169d',uuid=6942ebd1-823e-499a-a819-0f0125eb9fad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05fbeb54-faea-42cf-9128-480f9da03c72", "address": "fa:16:3e:4c:28:9f", "network": {"id": "5f23bf1b-ea03-4634-8add-2e0c56c8cd6f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-460992786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "34789ca811e44d7585580cf10432be2d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05fbeb54-fa", "ovs_interfaceid": "05fbeb54-faea-42cf-9128-480f9da03c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 00:57:43.338684 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Converting VIF {"id": "05fbeb54-faea-42cf-9128-480f9da03c72", "address": "fa:16:3e:4c:28:9f", "network": {"id": "5f23bf1b-ea03-4634-8add-2e0c56c8cd6f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-460992786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "34789ca811e44d7585580cf10432be2d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05fbeb54-fa", "ovs_interfaceid": "05fbeb54-faea-42cf-9128-480f9da03c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:57:43.339731 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:28:9f,bridge_name='br-int',has_traffic_filtering=True,id=05fbeb54-faea-42cf-9128-480f9da03c72,network=Network(5f23bf1b-ea03-4634-8add-2e0c56c8cd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05fbeb54-fa') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:57:43.339983 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Lazy-loading 'pci_devices' on Instance uuid 6942ebd1-823e-499a-a819-0f0125eb9fad {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:57:43.524265 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:43.624570 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:57:43.626631 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:57:43.634263 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:43.634435 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:43.634756 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:43.635021 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:43.635346 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:43.635662 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:43.805965 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-a7cb3b9e-1fa8-4e96-bb01-5d42004ae50c req-5df91615-ad00-439f-941e-4e731974d222 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:43.843826 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] End _get_guest_xml xml=<domain type="qemu">
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:   <uuid>6942ebd1-823e-499a-a819-0f0125eb9fad</uuid>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:   <name>instance-00000008</name>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:   <metadata>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       <nova:name>tempest-VolumesAdminNegativeTest-server-680486143</nova:name>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 00:57:43</nova:creationTime>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       </nova:image>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:         <nova:user uuid="aed2d10997a8409bb838d9992238169d">tempest-VolumesAdminNegativeTest-1882149120-project-member</nova:user>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:         <nova:project uuid="34789ca811e44d7585580cf10432be2d">tempest-VolumesAdminNegativeTest-1882149120</nova:project>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:         <nova:port uuid="05fbeb54-faea-42cf-9128-480f9da03c72">
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:         </nova:port>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:   </metadata>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:     <system>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       <entry name="serial">6942ebd1-823e-499a-a819-0f0125eb9fad</entry>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       <entry name="uuid">6942ebd1-823e-499a-a819-0f0125eb9fad</entry>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:     </system>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:   <os>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:   </os>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:   <features>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:     <acpi/>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:     <tcg>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:     </tcg>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:   </features>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:   <devices>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/6942ebd1-823e-499a-a819-0f0125eb9fad/disk"/>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:     </disk>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/6942ebd1-823e-499a-a819-0f0125eb9fad/disk.config"/>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:     </disk>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:4c:28:9f"/>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       <target dev="tap05fbeb54-fa"/>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:     </interface>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/6942ebd1-823e-499a-a819-0f0125eb9fad/console.log" append="off"/>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:     </serial>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:     <video>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:     </video>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:     </rng>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:     </memballoon>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:   </devices>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]: </domain>
May 28 00:57:43.843826 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 00:57:43.846391 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Preparing to wait for external event network-vif-plugged-05fbeb54-faea-42cf-9128-480f9da03c72 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 00:57:43.846391 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Acquiring lock "6942ebd1-823e-499a-a819-0f0125eb9fad-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:43.846391 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Lock "6942ebd1-823e-499a-a819-0f0125eb9fad-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:43.846391 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Lock "6942ebd1-823e-499a-a819-0f0125eb9fad-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:43.846391 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T00:57:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-680486143',display_name='tempest-VolumesAdminNegativeTest-server-680486143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumesadminnegativetest-server-680486143',id=8,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34789ca811e44d7585580cf10432be2d',ramdisk_id='',reservation_id='r-yuirvewo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1882149120',owner_user_name='tempest-VolumesAdminNegativeTest-1882149120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:57:41Z,user_data=None,user_id='aed2d10997a8409bb838d9992238169d',uuid=6942ebd1-823e-499a-a819-0f0125eb9fad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05fbeb54-faea-42cf-9128-480f9da03c72", "address": "fa:16:3e:4c:28:9f", "network": {"id": "5f23bf1b-ea03-4634-8add-2e0c56c8cd6f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-460992786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "34789ca811e44d7585580cf10432be2d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05fbeb54-fa", "ovs_interfaceid": "05fbeb54-faea-42cf-9128-480f9da03c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 00:57:43.846721 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Converting VIF {"id": "05fbeb54-faea-42cf-9128-480f9da03c72", "address": "fa:16:3e:4c:28:9f", "network": {"id": "5f23bf1b-ea03-4634-8add-2e0c56c8cd6f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-460992786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "34789ca811e44d7585580cf10432be2d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05fbeb54-fa", "ovs_interfaceid": "05fbeb54-faea-42cf-9128-480f9da03c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:57:43.846721 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:28:9f,bridge_name='br-int',has_traffic_filtering=True,id=05fbeb54-faea-42cf-9128-480f9da03c72,network=Network(5f23bf1b-ea03-4634-8add-2e0c56c8cd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05fbeb54-fa') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:57:43.846721 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:28:9f,bridge_name='br-int',has_traffic_filtering=True,id=05fbeb54-faea-42cf-9128-480f9da03c72,network=Network(5f23bf1b-ea03-4634-8add-2e0c56c8cd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05fbeb54-fa') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 00:57:43.847203 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:43.847415 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:43.847728 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 00:57:43.848505 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:43.848995 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e8f6a8d-005a-5abc-9ef2-588f1d0c579c', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:43.850102 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:43.852111 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:57:43.860615 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:43.860615 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05fbeb54-fa, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:43.860615 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05fbeb54-fa, col_values=(('qos', UUID('cdd2a16b-ecf4-4969-acd3-9177dd3e93b5')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:43.860615 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05fbeb54-fa, col_values=(('external_ids', {'iface-id': '05fbeb54-faea-42cf-9128-480f9da03c72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:28:9f', 'vm-uuid': '6942ebd1-823e-499a-a819-0f0125eb9fad'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:43.866076 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:57:43.867031 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:43.868638 np0000001577 nova-compute[98319]: INFO os_vif [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:28:9f,bridge_name='br-int',has_traffic_filtering=True,id=05fbeb54-faea-42cf-9128-480f9da03c72,network=Network(5f23bf1b-ea03-4634-8add-2e0c56c8cd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05fbeb54-fa')
May 28 00:57:43.907540 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:44.130039 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 00:57:44.142402 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Took 23.47 seconds to spawn the instance on the hypervisor.
May 28 00:57:44.142593 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:57:44.242200 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-a7cb3b9e-1fa8-4e96-bb01-5d42004ae50c req-5df91615-ad00-439f-941e-4e731974d222 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:44.249508 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:44.422079 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-a7cb3b9e-1fa8-4e96-bb01-5d42004ae50c req-5df91615-ad00-439f-941e-4e731974d222 service nova] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Updated VIF entry in instance network info cache for port 05fbeb54-faea-42cf-9128-480f9da03c72. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 00:57:44.422281 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-a7cb3b9e-1fa8-4e96-bb01-5d42004ae50c req-5df91615-ad00-439f-941e-4e731974d222 service nova] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Updating instance_info_cache with network_info: [{"id": "05fbeb54-faea-42cf-9128-480f9da03c72", "address": "fa:16:3e:4c:28:9f", "network": {"id": "5f23bf1b-ea03-4634-8add-2e0c56c8cd6f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-460992786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "34789ca811e44d7585580cf10432be2d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05fbeb54-fa", "ovs_interfaceid": "05fbeb54-faea-42cf-9128-480f9da03c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:57:44.611032 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:44.653449 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Took 33.91 seconds to build instance.
May 28 00:57:44.744770 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Updating instance_info_cache with network_info: [{"id": "97517937-1acb-4d47-93fb-fd89085e4f62", "address": "fa:16:3e:a2:ac:a1", "network": {"id": "f6da0cc2-457d-4d21-9646-f2139a582801", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1600296736-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap97517937-1a", "ovs_interfaceid": "97517937-1acb-4d47-93fb-fd89085e4f62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "61af54f4-c2a8-49db-8074-3f601131d7e3", "address": "fa:16:3e:05:ba:8e", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61af54f4-c2", "ovs_interfaceid": "61af54f4-c2a8-49db-8074-3f601131d7e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8eb6e856-e081-4dd7-b047-d48fd42c12f3", "address": "fa:16:3e:14:b7:15", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb6e856-e0", "ovs_interfaceid": "8eb6e856-e081-4dd7-b047-d48fd42c12f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ee97d14e-f88b-4516-a3a7-c7e4f7ae6483", "address": "fa:16:3e:67:4c:bd", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee97d14e-f8", "ovs_interfaceid": "ee97d14e-f88b-4516-a3a7-c7e4f7ae6483", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea9f7c06-6d37-45ce-b730-7abdf1004095", "address": "fa:16:3e:31:f3:63", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9f7c06-6d", "ovs_interfaceid": "ea9f7c06-6d37-45ce-b730-7abdf1004095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "232f9df8-2737-4ab4-9028-7ba9060284c4", "address": "fa:16:3e:fe:12:c6", "network": {"id": "d07566c3-0394-4dc6-ad3c-0d4f13f7703d", "bridge": "br-int", "label": "tempest-device-tagging-net2-2113905332", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap232f9df8-27", "ovs_interfaceid": "232f9df8-2737-4ab4-9028-7ba9060284c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "43668618-5b61-4949-9f06-e291b8f68cce", "address": "fa:16:3e:4c:71:ca", "network": {"id": "d07566c3-0394-4dc6-ad3c-0d4f13f7703d", "bridge": "br-int", "label": "tempest-device-tagging-net2-2113905332", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43668618-5b", "ovs_interfaceid": "43668618-5b61-4949-9f06-e291b8f68cce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:57:44.924047 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a7cb3b9e-1fa8-4e96-bb01-5d42004ae50c req-5df91615-ad00-439f-941e-4e731974d222 service nova] Releasing lock "refresh_cache-6942ebd1-823e-499a-a819-0f0125eb9fad" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:57:45.155036 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca5a662a-e4f8-4723-b024-c839109add64 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.420s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:45.182667 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4960dac4-3cda-4f68-937c-137301b34c30 req-8f40db4c-10d7-4b50-969f-2c88ad86afda service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Received event network-vif-plugged-9f8ec3b0-780e-4a36-ad3f-4664a6829868 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:45.185845 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4960dac4-3cda-4f68-937c-137301b34c30 req-8f40db4c-10d7-4b50-969f-2c88ad86afda service nova] Acquiring lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:45.185992 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4960dac4-3cda-4f68-937c-137301b34c30 req-8f40db4c-10d7-4b50-969f-2c88ad86afda service nova] Lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:45.186097 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4960dac4-3cda-4f68-937c-137301b34c30 req-8f40db4c-10d7-4b50-969f-2c88ad86afda service nova] Lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:45.186211 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4960dac4-3cda-4f68-937c-137301b34c30 req-8f40db4c-10d7-4b50-969f-2c88ad86afda service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] No waiting events found dispatching network-vif-plugged-9f8ec3b0-780e-4a36-ad3f-4664a6829868 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:57:45.186323 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-4960dac4-3cda-4f68-937c-137301b34c30 req-8f40db4c-10d7-4b50-969f-2c88ad86afda service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Received unexpected event network-vif-plugged-9f8ec3b0-780e-4a36-ad3f-4664a6829868 for instance with vm_state active and task_state None.
May 28 00:57:45.186588 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4960dac4-3cda-4f68-937c-137301b34c30 req-8f40db4c-10d7-4b50-969f-2c88ad86afda service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-unplugged-43668618-5b61-4949-9f06-e291b8f68cce {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:45.186732 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4960dac4-3cda-4f68-937c-137301b34c30 req-8f40db4c-10d7-4b50-969f-2c88ad86afda service nova] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:45.186846 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4960dac4-3cda-4f68-937c-137301b34c30 req-8f40db4c-10d7-4b50-969f-2c88ad86afda service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:45.186940 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4960dac4-3cda-4f68-937c-137301b34c30 req-8f40db4c-10d7-4b50-969f-2c88ad86afda service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:45.187039 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4960dac4-3cda-4f68-937c-137301b34c30 req-8f40db4c-10d7-4b50-969f-2c88ad86afda service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] No waiting events found dispatching network-vif-unplugged-43668618-5b61-4949-9f06-e291b8f68cce {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:57:45.187560 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-4960dac4-3cda-4f68-937c-137301b34c30 req-8f40db4c-10d7-4b50-969f-2c88ad86afda service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received unexpected event network-vif-unplugged-43668618-5b61-4949-9f06-e291b8f68cce for instance with vm_state building and task_state spawning.
May 28 00:57:45.187689 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4960dac4-3cda-4f68-937c-137301b34c30 req-8f40db4c-10d7-4b50-969f-2c88ad86afda service nova] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Received event network-vif-plugged-68c38c36-a152-4495-aa91-3a05281c5da6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:45.187801 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4960dac4-3cda-4f68-937c-137301b34c30 req-8f40db4c-10d7-4b50-969f-2c88ad86afda service nova] Acquiring lock "a84e49f5-0bde-41ee-866e-6b434748077f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:45.187913 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4960dac4-3cda-4f68-937c-137301b34c30 req-8f40db4c-10d7-4b50-969f-2c88ad86afda service nova] Lock "a84e49f5-0bde-41ee-866e-6b434748077f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:45.188015 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4960dac4-3cda-4f68-937c-137301b34c30 req-8f40db4c-10d7-4b50-969f-2c88ad86afda service nova] Lock "a84e49f5-0bde-41ee-866e-6b434748077f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:45.188111 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4960dac4-3cda-4f68-937c-137301b34c30 req-8f40db4c-10d7-4b50-969f-2c88ad86afda service nova] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Processing event network-vif-plugged-68c38c36-a152-4495-aa91-3a05281c5da6 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 00:57:45.188287 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4960dac4-3cda-4f68-937c-137301b34c30 req-8f40db4c-10d7-4b50-969f-2c88ad86afda service nova] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Received event network-vif-plugged-68c38c36-a152-4495-aa91-3a05281c5da6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:45.188344 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4960dac4-3cda-4f68-937c-137301b34c30 req-8f40db4c-10d7-4b50-969f-2c88ad86afda service nova] Acquiring lock "a84e49f5-0bde-41ee-866e-6b434748077f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:45.188453 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4960dac4-3cda-4f68-937c-137301b34c30 req-8f40db4c-10d7-4b50-969f-2c88ad86afda service nova] Lock "a84e49f5-0bde-41ee-866e-6b434748077f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:45.188555 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4960dac4-3cda-4f68-937c-137301b34c30 req-8f40db4c-10d7-4b50-969f-2c88ad86afda service nova] Lock "a84e49f5-0bde-41ee-866e-6b434748077f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:45.189569 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Instance event wait completed in 14 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 00:57:45.189778 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4960dac4-3cda-4f68-937c-137301b34c30 req-8f40db4c-10d7-4b50-969f-2c88ad86afda service nova] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] No waiting events found dispatching network-vif-plugged-68c38c36-a152-4495-aa91-3a05281c5da6 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:57:45.190003 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-4960dac4-3cda-4f68-937c-137301b34c30 req-8f40db4c-10d7-4b50-969f-2c88ad86afda service nova] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Received unexpected event network-vif-plugged-68c38c36-a152-4495-aa91-3a05281c5da6 for instance with vm_state building and task_state spawning.
May 28 00:57:45.194666 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 00:57:45.195217 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929865.194989, a84e49f5-0bde-41ee-866e-6b434748077f => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:57:45.195359 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] VM Resumed (Lifecycle Event)
May 28 00:57:45.198680 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Instance spawned successfully.
May 28 00:57:45.198680 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 00:57:45.249602 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Releasing lock "refresh_cache-9d7f874a-9bd5-4e26-abda-5978493313cf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:57:45.249602 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Instance network_info: |[{"id": "97517937-1acb-4d47-93fb-fd89085e4f62", "address": "fa:16:3e:a2:ac:a1", "network": {"id": "f6da0cc2-457d-4d21-9646-f2139a582801", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1600296736-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap97517937-1a", "ovs_interfaceid": "97517937-1acb-4d47-93fb-fd89085e4f62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "61af54f4-c2a8-49db-8074-3f601131d7e3", "address": "fa:16:3e:05:ba:8e", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61af54f4-c2", "ovs_interfaceid": "61af54f4-c2a8-49db-8074-3f601131d7e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8eb6e856-e081-4dd7-b047-d48fd42c12f3", "address": "fa:16:3e:14:b7:15", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb6e856-e0", "ovs_interfaceid": "8eb6e856-e081-4dd7-b047-d48fd42c12f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ee97d14e-f88b-4516-a3a7-c7e4f7ae6483", "address": "fa:16:3e:67:4c:bd", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee97d14e-f8", "ovs_interfaceid": "ee97d14e-f88b-4516-a3a7-c7e4f7ae6483", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea9f7c06-6d37-45ce-b730-7abdf1004095", "address": "fa:16:3e:31:f3:63", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9f7c06-6d", "ovs_interfaceid": "ea9f7c06-6d37-45ce-b730-7abdf1004095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "232f9df8-2737-4ab4-9028-7ba9060284c4", "address": "fa:16:3e:fe:12:c6", "network": {"id": "d07566c3-0394-4dc6-ad3c-0d4f13f7703d", "bridge": "br-int", "label": "tempest-device-tagging-net2-2113905332", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap232f9df8-27", "ovs_interfaceid": "232f9df8-2737-4ab4-9028-7ba9060284c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "43668618-5b61-4949-9f06-e291b8f68cce", "address": "fa:16:3e:4c:71:ca", "network": {"id": "d07566c3-0394-4dc6-ad3c-0d4f13f7703d", "bridge": "br-int", "label": "tempest-device-tagging-net2-2113905332", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43668618-5b", "ovs_interfaceid": "43668618-5b61-4949-9f06-e291b8f68cce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 00:57:45.252019 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Start _get_guest_xml network_info=[{"id": "97517937-1acb-4d47-93fb-fd89085e4f62", "address": "fa:16:3e:a2:ac:a1", "network": {"id": "f6da0cc2-457d-4d21-9646-f2139a582801", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1600296736-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap97517937-1a", "ovs_interfaceid": "97517937-1acb-4d47-93fb-fd89085e4f62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "61af54f4-c2a8-49db-8074-3f601131d7e3", "address": "fa:16:3e:05:ba:8e", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61af54f4-c2", "ovs_interfaceid": "61af54f4-c2a8-49db-8074-3f601131d7e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8eb6e856-e081-4dd7-b047-d48fd42c12f3", "address": "fa:16:3e:14:b7:15", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb6e856-e0", "ovs_interfaceid": "8eb6e856-e081-4dd7-b047-d48fd42c12f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ee97d14e-f88b-4516-a3a7-c7e4f7ae6483", "address": "fa:16:3e:67:4c:bd", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee97d14e-f8", "ovs_interfaceid": "ee97d14e-f88b-4516-a3a7-c7e4f7ae6483", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea9f7c06-6d37-45ce-b730-7abdf1004095", "address": "fa:16:3e:31:f3:63", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9f7c06-6d", "ovs_interfaceid": "ea9f7c06-6d37-45ce-b730-7abdf1004095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "232f9df8-2737-4ab4-9028-7ba9060284c4", "address": "fa:16:3e:fe:12:c6", "network": {"id": "d07566c3-0394-4dc6-ad3c-0d4f13f7703d", "bridge": "br-int", "label": "tempest-device-tagging-net2-2113905332", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap232f9df8-27", "ovs_interfaceid": "232f9df8-2737-4ab4-9028-7ba9060284c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "43668618-5b61-4949-9f06-e291b8f68cce", "address": "fa:16:3e:4c:71:ca", "network": {"id": "d07566c3-0394-4dc6-ad3c-0d4f13f7703d", "bridge": "br-int", "label": "tempest-device-tagging-net2-2113905332", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43668618-5b", "ovs_interfaceid": "43668618-5b61-4949-9f06-e291b8f68cce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098', 'iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7a0275e-e153-4b68-b49f-8ca9266df098', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '9d7f874a-9bd5-4e26-abda-5978493313cf', 'attached_at': '', 'detached_at': '', 'volume_id': 'a7a0275e-e153-4b68-b49f-8ca9266df098', 'serial': 'a7a0275e-e153-4b68-b49f-8ca9266df098'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '22608340-88bc-41c4-b3b8-fa0ef9352307', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce', 'iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '143fa2be-a5e9-4162-804b-8146030f3bce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '9d7f874a-9bd5-4e26-abda-5978493313cf', 'attached_at': '', 'detached_at': '', 'volume_id': '143fa2be-a5e9-4162-804b-8146030f3bce', 'serial': '143fa2be-a5e9-4162-804b-8146030f3bce'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '633af68d-3f0d-4b93-b1a1-3a2ba9a0d2e6', 'boot_index': 1, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884', 'iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '54210675-051f-4f9e-83c6-97577ccdf884', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '9d7f874a-9bd5-4e26-abda-5978493313cf', 'attached_at': '', 'detached_at': '', 'volume_id': '54210675-051f-4f9e-83c6-97577ccdf884', 'serial': '54210675-051f-4f9e-83c6-97577ccdf884'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '71b47828-680a-4a2f-8742-7c78708da929', 'boot_index': 2, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 00:57:45.252861 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 00:57:45.254138 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1872562561', uuid='9d7f874a-9bd5-4e26-abda-5978493313cf'), owner=OwnerMeta(userid='c58dcd3aae234c4dbc1260fbeb278f90', username='tempest-TaggedBootDevicesTest-1598854432-project-member', projectid='3b9278238dfa4e86ad7904a4a76caf6b', projectname='tempest-TaggedBootDevicesTest-1598854432'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "97517937-1acb-4d47-93fb-fd89085e4f62", "address": "fa:16:3e:a2:ac:a1", "network": {"id": "f6da0cc2-457d-4d21-9646-f2139a582801", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1600296736-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap97517937-1a", "ovs_interfaceid": "97517937-1acb-4d47-93fb-fd89085e4f62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "61af54f4-c2a8-49db-8074-3f601131d7e3", "address": "fa:16:3e:05:ba:8e", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61af54f4-c2", "ovs_interfaceid": "61af54f4-c2a8-49db-8074-3f601131d7e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8eb6e856-e081-4dd7-b047-d48fd42c12f3", "address": "fa:16:3e:14:b7:15", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb6e856-e0", "ovs_interfaceid": "8eb6e856-e081-4dd7-b047-d48fd42c12f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ee97d14e-f88b-4516-a3a7-c7e4f7ae6483", "address": "fa:16:3e:67:4c:bd", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee97d14e-f8", "ovs_interfaceid": "ee97d14e-f88b-4516-a3a7-c7e4f7ae6483", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea9f7c06-6d37-45ce-b730-7abdf1004095", "address": "fa:16:3e:31:f3:63", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9f7c06-6d", "ovs_interfaceid": "ea9f7c06-6d37-45ce-b730-7abdf1004095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "232f9df8-2737-4ab4-9028-7ba9060284c4", "address": "fa:16:3e:fe:12:c6", "network": {"id": "d07566c3-0394-4dc6-ad3c-0d4f13f7703d", "bridge": "br-int", "label": "tempest-device-tagging-net2-2113905332", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap232f9df8-27", "ovs_interfaceid": "232f9df8-2737-4ab4-9028-7ba9060284c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "43668618-5b61-4949-9f06-e291b8f68cce", "address": "fa:16:3e:4c:71:ca", "network": {"id": "d07566c3-0394-4dc6-ad3c-0d4f13f7703d", "bridge": "br-int", "label": "tempest-device-tagging-net2-2113905332", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43668618-5b", "ovs_interfaceid": "43668618-5b61-4949-9f06-e291b8f68cce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779929865.253684) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 00:57:45.257129 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 00:57:45.257129 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 00:57:45.257626 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 00:57:45.257830 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 00:57:45.258778 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 00:57:45.259164 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 00:57:45.259330 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 00:57:45.259451 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 00:57:45.259629 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 00:57:45.259745 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 00:57:45.259870 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 00:57:45.260052 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 00:57:45.260179 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 00:57:45.260346 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 00:57:45.260447 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 00:57:45.260613 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 00:57:45.274438 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:45.274631 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:45.277097 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connector [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Factory for ISCSI on None {{(pid=98319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}}
May 28 00:57:45.277331 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:45.277476 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 00:57:45.277839 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098', 'iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7a0275e-e153-4b68-b49f-8ca9266df098', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:57:45.278072 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:57:45.278439 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:57:45.280029 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098', 'iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7a0275e-e153-4b68-b49f-8ca9266df098', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 00:57:45.295466 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:57:45.295849 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:57:45.296142 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 00:57:45.297691 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:57:45.297691 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:57:45.297691 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 00:57:45.309281 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 00:57:45.309281 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:45.314662 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 00:57:45.314662 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:45.326267 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098] added
May 28 00:57:45.326267 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 00:57:45.326267 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:57:45.326267 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:57:45.326267 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:57:45.326267 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:57:45.326267 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:45.326559 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 00:57:45.326915 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0305(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 00:57:45.326915 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 00:57:45.329884 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098] added
May 28 00:57:45.329884 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 00:57:45.329884 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:57:45.329884 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:57:45.329884 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:57:45.329884 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:57:45.329884 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:45.330117 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 00:57:45.330196 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0328(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 00:57:45.330327 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 00:57:45.387078 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:57:45.387228 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:57:45.387358 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] No VIF found with MAC fa:16:3e:4c:28:9f, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 00:57:45.387810 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Using config drive
May 28 00:57:45.697645 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:57:45.703104 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:57:45.708850 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:45.708997 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:45.711401 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:45.711494 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:45.711870 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:45.713501 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:45.804166 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:45.892852 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:46.032606 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Creating config drive at /opt/stack/data/nova/instances/6942ebd1-823e-499a-a819-0f0125eb9fad/disk.config
May 28 00:57:46.035001 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6942ebd1-823e-499a-a819-0f0125eb9fad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf1hevq32 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:46.070921 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6942ebd1-823e-499a-a819-0f0125eb9fad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf1hevq32" returned: 0 in 0.035s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:46.121596 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1db88570-8e2b-44d8-b911-6f69322828fb req-ac330eb9-876d-4979-a877-4f58b5487b05 service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Received event network-changed-9f8ec3b0-780e-4a36-ad3f-4664a6829868 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:46.122572 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1db88570-8e2b-44d8-b911-6f69322828fb req-ac330eb9-876d-4979-a877-4f58b5487b05 service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Refreshing instance network info cache due to event network-changed-9f8ec3b0-780e-4a36-ad3f-4664a6829868. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:57:46.122572 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1db88570-8e2b-44d8-b911-6f69322828fb req-ac330eb9-876d-4979-a877-4f58b5487b05 service nova] Acquiring lock "refresh_cache-7fdf336e-65c1-4180-92eb-5f8ca0ebc526" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:57:46.122572 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1db88570-8e2b-44d8-b911-6f69322828fb req-ac330eb9-876d-4979-a877-4f58b5487b05 service nova] Acquired lock "refresh_cache-7fdf336e-65c1-4180-92eb-5f8ca0ebc526" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:57:46.122572 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-1db88570-8e2b-44d8-b911-6f69322828fb req-ac330eb9-876d-4979-a877-4f58b5487b05 service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Refreshing network info cache for port 9f8ec3b0-780e-4a36-ad3f-4664a6829868 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:57:46.206933 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 00:57:46.218398 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Took 23.20 seconds to spawn the instance on the hypervisor.
May 28 00:57:46.218612 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:57:46.327239 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 00:57:46.333408 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.startup = manual
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.port = 0
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 00:57:46.343051 np0000001577 nova-compute[98319]: # END RECORD
May 28 00:57:46.343051 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.startup = manual
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.port = 0
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 00:57:46.349731 np0000001577 nova-compute[98319]: # END RECORD
May 28 00:57:46.349731 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:46.358143 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:46.364385 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:46.369556 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 00:57:46.369556 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:57:46.369747 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 00:57:46.369747 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:57:46.369914 np0000001577 nova-compute[98319]: WARNING os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 00:57:46.369914 np0000001577 nova-compute[98319]: 
May 28 00:57:46.381050 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 00:57:46.381050 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:57:46.381050 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 00:57:46.381050 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:57:46.381050 np0000001577 nova-compute[98319]: WARNING os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 00:57:46.381050 np0000001577 nova-compute[98319]: 
May 28 00:57:46.414058 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098, portal: 192.168.40.100,3260]
May 28 00:57:46.414058 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098, portal: 192.168.40.100,3260] successful.
May 28 00:57:46.414058 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:46.425825 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:46.437137 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:46.437137 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:57:46.437321 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:46.437321 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:57:46.438595 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.142s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:57:46.438595 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 00:57:46.438793 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] HCTL ('7', '-', '-', 0) found on session 5 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 00:57:46.438793 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 00:57:46.456102 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Searching for a device in session 5 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 00:57:46.456289 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7a0275e-e153-4b68-b49f-8ca9266df098', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 00:57:46.544649 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:46.569848 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:46.626216 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-1db88570-8e2b-44d8-b911-6f69322828fb req-ac330eb9-876d-4979-a877-4f58b5487b05 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:46.698827 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:46.728450 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Took 33.89 seconds to build instance.
May 28 00:57:46.959933 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:46.967568 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:46.967687 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:46.994571 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:47.117752 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-1db88570-8e2b-44d8-b911-6f69322828fb req-ac330eb9-876d-4979-a877-4f58b5487b05 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:47.230961 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-585a4a09-4da3-4143-932a-1e17ada566a4 tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Lock "a84e49f5-0bde-41ee-866e-6b434748077f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.406s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:47.248879 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-1db88570-8e2b-44d8-b911-6f69322828fb req-ac330eb9-876d-4979-a877-4f58b5487b05 service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Updated VIF entry in instance network info cache for port 9f8ec3b0-780e-4a36-ad3f-4664a6829868. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 00:57:47.249196 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-1db88570-8e2b-44d8-b911-6f69322828fb req-ac330eb9-876d-4979-a877-4f58b5487b05 service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Updating instance_info_cache with network_info: [{"id": "9f8ec3b0-780e-4a36-ad3f-4664a6829868", "address": "fa:16:3e:a7:28:21", "network": {"id": "e43128b4-a829-486a-a380-4b92728ed2c5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-655543488-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df45e1c2b903482aa7e61c55b1f3f45b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8ec3b0-78", "ovs_interfaceid": "9f8ec3b0-780e-4a36-ad3f-4664a6829868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:57:47.362627 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-89aed421-cca4-4dea-b734-5db67203e907 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Acquiring lock "bd459d7f-74cf-42ac-8409-db592190cd52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:47.363016 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-89aed421-cca4-4dea-b734-5db67203e907 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Lock "bd459d7f-74cf-42ac-8409-db592190cd52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:47.363016 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-89aed421-cca4-4dea-b734-5db67203e907 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Acquiring lock "bd459d7f-74cf-42ac-8409-db592190cd52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:47.363016 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-89aed421-cca4-4dea-b734-5db67203e907 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Lock "bd459d7f-74cf-42ac-8409-db592190cd52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:47.363163 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-89aed421-cca4-4dea-b734-5db67203e907 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Lock "bd459d7f-74cf-42ac-8409-db592190cd52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:47.366103 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-89aed421-cca4-4dea-b734-5db67203e907 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Terminating instance
May 28 00:57:47.424292 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098, portal: 192.168.50.100,3260]
May 28 00:57:47.424292 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098, portal: 192.168.50.100,3260] successful.
May 28 00:57:47.424292 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:47.435613 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:47.446706 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:47.446706 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:47.446706 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:57:47.446871 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:47.446871 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:47.446871 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:57:47.447259 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.150s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:57:47.447429 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 00:57:47.448233 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] HCTL ('8', '-', '-', 0) found on session 6 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 00:57:47.448395 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 00:57:47.463107 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Searching for a device in session 6 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 00:57:47.463267 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a7a0275e-e153-4b68-b49f-8ca9266df098', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 00:57:47.685131 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929867.6838171, 6942ebd1-823e-499a-a819-0f0125eb9fad => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:57:47.685893 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] VM Started (Lifecycle Event)
May 28 00:57:47.727844 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ed4774ce-95e2-4392-bbd9-ac77f94519a4 req-d3b6f4de-1d74-4fec-9691-a078a1e835cf service nova] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Received event network-changed-68c38c36-a152-4495-aa91-3a05281c5da6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:47.727844 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ed4774ce-95e2-4392-bbd9-ac77f94519a4 req-d3b6f4de-1d74-4fec-9691-a078a1e835cf service nova] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Refreshing instance network info cache due to event network-changed-68c38c36-a152-4495-aa91-3a05281c5da6. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:57:47.727844 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ed4774ce-95e2-4392-bbd9-ac77f94519a4 req-d3b6f4de-1d74-4fec-9691-a078a1e835cf service nova] Acquiring lock "refresh_cache-a84e49f5-0bde-41ee-866e-6b434748077f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:57:47.727844 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ed4774ce-95e2-4392-bbd9-ac77f94519a4 req-d3b6f4de-1d74-4fec-9691-a078a1e835cf service nova] Acquired lock "refresh_cache-a84e49f5-0bde-41ee-866e-6b434748077f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:57:47.727844 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-ed4774ce-95e2-4392-bbd9-ac77f94519a4 req-d3b6f4de-1d74-4fec-9691-a078a1e835cf service nova] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Refreshing network info cache for port 68c38c36-a152-4495-aa91-3a05281c5da6 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:57:47.751789 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1db88570-8e2b-44d8-b911-6f69322828fb req-ac330eb9-876d-4979-a877-4f58b5487b05 service nova] Releasing lock "refresh_cache-7fdf336e-65c1-4180-92eb-5f8ca0ebc526" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:57:47.872162 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-89aed421-cca4-4dea-b734-5db67203e907 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 00:57:47.900344 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:47.903462 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:47.926896 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:47.929721 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:47.956830 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:48.181772 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-38715c3b-3adc-429e-8bfc-1946b48edec6 req-4369ac63-9cf0-4e7c-9b6d-c1e67a257692 service nova] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Received event network-vif-plugged-05fbeb54-faea-42cf-9128-480f9da03c72 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:48.183778 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:48.184522 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-38715c3b-3adc-429e-8bfc-1946b48edec6 req-4369ac63-9cf0-4e7c-9b6d-c1e67a257692 service nova] Acquiring lock "6942ebd1-823e-499a-a819-0f0125eb9fad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:48.184734 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-38715c3b-3adc-429e-8bfc-1946b48edec6 req-4369ac63-9cf0-4e7c-9b6d-c1e67a257692 service nova] Lock "6942ebd1-823e-499a-a819-0f0125eb9fad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:48.184854 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-38715c3b-3adc-429e-8bfc-1946b48edec6 req-4369ac63-9cf0-4e7c-9b6d-c1e67a257692 service nova] Lock "6942ebd1-823e-499a-a819-0f0125eb9fad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:48.184976 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-38715c3b-3adc-429e-8bfc-1946b48edec6 req-4369ac63-9cf0-4e7c-9b6d-c1e67a257692 service nova] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Processing event network-vif-plugged-05fbeb54-faea-42cf-9128-480f9da03c72 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 00:57:48.185110 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-38715c3b-3adc-429e-8bfc-1946b48edec6 req-4369ac63-9cf0-4e7c-9b6d-c1e67a257692 service nova] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Received event network-vif-plugged-05fbeb54-faea-42cf-9128-480f9da03c72 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:48.185591 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 00:57:48.185785 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-38715c3b-3adc-429e-8bfc-1946b48edec6 req-4369ac63-9cf0-4e7c-9b6d-c1e67a257692 service nova] Acquiring lock "6942ebd1-823e-499a-a819-0f0125eb9fad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:48.185946 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-38715c3b-3adc-429e-8bfc-1946b48edec6 req-4369ac63-9cf0-4e7c-9b6d-c1e67a257692 service nova] Lock "6942ebd1-823e-499a-a819-0f0125eb9fad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:48.186079 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-38715c3b-3adc-429e-8bfc-1946b48edec6 req-4369ac63-9cf0-4e7c-9b6d-c1e67a257692 service nova] Lock "6942ebd1-823e-499a-a819-0f0125eb9fad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:48.186220 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-38715c3b-3adc-429e-8bfc-1946b48edec6 req-4369ac63-9cf0-4e7c-9b6d-c1e67a257692 service nova] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] No waiting events found dispatching network-vif-plugged-05fbeb54-faea-42cf-9128-480f9da03c72 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:57:48.186391 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-38715c3b-3adc-429e-8bfc-1946b48edec6 req-4369ac63-9cf0-4e7c-9b6d-c1e67a257692 service nova] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Received unexpected event network-vif-plugged-05fbeb54-faea-42cf-9128-480f9da03c72 for instance with vm_state building and task_state spawning.
May 28 00:57:48.186527 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-38715c3b-3adc-429e-8bfc-1946b48edec6 req-4369ac63-9cf0-4e7c-9b6d-c1e67a257692 service nova] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Received event network-vif-unplugged-2a41ea61-9f86-4e35-8d94-573d2294fcea {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:48.186664 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-38715c3b-3adc-429e-8bfc-1946b48edec6 req-4369ac63-9cf0-4e7c-9b6d-c1e67a257692 service nova] Acquiring lock "bd459d7f-74cf-42ac-8409-db592190cd52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:48.186766 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-38715c3b-3adc-429e-8bfc-1946b48edec6 req-4369ac63-9cf0-4e7c-9b6d-c1e67a257692 service nova] Lock "bd459d7f-74cf-42ac-8409-db592190cd52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:48.186852 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-38715c3b-3adc-429e-8bfc-1946b48edec6 req-4369ac63-9cf0-4e7c-9b6d-c1e67a257692 service nova] Lock "bd459d7f-74cf-42ac-8409-db592190cd52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:48.186963 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-38715c3b-3adc-429e-8bfc-1946b48edec6 req-4369ac63-9cf0-4e7c-9b6d-c1e67a257692 service nova] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] No waiting events found dispatching network-vif-unplugged-2a41ea61-9f86-4e35-8d94-573d2294fcea {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:57:48.187075 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-38715c3b-3adc-429e-8bfc-1946b48edec6 req-4369ac63-9cf0-4e7c-9b6d-c1e67a257692 service nova] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Received event network-vif-unplugged-2a41ea61-9f86-4e35-8d94-573d2294fcea for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:57:48.187199 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-38715c3b-3adc-429e-8bfc-1946b48edec6 req-4369ac63-9cf0-4e7c-9b6d-c1e67a257692 service nova] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Received event network-vif-unplugged-2a41ea61-9f86-4e35-8d94-573d2294fcea {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:48.187327 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-38715c3b-3adc-429e-8bfc-1946b48edec6 req-4369ac63-9cf0-4e7c-9b6d-c1e67a257692 service nova] Acquiring lock "bd459d7f-74cf-42ac-8409-db592190cd52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:48.187756 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-38715c3b-3adc-429e-8bfc-1946b48edec6 req-4369ac63-9cf0-4e7c-9b6d-c1e67a257692 service nova] Lock "bd459d7f-74cf-42ac-8409-db592190cd52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:48.187756 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-38715c3b-3adc-429e-8bfc-1946b48edec6 req-4369ac63-9cf0-4e7c-9b6d-c1e67a257692 service nova] Lock "bd459d7f-74cf-42ac-8409-db592190cd52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:48.187756 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-38715c3b-3adc-429e-8bfc-1946b48edec6 req-4369ac63-9cf0-4e7c-9b6d-c1e67a257692 service nova] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] No waiting events found dispatching network-vif-unplugged-2a41ea61-9f86-4e35-8d94-573d2294fcea {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:57:48.187756 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-38715c3b-3adc-429e-8bfc-1946b48edec6 req-4369ac63-9cf0-4e7c-9b6d-c1e67a257692 service nova] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Received event network-vif-unplugged-2a41ea61-9f86-4e35-8d94-573d2294fcea for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:57:48.189683 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:57:48.191060 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 00:57:48.193125 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:48.197622 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:57:48.203096 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Instance spawned successfully.
May 28 00:57:48.205738 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 00:57:48.210352 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Instance destroyed successfully.
May 28 00:57:48.211303 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-89aed421-cca4-4dea-b734-5db67203e907 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Lazy-loading 'resources' on Instance uuid bd459d7f-74cf-42ac-8409-db592190cd52 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:57:48.229360 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-ed4774ce-95e2-4392-bbd9-ac77f94519a4 req-d3b6f4de-1d74-4fec-9691-a078a1e835cf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:48.317804 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Found WWN 330000000ca29251c for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 00:57:48.317804 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:57:48.317804 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '330000000ca29251c', 'path': '/dev/dm-0', 'multipath_id': '330000000ca29251c'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:57:48.317804 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ca29251c', 'path': '/dev/dm-0', 'multipath_id': '330000000ca29251c'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 00:57:48.566904 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-ed4774ce-95e2-4392-bbd9-ac77f94519a4 req-d3b6f4de-1d74-4fec-9691-a078a1e835cf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:48.700919 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 00:57:48.701128 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929868.700979, 6942ebd1-823e-499a-a819-0f0125eb9fad => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:57:48.701218 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] VM Paused (Lifecycle Event)
May 28 00:57:48.713755 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-89aed421-cca4-4dea-b734-5db67203e907 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-58167990',display_name='tempest-VolumesActionsTest-instance-58167990',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumesactionstest-instance-58167990',id=7,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T00:57:40Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3a934d83cfd4c36aec672eb707031f8',ramdisk_id='',reservation_id='r-5et70l3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1937639427',owner_user_name='tempest-VolumesActionsTest-1937639427-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T00:57:40Z,user_data=None,user_id='cc245730881946049e5b165f63e063e6',uuid=bd459d7f-74cf-42ac-8409-db592190cd52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a41ea61-9f86-4e35-8d94-573d2294fcea", "address": "fa:16:3e:ec:eb:f5", "network": {"id": "88fd116a-f16a-4dde-897a-75a4ca63b20c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-452512207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3a934d83cfd4c36aec672eb707031f8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a41ea61-9f", "ovs_interfaceid": "2a41ea61-9f86-4e35-8d94-573d2294fcea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 00:57:48.715148 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-89aed421-cca4-4dea-b734-5db67203e907 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Converting VIF {"id": "2a41ea61-9f86-4e35-8d94-573d2294fcea", "address": "fa:16:3e:ec:eb:f5", "network": {"id": "88fd116a-f16a-4dde-897a-75a4ca63b20c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-452512207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3a934d83cfd4c36aec672eb707031f8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a41ea61-9f", "ovs_interfaceid": "2a41ea61-9f86-4e35-8d94-573d2294fcea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:57:48.716169 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-89aed421-cca4-4dea-b734-5db67203e907 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:eb:f5,bridge_name='br-int',has_traffic_filtering=True,id=2a41ea61-9f86-4e35-8d94-573d2294fcea,network=Network(88fd116a-f16a-4dde-897a-75a4ca63b20c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a41ea61-9f') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:57:48.717578 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-89aed421-cca4-4dea-b734-5db67203e907 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:eb:f5,bridge_name='br-int',has_traffic_filtering=True,id=2a41ea61-9f86-4e35-8d94-573d2294fcea,network=Network(88fd116a-f16a-4dde-897a-75a4ca63b20c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a41ea61-9f') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 00:57:48.723216 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:48.724234 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a41ea61-9f, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:48.725675 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:48.726069 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:48.726710 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:48.729282 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:57:48.729623 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:48.729907 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:48.730170 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:48.730411 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:57:48.733207 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:48.733593 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=658a9ab5-9451-4841-adca-64e8297ccd00) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:48.734102 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:48.734554 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:57:48.735381 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:48.738957 np0000001577 nova-compute[98319]: INFO os_vif [None req-89aed421-cca4-4dea-b734-5db67203e907 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:eb:f5,bridge_name='br-int',has_traffic_filtering=True,id=2a41ea61-9f86-4e35-8d94-573d2294fcea,network=Network(88fd116a-f16a-4dde-897a-75a4ca63b20c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a41ea61-9f')
May 28 00:57:48.738957 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-89aed421-cca4-4dea-b734-5db67203e907 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Deleting instance files /opt/stack/data/nova/instances/bd459d7f-74cf-42ac-8409-db592190cd52_del
May 28 00:57:48.742168 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-89aed421-cca4-4dea-b734-5db67203e907 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Deletion of /opt/stack/data/nova/instances/bd459d7f-74cf-42ac-8409-db592190cd52_del complete
May 28 00:57:48.746733 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-ed4774ce-95e2-4392-bbd9-ac77f94519a4 req-d3b6f4de-1d74-4fec-9691-a078a1e835cf service nova] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Updated VIF entry in instance network info cache for port 68c38c36-a152-4495-aa91-3a05281c5da6. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 00:57:48.746990 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-ed4774ce-95e2-4392-bbd9-ac77f94519a4 req-d3b6f4de-1d74-4fec-9691-a078a1e835cf service nova] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Updating instance_info_cache with network_info: [{"id": "68c38c36-a152-4495-aa91-3a05281c5da6", "address": "fa:16:3e:0c:bd:d9", "network": {"id": "51c8a614-2632-4bfd-802a-f2e7e95980dc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-624499010-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "365a56f393cf409d8d1562e6be8318fa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap68c38c36-a1", "ovs_interfaceid": "68c38c36-a152-4495-aa91-3a05281c5da6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:57:48.827461 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 00:57:48.827819 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce', 'iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '143fa2be-a5e9-4162-804b-8146030f3bce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:57:48.827958 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:57:48.828316 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:57:48.828556 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce', 'iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '143fa2be-a5e9-4162-804b-8146030f3bce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 00:57:48.841021 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:57:48.841600 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:57:48.841761 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 00:57:48.842146 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:57:48.842710 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:57:48.843002 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 00:57:48.854148 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 00:57:48.854148 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:48.860883 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 00:57:48.860883 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:48.866564 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce] added
May 28 00:57:48.866564 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 00:57:48.866564 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:57:48.866564 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:57:48.866564 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:57:48.866564 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:57:48.866564 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:48.866564 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 00:57:48.866564 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0239(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 00:57:48.866564 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 00:57:48.872239 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce] added
May 28 00:57:48.872239 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 00:57:48.872239 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:57:48.872239 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:57:48.872239 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:57:48.872239 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:57:48.872239 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:48.872408 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 00:57:48.872588 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0296(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 00:57:48.872709 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 00:57:49.203299 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:57:49.204641 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929869.2044096, 6942ebd1-823e-499a-a819-0f0125eb9fad => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:57:49.204748 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] VM Resumed (Lifecycle Event)
May 28 00:57:49.235436 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Took 7.06 seconds to spawn the instance on the hypervisor.
May 28 00:57:49.235588 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:57:49.249298 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ed4774ce-95e2-4392-bbd9-ac77f94519a4 req-d3b6f4de-1d74-4fec-9691-a078a1e835cf service nova] Releasing lock "refresh_cache-a84e49f5-0bde-41ee-866e-6b434748077f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:57:49.249885 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-89aed421-cca4-4dea-b734-5db67203e907 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Took 1.38 seconds to destroy the instance on the hypervisor.
May 28 00:57:49.250578 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-89aed421-cca4-4dea-b734-5db67203e907 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 00:57:49.250935 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 00:57:49.251020 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 00:57:49.251235 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:49.350221 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:49.706934 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:57:49.709655 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:57:49.744574 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Took 12.87 seconds to build instance.
May 28 00:57:49.866828 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 00:57:49.873138 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.startup = manual
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.port = 0
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 00:57:49.879687 np0000001577 nova-compute[98319]: # END RECORD
May 28 00:57:49.879687 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.startup = manual
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.port = 0
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 00:57:49.887490 np0000001577 nova-compute[98319]: # END RECORD
May 28 00:57:49.887490 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:49.895572 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:49.901820 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:49.907798 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:49.907798 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:49.907798 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:57:49.907964 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:49.907964 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:49.907964 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:57:49.916600 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:49.916600 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:49.916600 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:57:49.916839 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:49.916839 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:49.916839 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:57:49.941755 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce, portal: 192.168.40.100,3260]
May 28 00:57:49.941755 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce, portal: 192.168.40.100,3260] successful.
May 28 00:57:49.941755 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:49.949251 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce, portal: 192.168.50.100,3260]
May 28 00:57:49.949251 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce, portal: 192.168.50.100,3260] successful.
May 28 00:57:49.949251 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:49.953875 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:49.963116 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:49.969790 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:49.969790 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:49.969790 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:57:49.969790 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:57:49.969790 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:57:49.969944 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:49.969944 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:49.969944 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:57:49.969944 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:57:49.969944 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:57:49.970210 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.129s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:57:49.970355 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 00:57:49.971313 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] HCTL ('9', '-', '-', 0) found on session 7 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 00:57:49.971500 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 00:57:49.979211 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:49.979211 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:49.979211 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:57:49.979211 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:57:49.979211 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:57:49.979384 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:49.979384 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:49.979384 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:57:49.979384 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:57:49.979384 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:57:49.979704 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:57:49.979704 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 00:57:49.980189 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] HCTL ('10', '-', '-', 0) found on session 8 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 00:57:49.980277 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 00:57:49.989991 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Searching for a device in session 7 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 00:57:49.989991 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '143fa2be-a5e9-4162-804b-8146030f3bce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 00:57:49.997693 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Searching for a device in session 8 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 00:57:49.997693 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '143fa2be-a5e9-4162-804b-8146030f3bce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 00:57:50.148931 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:57:50.213223 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999242202000005 future=<Future at 0x7c988c0c2690 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:57:50.214595 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.998333454000203 future=<Future at 0x7c988c0c2690 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:57:50.214595 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.9982178690002 future=<Future at 0x7c988c0c2690 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:57:50.244056 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-349d605b-249e-4421-ba21-6af92c80057b tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Lock "6942ebd1-823e-499a-a819-0f0125eb9fad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.380s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:50.253412 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c5ba781f-3ec2-40ed-8721-22d7bbb261ee req-fc7cee15-837d-4b7e-ab9a-ee6dc5196475 service nova] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Received event network-vif-deleted-2a41ea61-9f86-4e35-8d94-573d2294fcea {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:50.651171 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Took 1.40 seconds to deallocate network for instance.
May 28 00:57:50.805957 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:50.842949 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 00:57:51.156916 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-89aed421-cca4-4dea-b734-5db67203e907 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:51.157094 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-89aed421-cca4-4dea-b734-5db67203e907 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:51.675648 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-89aed421-cca4-4dea-b734-5db67203e907 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:57:51.676020 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-89aed421-cca4-4dea-b734-5db67203e907 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:57:51.857453 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Found WWN 330000000f6482198 for multipath device dm-3 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 00:57:51.857869 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:57:51.857963 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '330000000f6482198', 'path': '/dev/dm-3', 'multipath_id': '330000000f6482198'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:57:51.858117 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f6482198', 'path': '/dev/dm-3', 'multipath_id': '330000000f6482198'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 00:57:52.178835 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-89aed421-cca4-4dea-b734-5db67203e907 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:57:52.362428 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 00:57:52.362742 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884', 'iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '54210675-051f-4f9e-83c6-97577ccdf884', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:57:52.362856 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:57:52.363180 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:57:52.363416 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884', 'iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '54210675-051f-4f9e-83c6-97577ccdf884', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 00:57:52.375395 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:57:52.376020 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:57:52.376583 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:57:52.376794 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 00:57:52.377225 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:57:52.377475 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 00:57:52.388275 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 00:57:52.388275 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:52.394146 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 00:57:52.394146 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:52.400620 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884] added
May 28 00:57:52.400620 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 00:57:52.400620 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:57:52.400620 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:57:52.400620 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:57:52.400620 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:57:52.400620 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:52.400928 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 00:57:52.400965 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0242(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 00:57:52.401127 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 00:57:52.405815 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884] added
May 28 00:57:52.405815 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 00:57:52.405815 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:57:52.405815 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:57:52.405815 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:57:52.405815 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:57:52.405815 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:52.406140 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 00:57:52.406140 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0287(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 00:57:52.406289 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 00:57:52.687642 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-89aed421-cca4-4dea-b734-5db67203e907 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.530s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:52.748037 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-89aed421-cca4-4dea-b734-5db67203e907 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Deleted allocations for instance bd459d7f-74cf-42ac-8409-db592190cd52
May 28 00:57:53.195223 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8153c1fd-f685-4351-8b23-e6d390e561d1 tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Acquiring lock "6942ebd1-823e-499a-a819-0f0125eb9fad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:53.195223 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8153c1fd-f685-4351-8b23-e6d390e561d1 tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Lock "6942ebd1-823e-499a-a819-0f0125eb9fad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:53.195223 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8153c1fd-f685-4351-8b23-e6d390e561d1 tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Acquiring lock "6942ebd1-823e-499a-a819-0f0125eb9fad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:53.195223 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8153c1fd-f685-4351-8b23-e6d390e561d1 tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Lock "6942ebd1-823e-499a-a819-0f0125eb9fad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:53.195223 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8153c1fd-f685-4351-8b23-e6d390e561d1 tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Lock "6942ebd1-823e-499a-a819-0f0125eb9fad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:53.197207 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-8153c1fd-f685-4351-8b23-e6d390e561d1 tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Terminating instance
May 28 00:57:53.401665 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 00:57:53.406769 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.startup = manual
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.port = 0
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 00:57:53.420071 np0000001577 nova-compute[98319]: # END RECORD
May 28 00:57:53.420071 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.startup = manual
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.port = 0
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 00:57:53.424086 np0000001577 nova-compute[98319]: # END RECORD
May 28 00:57:53.424086 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:53.431130 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:53.437655 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:53.447323 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:53.447323 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:53.447323 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:57:53.447323 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:57:53.447323 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:57:53.447820 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:53.447820 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:53.447820 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:57:53.447820 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:57:53.447820 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:57:53.451925 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:53.451925 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:53.451925 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:57:53.451925 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:57:53.451925 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:57:53.452059 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:53.452059 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:53.452059 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:57:53.452059 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:57:53.452059 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:57:53.485103 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884, portal: 192.168.40.100,3260]
May 28 00:57:53.485103 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884, portal: 192.168.40.100,3260] successful.
May 28 00:57:53.485103 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:53.494213 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884, portal: 192.168.50.100,3260]
May 28 00:57:53.494213 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884, portal: 192.168.50.100,3260] successful.
May 28 00:57:53.494213 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:53.498951 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:53.508175 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:57:53.515907 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:57:53.515907 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:53.515907 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:53.515907 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:57:53.515907 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:57:53.515907 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:57:53.515907 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:57:53.516386 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:57:53.516386 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:53.516386 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:53.516386 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:57:53.516386 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:57:53.516386 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:57:53.516386 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:57:53.516709 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:57:53.516834 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 00:57:53.517699 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] HCTL ('11', '-', '-', 0) found on session 9 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 00:57:53.517838 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 00:57:53.525270 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:57:53.525270 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:53.525270 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:53.525270 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:57:53.525270 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:57:53.525270 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:57:53.525270 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:57:53.525473 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:57:53.525473 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:53.525473 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:57:53.525473 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:57:53.525473 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:57:53.525473 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:57:53.525473 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:57:53.526026 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:57:53.526026 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 00:57:53.526846 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] HCTL ('12', '-', '-', 0) found on session 10 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 00:57:53.527013 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 00:57:53.535125 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Searching for a device in session 9 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 00:57:53.535125 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '54210675-051f-4f9e-83c6-97577ccdf884', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 00:57:53.545854 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Searching for a device in session 10 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 00:57:53.545854 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '54210675-051f-4f9e-83c6-97577ccdf884', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 00:57:53.702934 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-8153c1fd-f685-4351-8b23-e6d390e561d1 tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 00:57:53.723281 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:53.725302 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:53.734789 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:53.754301 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:53.758794 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-89aed421-cca4-4dea-b734-5db67203e907 tempest-VolumesActionsTest-1937639427 tempest-VolumesActionsTest-1937639427-project-member] Lock "bd459d7f-74cf-42ac-8409-db592190cd52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.396s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:53.779309 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:53.929653 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ffb8fe2d-9f0a-4609-aeef-27af0f34dc2e req-c5fdb6b8-21a3-435e-8076-a75be2355a24 service nova] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Received event network-vif-unplugged-05fbeb54-faea-42cf-9128-480f9da03c72 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:53.929866 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ffb8fe2d-9f0a-4609-aeef-27af0f34dc2e req-c5fdb6b8-21a3-435e-8076-a75be2355a24 service nova] Acquiring lock "6942ebd1-823e-499a-a819-0f0125eb9fad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:53.929990 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ffb8fe2d-9f0a-4609-aeef-27af0f34dc2e req-c5fdb6b8-21a3-435e-8076-a75be2355a24 service nova] Lock "6942ebd1-823e-499a-a819-0f0125eb9fad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:53.930039 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ffb8fe2d-9f0a-4609-aeef-27af0f34dc2e req-c5fdb6b8-21a3-435e-8076-a75be2355a24 service nova] Lock "6942ebd1-823e-499a-a819-0f0125eb9fad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:53.930148 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ffb8fe2d-9f0a-4609-aeef-27af0f34dc2e req-c5fdb6b8-21a3-435e-8076-a75be2355a24 service nova] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] No waiting events found dispatching network-vif-unplugged-05fbeb54-faea-42cf-9128-480f9da03c72 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:57:53.930232 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ffb8fe2d-9f0a-4609-aeef-27af0f34dc2e req-c5fdb6b8-21a3-435e-8076-a75be2355a24 service nova] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Received event network-vif-unplugged-05fbeb54-faea-42cf-9128-480f9da03c72 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:57:54.030610 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:54.045949 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:54.066460 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999647816000106 future=<Future at 0x7c988f95c2f0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:57:54.068931 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Instance destroyed successfully.
May 28 00:57:54.069312 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-8153c1fd-f685-4351-8b23-e6d390e561d1 tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Lazy-loading 'resources' on Instance uuid 6942ebd1-823e-499a-a819-0f0125eb9fad {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:57:54.377042 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 00:57:54.572386 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-8153c1fd-f685-4351-8b23-e6d390e561d1 tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-680486143',display_name='tempest-VolumesAdminNegativeTest-server-680486143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumesadminnegativetest-server-680486143',id=8,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T00:57:49Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='34789ca811e44d7585580cf10432be2d',ramdisk_id='',reservation_id='r-yuirvewo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1882149120',owner_user_name='tempest-VolumesAdminNegativeTest-1882149120-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T00:57:49Z,user_data=None,user_id='aed2d10997a8409bb838d9992238169d',uuid=6942ebd1-823e-499a-a819-0f0125eb9fad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05fbeb54-faea-42cf-9128-480f9da03c72", "address": "fa:16:3e:4c:28:9f", "network": {"id": "5f23bf1b-ea03-4634-8add-2e0c56c8cd6f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-460992786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "34789ca811e44d7585580cf10432be2d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05fbeb54-fa", "ovs_interfaceid": "05fbeb54-faea-42cf-9128-480f9da03c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 00:57:54.572733 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8153c1fd-f685-4351-8b23-e6d390e561d1 tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Converting VIF {"id": "05fbeb54-faea-42cf-9128-480f9da03c72", "address": "fa:16:3e:4c:28:9f", "network": {"id": "5f23bf1b-ea03-4634-8add-2e0c56c8cd6f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-460992786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "34789ca811e44d7585580cf10432be2d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap05fbeb54-fa", "ovs_interfaceid": "05fbeb54-faea-42cf-9128-480f9da03c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:57:54.573354 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8153c1fd-f685-4351-8b23-e6d390e561d1 tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:28:9f,bridge_name='br-int',has_traffic_filtering=True,id=05fbeb54-faea-42cf-9128-480f9da03c72,network=Network(5f23bf1b-ea03-4634-8add-2e0c56c8cd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05fbeb54-fa') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:57:54.573649 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-8153c1fd-f685-4351-8b23-e6d390e561d1 tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:28:9f,bridge_name='br-int',has_traffic_filtering=True,id=05fbeb54-faea-42cf-9128-480f9da03c72,network=Network(5f23bf1b-ea03-4634-8add-2e0c56c8cd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05fbeb54-fa') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 00:57:54.575998 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:54.575998 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05fbeb54-fa, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:54.577181 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:54.577181 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:57:54.578638 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:54.579688 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:54.579688 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cdd2a16b-ecf4-4969-acd3-9177dd3e93b5) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:54.580375 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:54.580375 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:57:54.581026 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:54.582679 np0000001577 nova-compute[98319]: INFO os_vif [None req-8153c1fd-f685-4351-8b23-e6d390e561d1 tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:28:9f,bridge_name='br-int',has_traffic_filtering=True,id=05fbeb54-faea-42cf-9128-480f9da03c72,network=Network(5f23bf1b-ea03-4634-8add-2e0c56c8cd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05fbeb54-fa')
May 28 00:57:54.582998 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8153c1fd-f685-4351-8b23-e6d390e561d1 tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Deleting instance files /opt/stack/data/nova/instances/6942ebd1-823e-499a-a819-0f0125eb9fad_del
May 28 00:57:54.583585 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8153c1fd-f685-4351-8b23-e6d390e561d1 tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Deletion of /opt/stack/data/nova/instances/6942ebd1-823e-499a-a819-0f0125eb9fad_del complete
May 28 00:57:55.089107 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-8153c1fd-f685-4351-8b23-e6d390e561d1 tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Took 1.39 seconds to destroy the instance on the hypervisor.
May 28 00:57:55.089636 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-8153c1fd-f685-4351-8b23-e6d390e561d1 tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 00:57:55.089817 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 00:57:55.089907 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 00:57:55.090131 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:55.167221 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:55.399521 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Found WWN 3300000008fe36b99 for multipath device dm-4 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 00:57:55.399916 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:57:55.399968 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '3300000008fe36b99', 'path': '/dev/dm-4', 'multipath_id': '3300000008fe36b99'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:57:55.400083 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008fe36b99', 'path': '/dev/dm-4', 'multipath_id': '3300000008fe36b99'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 00:57:55.810076 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:55.910165 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872562561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1872562561',id=6,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPFecLIkLO5JTpGTObnYg1RtXOmtHpmcbB2B5euCdvCluRUc/DGskJJ3Y7sH4gsT6zfiT27zUbmA54IyG2Y0IducAkauw44DZU+1vJGF6ABjE9kQDlfmB7D3IJLj/JxnQ==',key_name='tempest-keypair-1485494395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b9278238dfa4e86ad7904a4a76caf6b',ramdisk_id='',reservation_id='r-t45dlllu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1598854432',owner_user_name='tempest-TaggedBootDevicesTest-1598854432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:57:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c58dcd3aae234c4dbc1260fbeb278f90',uuid=9d7f874a-9bd5-4e26-abda-5978493313cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97517937-1acb-4d47-93fb-fd89085e4f62", "address": "fa:16:3e:a2:ac:a1", "network": {"id": "f6da0cc2-457d-4d21-9646-f2139a582801", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1600296736-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap97517937-1a", "ovs_interfaceid": "97517937-1acb-4d47-93fb-fd89085e4f62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 00:57:55.910559 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converting VIF {"id": "97517937-1acb-4d47-93fb-fd89085e4f62", "address": "fa:16:3e:a2:ac:a1", "network": {"id": "f6da0cc2-457d-4d21-9646-f2139a582801", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1600296736-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap97517937-1a", "ovs_interfaceid": "97517937-1acb-4d47-93fb-fd89085e4f62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:57:55.911243 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:ac:a1,bridge_name='br-int',has_traffic_filtering=True,id=97517937-1acb-4d47-93fb-fd89085e4f62,network=Network(f6da0cc2-457d-4d21-9646-f2139a582801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97517937-1a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:57:55.912130 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872562561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1872562561',id=6,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPFecLIkLO5JTpGTObnYg1RtXOmtHpmcbB2B5euCdvCluRUc/DGskJJ3Y7sH4gsT6zfiT27zUbmA54IyG2Y0IducAkauw44DZU+1vJGF6ABjE9kQDlfmB7D3IJLj/JxnQ==',key_name='tempest-keypair-1485494395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b9278238dfa4e86ad7904a4a76caf6b',ramdisk_id='',reservation_id='r-t45dlllu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1598854432',owner_user_name='tempest-TaggedBootDevicesTest-1598854432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:57:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c58dcd3aae234c4dbc1260fbeb278f90',uuid=9d7f874a-9bd5-4e26-abda-5978493313cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61af54f4-c2a8-49db-8074-3f601131d7e3", "address": "fa:16:3e:05:ba:8e", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61af54f4-c2", "ovs_interfaceid": "61af54f4-c2a8-49db-8074-3f601131d7e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 00:57:55.912452 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converting VIF {"id": "61af54f4-c2a8-49db-8074-3f601131d7e3", "address": "fa:16:3e:05:ba:8e", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61af54f4-c2", "ovs_interfaceid": "61af54f4-c2a8-49db-8074-3f601131d7e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:57:55.913026 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:ba:8e,bridge_name='br-int',has_traffic_filtering=True,id=61af54f4-c2a8-49db-8074-3f601131d7e3,network=Network(5240346f-576d-4813-ae69-2c6157a9a77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap61af54f4-c2') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:57:55.913878 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872562561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1872562561',id=6,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPFecLIkLO5JTpGTObnYg1RtXOmtHpmcbB2B5euCdvCluRUc/DGskJJ3Y7sH4gsT6zfiT27zUbmA54IyG2Y0IducAkauw44DZU+1vJGF6ABjE9kQDlfmB7D3IJLj/JxnQ==',key_name='tempest-keypair-1485494395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b9278238dfa4e86ad7904a4a76caf6b',ramdisk_id='',reservation_id='r-t45dlllu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1598854432',owner_user_name='tempest-TaggedBootDevicesTest-1598854432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:57:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c58dcd3aae234c4dbc1260fbeb278f90',uuid=9d7f874a-9bd5-4e26-abda-5978493313cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8eb6e856-e081-4dd7-b047-d48fd42c12f3", "address": "fa:16:3e:14:b7:15", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb6e856-e0", "ovs_interfaceid": "8eb6e856-e081-4dd7-b047-d48fd42c12f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 00:57:55.914177 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converting VIF {"id": "8eb6e856-e081-4dd7-b047-d48fd42c12f3", "address": "fa:16:3e:14:b7:15", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb6e856-e0", "ovs_interfaceid": "8eb6e856-e081-4dd7-b047-d48fd42c12f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:57:55.914731 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:b7:15,bridge_name='br-int',has_traffic_filtering=True,id=8eb6e856-e081-4dd7-b047-d48fd42c12f3,network=Network(5240346f-576d-4813-ae69-2c6157a9a77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8eb6e856-e0') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:57:55.915699 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872562561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1872562561',id=6,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPFecLIkLO5JTpGTObnYg1RtXOmtHpmcbB2B5euCdvCluRUc/DGskJJ3Y7sH4gsT6zfiT27zUbmA54IyG2Y0IducAkauw44DZU+1vJGF6ABjE9kQDlfmB7D3IJLj/JxnQ==',key_name='tempest-keypair-1485494395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b9278238dfa4e86ad7904a4a76caf6b',ramdisk_id='',reservation_id='r-t45dlllu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1598854432',owner_user_name='tempest-TaggedBootDevicesTest-1598854432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:57:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c58dcd3aae234c4dbc1260fbeb278f90',uuid=9d7f874a-9bd5-4e26-abda-5978493313cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee97d14e-f88b-4516-a3a7-c7e4f7ae6483", "address": "fa:16:3e:67:4c:bd", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee97d14e-f8", "ovs_interfaceid": "ee97d14e-f88b-4516-a3a7-c7e4f7ae6483", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 00:57:55.916005 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converting VIF {"id": "ee97d14e-f88b-4516-a3a7-c7e4f7ae6483", "address": "fa:16:3e:67:4c:bd", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee97d14e-f8", "ovs_interfaceid": "ee97d14e-f88b-4516-a3a7-c7e4f7ae6483", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:57:55.916593 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:4c:bd,bridge_name='br-int',has_traffic_filtering=True,id=ee97d14e-f88b-4516-a3a7-c7e4f7ae6483,network=Network(5240346f-576d-4813-ae69-2c6157a9a77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee97d14e-f8') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:57:55.917446 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872562561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1872562561',id=6,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPFecLIkLO5JTpGTObnYg1RtXOmtHpmcbB2B5euCdvCluRUc/DGskJJ3Y7sH4gsT6zfiT27zUbmA54IyG2Y0IducAkauw44DZU+1vJGF6ABjE9kQDlfmB7D3IJLj/JxnQ==',key_name='tempest-keypair-1485494395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b9278238dfa4e86ad7904a4a76caf6b',ramdisk_id='',reservation_id='r-t45dlllu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1598854432',owner_user_name='tempest-TaggedBootDevicesTest-1598854432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:57:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c58dcd3aae234c4dbc1260fbeb278f90',uuid=9d7f874a-9bd5-4e26-abda-5978493313cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea9f7c06-6d37-45ce-b730-7abdf1004095", "address": "fa:16:3e:31:f3:63", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9f7c06-6d", "ovs_interfaceid": "ea9f7c06-6d37-45ce-b730-7abdf1004095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 00:57:55.917760 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converting VIF {"id": "ea9f7c06-6d37-45ce-b730-7abdf1004095", "address": "fa:16:3e:31:f3:63", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9f7c06-6d", "ovs_interfaceid": "ea9f7c06-6d37-45ce-b730-7abdf1004095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:57:55.918226 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:f3:63,bridge_name='br-int',has_traffic_filtering=True,id=ea9f7c06-6d37-45ce-b730-7abdf1004095,network=Network(5240346f-576d-4813-ae69-2c6157a9a77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea9f7c06-6d') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:57:55.919003 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872562561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1872562561',id=6,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPFecLIkLO5JTpGTObnYg1RtXOmtHpmcbB2B5euCdvCluRUc/DGskJJ3Y7sH4gsT6zfiT27zUbmA54IyG2Y0IducAkauw44DZU+1vJGF6ABjE9kQDlfmB7D3IJLj/JxnQ==',key_name='tempest-keypair-1485494395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b9278238dfa4e86ad7904a4a76caf6b',ramdisk_id='',reservation_id='r-t45dlllu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1598854432',owner_user_name='tempest-TaggedBootDevicesTest-1598854432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:57:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c58dcd3aae234c4dbc1260fbeb278f90',uuid=9d7f874a-9bd5-4e26-abda-5978493313cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "232f9df8-2737-4ab4-9028-7ba9060284c4", "address": "fa:16:3e:fe:12:c6", "network": {"id": "d07566c3-0394-4dc6-ad3c-0d4f13f7703d", "bridge": "br-int", "label": "tempest-device-tagging-net2-2113905332", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap232f9df8-27", "ovs_interfaceid": "232f9df8-2737-4ab4-9028-7ba9060284c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 00:57:55.919189 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converting VIF {"id": "232f9df8-2737-4ab4-9028-7ba9060284c4", "address": "fa:16:3e:fe:12:c6", "network": {"id": "d07566c3-0394-4dc6-ad3c-0d4f13f7703d", "bridge": "br-int", "label": "tempest-device-tagging-net2-2113905332", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap232f9df8-27", "ovs_interfaceid": "232f9df8-2737-4ab4-9028-7ba9060284c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:57:55.919902 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:12:c6,bridge_name='br-int',has_traffic_filtering=True,id=232f9df8-2737-4ab4-9028-7ba9060284c4,network=Network(d07566c3-0394-4dc6-ad3c-0d4f13f7703d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap232f9df8-27') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:57:55.920721 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872562561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1872562561',id=6,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPFecLIkLO5JTpGTObnYg1RtXOmtHpmcbB2B5euCdvCluRUc/DGskJJ3Y7sH4gsT6zfiT27zUbmA54IyG2Y0IducAkauw44DZU+1vJGF6ABjE9kQDlfmB7D3IJLj/JxnQ==',key_name='tempest-keypair-1485494395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b9278238dfa4e86ad7904a4a76caf6b',ramdisk_id='',reservation_id='r-t45dlllu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1598854432',owner_user_name='tempest-TaggedBootDevicesTest-1598854432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:57:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c58dcd3aae234c4dbc1260fbeb278f90',uuid=9d7f874a-9bd5-4e26-abda-5978493313cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43668618-5b61-4949-9f06-e291b8f68cce", "address": "fa:16:3e:4c:71:ca", "network": {"id": "d07566c3-0394-4dc6-ad3c-0d4f13f7703d", "bridge": "br-int", "label": "tempest-device-tagging-net2-2113905332", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43668618-5b", "ovs_interfaceid": "43668618-5b61-4949-9f06-e291b8f68cce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 00:57:55.921022 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converting VIF {"id": "43668618-5b61-4949-9f06-e291b8f68cce", "address": "fa:16:3e:4c:71:ca", "network": {"id": "d07566c3-0394-4dc6-ad3c-0d4f13f7703d", "bridge": "br-int", "label": "tempest-device-tagging-net2-2113905332", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43668618-5b", "ovs_interfaceid": "43668618-5b61-4949-9f06-e291b8f68cce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:57:55.921577 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:71:ca,bridge_name='br-int',has_traffic_filtering=True,id=43668618-5b61-4949-9f06-e291b8f68cce,network=Network(d07566c3-0394-4dc6-ad3c-0d4f13f7703d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43668618-5b') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:57:55.922470 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d7f874a-9bd5-4e26-abda-5978493313cf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:57:55.984956 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:57:56.017211 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8da2f613-d33d-4132-94f1-9c5d5d79770b req-5afe16f5-4d20-4af5-bc57-d2b386ee0ace service nova] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Received event network-vif-unplugged-05fbeb54-faea-42cf-9128-480f9da03c72 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:56.021241 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8da2f613-d33d-4132-94f1-9c5d5d79770b req-5afe16f5-4d20-4af5-bc57-d2b386ee0ace service nova] Acquiring lock "6942ebd1-823e-499a-a819-0f0125eb9fad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:56.021241 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8da2f613-d33d-4132-94f1-9c5d5d79770b req-5afe16f5-4d20-4af5-bc57-d2b386ee0ace service nova] Lock "6942ebd1-823e-499a-a819-0f0125eb9fad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:56.021241 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8da2f613-d33d-4132-94f1-9c5d5d79770b req-5afe16f5-4d20-4af5-bc57-d2b386ee0ace service nova] Lock "6942ebd1-823e-499a-a819-0f0125eb9fad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:56.021241 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8da2f613-d33d-4132-94f1-9c5d5d79770b req-5afe16f5-4d20-4af5-bc57-d2b386ee0ace service nova] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] No waiting events found dispatching network-vif-unplugged-05fbeb54-faea-42cf-9128-480f9da03c72 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:57:56.021241 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8da2f613-d33d-4132-94f1-9c5d5d79770b req-5afe16f5-4d20-4af5-bc57-d2b386ee0ace service nova] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Received event network-vif-unplugged-05fbeb54-faea-42cf-9128-480f9da03c72 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:57:56.021241 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8da2f613-d33d-4132-94f1-9c5d5d79770b req-5afe16f5-4d20-4af5-bc57-d2b386ee0ace service nova] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Received event network-vif-deleted-05fbeb54-faea-42cf-9128-480f9da03c72 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:56.425425 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] End _get_guest_xml xml=<domain type="qemu">
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:   <uuid>9d7f874a-9bd5-4e26-abda-5978493313cf</uuid>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:   <name>instance-00000006</name>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:   <metadata>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <nova:name>tempest-device-tagging-server-1872562561</nova:name>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 00:57:45</nova:creationTime>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       </nova:image>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:         <nova:user uuid="c58dcd3aae234c4dbc1260fbeb278f90">tempest-TaggedBootDevicesTest-1598854432-project-member</nova:user>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:         <nova:project uuid="3b9278238dfa4e86ad7904a4a76caf6b">tempest-TaggedBootDevicesTest-1598854432</nova:project>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:         <nova:port uuid="97517937-1acb-4d47-93fb-fd89085e4f62">
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:         </nova:port>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:         <nova:port uuid="61af54f4-c2a8-49db-8074-3f601131d7e3">
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.1.64" ipVersion="4"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:         </nova:port>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:         <nova:port uuid="8eb6e856-e081-4dd7-b047-d48fd42c12f3">
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.1.237" ipVersion="4"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:         </nova:port>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:         <nova:port uuid="ee97d14e-f88b-4516-a3a7-c7e4f7ae6483">
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.1.82" ipVersion="4"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:         </nova:port>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:         <nova:port uuid="ea9f7c06-6d37-45ce-b730-7abdf1004095">
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.1.183" ipVersion="4"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:         </nova:port>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:         <nova:port uuid="232f9df8-2737-4ab4-9028-7ba9060284c4">
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:         </nova:port>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:         <nova:port uuid="43668618-5b61-4949-9f06-e291b8f68cce">
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:         </nova:port>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:   </metadata>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     <system>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <entry name="serial">9d7f874a-9bd5-4e26-abda-5978493313cf</entry>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <entry name="uuid">9d7f874a-9bd5-4e26-abda-5978493313cf</entry>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     </system>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:   <os>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:   </os>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:   <features>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     <acpi/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     <tcg>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     </tcg>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:   </features>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:   <devices>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/9d7f874a-9bd5-4e26-abda-5978493313cf/disk.config"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     </disk>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <alias name="ua-a7a0275e-e153-4b68-b49f-8ca9266df098"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-0"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <serial>a7a0275e-e153-4b68-b49f-8ca9266df098</serial>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     </disk>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <alias name="ua-143fa2be-a5e9-4162-804b-8146030f3bce"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-3"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <serial>143fa2be-a5e9-4162-804b-8146030f3bce</serial>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     </disk>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <alias name="ua-54210675-051f-4f9e-83c6-97577ccdf884"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-4"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <target dev="vdc" bus="virtio"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <serial>54210675-051f-4f9e-83c6-97577ccdf884</serial>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     </disk>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:a2:ac:a1"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <target dev="tap97517937-1a"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     </interface>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:05:ba:8e"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <target dev="tap61af54f4-c2"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     </interface>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:14:b7:15"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <target dev="tap8eb6e856-e0"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     </interface>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:67:4c:bd"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <target dev="tapee97d14e-f8"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     </interface>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:31:f3:63"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <target dev="tapea9f7c06-6d"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     </interface>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:fe:12:c6"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <target dev="tap232f9df8-27"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     </interface>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:4c:71:ca"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <target dev="tap43668618-5b"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     </interface>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/9d7f874a-9bd5-4e26-abda-5978493313cf/console.log" append="off"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     </serial>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     <video>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     </video>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     </rng>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:     </memballoon>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:   </devices>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]: </domain>
May 28 00:57:56.425425 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 00:57:56.432046 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Preparing to wait for external event network-vif-plugged-97517937-1acb-4d47-93fb-fd89085e4f62 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 00:57:56.432046 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:56.432046 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:56.432046 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:56.432046 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Preparing to wait for external event network-vif-plugged-61af54f4-c2a8-49db-8074-3f601131d7e3 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 00:57:56.432046 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:56.432046 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:56.432046 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:56.432046 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Preparing to wait for external event network-vif-plugged-8eb6e856-e081-4dd7-b047-d48fd42c12f3 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 00:57:56.432046 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:56.432046 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:56.432046 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:56.432046 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Preparing to wait for external event network-vif-plugged-ee97d14e-f88b-4516-a3a7-c7e4f7ae6483 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 00:57:56.432046 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:56.432046 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:56.432046 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:56.432046 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Preparing to wait for external event network-vif-plugged-ea9f7c06-6d37-45ce-b730-7abdf1004095 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 00:57:56.432046 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:56.432046 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:56.432046 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:56.432046 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Preparing to wait for external event network-vif-plugged-232f9df8-2737-4ab4-9028-7ba9060284c4 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 00:57:56.432046 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:56.432046 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:56.432046 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:56.432046 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Preparing to wait for external event network-vif-plugged-43668618-5b61-4949-9f06-e291b8f68cce {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 00:57:56.432046 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:56.432046 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:56.432046 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:56.432852 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872562561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1872562561',id=6,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPFecLIkLO5JTpGTObnYg1RtXOmtHpmcbB2B5euCdvCluRUc/DGskJJ3Y7sH4gsT6zfiT27zUbmA54IyG2Y0IducAkauw44DZU+1vJGF6ABjE9kQDlfmB7D3IJLj/JxnQ==',key_name='tempest-keypair-1485494395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b9278238dfa4e86ad7904a4a76caf6b',ramdisk_id='',reservation_id='r-t45dlllu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1598854432',owner_user_name='tempest-TaggedBootDevicesTest-1598854432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:57:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c58dcd3aae234c4dbc1260fbeb278f90',uuid=9d7f874a-9bd5-4e26-abda-5978493313cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97517937-1acb-4d47-93fb-fd89085e4f62", "address": "fa:16:3e:a2:ac:a1", "network": {"id": "f6da0cc2-457d-4d21-9646-f2139a582801", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1600296736-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap97517937-1a", "ovs_interfaceid": "97517937-1acb-4d47-93fb-fd89085e4f62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 00:57:56.432852 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converting VIF {"id": "97517937-1acb-4d47-93fb-fd89085e4f62", "address": "fa:16:3e:a2:ac:a1", "network": {"id": "f6da0cc2-457d-4d21-9646-f2139a582801", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1600296736-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap97517937-1a", "ovs_interfaceid": "97517937-1acb-4d47-93fb-fd89085e4f62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:57:56.432852 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:ac:a1,bridge_name='br-int',has_traffic_filtering=True,id=97517937-1acb-4d47-93fb-fd89085e4f62,network=Network(f6da0cc2-457d-4d21-9646-f2139a582801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97517937-1a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:57:56.432852 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:ac:a1,bridge_name='br-int',has_traffic_filtering=True,id=97517937-1acb-4d47-93fb-fd89085e4f62,network=Network(f6da0cc2-457d-4d21-9646-f2139a582801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97517937-1a') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 00:57:56.434559 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.434559 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.434559 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 00:57:56.434559 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.434559 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5fa12b95-da43-5d65-9fce-38337276c7fc', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.446821 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.447682 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:57:56.449766 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.449906 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97517937-1a, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.450180 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap97517937-1a, col_values=(('qos', UUID('e3a17967-8710-4049-8df1-f92e60cab612')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.450314 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap97517937-1a, col_values=(('external_ids', {'iface-id': '97517937-1acb-4d47-93fb-fd89085e4f62', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:ac:a1', 'vm-uuid': '9d7f874a-9bd5-4e26-abda-5978493313cf'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.450965 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.451913 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:57:56.457713 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.458366 np0000001577 nova-compute[98319]: INFO os_vif [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:ac:a1,bridge_name='br-int',has_traffic_filtering=True,id=97517937-1acb-4d47-93fb-fd89085e4f62,network=Network(f6da0cc2-457d-4d21-9646-f2139a582801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97517937-1a')
May 28 00:57:56.459000 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872562561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1872562561',id=6,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPFecLIkLO5JTpGTObnYg1RtXOmtHpmcbB2B5euCdvCluRUc/DGskJJ3Y7sH4gsT6zfiT27zUbmA54IyG2Y0IducAkauw44DZU+1vJGF6ABjE9kQDlfmB7D3IJLj/JxnQ==',key_name='tempest-keypair-1485494395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b9278238dfa4e86ad7904a4a76caf6b',ramdisk_id='',reservation_id='r-t45dlllu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1598854432',owner_user_name='tempest-TaggedBootDevicesTest-1598854432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:57:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c58dcd3aae234c4dbc1260fbeb278f90',uuid=9d7f874a-9bd5-4e26-abda-5978493313cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61af54f4-c2a8-49db-8074-3f601131d7e3", "address": "fa:16:3e:05:ba:8e", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61af54f4-c2", "ovs_interfaceid": "61af54f4-c2a8-49db-8074-3f601131d7e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 00:57:56.459169 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converting VIF {"id": "61af54f4-c2a8-49db-8074-3f601131d7e3", "address": "fa:16:3e:05:ba:8e", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61af54f4-c2", "ovs_interfaceid": "61af54f4-c2a8-49db-8074-3f601131d7e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:57:56.459543 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:ba:8e,bridge_name='br-int',has_traffic_filtering=True,id=61af54f4-c2a8-49db-8074-3f601131d7e3,network=Network(5240346f-576d-4813-ae69-2c6157a9a77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap61af54f4-c2') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:57:56.459760 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:ba:8e,bridge_name='br-int',has_traffic_filtering=True,id=61af54f4-c2a8-49db-8074-3f601131d7e3,network=Network(5240346f-576d-4813-ae69-2c6157a9a77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap61af54f4-c2') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 00:57:56.459901 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.460027 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.460171 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 00:57:56.460638 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.460748 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '653f9299-3feb-5cb8-b617-4b40becbbbb8', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.461229 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.461793 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:57:56.467635 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.469290 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.469408 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61af54f4-c2, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.469701 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap61af54f4-c2, col_values=(('qos', UUID('e8aaeb24-1674-4008-ad81-89c8595e5f10')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.469862 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap61af54f4-c2, col_values=(('external_ids', {'iface-id': '61af54f4-c2a8-49db-8074-3f601131d7e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:ba:8e', 'vm-uuid': '9d7f874a-9bd5-4e26-abda-5978493313cf'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.470496 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.471491 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:57:56.484039 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.484786 np0000001577 nova-compute[98319]: INFO os_vif [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:ba:8e,bridge_name='br-int',has_traffic_filtering=True,id=61af54f4-c2a8-49db-8074-3f601131d7e3,network=Network(5240346f-576d-4813-ae69-2c6157a9a77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap61af54f4-c2')
May 28 00:57:56.485538 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872562561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1872562561',id=6,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPFecLIkLO5JTpGTObnYg1RtXOmtHpmcbB2B5euCdvCluRUc/DGskJJ3Y7sH4gsT6zfiT27zUbmA54IyG2Y0IducAkauw44DZU+1vJGF6ABjE9kQDlfmB7D3IJLj/JxnQ==',key_name='tempest-keypair-1485494395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b9278238dfa4e86ad7904a4a76caf6b',ramdisk_id='',reservation_id='r-t45dlllu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1598854432',owner_user_name='tempest-TaggedBootDevicesTest-1598854432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:57:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c58dcd3aae234c4dbc1260fbeb278f90',uuid=9d7f874a-9bd5-4e26-abda-5978493313cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8eb6e856-e081-4dd7-b047-d48fd42c12f3", "address": "fa:16:3e:14:b7:15", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb6e856-e0", "ovs_interfaceid": "8eb6e856-e081-4dd7-b047-d48fd42c12f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 00:57:56.485757 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converting VIF {"id": "8eb6e856-e081-4dd7-b047-d48fd42c12f3", "address": "fa:16:3e:14:b7:15", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb6e856-e0", "ovs_interfaceid": "8eb6e856-e081-4dd7-b047-d48fd42c12f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:57:56.486254 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:b7:15,bridge_name='br-int',has_traffic_filtering=True,id=8eb6e856-e081-4dd7-b047-d48fd42c12f3,network=Network(5240346f-576d-4813-ae69-2c6157a9a77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8eb6e856-e0') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:57:56.486500 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:b7:15,bridge_name='br-int',has_traffic_filtering=True,id=8eb6e856-e081-4dd7-b047-d48fd42c12f3,network=Network(5240346f-576d-4813-ae69-2c6157a9a77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8eb6e856-e0') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 00:57:56.486737 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.486955 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.487108 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 00:57:56.487789 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.487974 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '55823a48-fc3a-55bd-8458-247bcadef5c1', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.488755 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Took 1.40 seconds to deallocate network for instance.
May 28 00:57:56.489628 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:57:56.499347 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.504737 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.504948 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8eb6e856-e0, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.505308 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8eb6e856-e0, col_values=(('qos', UUID('754f34d2-b7be-4bff-a5ce-af77cd9907d7')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.505469 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8eb6e856-e0, col_values=(('external_ids', {'iface-id': '8eb6e856-e081-4dd7-b047-d48fd42c12f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:b7:15', 'vm-uuid': '9d7f874a-9bd5-4e26-abda-5978493313cf'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.506963 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.508190 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:57:56.527331 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.528477 np0000001577 nova-compute[98319]: INFO os_vif [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:b7:15,bridge_name='br-int',has_traffic_filtering=True,id=8eb6e856-e081-4dd7-b047-d48fd42c12f3,network=Network(5240346f-576d-4813-ae69-2c6157a9a77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8eb6e856-e0')
May 28 00:57:56.529317 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872562561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1872562561',id=6,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPFecLIkLO5JTpGTObnYg1RtXOmtHpmcbB2B5euCdvCluRUc/DGskJJ3Y7sH4gsT6zfiT27zUbmA54IyG2Y0IducAkauw44DZU+1vJGF6ABjE9kQDlfmB7D3IJLj/JxnQ==',key_name='tempest-keypair-1485494395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b9278238dfa4e86ad7904a4a76caf6b',ramdisk_id='',reservation_id='r-t45dlllu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1598854432',owner_user_name='tempest-TaggedBootDevicesTest-1598854432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:57:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c58dcd3aae234c4dbc1260fbeb278f90',uuid=9d7f874a-9bd5-4e26-abda-5978493313cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee97d14e-f88b-4516-a3a7-c7e4f7ae6483", "address": "fa:16:3e:67:4c:bd", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee97d14e-f8", "ovs_interfaceid": "ee97d14e-f88b-4516-a3a7-c7e4f7ae6483", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 00:57:56.529512 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converting VIF {"id": "ee97d14e-f88b-4516-a3a7-c7e4f7ae6483", "address": "fa:16:3e:67:4c:bd", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee97d14e-f8", "ovs_interfaceid": "ee97d14e-f88b-4516-a3a7-c7e4f7ae6483", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:57:56.530098 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:4c:bd,bridge_name='br-int',has_traffic_filtering=True,id=ee97d14e-f88b-4516-a3a7-c7e4f7ae6483,network=Network(5240346f-576d-4813-ae69-2c6157a9a77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee97d14e-f8') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:57:56.530666 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:4c:bd,bridge_name='br-int',has_traffic_filtering=True,id=ee97d14e-f88b-4516-a3a7-c7e4f7ae6483,network=Network(5240346f-576d-4813-ae69-2c6157a9a77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee97d14e-f8') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 00:57:56.530904 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.531055 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.531233 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 00:57:56.531991 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.532670 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c76b7fae-021c-5b73-8830-690e12a54de5', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.532977 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.533781 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:57:56.553915 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.556372 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.556525 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee97d14e-f8, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.556826 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapee97d14e-f8, col_values=(('qos', UUID('e9056b02-5740-4c27-aa41-0a47a7ed4238')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.556933 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapee97d14e-f8, col_values=(('external_ids', {'iface-id': 'ee97d14e-f88b-4516-a3a7-c7e4f7ae6483', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:4c:bd', 'vm-uuid': '9d7f874a-9bd5-4e26-abda-5978493313cf'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.559277 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.560926 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:57:56.578799 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.580443 np0000001577 nova-compute[98319]: INFO os_vif [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:4c:bd,bridge_name='br-int',has_traffic_filtering=True,id=ee97d14e-f88b-4516-a3a7-c7e4f7ae6483,network=Network(5240346f-576d-4813-ae69-2c6157a9a77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee97d14e-f8')
May 28 00:57:56.581267 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872562561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1872562561',id=6,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPFecLIkLO5JTpGTObnYg1RtXOmtHpmcbB2B5euCdvCluRUc/DGskJJ3Y7sH4gsT6zfiT27zUbmA54IyG2Y0IducAkauw44DZU+1vJGF6ABjE9kQDlfmB7D3IJLj/JxnQ==',key_name='tempest-keypair-1485494395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b9278238dfa4e86ad7904a4a76caf6b',ramdisk_id='',reservation_id='r-t45dlllu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1598854432',owner_user_name='tempest-TaggedBootDevicesTest-1598854432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:57:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c58dcd3aae234c4dbc1260fbeb278f90',uuid=9d7f874a-9bd5-4e26-abda-5978493313cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea9f7c06-6d37-45ce-b730-7abdf1004095", "address": "fa:16:3e:31:f3:63", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9f7c06-6d", "ovs_interfaceid": "ea9f7c06-6d37-45ce-b730-7abdf1004095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 00:57:56.584535 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converting VIF {"id": "ea9f7c06-6d37-45ce-b730-7abdf1004095", "address": "fa:16:3e:31:f3:63", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9f7c06-6d", "ovs_interfaceid": "ea9f7c06-6d37-45ce-b730-7abdf1004095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:57:56.584535 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:f3:63,bridge_name='br-int',has_traffic_filtering=True,id=ea9f7c06-6d37-45ce-b730-7abdf1004095,network=Network(5240346f-576d-4813-ae69-2c6157a9a77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea9f7c06-6d') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:57:56.584535 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:f3:63,bridge_name='br-int',has_traffic_filtering=True,id=ea9f7c06-6d37-45ce-b730-7abdf1004095,network=Network(5240346f-576d-4813-ae69-2c6157a9a77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea9f7c06-6d') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 00:57:56.584535 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.584535 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.584535 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 00:57:56.584535 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.584535 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b5bc9cac-6ac4-54cc-925f-d267b2af9a29', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.585762 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.586729 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:57:56.607512 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.612195 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.612859 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea9f7c06-6d, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.612859 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea9f7c06-6d, col_values=(('qos', UUID('0cecbaf1-5a91-44a1-a8d1-2f3ddb6334c0')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.612973 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea9f7c06-6d, col_values=(('external_ids', {'iface-id': 'ea9f7c06-6d37-45ce-b730-7abdf1004095', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:f3:63', 'vm-uuid': '9d7f874a-9bd5-4e26-abda-5978493313cf'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.613920 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.617910 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:57:56.640677 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.641268 np0000001577 nova-compute[98319]: INFO os_vif [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:f3:63,bridge_name='br-int',has_traffic_filtering=True,id=ea9f7c06-6d37-45ce-b730-7abdf1004095,network=Network(5240346f-576d-4813-ae69-2c6157a9a77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea9f7c06-6d')
May 28 00:57:56.642012 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872562561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1872562561',id=6,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPFecLIkLO5JTpGTObnYg1RtXOmtHpmcbB2B5euCdvCluRUc/DGskJJ3Y7sH4gsT6zfiT27zUbmA54IyG2Y0IducAkauw44DZU+1vJGF6ABjE9kQDlfmB7D3IJLj/JxnQ==',key_name='tempest-keypair-1485494395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b9278238dfa4e86ad7904a4a76caf6b',ramdisk_id='',reservation_id='r-t45dlllu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1598854432',owner_user_name='tempest-TaggedBootDevicesTest-1598854432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:57:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c58dcd3aae234c4dbc1260fbeb278f90',uuid=9d7f874a-9bd5-4e26-abda-5978493313cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "232f9df8-2737-4ab4-9028-7ba9060284c4", "address": "fa:16:3e:fe:12:c6", "network": {"id": "d07566c3-0394-4dc6-ad3c-0d4f13f7703d", "bridge": "br-int", "label": "tempest-device-tagging-net2-2113905332", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap232f9df8-27", "ovs_interfaceid": "232f9df8-2737-4ab4-9028-7ba9060284c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 00:57:56.642158 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converting VIF {"id": "232f9df8-2737-4ab4-9028-7ba9060284c4", "address": "fa:16:3e:fe:12:c6", "network": {"id": "d07566c3-0394-4dc6-ad3c-0d4f13f7703d", "bridge": "br-int", "label": "tempest-device-tagging-net2-2113905332", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap232f9df8-27", "ovs_interfaceid": "232f9df8-2737-4ab4-9028-7ba9060284c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:57:56.642560 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:12:c6,bridge_name='br-int',has_traffic_filtering=True,id=232f9df8-2737-4ab4-9028-7ba9060284c4,network=Network(d07566c3-0394-4dc6-ad3c-0d4f13f7703d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap232f9df8-27') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:57:56.642928 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:12:c6,bridge_name='br-int',has_traffic_filtering=True,id=232f9df8-2737-4ab4-9028-7ba9060284c4,network=Network(d07566c3-0394-4dc6-ad3c-0d4f13f7703d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap232f9df8-27') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 00:57:56.643153 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.643329 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.643427 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 00:57:56.644073 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.644184 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6b1127c5-65e9-56d0-8a29-a6bf5e7a279b', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.645965 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.645965 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:57:56.669161 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.671702 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.671802 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap232f9df8-27, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.672066 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap232f9df8-27, col_values=(('qos', UUID('9ca3938f-a768-4afd-8277-e37f16609ec8')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.672188 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap232f9df8-27, col_values=(('external_ids', {'iface-id': '232f9df8-2737-4ab4-9028-7ba9060284c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:12:c6', 'vm-uuid': '9d7f874a-9bd5-4e26-abda-5978493313cf'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.673024 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.673905 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:57:56.702935 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.703018 np0000001577 nova-compute[98319]: INFO os_vif [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:12:c6,bridge_name='br-int',has_traffic_filtering=True,id=232f9df8-2737-4ab4-9028-7ba9060284c4,network=Network(d07566c3-0394-4dc6-ad3c-0d4f13f7703d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap232f9df8-27')
May 28 00:57:56.703577 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872562561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1872562561',id=6,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPFecLIkLO5JTpGTObnYg1RtXOmtHpmcbB2B5euCdvCluRUc/DGskJJ3Y7sH4gsT6zfiT27zUbmA54IyG2Y0IducAkauw44DZU+1vJGF6ABjE9kQDlfmB7D3IJLj/JxnQ==',key_name='tempest-keypair-1485494395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b9278238dfa4e86ad7904a4a76caf6b',ramdisk_id='',reservation_id='r-t45dlllu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1598854432',owner_user_name='tempest-TaggedBootDevicesTest-1598854432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:57:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c58dcd3aae234c4dbc1260fbeb278f90',uuid=9d7f874a-9bd5-4e26-abda-5978493313cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43668618-5b61-4949-9f06-e291b8f68cce", "address": "fa:16:3e:4c:71:ca", "network": {"id": "d07566c3-0394-4dc6-ad3c-0d4f13f7703d", "bridge": "br-int", "label": "tempest-device-tagging-net2-2113905332", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43668618-5b", "ovs_interfaceid": "43668618-5b61-4949-9f06-e291b8f68cce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 00:57:56.703756 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converting VIF {"id": "43668618-5b61-4949-9f06-e291b8f68cce", "address": "fa:16:3e:4c:71:ca", "network": {"id": "d07566c3-0394-4dc6-ad3c-0d4f13f7703d", "bridge": "br-int", "label": "tempest-device-tagging-net2-2113905332", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43668618-5b", "ovs_interfaceid": "43668618-5b61-4949-9f06-e291b8f68cce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:57:56.704130 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:71:ca,bridge_name='br-int',has_traffic_filtering=True,id=43668618-5b61-4949-9f06-e291b8f68cce,network=Network(d07566c3-0394-4dc6-ad3c-0d4f13f7703d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43668618-5b') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:57:56.704301 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:71:ca,bridge_name='br-int',has_traffic_filtering=True,id=43668618-5b61-4949-9f06-e291b8f68cce,network=Network(d07566c3-0394-4dc6-ad3c-0d4f13f7703d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43668618-5b') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 00:57:56.704479 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.704711 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.704828 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 00:57:56.705479 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.705638 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '307422a8-7711-5f93-a362-8548dd1b22fb', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.706288 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.706812 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:57:56.734605 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.736401 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.736612 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43668618-5b, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.736867 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap43668618-5b, col_values=(('qos', UUID('7f22ec5f-ce1b-4a38-a169-b4890f512917')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.737006 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap43668618-5b, col_values=(('external_ids', {'iface-id': '43668618-5b61-4949-9f06-e291b8f68cce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:71:ca', 'vm-uuid': '9d7f874a-9bd5-4e26-abda-5978493313cf'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:57:56.737929 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.739350 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:57:56.771143 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:56.771989 np0000001577 nova-compute[98319]: INFO os_vif [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:71:ca,bridge_name='br-int',has_traffic_filtering=True,id=43668618-5b61-4949-9f06-e291b8f68cce,network=Network(d07566c3-0394-4dc6-ad3c-0d4f13f7703d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43668618-5b')
May 28 00:57:57.004792 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8153c1fd-f685-4351-8b23-e6d390e561d1 tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:57.004951 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8153c1fd-f685-4351-8b23-e6d390e561d1 tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:57.325503 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8153c1fd-f685-4351-8b23-e6d390e561d1 tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:57:57.325704 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-8153c1fd-f685-4351-8b23-e6d390e561d1 tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:57:57.830728 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-8153c1fd-f685-4351-8b23-e6d390e561d1 tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:57:58.290098 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:57:58.290328 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:57:58.290448 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] No VIF found with MAC fa:16:3e:a2:ac:a1, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 00:57:58.290740 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] No VIF found with MAC fa:16:3e:31:f3:63, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 00:57:58.291192 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Using config drive
May 28 00:57:58.334111 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8153c1fd-f685-4351-8b23-e6d390e561d1 tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.329s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:58.376998 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-8153c1fd-f685-4351-8b23-e6d390e561d1 tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Deleted allocations for instance 6942ebd1-823e-499a-a819-0f0125eb9fad
May 28 00:57:58.800275 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:57:58.946396 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Creating config drive at /opt/stack/data/nova/instances/9d7f874a-9bd5-4e26-abda-5978493313cf/disk.config
May 28 00:57:58.951254 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9d7f874a-9bd5-4e26-abda-5978493313cf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_br25eur {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:57:58.985776 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9d7f874a-9bd5-4e26-abda-5978493313cf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_br25eur" returned: 0 in 0.034s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:57:59.387095 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8153c1fd-f685-4351-8b23-e6d390e561d1 tempest-VolumesAdminNegativeTest-1882149120 tempest-VolumesAdminNegativeTest-1882149120-project-member] Lock "6942ebd1-823e-499a-a819-0f0125eb9fad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.192s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:59.471622 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:59.534813 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:59.535902 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:59.581583 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:59.608846 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:59.695934 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:59.722616 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:59.747765 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-947ad395-e406-4bc0-a148-6f446c111abc req-e5e2e916-2375-489d-b4aa-42d66762bead service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-plugged-97517937-1acb-4d47-93fb-fd89085e4f62 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:57:59.752456 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-947ad395-e406-4bc0-a148-6f446c111abc req-e5e2e916-2375-489d-b4aa-42d66762bead service nova] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:57:59.752456 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-947ad395-e406-4bc0-a148-6f446c111abc req-e5e2e916-2375-489d-b4aa-42d66762bead service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:57:59.752456 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-947ad395-e406-4bc0-a148-6f446c111abc req-e5e2e916-2375-489d-b4aa-42d66762bead service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:57:59.752456 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-947ad395-e406-4bc0-a148-6f446c111abc req-e5e2e916-2375-489d-b4aa-42d66762bead service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Processing event network-vif-plugged-97517937-1acb-4d47-93fb-fd89085e4f62 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 00:57:59.755416 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:59.763036 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:59.781249 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:59.817444 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:59.821826 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:59.863221 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:59.871588 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:59.904115 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:59.923178 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:59.961280 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:57:59.978451 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:00.003316 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a2cd221c-fe67-469e-98c2-54a1e951bb38 req-b7395e6f-fdef-4a81-87c4-0780c8eb98c8 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-plugged-61af54f4-c2a8-49db-8074-3f601131d7e3 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:00.003470 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a2cd221c-fe67-469e-98c2-54a1e951bb38 req-b7395e6f-fdef-4a81-87c4-0780c8eb98c8 service nova] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:00.003640 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a2cd221c-fe67-469e-98c2-54a1e951bb38 req-b7395e6f-fdef-4a81-87c4-0780c8eb98c8 service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:00.003760 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a2cd221c-fe67-469e-98c2-54a1e951bb38 req-b7395e6f-fdef-4a81-87c4-0780c8eb98c8 service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:00.009661 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:00.009766 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a2cd221c-fe67-469e-98c2-54a1e951bb38 req-b7395e6f-fdef-4a81-87c4-0780c8eb98c8 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Processing event network-vif-plugged-61af54f4-c2a8-49db-8074-3f601131d7e3 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 00:58:00.100672 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9f98ded2-1016-4745-bed8-54bef71c99af req-78738818-6bf6-4d16-95de-af9edef5ff7f service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-plugged-8eb6e856-e081-4dd7-b047-d48fd42c12f3 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:00.101231 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9f98ded2-1016-4745-bed8-54bef71c99af req-78738818-6bf6-4d16-95de-af9edef5ff7f service nova] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:00.101448 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9f98ded2-1016-4745-bed8-54bef71c99af req-78738818-6bf6-4d16-95de-af9edef5ff7f service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:00.101718 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9f98ded2-1016-4745-bed8-54bef71c99af req-78738818-6bf6-4d16-95de-af9edef5ff7f service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:00.101944 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9f98ded2-1016-4745-bed8-54bef71c99af req-78738818-6bf6-4d16-95de-af9edef5ff7f service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Processing event network-vif-plugged-8eb6e856-e081-4dd7-b047-d48fd42c12f3 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 00:58:00.109704 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:00.180685 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:00.185284 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:00.193663 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:00.267944 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:00.275005 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:00.308786 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:00.413659 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:00.495193 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:00.498931 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:00.504132 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:00.531487 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:00.536040 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:00.814963 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:00.872493 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:00.872576 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:01.033126 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:01.034071 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:01.176486 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:01.177540 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:01.437213 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929881.4368625, 9d7f874a-9bd5-4e26-abda-5978493313cf => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:58:01.437339 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] VM Started (Lifecycle Event)
May 28 00:58:01.479647 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:01.482236 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:01.485959 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:01.508604 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:01.737248 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:01.739798 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:01.805729 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-dc7af553-eec1-4d41-8786-9577e1f22176 req-c8e98c57-588a-4a59-b39b-f46d99f9340e service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-plugged-97517937-1acb-4d47-93fb-fd89085e4f62 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:01.806189 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dc7af553-eec1-4d41-8786-9577e1f22176 req-c8e98c57-588a-4a59-b39b-f46d99f9340e service nova] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:01.806376 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dc7af553-eec1-4d41-8786-9577e1f22176 req-c8e98c57-588a-4a59-b39b-f46d99f9340e service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:01.806446 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dc7af553-eec1-4d41-8786-9577e1f22176 req-c8e98c57-588a-4a59-b39b-f46d99f9340e service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:01.806609 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-dc7af553-eec1-4d41-8786-9577e1f22176 req-c8e98c57-588a-4a59-b39b-f46d99f9340e service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] No event matching network-vif-plugged-97517937-1acb-4d47-93fb-fd89085e4f62 in dict_keys([('network-vif-plugged', 'ee97d14e-f88b-4516-a3a7-c7e4f7ae6483'), ('network-vif-plugged', 'ea9f7c06-6d37-45ce-b730-7abdf1004095'), ('network-vif-plugged', '232f9df8-2737-4ab4-9028-7ba9060284c4'), ('network-vif-plugged', '43668618-5b61-4949-9f06-e291b8f68cce')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 00:58:01.806728 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-dc7af553-eec1-4d41-8786-9577e1f22176 req-c8e98c57-588a-4a59-b39b-f46d99f9340e service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received unexpected event network-vif-plugged-97517937-1acb-4d47-93fb-fd89085e4f62 for instance with vm_state building and task_state spawning.
May 28 00:58:01.806990 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-dc7af553-eec1-4d41-8786-9577e1f22176 req-c8e98c57-588a-4a59-b39b-f46d99f9340e service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-plugged-43668618-5b61-4949-9f06-e291b8f68cce {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:01.807223 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dc7af553-eec1-4d41-8786-9577e1f22176 req-c8e98c57-588a-4a59-b39b-f46d99f9340e service nova] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:01.807408 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dc7af553-eec1-4d41-8786-9577e1f22176 req-c8e98c57-588a-4a59-b39b-f46d99f9340e service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:01.807584 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dc7af553-eec1-4d41-8786-9577e1f22176 req-c8e98c57-588a-4a59-b39b-f46d99f9340e service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:01.807705 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-dc7af553-eec1-4d41-8786-9577e1f22176 req-c8e98c57-588a-4a59-b39b-f46d99f9340e service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Processing event network-vif-plugged-43668618-5b61-4949-9f06-e291b8f68cce {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 00:58:01.807816 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-dc7af553-eec1-4d41-8786-9577e1f22176 req-c8e98c57-588a-4a59-b39b-f46d99f9340e service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-plugged-43668618-5b61-4949-9f06-e291b8f68cce {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:01.807921 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dc7af553-eec1-4d41-8786-9577e1f22176 req-c8e98c57-588a-4a59-b39b-f46d99f9340e service nova] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:01.808034 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dc7af553-eec1-4d41-8786-9577e1f22176 req-c8e98c57-588a-4a59-b39b-f46d99f9340e service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:01.808192 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dc7af553-eec1-4d41-8786-9577e1f22176 req-c8e98c57-588a-4a59-b39b-f46d99f9340e service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:01.808384 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-dc7af553-eec1-4d41-8786-9577e1f22176 req-c8e98c57-588a-4a59-b39b-f46d99f9340e service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] No event matching network-vif-plugged-43668618-5b61-4949-9f06-e291b8f68cce in dict_keys([('network-vif-plugged', 'ee97d14e-f88b-4516-a3a7-c7e4f7ae6483'), ('network-vif-plugged', 'ea9f7c06-6d37-45ce-b730-7abdf1004095'), ('network-vif-plugged', '232f9df8-2737-4ab4-9028-7ba9060284c4')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 00:58:01.808601 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-dc7af553-eec1-4d41-8786-9577e1f22176 req-c8e98c57-588a-4a59-b39b-f46d99f9340e service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received unexpected event network-vif-plugged-43668618-5b61-4949-9f06-e291b8f68cce for instance with vm_state building and task_state spawning.
May 28 00:58:01.939803 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:58:01.941190 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929881.9409273, 9d7f874a-9bd5-4e26-abda-5978493313cf => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:58:01.941303 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] VM Paused (Lifecycle Event)
May 28 00:58:02.103596 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-fa6c12a3-16b2-4962-a9a0-085534c938f0 req-8fe718f2-1dcf-45f5-85bc-3f3fc618d3b9 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-plugged-61af54f4-c2a8-49db-8074-3f601131d7e3 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:02.103596 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fa6c12a3-16b2-4962-a9a0-085534c938f0 req-8fe718f2-1dcf-45f5-85bc-3f3fc618d3b9 service nova] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:02.103596 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fa6c12a3-16b2-4962-a9a0-085534c938f0 req-8fe718f2-1dcf-45f5-85bc-3f3fc618d3b9 service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:02.103596 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fa6c12a3-16b2-4962-a9a0-085534c938f0 req-8fe718f2-1dcf-45f5-85bc-3f3fc618d3b9 service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:02.103596 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-fa6c12a3-16b2-4962-a9a0-085534c938f0 req-8fe718f2-1dcf-45f5-85bc-3f3fc618d3b9 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] No event matching network-vif-plugged-61af54f4-c2a8-49db-8074-3f601131d7e3 in dict_keys([('network-vif-plugged', 'ee97d14e-f88b-4516-a3a7-c7e4f7ae6483'), ('network-vif-plugged', 'ea9f7c06-6d37-45ce-b730-7abdf1004095'), ('network-vif-plugged', '232f9df8-2737-4ab4-9028-7ba9060284c4')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 00:58:02.103596 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-fa6c12a3-16b2-4962-a9a0-085534c938f0 req-8fe718f2-1dcf-45f5-85bc-3f3fc618d3b9 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received unexpected event network-vif-plugged-61af54f4-c2a8-49db-8074-3f601131d7e3 for instance with vm_state building and task_state spawning.
May 28 00:58:02.103596 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-fa6c12a3-16b2-4962-a9a0-085534c938f0 req-8fe718f2-1dcf-45f5-85bc-3f3fc618d3b9 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-plugged-ee97d14e-f88b-4516-a3a7-c7e4f7ae6483 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:02.103596 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fa6c12a3-16b2-4962-a9a0-085534c938f0 req-8fe718f2-1dcf-45f5-85bc-3f3fc618d3b9 service nova] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:02.104739 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fa6c12a3-16b2-4962-a9a0-085534c938f0 req-8fe718f2-1dcf-45f5-85bc-3f3fc618d3b9 service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:02.104739 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fa6c12a3-16b2-4962-a9a0-085534c938f0 req-8fe718f2-1dcf-45f5-85bc-3f3fc618d3b9 service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:02.104739 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-fa6c12a3-16b2-4962-a9a0-085534c938f0 req-8fe718f2-1dcf-45f5-85bc-3f3fc618d3b9 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Processing event network-vif-plugged-ee97d14e-f88b-4516-a3a7-c7e4f7ae6483 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 00:58:02.104739 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-fa6c12a3-16b2-4962-a9a0-085534c938f0 req-8fe718f2-1dcf-45f5-85bc-3f3fc618d3b9 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-plugged-ee97d14e-f88b-4516-a3a7-c7e4f7ae6483 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:02.104739 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fa6c12a3-16b2-4962-a9a0-085534c938f0 req-8fe718f2-1dcf-45f5-85bc-3f3fc618d3b9 service nova] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:02.104898 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fa6c12a3-16b2-4962-a9a0-085534c938f0 req-8fe718f2-1dcf-45f5-85bc-3f3fc618d3b9 service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:02.104898 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fa6c12a3-16b2-4962-a9a0-085534c938f0 req-8fe718f2-1dcf-45f5-85bc-3f3fc618d3b9 service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:02.105206 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-fa6c12a3-16b2-4962-a9a0-085534c938f0 req-8fe718f2-1dcf-45f5-85bc-3f3fc618d3b9 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] No event matching network-vif-plugged-ee97d14e-f88b-4516-a3a7-c7e4f7ae6483 in dict_keys([('network-vif-plugged', 'ea9f7c06-6d37-45ce-b730-7abdf1004095'), ('network-vif-plugged', '232f9df8-2737-4ab4-9028-7ba9060284c4')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 00:58:02.105319 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-fa6c12a3-16b2-4962-a9a0-085534c938f0 req-8fe718f2-1dcf-45f5-85bc-3f3fc618d3b9 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received unexpected event network-vif-plugged-ee97d14e-f88b-4516-a3a7-c7e4f7ae6483 for instance with vm_state building and task_state spawning.
May 28 00:58:02.170007 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-724ec095-23a9-41b0-b904-bf810499efb5 req-18e7ec1a-e77c-4d18-a157-b5443a0aee8a service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-plugged-8eb6e856-e081-4dd7-b047-d48fd42c12f3 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:02.170700 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-724ec095-23a9-41b0-b904-bf810499efb5 req-18e7ec1a-e77c-4d18-a157-b5443a0aee8a service nova] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:02.170851 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-724ec095-23a9-41b0-b904-bf810499efb5 req-18e7ec1a-e77c-4d18-a157-b5443a0aee8a service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:02.170969 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-724ec095-23a9-41b0-b904-bf810499efb5 req-18e7ec1a-e77c-4d18-a157-b5443a0aee8a service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:02.171104 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-724ec095-23a9-41b0-b904-bf810499efb5 req-18e7ec1a-e77c-4d18-a157-b5443a0aee8a service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] No event matching network-vif-plugged-8eb6e856-e081-4dd7-b047-d48fd42c12f3 in dict_keys([('network-vif-plugged', 'ea9f7c06-6d37-45ce-b730-7abdf1004095'), ('network-vif-plugged', '232f9df8-2737-4ab4-9028-7ba9060284c4')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 00:58:02.171228 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-724ec095-23a9-41b0-b904-bf810499efb5 req-18e7ec1a-e77c-4d18-a157-b5443a0aee8a service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received unexpected event network-vif-plugged-8eb6e856-e081-4dd7-b047-d48fd42c12f3 for instance with vm_state building and task_state spawning.
May 28 00:58:02.171336 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-724ec095-23a9-41b0-b904-bf810499efb5 req-18e7ec1a-e77c-4d18-a157-b5443a0aee8a service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-plugged-ea9f7c06-6d37-45ce-b730-7abdf1004095 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:02.171459 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-724ec095-23a9-41b0-b904-bf810499efb5 req-18e7ec1a-e77c-4d18-a157-b5443a0aee8a service nova] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:02.171605 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-724ec095-23a9-41b0-b904-bf810499efb5 req-18e7ec1a-e77c-4d18-a157-b5443a0aee8a service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:02.171726 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-724ec095-23a9-41b0-b904-bf810499efb5 req-18e7ec1a-e77c-4d18-a157-b5443a0aee8a service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:02.171835 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-724ec095-23a9-41b0-b904-bf810499efb5 req-18e7ec1a-e77c-4d18-a157-b5443a0aee8a service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Processing event network-vif-plugged-ea9f7c06-6d37-45ce-b730-7abdf1004095 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 00:58:02.171969 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-724ec095-23a9-41b0-b904-bf810499efb5 req-18e7ec1a-e77c-4d18-a157-b5443a0aee8a service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-plugged-ea9f7c06-6d37-45ce-b730-7abdf1004095 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:02.172152 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-724ec095-23a9-41b0-b904-bf810499efb5 req-18e7ec1a-e77c-4d18-a157-b5443a0aee8a service nova] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:02.172274 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-724ec095-23a9-41b0-b904-bf810499efb5 req-18e7ec1a-e77c-4d18-a157-b5443a0aee8a service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:02.172970 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-724ec095-23a9-41b0-b904-bf810499efb5 req-18e7ec1a-e77c-4d18-a157-b5443a0aee8a service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:02.173095 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-724ec095-23a9-41b0-b904-bf810499efb5 req-18e7ec1a-e77c-4d18-a157-b5443a0aee8a service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] No event matching network-vif-plugged-ea9f7c06-6d37-45ce-b730-7abdf1004095 in dict_keys([('network-vif-plugged', '232f9df8-2737-4ab4-9028-7ba9060284c4')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 00:58:02.173226 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-724ec095-23a9-41b0-b904-bf810499efb5 req-18e7ec1a-e77c-4d18-a157-b5443a0aee8a service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received unexpected event network-vif-plugged-ea9f7c06-6d37-45ce-b730-7abdf1004095 for instance with vm_state building and task_state spawning.
May 28 00:58:02.173332 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-724ec095-23a9-41b0-b904-bf810499efb5 req-18e7ec1a-e77c-4d18-a157-b5443a0aee8a service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-plugged-232f9df8-2737-4ab4-9028-7ba9060284c4 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:02.173452 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-724ec095-23a9-41b0-b904-bf810499efb5 req-18e7ec1a-e77c-4d18-a157-b5443a0aee8a service nova] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:02.173604 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-724ec095-23a9-41b0-b904-bf810499efb5 req-18e7ec1a-e77c-4d18-a157-b5443a0aee8a service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:02.173793 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-724ec095-23a9-41b0-b904-bf810499efb5 req-18e7ec1a-e77c-4d18-a157-b5443a0aee8a service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:02.173856 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-724ec095-23a9-41b0-b904-bf810499efb5 req-18e7ec1a-e77c-4d18-a157-b5443a0aee8a service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Processing event network-vif-plugged-232f9df8-2737-4ab4-9028-7ba9060284c4 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 00:58:02.173995 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-724ec095-23a9-41b0-b904-bf810499efb5 req-18e7ec1a-e77c-4d18-a157-b5443a0aee8a service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-plugged-232f9df8-2737-4ab4-9028-7ba9060284c4 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:02.174111 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-724ec095-23a9-41b0-b904-bf810499efb5 req-18e7ec1a-e77c-4d18-a157-b5443a0aee8a service nova] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:02.174236 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-724ec095-23a9-41b0-b904-bf810499efb5 req-18e7ec1a-e77c-4d18-a157-b5443a0aee8a service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:02.174344 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-724ec095-23a9-41b0-b904-bf810499efb5 req-18e7ec1a-e77c-4d18-a157-b5443a0aee8a service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:02.174461 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-724ec095-23a9-41b0-b904-bf810499efb5 req-18e7ec1a-e77c-4d18-a157-b5443a0aee8a service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] No waiting events found dispatching network-vif-plugged-232f9df8-2737-4ab4-9028-7ba9060284c4 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:58:02.174605 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-724ec095-23a9-41b0-b904-bf810499efb5 req-18e7ec1a-e77c-4d18-a157-b5443a0aee8a service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received unexpected event network-vif-plugged-232f9df8-2737-4ab4-9028-7ba9060284c4 for instance with vm_state building and task_state spawning.
May 28 00:58:02.175201 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Instance event wait completed in 0 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 00:58:02.178613 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 00:58:02.180741 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Instance spawned successfully.
May 28 00:58:02.181208 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 00:58:02.219496 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:02.443884 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:58:02.445319 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929882.4451, 9d7f874a-9bd5-4e26-abda-5978493313cf => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:58:02.445438 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] VM Resumed (Lifecycle Event)
May 28 00:58:02.690416 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:58:02.690667 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:58:02.691176 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:58:02.691530 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:58:02.692005 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:58:02.692475 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:58:02.947773 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:58:02.950143 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:58:03.200288 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Took 27.59 seconds to spawn the instance on the hypervisor.
May 28 00:58:03.200920 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:58:03.455750 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 00:58:03.719292 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Took 40.32 seconds to build instance.
May 28 00:58:04.221521 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.833s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:04.599486 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:05.216563 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00390486699984649 future=<Future at 0x7c988c0c2690 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:58:05.216563 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:58:05.216563 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=3.8495631519999733 future=<Future at 0x7c988f95c2f0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:58:05.216563 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=3.849478934999979 future=<Future at 0x7c988f95c2f0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:58:05.217408 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Emitting event <LifecycleEvent: 1779929870.2123163, bd459d7f-74cf-42ac-8409-db592190cd52 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:58:05.217408 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] VM Stopped (Lifecycle Event)
May 28 00:58:05.720402 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ba84b514-e5bf-40b6-826f-17b8790e572d tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: bd459d7f-74cf-42ac-8409-db592190cd52] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:58:05.753198 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b04f425f-008e-432b-a174-7956e5a6bf7a req-891a1f96-9b58-4b8f-ba84-1cd6790d80aa service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-changed-97517937-1acb-4d47-93fb-fd89085e4f62 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:05.754786 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b04f425f-008e-432b-a174-7956e5a6bf7a req-891a1f96-9b58-4b8f-ba84-1cd6790d80aa service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Refreshing instance network info cache due to event network-changed-97517937-1acb-4d47-93fb-fd89085e4f62. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:58:05.755043 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b04f425f-008e-432b-a174-7956e5a6bf7a req-891a1f96-9b58-4b8f-ba84-1cd6790d80aa service nova] Acquiring lock "refresh_cache-9d7f874a-9bd5-4e26-abda-5978493313cf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:58:05.755202 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b04f425f-008e-432b-a174-7956e5a6bf7a req-891a1f96-9b58-4b8f-ba84-1cd6790d80aa service nova] Acquired lock "refresh_cache-9d7f874a-9bd5-4e26-abda-5978493313cf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:58:05.755490 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b04f425f-008e-432b-a174-7956e5a6bf7a req-891a1f96-9b58-4b8f-ba84-1cd6790d80aa service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Refreshing network info cache for port 97517937-1acb-4d47-93fb-fd89085e4f62 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:58:05.818928 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:06.258573 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-b04f425f-008e-432b-a174-7956e5a6bf7a req-891a1f96-9b58-4b8f-ba84-1cd6790d80aa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:06.345699 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Acquiring lock "interface-b1380963-8254-4ad0-95bb-91d24cea00f9-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:06.345836 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "interface-b1380963-8254-4ad0-95bb-91d24cea00f9-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:06.346096 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lazy-loading 'flavor' on Instance uuid b1380963-8254-4ad0-95bb-91d24cea00f9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:58:06.504626 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:06.593787 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-b04f425f-008e-432b-a174-7956e5a6bf7a req-891a1f96-9b58-4b8f-ba84-1cd6790d80aa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:06.730516 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b04f425f-008e-432b-a174-7956e5a6bf7a req-891a1f96-9b58-4b8f-ba84-1cd6790d80aa service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Updated VIF entry in instance network info cache for port 97517937-1acb-4d47-93fb-fd89085e4f62. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 00:58:06.731104 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b04f425f-008e-432b-a174-7956e5a6bf7a req-891a1f96-9b58-4b8f-ba84-1cd6790d80aa service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Updating instance_info_cache with network_info: [{"id": "97517937-1acb-4d47-93fb-fd89085e4f62", "address": "fa:16:3e:a2:ac:a1", "network": {"id": "f6da0cc2-457d-4d21-9646-f2139a582801", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1600296736-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap97517937-1a", "ovs_interfaceid": "97517937-1acb-4d47-93fb-fd89085e4f62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "61af54f4-c2a8-49db-8074-3f601131d7e3", "address": "fa:16:3e:05:ba:8e", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61af54f4-c2", "ovs_interfaceid": "61af54f4-c2a8-49db-8074-3f601131d7e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8eb6e856-e081-4dd7-b047-d48fd42c12f3", "address": "fa:16:3e:14:b7:15", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb6e856-e0", "ovs_interfaceid": "8eb6e856-e081-4dd7-b047-d48fd42c12f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ee97d14e-f88b-4516-a3a7-c7e4f7ae6483", "address": "fa:16:3e:67:4c:bd", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee97d14e-f8", "ovs_interfaceid": "ee97d14e-f88b-4516-a3a7-c7e4f7ae6483", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ea9f7c06-6d37-45ce-b730-7abdf1004095", "address": "fa:16:3e:31:f3:63", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9f7c06-6d", "ovs_interfaceid": "ea9f7c06-6d37-45ce-b730-7abdf1004095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "232f9df8-2737-4ab4-9028-7ba9060284c4", "address": "fa:16:3e:fe:12:c6", "network": {"id": "d07566c3-0394-4dc6-ad3c-0d4f13f7703d", "bridge": "br-int", "label": "tempest-device-tagging-net2-2113905332", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap232f9df8-27", "ovs_interfaceid": "232f9df8-2737-4ab4-9028-7ba9060284c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "43668618-5b61-4949-9f06-e291b8f68cce", "address": "fa:16:3e:4c:71:ca", "network": {"id": "d07566c3-0394-4dc6-ad3c-0d4f13f7703d", "bridge": "br-int", "label": "tempest-device-tagging-net2-2113905332", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43668618-5b", "ovs_interfaceid": "43668618-5b61-4949-9f06-e291b8f68cce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:58:06.739355 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:06.848637 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:07.002166 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lazy-loading 'pci_requests' on Instance uuid b1380963-8254-4ad0-95bb-91d24cea00f9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:58:07.240146 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b04f425f-008e-432b-a174-7956e5a6bf7a req-891a1f96-9b58-4b8f-ba84-1cd6790d80aa service nova] Releasing lock "refresh_cache-9d7f874a-9bd5-4e26-abda-5978493313cf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:58:07.506180 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Object Instance<b1380963-8254-4ad0-95bb-91d24cea00f9> lazy-loaded attributes: flavor,pci_requests {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 00:58:07.506320 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 00:58:07.506641 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:07.506870 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:07.614854 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b4ab7230b24d4ebf9090a752493983fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355551e9b29346059ddbe389bc51efa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 00:58:08.157320 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Successfully created port: ec4fad7e-3a01-4591-ae8f-0b8fe30d60de {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 00:58:08.753270 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:08.771963 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Successfully updated port: ec4fad7e-3a01-4591-ae8f-0b8fe30d60de {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 00:58:08.834725 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-898d1ace-5c61-45ca-adbb-88110b46a3de req-d10be7c6-b7d5-4dfb-b523-65226a5df2ef service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Received event network-changed-ec4fad7e-3a01-4591-ae8f-0b8fe30d60de {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:08.834821 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-898d1ace-5c61-45ca-adbb-88110b46a3de req-d10be7c6-b7d5-4dfb-b523-65226a5df2ef service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Refreshing instance network info cache due to event network-changed-ec4fad7e-3a01-4591-ae8f-0b8fe30d60de. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:58:08.834987 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-898d1ace-5c61-45ca-adbb-88110b46a3de req-d10be7c6-b7d5-4dfb-b523-65226a5df2ef service nova] Acquiring lock "refresh_cache-b1380963-8254-4ad0-95bb-91d24cea00f9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:58:08.835085 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-898d1ace-5c61-45ca-adbb-88110b46a3de req-d10be7c6-b7d5-4dfb-b523-65226a5df2ef service nova] Acquired lock "refresh_cache-b1380963-8254-4ad0-95bb-91d24cea00f9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:58:08.835492 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-898d1ace-5c61-45ca-adbb-88110b46a3de req-d10be7c6-b7d5-4dfb-b523-65226a5df2ef service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Refreshing network info cache for port ec4fad7e-3a01-4591-ae8f-0b8fe30d60de {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:58:09.066452 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0003520889999890642 future=<Future at 0x7c988f95c2f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:58:09.067088 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1779929874.0659828, 6942ebd1-823e-499a-a819-0f0125eb9fad => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:58:09.067823 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:58:09.067823 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] VM Stopped (Lifecycle Event)
May 28 00:58:09.225330 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:09.274988 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Acquiring lock "refresh_cache-b1380963-8254-4ad0-95bb-91d24cea00f9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:58:09.339189 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-898d1ace-5c61-45ca-adbb-88110b46a3de req-d10be7c6-b7d5-4dfb-b523-65226a5df2ef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:09.571183 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-8e2733ec-050b-4b43-bbb4-00d959490903 None None] [instance: 6942ebd1-823e-499a-a819-0f0125eb9fad] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:58:09.689899 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-898d1ace-5c61-45ca-adbb-88110b46a3de req-d10be7c6-b7d5-4dfb-b523-65226a5df2ef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:09.855724 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-898d1ace-5c61-45ca-adbb-88110b46a3de req-d10be7c6-b7d5-4dfb-b523-65226a5df2ef service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Added VIF to instance network info cache for port ec4fad7e-3a01-4591-ae8f-0b8fe30d60de. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3530}}
May 28 00:58:09.856957 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-898d1ace-5c61-45ca-adbb-88110b46a3de req-d10be7c6-b7d5-4dfb-b523-65226a5df2ef service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Updating instance_info_cache with network_info: [{"id": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "address": "fa:16:3e:3a:fe:3d", "network": {"id": "3ceee21d-d4b4-4c77-8ac9-f2338f96e022", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-960987788-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "355551e9b29346059ddbe389bc51efa8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc9c0c0-6e", "ovs_interfaceid": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec4fad7e-3a01-4591-ae8f-0b8fe30d60de", "address": "fa:16:3e:0c:39:3a", "network": {"id": "65e0ba59-7e4f-47d7-94c5-e32485b75aeb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1157326562", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "355551e9b29346059ddbe389bc51efa8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4fad7e-3a", "ovs_interfaceid": "ec4fad7e-3a01-4591-ae8f-0b8fe30d60de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:58:10.359214 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-898d1ace-5c61-45ca-adbb-88110b46a3de req-d10be7c6-b7d5-4dfb-b523-65226a5df2ef service nova] Releasing lock "refresh_cache-b1380963-8254-4ad0-95bb-91d24cea00f9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:58:10.359694 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Acquired lock "refresh_cache-b1380963-8254-4ad0-95bb-91d24cea00f9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:58:10.359694 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 00:58:10.877779 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:10.882862 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:11.208789 np0000001577 nova-compute[98319]: WARNING nova.network.neutron [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] 65e0ba59-7e4f-47d7-94c5-e32485b75aeb already exists in list: networks containing: ['65e0ba59-7e4f-47d7-94c5-e32485b75aeb']. ignoring it
May 28 00:58:11.208978 np0000001577 nova-compute[98319]: WARNING nova.network.neutron [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] ec4fad7e-3a01-4591-ae8f-0b8fe30d60de already exists in list: port_ids containing: ['ec4fad7e-3a01-4591-ae8f-0b8fe30d60de']. ignoring it
May 28 00:58:11.411177 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:11.743203 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:11.845457 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:12.011674 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Updating instance_info_cache with network_info: [{"id": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "address": "fa:16:3e:3a:fe:3d", "network": {"id": "3ceee21d-d4b4-4c77-8ac9-f2338f96e022", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-960987788-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "355551e9b29346059ddbe389bc51efa8", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc9c0c0-6e", "ovs_interfaceid": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec4fad7e-3a01-4591-ae8f-0b8fe30d60de", "address": "fa:16:3e:0c:39:3a", "network": {"id": "65e0ba59-7e4f-47d7-94c5-e32485b75aeb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1157326562", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "355551e9b29346059ddbe389bc51efa8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4fad7e-3a", "ovs_interfaceid": "ec4fad7e-3a01-4591-ae8f-0b8fe30d60de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:58:12.431584 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:12.515950 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Releasing lock "refresh_cache-b1380963-8254-4ad0-95bb-91d24cea00f9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:58:12.518143 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1446893669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1446893669',id=2,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgdSzXGUKNMMeuA2Cyvm6EZFtiJzxD7NWnlARJicpzFqN2FImWG3sU3198MgahdHOMaJqdmKUE8nRVq4d1z2/aQ8GRY/yfj1gslPX4PwbxVdsepP0DFICVmWgbQsQGwKA==',key_name='tempest-keypair-1022143858',keypairs=<?>,launch_index=0,launched_at=2026-05-28T00:57:26Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='355551e9b29346059ddbe389bc51efa8',ramdisk_id='',reservation_id='r-nlwfuhg8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-585237783',owner_user_name='tempest-TaggedAttachmentsTest-585237783-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T00:57:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4ab7230b24d4ebf9090a752493983fb',uuid=b1380963-8254-4ad0-95bb-91d24cea00f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec4fad7e-3a01-4591-ae8f-0b8fe30d60de", "address": "fa:16:3e:0c:39:3a", "network": {"id": "65e0ba59-7e4f-47d7-94c5-e32485b75aeb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1157326562", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "355551e9b29346059ddbe389bc51efa8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4fad7e-3a", "ovs_interfaceid": "ec4fad7e-3a01-4591-ae8f-0b8fe30d60de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 00:58:12.518424 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Converting VIF {"id": "ec4fad7e-3a01-4591-ae8f-0b8fe30d60de", "address": "fa:16:3e:0c:39:3a", "network": {"id": "65e0ba59-7e4f-47d7-94c5-e32485b75aeb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1157326562", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "355551e9b29346059ddbe389bc51efa8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4fad7e-3a", "ovs_interfaceid": "ec4fad7e-3a01-4591-ae8f-0b8fe30d60de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:58:12.519137 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:39:3a,bridge_name='br-int',has_traffic_filtering=True,id=ec4fad7e-3a01-4591-ae8f-0b8fe30d60de,network=Network(65e0ba59-7e4f-47d7-94c5-e32485b75aeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4fad7e-3a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:58:12.520070 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:39:3a,bridge_name='br-int',has_traffic_filtering=True,id=ec4fad7e-3a01-4591-ae8f-0b8fe30d60de,network=Network(65e0ba59-7e4f-47d7-94c5-e32485b75aeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4fad7e-3a') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 00:58:12.520360 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:12.520656 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:12.520885 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 00:58:12.521850 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:12.522015 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '57f61123-e3ea-547c-8df5-3fd109b975e4', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:12.522829 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:12.523570 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:12.524875 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:12.527168 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:12.527338 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec4fad7e-3a, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:12.527831 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec4fad7e-3a, col_values=(('qos', UUID('dd500cbb-275d-4b1b-a0cc-d6a1bc5aef99')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:12.527910 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec4fad7e-3a, col_values=(('external_ids', {'iface-id': 'ec4fad7e-3a01-4591-ae8f-0b8fe30d60de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:39:3a', 'vm-uuid': 'b1380963-8254-4ad0-95bb-91d24cea00f9'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:12.529638 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:12.531040 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:12.535391 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:12.536012 np0000001577 nova-compute[98319]: INFO os_vif [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:39:3a,bridge_name='br-int',has_traffic_filtering=True,id=ec4fad7e-3a01-4591-ae8f-0b8fe30d60de,network=Network(65e0ba59-7e4f-47d7-94c5-e32485b75aeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4fad7e-3a')
May 28 00:58:12.536650 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1446893669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1446893669',id=2,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgdSzXGUKNMMeuA2Cyvm6EZFtiJzxD7NWnlARJicpzFqN2FImWG3sU3198MgahdHOMaJqdmKUE8nRVq4d1z2/aQ8GRY/yfj1gslPX4PwbxVdsepP0DFICVmWgbQsQGwKA==',key_name='tempest-keypair-1022143858',keypairs=<?>,launch_index=0,launched_at=2026-05-28T00:57:26Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='355551e9b29346059ddbe389bc51efa8',ramdisk_id='',reservation_id='r-nlwfuhg8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-585237783',owner_user_name='tempest-TaggedAttachmentsTest-585237783-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T00:57:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4ab7230b24d4ebf9090a752493983fb',uuid=b1380963-8254-4ad0-95bb-91d24cea00f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec4fad7e-3a01-4591-ae8f-0b8fe30d60de", "address": "fa:16:3e:0c:39:3a", "network": {"id": "65e0ba59-7e4f-47d7-94c5-e32485b75aeb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1157326562", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "355551e9b29346059ddbe389bc51efa8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4fad7e-3a", "ovs_interfaceid": "ec4fad7e-3a01-4591-ae8f-0b8fe30d60de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 00:58:12.537238 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Converting VIF {"id": "ec4fad7e-3a01-4591-ae8f-0b8fe30d60de", "address": "fa:16:3e:0c:39:3a", "network": {"id": "65e0ba59-7e4f-47d7-94c5-e32485b75aeb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1157326562", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "355551e9b29346059ddbe389bc51efa8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4fad7e-3a", "ovs_interfaceid": "ec4fad7e-3a01-4591-ae8f-0b8fe30d60de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:58:12.537238 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:39:3a,bridge_name='br-int',has_traffic_filtering=True,id=ec4fad7e-3a01-4591-ae8f-0b8fe30d60de,network=Network(65e0ba59-7e4f-47d7-94c5-e32485b75aeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4fad7e-3a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:58:12.538057 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] attach device xml: <interface type="ethernet">
May 28 00:58:12.538057 np0000001577 nova-compute[98319]:   <mac address="fa:16:3e:0c:39:3a"/>
May 28 00:58:12.538057 np0000001577 nova-compute[98319]:   <model type="virtio"/>
May 28 00:58:12.538057 np0000001577 nova-compute[98319]:   <driver name="qemu"/>
May 28 00:58:12.538057 np0000001577 nova-compute[98319]:   <mtu size="1372"/>
May 28 00:58:12.538057 np0000001577 nova-compute[98319]:   <target dev="tapec4fad7e-3a"/>
May 28 00:58:12.538057 np0000001577 nova-compute[98319]: </interface>
May 28 00:58:12.538057 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 00:58:12.558979 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:12.605022 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:12.612112 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:12.614940 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:12.673765 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:12.818345 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-938765ef-2731-4f3b-8f94-a5d538a4a6dc req-468a125f-435b-4e99-a78f-c5da8d87aecf service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Received event network-vif-plugged-ec4fad7e-3a01-4591-ae8f-0b8fe30d60de {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:12.820112 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-938765ef-2731-4f3b-8f94-a5d538a4a6dc req-468a125f-435b-4e99-a78f-c5da8d87aecf service nova] Acquiring lock "b1380963-8254-4ad0-95bb-91d24cea00f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:12.820356 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-938765ef-2731-4f3b-8f94-a5d538a4a6dc req-468a125f-435b-4e99-a78f-c5da8d87aecf service nova] Lock "b1380963-8254-4ad0-95bb-91d24cea00f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:12.820613 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-938765ef-2731-4f3b-8f94-a5d538a4a6dc req-468a125f-435b-4e99-a78f-c5da8d87aecf service nova] Lock "b1380963-8254-4ad0-95bb-91d24cea00f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:12.820819 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-938765ef-2731-4f3b-8f94-a5d538a4a6dc req-468a125f-435b-4e99-a78f-c5da8d87aecf service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] No waiting events found dispatching network-vif-plugged-ec4fad7e-3a01-4591-ae8f-0b8fe30d60de {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:58:12.821674 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-938765ef-2731-4f3b-8f94-a5d538a4a6dc req-468a125f-435b-4e99-a78f-c5da8d87aecf service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Received unexpected event network-vif-plugged-ec4fad7e-3a01-4591-ae8f-0b8fe30d60de for instance with vm_state active and task_state None.
May 28 00:58:12.990277 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:12.993271 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:13.018908 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:13.639997 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:14.205857 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:58:14.205967 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:58:14.206073 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] No VIF found with MAC fa:16:3e:3a:fe:3d, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 00:58:14.713568 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1446893669', uuid='b1380963-8254-4ad0-95bb-91d24cea00f9'), owner=OwnerMeta(userid='b4ab7230b24d4ebf9090a752493983fb', username='tempest-TaggedAttachmentsTest-585237783-project-member', projectid='355551e9b29346059ddbe389bc51efa8', projectname='tempest-TaggedAttachmentsTest-585237783'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "address": "fa:16:3e:3a:fe:3d", "network": {"id": "3ceee21d-d4b4-4c77-8ac9-f2338f96e022", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-960987788-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "355551e9b29346059ddbe389bc51efa8", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc9c0c0-6e", "ovs_interfaceid": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec4fad7e-3a01-4591-ae8f-0b8fe30d60de", "address": "fa:16:3e:0c:39:3a", "network": {"id": "65e0ba59-7e4f-47d7-94c5-e32485b75aeb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1157326562", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "355551e9b29346059ddbe389bc51efa8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4fad7e-3a", "ovs_interfaceid": "ec4fad7e-3a01-4591-ae8f-0b8fe30d60de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779929894.7131662) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 00:58:14.714103 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:   <nova:package version="33.1.0"/>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:   <nova:name>tempest-device-tagging-server-1446893669</nova:name>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:   <nova:creationTime>2026-05-28 00:58:14</nova:creationTime>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:   <nova:flavor name="m1.nano" id="42">
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:     <nova:memory>192</nova:memory>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:     <nova:disk>1</nova:disk>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:     <nova:swap>0</nova:swap>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:     <nova:ephemeral>0</nova:ephemeral>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:     <nova:vcpus>1</nova:vcpus>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:     <nova:extraSpecs>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:     </nova:extraSpecs>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:   </nova:flavor>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:   <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:     <nova:minDisk>1</nova:minDisk>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:     <nova:minRam>0</nova:minRam>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:     <nova:properties>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:     </nova:properties>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:   </nova:image>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:   <nova:owner>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:     <nova:user uuid="b4ab7230b24d4ebf9090a752493983fb">tempest-TaggedAttachmentsTest-585237783-project-member</nova:user>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:     <nova:project uuid="355551e9b29346059ddbe389bc51efa8">tempest-TaggedAttachmentsTest-585237783</nova:project>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:   </nova:owner>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:   <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:   <nova:ports>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:     <nova:port uuid="5dc9c0c0-6ee4-4266-8024-0f8313319a2c">
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:       <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:     </nova:port>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:     <nova:port uuid="ec4fad7e-3a01-4591-ae8f-0b8fe30d60de">
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:       <nova:ip type="fixed" address="10.10.10.175" ipVersion="4"/>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:     </nova:port>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:   </nova:ports>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]: </nova:instance>
May 28 00:58:14.714103 np0000001577 nova-compute[98319]:  {{(pid=98319) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 28 00:58:14.896675 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e309209c-d211-4ca4-b111-99c234693898 req-9fd67fdf-f7d3-494b-93a1-d534ec3f6621 service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Received event network-vif-plugged-ec4fad7e-3a01-4591-ae8f-0b8fe30d60de {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:14.901149 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e309209c-d211-4ca4-b111-99c234693898 req-9fd67fdf-f7d3-494b-93a1-d534ec3f6621 service nova] Acquiring lock "b1380963-8254-4ad0-95bb-91d24cea00f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:14.901149 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e309209c-d211-4ca4-b111-99c234693898 req-9fd67fdf-f7d3-494b-93a1-d534ec3f6621 service nova] Lock "b1380963-8254-4ad0-95bb-91d24cea00f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:14.901639 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e309209c-d211-4ca4-b111-99c234693898 req-9fd67fdf-f7d3-494b-93a1-d534ec3f6621 service nova] Lock "b1380963-8254-4ad0-95bb-91d24cea00f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:14.902197 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e309209c-d211-4ca4-b111-99c234693898 req-9fd67fdf-f7d3-494b-93a1-d534ec3f6621 service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] No waiting events found dispatching network-vif-plugged-ec4fad7e-3a01-4591-ae8f-0b8fe30d60de {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:58:14.902197 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-e309209c-d211-4ca4-b111-99c234693898 req-9fd67fdf-f7d3-494b-93a1-d534ec3f6621 service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Received unexpected event network-vif-plugged-ec4fad7e-3a01-4591-ae8f-0b8fe30d60de for instance with vm_state active and task_state None.
May 28 00:58:15.220967 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3c6f6b26-195b-4d0e-89f4-39e3201a3203 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "interface-b1380963-8254-4ad0-95bb-91d24cea00f9-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 8.875s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:15.881181 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:16.172670 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Acquiring lock "b1380963-8254-4ad0-95bb-91d24cea00f9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:16.172838 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "b1380963-8254-4ad0-95bb-91d24cea00f9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:16.255466 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Acquiring lock "8783a79a-1374-43cf-8f20-81f1a156a315" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:16.256447 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "8783a79a-1374-43cf-8f20-81f1a156a315" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:16.405227 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:16.680233 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lazy-loading 'flavor' on Instance uuid b1380963-8254-4ad0-95bb-91d24cea00f9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:58:16.761265 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lazy-loading 'flavor' on Instance uuid 8783a79a-1374-43cf-8f20-81f1a156a315 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:58:16.888584 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:17.529520 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:17.686767 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "b1380963-8254-4ad0-95bb-91d24cea00f9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:17.771287 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "8783a79a-1374-43cf-8f20-81f1a156a315" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:18.623646 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:19.186264 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Acquiring lock "b1380963-8254-4ad0-95bb-91d24cea00f9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:19.186395 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "b1380963-8254-4ad0-95bb-91d24cea00f9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:19.186641 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Attaching volume e875c703-e9a0-42eb-8ebf-f69730042373 to /dev/vdb
May 28 00:58:19.201431 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Acquiring lock "8783a79a-1374-43cf-8f20-81f1a156a315" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:19.202770 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "8783a79a-1374-43cf-8f20-81f1a156a315" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:19.202946 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Attaching volume f1ba50c1-ad16-4bf8-a1df-95aa01a1925d to /dev/sdc
May 28 00:58:19.237851 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:58:19.253677 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:58:19.259103 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 00:58:19.269166 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 00:58:19.289052 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:19.305708 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:19.320753 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 00:58:19.320753 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 00:58:19.333454 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 00:58:19.333726 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 00:58:19.335828 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 00:58:19.339122 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe2c:d2b6', 'fe80::1c4b:31ff:fe4e:7f0', 'fe80::fc16:3eff:fe3a:fe3d', 'fe80::709d:70ff:fe70:893c', 'fe80::fc16:3eff:fe89:efd4', 'fe80::5801:aff:fe37:eba3', 'fe80::fc16:3eff:fea7:2821', 'fe80::fc16:3eff:fe0c:bdd9', 'fe80::fc11:9dff:fe9e:8235', 'fe80::fc16:3eff:fea2:aca1', 'fe80::9074:35ff:fed3:23bc', 'fe80::fc16:3eff:fe05:ba8e', 'fe80::fc16:3eff:fe14:b715', 'fe80::fc16:3eff:fe67:4cbd', 'fe80::fc16:3eff:fe31:f363', 'fe80::fc16:3eff:fefe:12c6', 'fe80::74a3:c5ff:fe48:a048', 'fe80::fc16:3eff:fe4c:71ca', 'fe80::c061:57ff:feca:6b8e', 'fe80::fc16:3eff:fe0c:393a', 'fe80::40cf:5bff:fe45:e1a0'] 
May 28 00:58:19.339122 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 00:58:19.339122 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 00:58:19.339122 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:58:19.339122 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Updating existing volume attachment record: 5b863fd8-9a0f-4153-a3b4-0b17f00c233d {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 00:58:19.341771 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 00:58:19.343199 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe2c:d2b6', 'fe80::1c4b:31ff:fe4e:7f0', 'fe80::fc16:3eff:fe3a:fe3d', 'fe80::709d:70ff:fe70:893c', 'fe80::fc16:3eff:fe89:efd4', 'fe80::5801:aff:fe37:eba3', 'fe80::fc16:3eff:fea7:2821', 'fe80::fc16:3eff:fe0c:bdd9', 'fe80::fc11:9dff:fe9e:8235', 'fe80::fc16:3eff:fea2:aca1', 'fe80::9074:35ff:fed3:23bc', 'fe80::fc16:3eff:fe05:ba8e', 'fe80::fc16:3eff:fe14:b715', 'fe80::fc16:3eff:fe67:4cbd', 'fe80::fc16:3eff:fe31:f363', 'fe80::fc16:3eff:fefe:12c6', 'fe80::74a3:c5ff:fe48:a048', 'fe80::fc16:3eff:fe4c:71ca', 'fe80::c061:57ff:feca:6b8e', 'fe80::fc16:3eff:fe0c:393a', 'fe80::40cf:5bff:fe45:e1a0'] 
May 28 00:58:19.343541 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 00:58:19.343698 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 00:58:19.343876 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:58:19.344027 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Updating existing volume attachment record: 5f8f7282-135d-49b5-b9c9-cf2d4faefe89 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 00:58:19.908378 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 00:58:19.908760 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373', 'iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e875c703-e9a0-42eb-8ebf-f69730042373', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:58:19.908913 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:58:19.909289 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:58:19.909554 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373', 'iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e875c703-e9a0-42eb-8ebf-f69730042373', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 00:58:19.916804 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 00:58:19.917041 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d', 'iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f1ba50c1-ad16-4bf8-a1df-95aa01a1925d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:58:19.917170 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:58:19.923056 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:58:19.923691 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:58:19.924142 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:58:19.924353 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 00:58:19.924876 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:58:19.925279 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 00:58:19.936282 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 00:58:19.936282 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:19.937345 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 00:58:19.937345 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:19.949299 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373] added
May 28 00:58:19.949299 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 00:58:19.949299 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:58:19.949299 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:58:19.949299 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:58:19.949299 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:58:19.949299 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:19.949470 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 00:58:19.950516 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0253(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 00:58:19.950516 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 00:58:19.950516 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373] added
May 28 00:58:19.950516 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 00:58:19.950516 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:58:19.950516 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:58:19.950516 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:58:19.950516 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:58:19.950516 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:19.950858 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 00:58:19.950920 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0256(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 00:58:19.951102 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 00:58:20.884464 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:20.950351 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 00:58:20.951456 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.startup = manual
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.port = 0
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 00:58:20.971204 np0000001577 nova-compute[98319]: # END RECORD
May 28 00:58:20.971204 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.startup = manual
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.port = 0
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 00:58:20.974295 np0000001577 nova-compute[98319]: # END RECORD
May 28 00:58:20.974295 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:20.988405 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:20.989099 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:21.005200 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:21.005200 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:21.005200 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:21.005200 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:21.005200 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:21.005200 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:21.005200 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:58:21.005200 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:21.005200 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:21.005200 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:21.005200 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:21.005200 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:21.005200 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:21.005200 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:58:21.010289 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:21.010289 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:21.010289 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:21.010289 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:21.010289 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:21.010289 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:21.010289 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:58:21.010289 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:21.010289 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:21.010289 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:21.010289 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:21.010289 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:21.010289 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:21.010289 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:58:21.053500 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373, portal: 192.168.50.100,3260]
May 28 00:58:21.053500 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373, portal: 192.168.50.100,3260] successful.
May 28 00:58:21.053500 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:21.060446 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373, portal: 192.168.40.100,3260]
May 28 00:58:21.060446 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373, portal: 192.168.40.100,3260] successful.
May 28 00:58:21.060446 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:21.066958 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:21.074757 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:21.089880 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:21.089880 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:21.089880 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:21.089880 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:21.089880 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:21.089880 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:21.089880 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:21.089880 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:21.089880 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:58:21.089880 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:21.089880 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:21.089880 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:21.089880 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:21.089880 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:21.089880 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:21.089880 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:21.089880 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:21.089880 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:58:21.089880 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:58:21.089880 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 00:58:21.093343 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] HCTL ('13', '-', '-', 0) found on session 11 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 00:58:21.093343 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 00:58:21.093343 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:21.093343 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:21.093343 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:21.093343 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:21.093343 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:21.093343 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:21.093343 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:21.093343 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:21.093343 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:58:21.093343 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:21.093343 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:21.093343 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:21.093343 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:21.093343 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:21.093343 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:21.093343 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:21.093343 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:21.093343 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:58:21.093343 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:58:21.093343 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 00:58:21.093343 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] HCTL ('14', '-', '-', 0) found on session 12 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 00:58:21.093343 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 00:58:21.146788 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Searching for a device in session 12 and hctl ['14', '*', '*', 0] yield: sdh {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 00:58:21.146788 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e875c703-e9a0-42eb-8ebf-f69730042373', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 00:58:21.148375 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Searching for a device in session 11 and hctl ['13', '*', '*', 0] yield: sdi {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 00:58:21.148375 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e875c703-e9a0-42eb-8ebf-f69730042373', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 00:58:21.771588 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "8bca25d8-071e-4b2d-960c-50582381cc75" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:21.771852 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "8bca25d8-071e-4b2d-960c-50582381cc75" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:21.924685 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 00:58:21.980302 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Acquiring lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:21.980702 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:22.274521 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 00:58:22.482095 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 00:58:22.533679 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:22.656568 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4e2c0fdb-540a-4380-836f-6f4e5ad47852 req-0460eca5-97e6-40ae-8da1-787ee2a86df1 service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Received event network-changed-9f8ec3b0-780e-4a36-ad3f-4664a6829868 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:22.656666 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4e2c0fdb-540a-4380-836f-6f4e5ad47852 req-0460eca5-97e6-40ae-8da1-787ee2a86df1 service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Refreshing instance network info cache due to event network-changed-9f8ec3b0-780e-4a36-ad3f-4664a6829868. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:58:22.656802 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4e2c0fdb-540a-4380-836f-6f4e5ad47852 req-0460eca5-97e6-40ae-8da1-787ee2a86df1 service nova] Acquiring lock "refresh_cache-7fdf336e-65c1-4180-92eb-5f8ca0ebc526" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:58:22.656900 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4e2c0fdb-540a-4380-836f-6f4e5ad47852 req-0460eca5-97e6-40ae-8da1-787ee2a86df1 service nova] Acquired lock "refresh_cache-7fdf336e-65c1-4180-92eb-5f8ca0ebc526" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:58:22.657567 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-4e2c0fdb-540a-4380-836f-6f4e5ad47852 req-0460eca5-97e6-40ae-8da1-787ee2a86df1 service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Refreshing network info cache for port 9f8ec3b0-780e-4a36-ad3f-4664a6829868 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:58:22.828281 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:22.828750 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:22.831241 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 00:58:22.831484 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Claim successful on node np0000001577
May 28 00:58:22.938960 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Found WWN 330000000d4ea86dd for multipath device dm-5 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 00:58:22.939258 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:58:22.939618 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '330000000d4ea86dd', 'path': '/dev/dm-5', 'multipath_id': '330000000d4ea86dd'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:58:22.939783 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d4ea86dd', 'path': '/dev/dm-5', 'multipath_id': '330000000d4ea86dd'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 00:58:22.940222 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.023s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:58:22.940513 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d', 'iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f1ba50c1-ad16-4bf8-a1df-95aa01a1925d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 00:58:22.941577 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lazy-loading 'flavor' on Instance uuid b1380963-8254-4ad0-95bb-91d24cea00f9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:58:22.954215 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:58:22.954681 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:58:22.954998 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:58:22.955161 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 00:58:22.955423 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:58:22.955592 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 00:58:22.968205 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 00:58:22.968205 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:22.973012 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 00:58:22.973012 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:22.983666 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d] added
May 28 00:58:22.983666 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 00:58:22.983666 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:58:22.983666 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:58:22.983666 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:58:22.983666 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:58:22.983666 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:22.984149 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 00:58:22.984149 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0289(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 00:58:22.985253 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 00:58:22.985253 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d] added
May 28 00:58:22.985253 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 00:58:22.985253 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:58:22.985253 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:58:22.985253 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:58:22.985253 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:58:22.985253 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:22.985253 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 00:58:22.985253 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0294(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 00:58:22.985253 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 00:58:23.041378 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:23.159165 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-4e2c0fdb-540a-4380-836f-6f4e5ad47852 req-0460eca5-97e6-40ae-8da1-787ee2a86df1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:23.447362 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Attempting to attach volume e875c703-e9a0-42eb-8ebf-f69730042373 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 00:58:23.448519 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] attach device xml: <disk type="block" device="disk">
May 28 00:58:23.448519 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 00:58:23.448519 np0000001577 nova-compute[98319]:   <alias name="ua-e875c703-e9a0-42eb-8ebf-f69730042373"/>
May 28 00:58:23.448519 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-5"/>
May 28 00:58:23.448519 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 00:58:23.448519 np0000001577 nova-compute[98319]:   <serial>e875c703-e9a0-42eb-8ebf-f69730042373</serial>
May 28 00:58:23.448519 np0000001577 nova-compute[98319]: </disk>
May 28 00:58:23.448519 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 00:58:23.470178 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-4e2c0fdb-540a-4380-836f-6f4e5ad47852 req-0460eca5-97e6-40ae-8da1-787ee2a86df1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:23.514445 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquiring lock "0928917f-0c8c-4019-aef4-083ba8224ce0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:23.514850 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "0928917f-0c8c-4019-aef4-083ba8224ce0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:23.605902 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-4e2c0fdb-540a-4380-836f-6f4e5ad47852 req-0460eca5-97e6-40ae-8da1-787ee2a86df1 service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Updated VIF entry in instance network info cache for port 9f8ec3b0-780e-4a36-ad3f-4664a6829868. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 00:58:23.606196 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-4e2c0fdb-540a-4380-836f-6f4e5ad47852 req-0460eca5-97e6-40ae-8da1-787ee2a86df1 service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Updating instance_info_cache with network_info: [{"id": "9f8ec3b0-780e-4a36-ad3f-4664a6829868", "address": "fa:16:3e:a7:28:21", "network": {"id": "e43128b4-a829-486a-a380-4b92728ed2c5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-655543488-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df45e1c2b903482aa7e61c55b1f3f45b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8ec3b0-78", "ovs_interfaceid": "9f8ec3b0-780e-4a36-ad3f-4664a6829868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:58:23.985664 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 00:58:23.986653 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.startup = manual
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.port = 0
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 00:58:23.997859 np0000001577 nova-compute[98319]: # END RECORD
May 28 00:58:23.997859 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.startup = manual
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.port = 0
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 00:58:24.004319 np0000001577 nova-compute[98319]: # END RECORD
May 28 00:58:24.004319 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:24.010825 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:24.017676 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lazy-loading 'flavor' on Instance uuid 0928917f-0c8c-4019-aef4-083ba8224ce0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:58:24.019108 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:24.026769 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:24.026769 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:24.026769 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:24.026769 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:24.026769 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:24.026769 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:24.026769 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:24.026769 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:24.026769 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:58:24.026769 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:24.026769 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:24.026769 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:24.026769 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:24.026769 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:24.026769 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:24.026769 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:24.026769 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:24.026769 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:58:24.035586 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:24.035586 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:24.035586 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:24.035586 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:24.035586 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:24.035586 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:24.035586 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:24.035586 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:24.035586 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:58:24.035918 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:24.035918 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:24.035918 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:24.035918 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:24.035918 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:24.035918 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:24.035918 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:24.035918 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:24.035918 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:58:24.074786 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Acquiring lock "a84e49f5-0bde-41ee-866e-6b434748077f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:24.075083 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Lock "a84e49f5-0bde-41ee-866e-6b434748077f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:24.079158 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d, portal: 192.168.40.100,3260]
May 28 00:58:24.079158 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d, portal: 192.168.40.100,3260] successful.
May 28 00:58:24.079158 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:24.086218 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d, portal: 192.168.50.100,3260]
May 28 00:58:24.086218 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d, portal: 192.168.50.100,3260] successful.
May 28 00:58:24.086218 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:24.092924 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:24.098851 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:24.112777 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4e2c0fdb-540a-4380-836f-6f4e5ad47852 req-0460eca5-97e6-40ae-8da1-787ee2a86df1 service nova] Releasing lock "refresh_cache-7fdf336e-65c1-4180-92eb-5f8ca0ebc526" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:58:24.114274 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:24.114274 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:24.114274 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:24.114274 np0000001577 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:24.114274 np0000001577 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:24.114274 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:24.114274 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:24.114274 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:24.114274 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:24.114274 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:24.114274 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:58:24.114640 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:24.114640 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:24.114640 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:24.114640 np0000001577 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:24.114640 np0000001577 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:24.114640 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:24.114640 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:24.114640 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:24.114640 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:24.114640 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:24.114640 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:58:24.114926 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.160s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:58:24.114926 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 00:58:24.116290 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] HCTL ('15', '-', '-', 0) found on session 13 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 00:58:24.116437 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 00:58:24.121919 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:24.121919 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:24.121919 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:24.121919 np0000001577 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:24.121919 np0000001577 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:24.121919 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:24.121919 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:24.121919 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:24.121919 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:24.121919 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:24.121919 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:58:24.122198 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:24.122198 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:24.122198 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:24.122198 np0000001577 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:24.122198 np0000001577 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:24.122198 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:24.122198 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:24.122198 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:24.122198 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:24.122198 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:24.122198 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:58:24.122198 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.167s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:58:24.122476 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 00:58:24.123224 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] HCTL ('16', '-', '-', 0) found on session 14 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 00:58:24.123326 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 00:58:24.133458 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Searching for a device in session 13 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 00:58:24.133614 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f1ba50c1-ad16-4bf8-a1df-95aa01a1925d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 00:58:24.135502 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Searching for a device in session 14 and hctl ['16', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 00:58:24.245153 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:58:24.245680 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:58:24.578289 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Lazy-loading 'flavor' on Instance uuid a84e49f5-0bde-41ee-866e-6b434748077f {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:58:24.742448 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-171a4fbf-74f6-48a2-8a8d-ff9bf40fee87 req-86224db9-c66c-482a-b8e9-c35e3434d182 service nova] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Received event network-changed-16d9022a-b978-4e59-80a0-34d8d6da6b87 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:24.742648 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-171a4fbf-74f6-48a2-8a8d-ff9bf40fee87 req-86224db9-c66c-482a-b8e9-c35e3434d182 service nova] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Refreshing instance network info cache due to event network-changed-16d9022a-b978-4e59-80a0-34d8d6da6b87. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:58:24.742801 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-171a4fbf-74f6-48a2-8a8d-ff9bf40fee87 req-86224db9-c66c-482a-b8e9-c35e3434d182 service nova] Acquiring lock "refresh_cache-0928917f-0c8c-4019-aef4-083ba8224ce0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:58:24.742901 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-171a4fbf-74f6-48a2-8a8d-ff9bf40fee87 req-86224db9-c66c-482a-b8e9-c35e3434d182 service nova] Acquired lock "refresh_cache-0928917f-0c8c-4019-aef4-083ba8224ce0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:58:24.743001 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-171a4fbf-74f6-48a2-8a8d-ff9bf40fee87 req-86224db9-c66c-482a-b8e9-c35e3434d182 service nova] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Refreshing network info cache for port 16d9022a-b978-4e59-80a0-34d8d6da6b87 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:58:24.752567 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:58:25.022492 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "0928917f-0c8c-4019-aef4-083ba8224ce0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.507s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:25.093933 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:58:25.093933 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:58:25.093933 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] No VIF found with MAC fa:16:3e:3a:fe:3d, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 00:58:25.136067 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Searching for a device in session 14 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 00:58:25.136191 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f1ba50c1-ad16-4bf8-a1df-95aa01a1925d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 00:58:25.245429 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-171a4fbf-74f6-48a2-8a8d-ff9bf40fee87 req-86224db9-c66c-482a-b8e9-c35e3434d182 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:25.255834 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.427s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:25.256749 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.215s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:25.256918 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 00:58:25.260947 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 00:58:25.261054 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Claim successful on node np0000001577
May 28 00:58:25.537871 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-171a4fbf-74f6-48a2-8a8d-ff9bf40fee87 req-86224db9-c66c-482a-b8e9-c35e3434d182 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:25.583696 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Lock "a84e49f5-0bde-41ee-866e-6b434748077f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:25.681967 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-171a4fbf-74f6-48a2-8a8d-ff9bf40fee87 req-86224db9-c66c-482a-b8e9-c35e3434d182 service nova] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Updated VIF entry in instance network info cache for port 16d9022a-b978-4e59-80a0-34d8d6da6b87. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 00:58:25.682178 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-171a4fbf-74f6-48a2-8a8d-ff9bf40fee87 req-86224db9-c66c-482a-b8e9-c35e3434d182 service nova] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Updating instance_info_cache with network_info: [{"id": "16d9022a-b978-4e59-80a0-34d8d6da6b87", "address": "fa:16:3e:89:ef:d4", "network": {"id": "e43128b4-a829-486a-a380-4b92728ed2c5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-655543488-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df45e1c2b903482aa7e61c55b1f3f45b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d9022a-b9", "ovs_interfaceid": "16d9022a-b978-4e59-80a0-34d8d6da6b87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:58:25.769489 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 00:58:25.769742 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 00:58:25.770020 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:25.770956 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:25.843121 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8586a18edcf42cab0a60028135ae401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938c2829112843edb2054984e80ce7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 00:58:25.904997 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:25.977377 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Found WWN 330000000eac6fd34 for multipath device dm-6 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 00:58:25.977740 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:58:25.977916 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] <== connect_volume: return (6060ms) {'type': 'block', 'scsi_wwn': '330000000eac6fd34', 'path': '/dev/dm-6', 'multipath_id': '330000000eac6fd34'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:58:25.978032 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000eac6fd34', 'path': '/dev/dm-6', 'multipath_id': '330000000eac6fd34'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 00:58:25.980714 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lazy-loading 'flavor' on Instance uuid 8783a79a-1374-43cf-8f20-81f1a156a315 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:58:26.110378 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquiring lock "0928917f-0c8c-4019-aef4-083ba8224ce0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:26.110909 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "0928917f-0c8c-4019-aef4-083ba8224ce0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:26.110909 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Attaching volume d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 to /dev/vdb
May 28 00:58:26.159033 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:58:26.169669 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 00:58:26.186322 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-171a4fbf-74f6-48a2-8a8d-ff9bf40fee87 req-86224db9-c66c-482a-b8e9-c35e3434d182 service nova] Releasing lock "refresh_cache-0928917f-0c8c-4019-aef4-083ba8224ce0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:58:26.195588 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:26.219130 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 00:58:26.219509 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 00:58:26.228244 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 00:58:26.233026 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe2c:d2b6', 'fe80::1c4b:31ff:fe4e:7f0', 'fe80::fc16:3eff:fe3a:fe3d', 'fe80::709d:70ff:fe70:893c', 'fe80::fc16:3eff:fe89:efd4', 'fe80::5801:aff:fe37:eba3', 'fe80::fc16:3eff:fea7:2821', 'fe80::fc16:3eff:fe0c:bdd9', 'fe80::fc11:9dff:fe9e:8235', 'fe80::fc16:3eff:fea2:aca1', 'fe80::9074:35ff:fed3:23bc', 'fe80::fc16:3eff:fe05:ba8e', 'fe80::fc16:3eff:fe14:b715', 'fe80::fc16:3eff:fe67:4cbd', 'fe80::fc16:3eff:fe31:f363', 'fe80::fc16:3eff:fefe:12c6', 'fe80::74a3:c5ff:fe48:a048', 'fe80::fc16:3eff:fe4c:71ca', 'fe80::c061:57ff:feca:6b8e', 'fe80::fc16:3eff:fe0c:393a', 'fe80::40cf:5bff:fe45:e1a0'] 
May 28 00:58:26.233262 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 00:58:26.233262 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 00:58:26.233474 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] <== get_connector_properties: return (73ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:58:26.234831 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Updating existing volume attachment record: a679b67e-4d2f-469a-9f4e-41d876da2978 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 00:58:26.272591 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 00:58:26.291176 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Successfully created port: ed09134a-777e-4b64-a80d-4d4e00e3b25a {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 00:58:26.488255 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] attach device xml: <disk type="block" device="disk">
May 28 00:58:26.488255 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 00:58:26.488255 np0000001577 nova-compute[98319]:   <alias name="ua-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d"/>
May 28 00:58:26.488255 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-6"/>
May 28 00:58:26.488255 np0000001577 nova-compute[98319]:   <target dev="sdc" bus="scsi"/>
May 28 00:58:26.488255 np0000001577 nova-compute[98319]:   <serial>f1ba50c1-ad16-4bf8-a1df-95aa01a1925d</serial>
May 28 00:58:26.488255 np0000001577 nova-compute[98319]:   <address type="drive" controller="0" unit="2"/>
May 28 00:58:26.488255 np0000001577 nova-compute[98319]: </disk>
May 28 00:58:26.488255 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 00:58:26.657588 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52920ed8-34dc-48fd-b23e-f67e011ea266 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "b1380963-8254-4ad0-95bb-91d24cea00f9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.471s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:26.770196 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:58:26.770420 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:58:26.781499 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 00:58:26.803594 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 00:58:26.803772 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd2d3e5ca-4e68-4f8d-84af-117ab421d9f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:58:26.803893 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:58:26.804349 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:58:26.804430 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd2d3e5ca-4e68-4f8d-84af-117ab421d9f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 00:58:26.817017 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:58:26.817523 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:58:26.817792 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 00:58:26.819788 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:58:26.820183 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:58:26.820342 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 00:58:26.831832 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 00:58:26.831832 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:26.836855 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Successfully updated port: ed09134a-777e-4b64-a80d-4d4e00e3b25a {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 00:58:26.838711 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 00:58:26.838711 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:26.846276 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5] added
May 28 00:58:26.846276 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 00:58:26.846276 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:58:26.846276 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:58:26.846276 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:58:26.846276 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:58:26.846276 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:26.846692 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 00:58:26.846954 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0291(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 00:58:26.847327 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 00:58:26.851995 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5] added
May 28 00:58:26.851995 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 00:58:26.851995 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:58:26.851995 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:58:26.851995 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:58:26.851995 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:58:26.851995 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:26.852255 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 00:58:26.852509 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0321(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 00:58:26.852689 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 00:58:26.918502 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a7a7fd5f-6fcc-4b90-b4d3-f62aeeed6197 req-dddc9710-83d4-437d-9cb6-4b53b8659ab3 service nova] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Received event network-changed-ed09134a-777e-4b64-a80d-4d4e00e3b25a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:26.918647 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a7a7fd5f-6fcc-4b90-b4d3-f62aeeed6197 req-dddc9710-83d4-437d-9cb6-4b53b8659ab3 service nova] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Refreshing instance network info cache due to event network-changed-ed09134a-777e-4b64-a80d-4d4e00e3b25a. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:58:26.918797 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a7a7fd5f-6fcc-4b90-b4d3-f62aeeed6197 req-dddc9710-83d4-437d-9cb6-4b53b8659ab3 service nova] Acquiring lock "refresh_cache-8bca25d8-071e-4b2d-960c-50582381cc75" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:58:26.918892 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a7a7fd5f-6fcc-4b90-b4d3-f62aeeed6197 req-dddc9710-83d4-437d-9cb6-4b53b8659ab3 service nova] Acquired lock "refresh_cache-8bca25d8-071e-4b2d-960c-50582381cc75" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:58:26.918991 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-a7a7fd5f-6fcc-4b90-b4d3-f62aeeed6197 req-dddc9710-83d4-437d-9cb6-4b53b8659ab3 service nova] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Refreshing network info cache for port ed09134a-777e-4b64-a80d-4d4e00e3b25a {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:58:27.060420 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Acquiring lock "a84e49f5-0bde-41ee-866e-6b434748077f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:27.060584 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Lock "a84e49f5-0bde-41ee-866e-6b434748077f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:27.060749 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Attaching volume 8969959e-493f-4daf-a2dd-1d0198bab335 to /dev/vdb
May 28 00:58:27.107977 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:58:27.123608 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 00:58:27.140912 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:27.162153 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 00:58:27.162401 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 00:58:27.170170 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 00:58:27.171644 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe2c:d2b6', 'fe80::1c4b:31ff:fe4e:7f0', 'fe80::fc16:3eff:fe3a:fe3d', 'fe80::709d:70ff:fe70:893c', 'fe80::fc16:3eff:fe89:efd4', 'fe80::5801:aff:fe37:eba3', 'fe80::fc16:3eff:fea7:2821', 'fe80::fc16:3eff:fe0c:bdd9', 'fe80::fc11:9dff:fe9e:8235', 'fe80::fc16:3eff:fea2:aca1', 'fe80::9074:35ff:fed3:23bc', 'fe80::fc16:3eff:fe05:ba8e', 'fe80::fc16:3eff:fe14:b715', 'fe80::fc16:3eff:fe67:4cbd', 'fe80::fc16:3eff:fe31:f363', 'fe80::fc16:3eff:fefe:12c6', 'fe80::74a3:c5ff:fe48:a048', 'fe80::fc16:3eff:fe4c:71ca', 'fe80::c061:57ff:feca:6b8e', 'fe80::fc16:3eff:fe0c:393a', 'fe80::40cf:5bff:fe45:e1a0'] 
May 28 00:58:27.171797 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 00:58:27.171841 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 00:58:27.172032 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] <== get_connector_properties: return (64ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:58:27.172240 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Updating existing volume attachment record: 7d3a246b-22da-44ee-bcbf-ca78f43ec2c8 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 00:58:27.273013 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:58:27.288704 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Booting with volume 16418261-7c75-4055-8eaf-81fc4861a35c at /dev/vda
May 28 00:58:27.335308 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:58:27.340202 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "refresh_cache-8bca25d8-071e-4b2d-960c-50582381cc75" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:58:27.346372 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 00:58:27.367568 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:27.393297 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 00:58:27.393878 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 00:58:27.405572 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 00:58:27.405572 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe2c:d2b6', 'fe80::1c4b:31ff:fe4e:7f0', 'fe80::fc16:3eff:fe3a:fe3d', 'fe80::709d:70ff:fe70:893c', 'fe80::fc16:3eff:fe89:efd4', 'fe80::5801:aff:fe37:eba3', 'fe80::fc16:3eff:fea7:2821', 'fe80::fc16:3eff:fe0c:bdd9', 'fe80::fc11:9dff:fe9e:8235', 'fe80::fc16:3eff:fea2:aca1', 'fe80::9074:35ff:fed3:23bc', 'fe80::fc16:3eff:fe05:ba8e', 'fe80::fc16:3eff:fe14:b715', 'fe80::fc16:3eff:fe67:4cbd', 'fe80::fc16:3eff:fe31:f363', 'fe80::fc16:3eff:fefe:12c6', 'fe80::74a3:c5ff:fe48:a048', 'fe80::fc16:3eff:fe4c:71ca', 'fe80::c061:57ff:feca:6b8e', 'fe80::fc16:3eff:fe0c:393a', 'fe80::40cf:5bff:fe45:e1a0'] 
May 28 00:58:27.405572 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 00:58:27.405572 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 00:58:27.405572 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] <== get_connector_properties: return (68ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:58:27.405572 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Updating existing volume attachment record: 396944a0-0757-4c8b-824f-016388361922 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 00:58:27.423946 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-a7a7fd5f-6fcc-4b90-b4d3-f62aeeed6197 req-dddc9710-83d4-437d-9cb6-4b53b8659ab3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:27.505193 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-a7a7fd5f-6fcc-4b90-b4d3-f62aeeed6197 req-dddc9710-83d4-437d-9cb6-4b53b8659ab3 service nova] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:58:27.536059 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:27.635197 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-a7a7fd5f-6fcc-4b90-b4d3-f62aeeed6197 req-dddc9710-83d4-437d-9cb6-4b53b8659ab3 service nova] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:58:27.714793 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 00:58:27.715124 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335', 'iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8969959e-493f-4daf-a2dd-1d0198bab335', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:58:27.715277 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:58:27.780209 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.524s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:27.780771 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 00:58:27.847880 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 00:58:27.853120 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.startup = manual
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.port = 0
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 00:58:27.860993 np0000001577 nova-compute[98319]: # END RECORD
May 28 00:58:27.860993 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.startup = manual
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.port = 0
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 00:58:27.866291 np0000001577 nova-compute[98319]: # END RECORD
May 28 00:58:27.866291 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:27.873840 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:27.879866 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:27.890155 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:27.890155 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:27.890155 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:27.890155 np0000001577 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:27.890155 np0000001577 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:27.890155 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:27.890155 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:27.890155 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:27.890155 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:27.890155 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:27.890155 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:58:27.890669 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:27.890669 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:27.890669 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:27.890669 np0000001577 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:27.890669 np0000001577 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:27.890669 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:27.890669 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:27.890669 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:27.890669 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:27.890669 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:27.890669 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:58:27.901948 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:27.901948 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:27.901948 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:27.901948 np0000001577 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:27.901948 np0000001577 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:27.901948 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:27.901948 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:27.901948 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:27.901948 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:27.901948 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:27.901948 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:58:27.902253 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:27.902253 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:27.902253 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:27.902253 np0000001577 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:27.902253 np0000001577 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:27.902253 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:27.902253 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:27.902253 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:27.902253 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:27.902253 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:27.902253 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:58:27.947737 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5, portal: 192.168.40.100,3260]
May 28 00:58:27.947737 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5, portal: 192.168.40.100,3260] successful.
May 28 00:58:27.947737 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:27.954803 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5, portal: 192.168.50.100,3260]
May 28 00:58:27.954803 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5, portal: 192.168.50.100,3260] successful.
May 28 00:58:27.954803 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:27.966431 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:27.973002 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:27.987990 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:27.987990 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:27.987990 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:27.987990 np0000001577 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:27.987990 np0000001577 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:27.987990 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:27.987990 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:27.987990 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:27.987990 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:27.987990 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:27.987990 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:27.987990 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:27.987990 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:58:27.990285 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:27.990285 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:27.990285 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:27.990285 np0000001577 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:27.990285 np0000001577 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:27.990285 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:27.990285 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:27.990285 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:27.990285 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:27.990285 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:27.990285 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:27.990285 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:27.990285 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:58:27.990285 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:58:27.990285 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 00:58:27.990840 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] HCTL ('17', '-', '-', 0) found on session 15 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 00:58:27.990893 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 00:58:27.998800 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:27.998800 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:27.998800 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:27.998800 np0000001577 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:27.998800 np0000001577 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:27.998800 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:27.998800 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:27.998800 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:27.998800 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:27.998800 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:27.998800 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:27.998800 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:27.998800 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:58:27.999881 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:27.999881 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:27.999881 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:27.999881 np0000001577 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:27.999881 np0000001577 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:27.999881 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:27.999881 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:27.999881 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:27.999881 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:27.999881 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:27.999881 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:27.999881 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:27.999881 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:58:28.009800 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.180s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:58:28.009800 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 00:58:28.009800 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Searching for a device in session 15 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 00:58:28.009800 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd2d3e5ca-4e68-4f8d-84af-117ab421d9f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 00:58:28.016414 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] HCTL ('18', '-', '-', 0) found on session 16 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 00:58:28.016414 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 00:58:28.030780 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Searching for a device in session 16 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 00:58:28.030780 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd2d3e5ca-4e68-4f8d-84af-117ab421d9f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 00:58:28.138450 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a7a7fd5f-6fcc-4b90-b4d3-f62aeeed6197 req-dddc9710-83d4-437d-9cb6-4b53b8659ab3 service nova] Releasing lock "refresh_cache-8bca25d8-071e-4b2d-960c-50582381cc75" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:58:28.138878 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquired lock "refresh_cache-8bca25d8-071e-4b2d-960c-50582381cc75" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:58:28.138963 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 00:58:28.205082 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] No BDM found with device name sda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:58:28.205262 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:58:28.205419 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] No BDM found with device name sdc, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:58:28.205577 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] No VIF found with MAC fa:16:3e:2c:d2:b6, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 00:58:28.287185 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 00:58:28.287404 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 00:58:28.287744 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:28.287972 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:28.354383 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8fe24b43fd0b4818a4fd4bbced85a6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e72ea70b9147f68a0d66cd524ae614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 00:58:28.709431 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:58:28.789943 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 00:58:28.821223 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 00:58:28.825857 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Successfully created port: 73b37d7b-3ec2-45cc-8a9c-22ee6556af87 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 00:58:28.860446 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:28.992482 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Updating instance_info_cache with network_info: [{"id": "ed09134a-777e-4b64-a80d-4d4e00e3b25a", "address": "fa:16:3e:75:1c:46", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped09134a-77", "ovs_interfaceid": "ed09134a-777e-4b64-a80d-4d4e00e3b25a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:58:29.171311 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Acquiring lock "b1380963-8254-4ad0-95bb-91d24cea00f9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:29.171711 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "b1380963-8254-4ad0-95bb-91d24cea00f9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:29.268853 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Successfully updated port: 73b37d7b-3ec2-45cc-8a9c-22ee6556af87 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 00:58:29.292884 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 00:58:29.312636 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6e8b3678-10eb-4e46-aafd-0f645a0f6e90 req-3e60055c-9e74-467a-95ee-a4bf2e352460 service nova] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Received event network-changed-73b37d7b-3ec2-45cc-8a9c-22ee6556af87 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:29.312765 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6e8b3678-10eb-4e46-aafd-0f645a0f6e90 req-3e60055c-9e74-467a-95ee-a4bf2e352460 service nova] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Refreshing instance network info cache due to event network-changed-73b37d7b-3ec2-45cc-8a9c-22ee6556af87. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:58:29.312931 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6e8b3678-10eb-4e46-aafd-0f645a0f6e90 req-3e60055c-9e74-467a-95ee-a4bf2e352460 service nova] Acquiring lock "refresh_cache-a8a28bb4-c3ea-4fb9-9130-1e8239191c5b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:58:29.312997 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6e8b3678-10eb-4e46-aafd-0f645a0f6e90 req-3e60055c-9e74-467a-95ee-a4bf2e352460 service nova] Acquired lock "refresh_cache-a8a28bb4-c3ea-4fb9-9130-1e8239191c5b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:58:29.313106 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-6e8b3678-10eb-4e46-aafd-0f645a0f6e90 req-3e60055c-9e74-467a-95ee-a4bf2e352460 service nova] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Refreshing network info cache for port 73b37d7b-3ec2-45cc-8a9c-22ee6556af87 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:58:29.494394 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Releasing lock "refresh_cache-8bca25d8-071e-4b2d-960c-50582381cc75" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:58:29.494641 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Instance network_info: |[{"id": "ed09134a-777e-4b64-a80d-4d4e00e3b25a", "address": "fa:16:3e:75:1c:46", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped09134a-77", "ovs_interfaceid": "ed09134a-777e-4b64-a80d-4d4e00e3b25a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 00:58:29.511409 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 00:58:29.512224 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 00:58:29.512441 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Creating image(s)
May 28 00:58:29.512703 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 00:58:29.512818 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Ensure instance console log exists: /opt/stack/data/nova/instances/8bca25d8-071e-4b2d-960c-50582381cc75/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 00:58:29.513011 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:29.513156 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:29.513265 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:29.513684 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Start _get_guest_xml network_info=[{"id": "ed09134a-777e-4b64-a80d-4d4e00e3b25a", "address": "fa:16:3e:75:1c:46", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped09134a-77", "ovs_interfaceid": "ed09134a-777e-4b64-a80d-4d4e00e3b25a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '16418261-7c75-4055-8eaf-81fc4861a35c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '8bca25d8-071e-4b2d-960c-50582381cc75', 'attached_at': '', 'detached_at': '', 'volume_id': '16418261-7c75-4055-8eaf-81fc4861a35c', 'serial': '16418261-7c75-4055-8eaf-81fc4861a35c', 'multiattach': True}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '396944a0-0757-4c8b-824f-016388361922', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 00:58:29.514946 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 00:58:29.515801 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-21773514', uuid='8bca25d8-071e-4b2d-960c-50582381cc75'), owner=OwnerMeta(userid='f8586a18edcf42cab0a60028135ae401', username='tempest-AttachVolumeMultiAttachTest-89204095-project-member', projectid='938c2829112843edb2054984e80ce7ad', projectname='tempest-AttachVolumeMultiAttachTest-89204095'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ed09134a-777e-4b64-a80d-4d4e00e3b25a", "address": "fa:16:3e:75:1c:46", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped09134a-77", "ovs_interfaceid": "ed09134a-777e-4b64-a80d-4d4e00e3b25a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779929909.5155208) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 00:58:29.516379 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 00:58:29.516705 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 00:58:29.517226 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 00:58:29.517375 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 00:58:29.518094 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 00:58:29.518312 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 00:58:29.518466 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 00:58:29.518558 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 00:58:29.518680 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 00:58:29.518761 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 00:58:29.518849 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 00:58:29.518984 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 00:58:29.519073 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 00:58:29.519173 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 00:58:29.519264 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 00:58:29.519369 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 00:58:29.528714 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 00:58:29.528928 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '16418261-7c75-4055-8eaf-81fc4861a35c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:58:29.529031 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:58:29.674019 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Detaching volume e875c703-e9a0-42eb-8ebf-f69730042373
May 28 00:58:29.707714 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Attempting to driver detach volume e875c703-e9a0-42eb-8ebf-f69730042373 from mountpoint /dev/vdb
May 28 00:58:29.709877 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Found disk vdb by alias ua-e875c703-e9a0-42eb-8ebf-f69730042373 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 00:58:29.710757 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Found disk vdb by alias ua-e875c703-e9a0-42eb-8ebf-f69730042373 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 00:58:29.710870 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Attempting to detach device vdb from instance b1380963-8254-4ad0-95bb-91d24cea00f9 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 00:58:29.711130 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] detach device xml: <disk type="block" device="disk">
May 28 00:58:29.711130 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 00:58:29.711130 np0000001577 nova-compute[98319]:   <alias name="ua-e875c703-e9a0-42eb-8ebf-f69730042373"/>
May 28 00:58:29.711130 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-5"/>
May 28 00:58:29.711130 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 00:58:29.711130 np0000001577 nova-compute[98319]:   <serial>e875c703-e9a0-42eb-8ebf-f69730042373</serial>
May 28 00:58:29.711130 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 00:58:29.711130 np0000001577 nova-compute[98319]: </disk>
May 28 00:58:29.711130 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 00:58:29.715352 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Successfully detached device vdb from instance b1380963-8254-4ad0-95bb-91d24cea00f9 from the persistent domain config.
May 28 00:58:29.715626 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] (1/8): Attempting to detach device vdb with device alias ua-e875c703-e9a0-42eb-8ebf-f69730042373 from instance b1380963-8254-4ad0-95bb-91d24cea00f9 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 00:58:29.715834 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] detach device xml: <disk type="block" device="disk">
May 28 00:58:29.715834 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 00:58:29.715834 np0000001577 nova-compute[98319]:   <alias name="ua-e875c703-e9a0-42eb-8ebf-f69730042373"/>
May 28 00:58:29.715834 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-5"/>
May 28 00:58:29.715834 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 00:58:29.715834 np0000001577 nova-compute[98319]:   <serial>e875c703-e9a0-42eb-8ebf-f69730042373</serial>
May 28 00:58:29.715834 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 00:58:29.715834 np0000001577 nova-compute[98319]: </disk>
May 28 00:58:29.715834 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 00:58:29.757610 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9ae67c9-f2c4-434c-9b5c-15932450fe88 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "8783a79a-1374-43cf-8f20-81f1a156a315" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.555s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:29.770614 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Acquiring lock "refresh_cache-a8a28bb4-c3ea-4fb9-9130-1e8239191c5b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:58:29.814897 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-6e8b3678-10eb-4e46-aafd-0f645a0f6e90 req-3e60055c-9e74-467a-95ee-a4bf2e352460 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:29.835762 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Found WWN 3300000001491b408 for multipath device dm-7 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 00:58:29.836778 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:58:29.836778 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '3300000001491b408', 'path': '/dev/dm-7', 'multipath_id': '3300000001491b408'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:58:29.836778 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001491b408', 'path': '/dev/dm-7', 'multipath_id': '3300000001491b408'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 00:58:29.837244 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.122s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:58:29.837517 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335', 'iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8969959e-493f-4daf-a2dd-1d0198bab335', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 00:58:29.840049 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lazy-loading 'flavor' on Instance uuid 0928917f-0c8c-4019-aef4-083ba8224ce0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:58:29.851244 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:58:29.851960 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:58:29.853690 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:58:29.854089 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 00:58:29.855885 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:58:29.859832 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 00:58:29.867635 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 00:58:29.867635 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:29.871907 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 00:58:29.871907 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:29.878016 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335] added
May 28 00:58:29.878016 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 00:58:29.878016 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:58:29.878016 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:58:29.878016 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:58:29.878016 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:58:29.878016 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:29.878467 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 00:58:29.878467 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0243(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 00:58:29.878578 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 00:58:29.883662 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335] added
May 28 00:58:29.883662 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 00:58:29.883662 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:58:29.883662 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:58:29.883662 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:58:29.883662 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:58:29.883662 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:29.883891 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 00:58:29.884158 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0242(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 00:58:29.884158 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 00:58:29.887404 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-6e8b3678-10eb-4e46-aafd-0f645a0f6e90 req-3e60055c-9e74-467a-95ee-a4bf2e352460 service nova] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:58:30.019258 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-6e8b3678-10eb-4e46-aafd-0f645a0f6e90 req-3e60055c-9e74-467a-95ee-a4bf2e352460 service nova] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:58:30.221519 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779929910.220695, b1380963-8254-4ad0-95bb-91d24cea00f9 => ua-e875c703-e9a0-42eb-8ebf-f69730042373> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 00:58:30.222066 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e875c703-e9a0-42eb-8ebf-f69730042373 for instance b1380963-8254-4ad0-95bb-91d24cea00f9 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 00:58:30.223636 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Successfully detached device vdb from instance b1380963-8254-4ad0-95bb-91d24cea00f9 from the live domain config.
May 28 00:58:30.224260 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 00:58:30.224519 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373', 'iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e875c703-e9a0-42eb-8ebf-f69730042373', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:58:30.224676 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:58:30.300183 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 00:58:30.300990 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 00:58:30.301225 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Creating image(s)
May 28 00:58:30.301703 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8a28bb4-c3ea-4fb9-9130-1e8239191c5b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:30.301911 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "/opt/stack/data/nova/instances/a8a28bb4-c3ea-4fb9-9130-1e8239191c5b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:30.302449 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "/opt/stack/data/nova/instances/a8a28bb4-c3ea-4fb9-9130-1e8239191c5b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:30.303109 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:58:30.307209 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:58:30.308951 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:30.342796 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Attempting to attach volume d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 00:58:30.345238 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] attach device xml: <disk type="block" device="disk">
May 28 00:58:30.345238 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 00:58:30.345238 np0000001577 nova-compute[98319]:   <alias name="ua-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5"/>
May 28 00:58:30.345238 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-7"/>
May 28 00:58:30.345238 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 00:58:30.345238 np0000001577 nova-compute[98319]:   <serial>d2d3e5ca-4e68-4f8d-84af-117ab421d9f5</serial>
May 28 00:58:30.345238 np0000001577 nova-compute[98319]:   <shareable/>
May 28 00:58:30.345238 np0000001577 nova-compute[98319]: </disk>
May 28 00:58:30.345238 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 00:58:30.380593 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.071s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:58:30.381052 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:30.381519 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:30.381936 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:58:30.384567 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:58:30.384942 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:30.454201 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.069s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:58:30.455620 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/a8a28bb4-c3ea-4fb9-9130-1e8239191c5b/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:30.491303 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/a8a28bb4-c3ea-4fb9-9130-1e8239191c5b/disk 1073741824" returned: 0 in 0.036s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:58:30.491731 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.110s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:30.491970 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:30.521740 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6e8b3678-10eb-4e46-aafd-0f645a0f6e90 req-3e60055c-9e74-467a-95ee-a4bf2e352460 service nova] Releasing lock "refresh_cache-a8a28bb4-c3ea-4fb9-9130-1e8239191c5b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:58:30.522262 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Acquired lock "refresh_cache-a8a28bb4-c3ea-4fb9-9130-1e8239191c5b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:58:30.522522 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 00:58:30.555581 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.063s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:58:30.555894 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8a28bb4-c3ea-4fb9-9130-1e8239191c5b/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 00:58:30.556145 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a28bb4-c3ea-4fb9-9130-1e8239191c5b/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:30.626673 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a28bb4-c3ea-4fb9-9130-1e8239191c5b/disk --force-share --output=json" returned: 0 in 0.070s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:58:30.627052 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Cannot resize image /opt/stack/data/nova/instances/a8a28bb4-c3ea-4fb9-9130-1e8239191c5b/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 00:58:30.627425 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 00:58:30.627628 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Ensure instance console log exists: /opt/stack/data/nova/instances/a8a28bb4-c3ea-4fb9-9130-1e8239191c5b/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 00:58:30.627869 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:30.628103 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:30.628243 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:30.879081 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 00:58:30.884651 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.startup = manual
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.port = 0
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 00:58:30.891825 np0000001577 nova-compute[98319]: # END RECORD
May 28 00:58:30.891825 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.startup = manual
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.port = 0
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 00:58:30.899284 np0000001577 nova-compute[98319]: # END RECORD
May 28 00:58:30.899284 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:30.904422 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:30.908160 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:30.911922 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:30.921364 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:30.921364 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:30.921364 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:30.921364 np0000001577 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:30.921364 np0000001577 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:30.921364 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:30.921364 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:30.921364 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:30.921364 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:30.921364 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:30.921364 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:30.921364 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:30.921364 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:58:30.921731 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:30.921731 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:30.921731 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:30.921731 np0000001577 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:30.921731 np0000001577 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:30.921731 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:30.921731 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:30.921731 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:30.921731 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:30.921731 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:30.921731 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:30.921731 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:30.921731 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:58:30.929754 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:30.929754 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:30.929754 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:30.929754 np0000001577 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:30.929754 np0000001577 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:30.929754 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:30.929754 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:30.929754 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:30.929754 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:30.929754 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:30.929754 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:30.929754 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:30.929754 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:58:30.930331 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:30.930331 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:30.930331 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:30.930331 np0000001577 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:30.930331 np0000001577 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:30.930331 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:30.930331 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:30.930331 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:30.930331 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:30.930331 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:30.930331 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:30.930331 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:30.930331 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:58:30.967541 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335, portal: 192.168.50.100,3260]
May 28 00:58:30.967541 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335, portal: 192.168.50.100,3260] successful.
May 28 00:58:30.967541 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:30.975688 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Acquiring lock "8783a79a-1374-43cf-8f20-81f1a156a315" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:30.975854 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "8783a79a-1374-43cf-8f20-81f1a156a315" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:30.978984 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:30.997286 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335, portal: 192.168.40.100,3260]
May 28 00:58:30.997286 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335, portal: 192.168.40.100,3260] successful.
May 28 00:58:30.997286 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:31.002226 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:31.002226 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:31.002226 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:31.002226 np0000001577 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:31.002226 np0000001577 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:31.002226 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:31.002226 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:31.002226 np0000001577 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:31.002226 np0000001577 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:31.002226 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:31.002226 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:31.002226 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:31.002226 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:31.002226 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:31.002226 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:58:31.002766 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:31.002766 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:31.002766 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:31.002766 np0000001577 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:31.002766 np0000001577 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:31.002766 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:31.002766 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:31.002766 np0000001577 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:31.002766 np0000001577 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:31.002766 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:31.002766 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:31.002766 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:31.002766 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:31.002766 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:31.002766 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:58:31.003021 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:58:31.003021 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 00:58:31.004536 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] HCTL ('19', '-', '-', 0) found on session 17 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 00:58:31.004731 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Scanning host 19 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 00:58:31.010018 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:31.019410 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Searching for a device in session 17 and hctl ['19', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 00:58:31.028157 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:31.028157 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:31.028157 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:31.028157 np0000001577 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:31.028157 np0000001577 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:31.028157 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:31.028157 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:31.028157 np0000001577 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:31.028157 np0000001577 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:31.028157 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:31.028157 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:31.028157 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:31.028157 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:31.028157 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:31.028157 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:58:31.028456 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:31.028456 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:31.028456 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:31.028456 np0000001577 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:31.028456 np0000001577 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:31.028456 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:31.028456 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:31.028456 np0000001577 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:31.028456 np0000001577 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:31.028456 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:31.028456 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:31.028456 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:31.028456 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:31.028456 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:31.028456 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:58:31.028725 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.174s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:58:31.028725 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 00:58:31.029997 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] HCTL ('20', '-', '-', 0) found on session 18 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 00:58:31.030156 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Scanning host 20 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 00:58:31.043023 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Searching for a device in session 18 and hctl ['20', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 00:58:31.104358 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:58:31.246749 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:31.368940 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Updating instance_info_cache with network_info: [{"id": "73b37d7b-3ec2-45cc-8a9c-22ee6556af87", "address": "fa:16:3e:07:50:fa", "network": {"id": "0dbd83f8-e813-4259-a5a9-71f615374a48", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1523117392-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07e72ea70b9147f68a0d66cd524ae614", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b37d7b-3e", "ovs_interfaceid": "73b37d7b-3ec2-45cc-8a9c-22ee6556af87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:58:31.478795 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Detaching volume f1ba50c1-ad16-4bf8-a1df-95aa01a1925d
May 28 00:58:31.515879 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Attempting to driver detach volume f1ba50c1-ad16-4bf8-a1df-95aa01a1925d from mountpoint /dev/sdc
May 28 00:58:31.518362 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Found disk sdc by alias ua-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 00:58:31.519322 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Found disk sdc by alias ua-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 00:58:31.519322 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Attempting to detach device sdc from instance 8783a79a-1374-43cf-8f20-81f1a156a315 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 00:58:31.519489 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] detach device xml: <disk type="block" device="disk">
May 28 00:58:31.519489 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 00:58:31.519489 np0000001577 nova-compute[98319]:   <alias name="ua-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d"/>
May 28 00:58:31.519489 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-6"/>
May 28 00:58:31.519489 np0000001577 nova-compute[98319]:   <target dev="sdc" bus="scsi"/>
May 28 00:58:31.519489 np0000001577 nova-compute[98319]:   <serial>f1ba50c1-ad16-4bf8-a1df-95aa01a1925d</serial>
May 28 00:58:31.519489 np0000001577 nova-compute[98319]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
May 28 00:58:31.519489 np0000001577 nova-compute[98319]: </disk>
May 28 00:58:31.519489 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 00:58:31.523884 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Successfully detached device sdc from instance 8783a79a-1374-43cf-8f20-81f1a156a315 from the persistent domain config.
May 28 00:58:31.524009 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] (1/8): Attempting to detach device sdc with device alias ua-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d from instance 8783a79a-1374-43cf-8f20-81f1a156a315 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 00:58:31.524264 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] detach device xml: <disk type="block" device="disk">
May 28 00:58:31.524264 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 00:58:31.524264 np0000001577 nova-compute[98319]:   <alias name="ua-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d"/>
May 28 00:58:31.524264 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-6"/>
May 28 00:58:31.524264 np0000001577 nova-compute[98319]:   <target dev="sdc" bus="scsi"/>
May 28 00:58:31.524264 np0000001577 nova-compute[98319]:   <serial>f1ba50c1-ad16-4bf8-a1df-95aa01a1925d</serial>
May 28 00:58:31.524264 np0000001577 nova-compute[98319]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
May 28 00:58:31.524264 np0000001577 nova-compute[98319]: </disk>
May 28 00:58:31.524264 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 00:58:31.677063 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779929911.676691, 8783a79a-1374-43cf-8f20-81f1a156a315 => ua-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 00:58:31.678220 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Start waiting for the detach event from libvirt for device sdc with device alias ua-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d for instance 8783a79a-1374-43cf-8f20-81f1a156a315 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 00:58:31.680127 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Successfully detached device sdc from instance 8783a79a-1374-43cf-8f20-81f1a156a315 from the live domain config.
May 28 00:58:31.680794 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 00:58:31.681098 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d', 'iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f1ba50c1-ad16-4bf8-a1df-95aa01a1925d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:58:31.681235 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:58:31.870997 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Releasing lock "refresh_cache-a8a28bb4-c3ea-4fb9-9130-1e8239191c5b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:58:31.871179 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Instance network_info: |[{"id": "73b37d7b-3ec2-45cc-8a9c-22ee6556af87", "address": "fa:16:3e:07:50:fa", "network": {"id": "0dbd83f8-e813-4259-a5a9-71f615374a48", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1523117392-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07e72ea70b9147f68a0d66cd524ae614", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b37d7b-3e", "ovs_interfaceid": "73b37d7b-3ec2-45cc-8a9c-22ee6556af87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 00:58:31.873496 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Start _get_guest_xml network_info=[{"id": "73b37d7b-3ec2-45cc-8a9c-22ee6556af87", "address": "fa:16:3e:07:50:fa", "network": {"id": "0dbd83f8-e813-4259-a5a9-71f615374a48", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1523117392-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07e72ea70b9147f68a0d66cd524ae614", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b37d7b-3e", "ovs_interfaceid": "73b37d7b-3ec2-45cc-8a9c-22ee6556af87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 00:58:31.875154 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 00:58:31.876268 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-TestServerVolumeAttachmentScenario-server-1019416892', uuid='a8a28bb4-c3ea-4fb9-9130-1e8239191c5b'), owner=OwnerMeta(userid='8fe24b43fd0b4818a4fd4bbced85a6e3', username='tempest-TestServerVolumeAttachmentScenario-1047363655-project-member', projectid='07e72ea70b9147f68a0d66cd524ae614', projectname='tempest-TestServerVolumeAttachmentScenario-1047363655'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "73b37d7b-3ec2-45cc-8a9c-22ee6556af87", "address": "fa:16:3e:07:50:fa", "network": {"id": "0dbd83f8-e813-4259-a5a9-71f615374a48", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1523117392-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07e72ea70b9147f68a0d66cd524ae614", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b37d7b-3e", "ovs_interfaceid": "73b37d7b-3ec2-45cc-8a9c-22ee6556af87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779929911.875975) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 00:58:31.876990 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 00:58:31.877302 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 00:58:31.877810 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 00:58:31.877957 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 00:58:31.878804 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 00:58:31.879115 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 00:58:31.879269 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 00:58:31.879354 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 00:58:31.879506 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 00:58:31.879622 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 00:58:31.879727 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 00:58:31.879867 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 00:58:31.879977 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 00:58:31.880104 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 00:58:31.880211 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 00:58:31.880323 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 00:58:31.890129 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T00:58:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1019416892',display_name='tempest-TestServerVolumeAttachmentScenario-server-1019416892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testservervolumeattachmentscenario-server-1019416892',id=10,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhE3klP3t3yPdT8s2nQVboZn/3UjT+0OWw3+eokvovJgBH9qjUTjY0178ZpP0ENO8gC7LTRwNHllNITeG6iz6rto97Lsxn2pzptoki+tWe8lfn7v90PbUlnupavcTmNHQ==',key_name='tempest-keypair-2110859788',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07e72ea70b9147f68a0d66cd524ae614',ramdisk_id='',reservation_id='r-0ffxn1x8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1047363655',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1047363655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:58:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fe24b43fd0b4818a4fd4bbced85a6e3',uuid=a8a28bb4-c3ea-4fb9-9130-1e8239191c5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73b37d7b-3ec2-45cc-8a9c-22ee6556af87", "address": "fa:16:3e:07:50:fa", "network": {"id": "0dbd83f8-e813-4259-a5a9-71f615374a48", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1523117392-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07e72ea70b9147f68a0d66cd524ae614", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b37d7b-3e", "ovs_interfaceid": "73b37d7b-3ec2-45cc-8a9c-22ee6556af87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 00:58:31.890283 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Converting VIF {"id": "73b37d7b-3ec2-45cc-8a9c-22ee6556af87", "address": "fa:16:3e:07:50:fa", "network": {"id": "0dbd83f8-e813-4259-a5a9-71f615374a48", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1523117392-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07e72ea70b9147f68a0d66cd524ae614", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b37d7b-3e", "ovs_interfaceid": "73b37d7b-3ec2-45cc-8a9c-22ee6556af87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:58:31.890806 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:50:fa,bridge_name='br-int',has_traffic_filtering=True,id=73b37d7b-3ec2-45cc-8a9c-22ee6556af87,network=Network(0dbd83f8-e813-4259-a5a9-71f615374a48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73b37d7b-3e') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:58:31.891249 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lazy-loading 'pci_devices' on Instance uuid a8a28bb4-c3ea-4fb9-9130-1e8239191c5b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:58:31.993841 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:58:31.993948 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:58:31.994033 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:58:31.994125 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] No VIF found with MAC fa:16:3e:89:ef:d4, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 00:58:32.020005 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Searching for a device in session 17 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 00:58:32.020174 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8969959e-493f-4daf-a2dd-1d0198bab335', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 00:58:32.042757 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Searching for a device in session 18 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 00:58:32.042885 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8969959e-493f-4daf-a2dd-1d0198bab335', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 00:58:32.393748 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] End _get_guest_xml xml=<domain type="qemu">
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:   <uuid>a8a28bb4-c3ea-4fb9-9130-1e8239191c5b</uuid>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:   <name>instance-0000000a</name>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:   <metadata>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1019416892</nova:name>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 00:58:31</nova:creationTime>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       </nova:image>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:         <nova:user uuid="8fe24b43fd0b4818a4fd4bbced85a6e3">tempest-TestServerVolumeAttachmentScenario-1047363655-project-member</nova:user>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:         <nova:project uuid="07e72ea70b9147f68a0d66cd524ae614">tempest-TestServerVolumeAttachmentScenario-1047363655</nova:project>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:         <nova:port uuid="73b37d7b-3ec2-45cc-8a9c-22ee6556af87">
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:         </nova:port>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:   </metadata>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:     <system>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       <entry name="serial">a8a28bb4-c3ea-4fb9-9130-1e8239191c5b</entry>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       <entry name="uuid">a8a28bb4-c3ea-4fb9-9130-1e8239191c5b</entry>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:     </system>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:   <os>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:   </os>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:   <features>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:     <acpi/>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:     <tcg>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:     </tcg>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:   </features>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:   <devices>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/a8a28bb4-c3ea-4fb9-9130-1e8239191c5b/disk"/>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:     </disk>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/a8a28bb4-c3ea-4fb9-9130-1e8239191c5b/disk.config"/>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:     </disk>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:07:50:fa"/>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       <target dev="tap73b37d7b-3e"/>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:     </interface>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/a8a28bb4-c3ea-4fb9-9130-1e8239191c5b/console.log" append="off"/>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:     </serial>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:     <video>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:     </video>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:     </rng>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:     </memballoon>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:   </devices>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]: </domain>
May 28 00:58:32.393748 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 00:58:32.396016 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Preparing to wait for external event network-vif-plugged-73b37d7b-3ec2-45cc-8a9c-22ee6556af87 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 00:58:32.396016 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Acquiring lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:32.396016 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:32.396016 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:32.396016 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T00:58:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1019416892',display_name='tempest-TestServerVolumeAttachmentScenario-server-1019416892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testservervolumeattachmentscenario-server-1019416892',id=10,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhE3klP3t3yPdT8s2nQVboZn/3UjT+0OWw3+eokvovJgBH9qjUTjY0178ZpP0ENO8gC7LTRwNHllNITeG6iz6rto97Lsxn2pzptoki+tWe8lfn7v90PbUlnupavcTmNHQ==',key_name='tempest-keypair-2110859788',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07e72ea70b9147f68a0d66cd524ae614',ramdisk_id='',reservation_id='r-0ffxn1x8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1047363655',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1047363655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:58:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fe24b43fd0b4818a4fd4bbced85a6e3',uuid=a8a28bb4-c3ea-4fb9-9130-1e8239191c5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73b37d7b-3ec2-45cc-8a9c-22ee6556af87", "address": "fa:16:3e:07:50:fa", "network": {"id": "0dbd83f8-e813-4259-a5a9-71f615374a48", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1523117392-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07e72ea70b9147f68a0d66cd524ae614", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b37d7b-3e", "ovs_interfaceid": "73b37d7b-3ec2-45cc-8a9c-22ee6556af87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 00:58:32.396016 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Converting VIF {"id": "73b37d7b-3ec2-45cc-8a9c-22ee6556af87", "address": "fa:16:3e:07:50:fa", "network": {"id": "0dbd83f8-e813-4259-a5a9-71f615374a48", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1523117392-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07e72ea70b9147f68a0d66cd524ae614", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b37d7b-3e", "ovs_interfaceid": "73b37d7b-3ec2-45cc-8a9c-22ee6556af87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:58:32.396016 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:50:fa,bridge_name='br-int',has_traffic_filtering=True,id=73b37d7b-3ec2-45cc-8a9c-22ee6556af87,network=Network(0dbd83f8-e813-4259-a5a9-71f615374a48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73b37d7b-3e') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:58:32.396016 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:50:fa,bridge_name='br-int',has_traffic_filtering=True,id=73b37d7b-3ec2-45cc-8a9c-22ee6556af87,network=Network(0dbd83f8-e813-4259-a5a9-71f615374a48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73b37d7b-3e') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 00:58:32.396016 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:32.396016 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:32.396435 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 00:58:32.397180 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:32.397308 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0b46e1f-4661-551f-ac1f-324ed7f65d1c', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:32.411002 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:32.411704 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:32.412483 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:32.414054 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:32.414199 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73b37d7b-3e, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:32.414513 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap73b37d7b-3e, col_values=(('qos', UUID('4ec71f41-562e-46d6-9ed8-568356ea23c7')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:32.414708 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap73b37d7b-3e, col_values=(('external_ids', {'iface-id': '73b37d7b-3ec2-45cc-8a9c-22ee6556af87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:50:fa', 'vm-uuid': 'a8a28bb4-c3ea-4fb9-9130-1e8239191c5b'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:32.415384 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:32.416364 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:32.420172 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:32.420879 np0000001577 nova-compute[98319]: INFO os_vif [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:50:fa,bridge_name='br-int',has_traffic_filtering=True,id=73b37d7b-3ec2-45cc-8a9c-22ee6556af87,network=Network(0dbd83f8-e813-4259-a5a9-71f615374a48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73b37d7b-3e')
May 28 00:58:32.853998 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 00:58:33.369580 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquiring lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:33.369903 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:33.534892 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-24887fc7-6750-4203-b295-94064bc86916 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "0928917f-0c8c-4019-aef4-083ba8224ce0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.424s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:33.867873 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Found WWN 3300000005f2e0bc5 for multipath device dm-8 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 00:58:33.868137 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.031s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:58:33.868305 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] <== connect_volume: return (6152ms) {'type': 'block', 'scsi_wwn': '3300000005f2e0bc5', 'path': '/dev/dm-8', 'multipath_id': '3300000005f2e0bc5'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:58:33.868463 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005f2e0bc5', 'path': '/dev/dm-8', 'multipath_id': '3300000005f2e0bc5'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 00:58:33.869015 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 4.340s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:58:33.869270 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '16418261-7c75-4055-8eaf-81fc4861a35c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 00:58:33.870910 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Lazy-loading 'flavor' on Instance uuid a84e49f5-0bde-41ee-866e-6b434748077f {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:58:33.872883 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lazy-loading 'flavor' on Instance uuid 7fdf336e-65c1-4180-92eb-5f8ca0ebc526 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:58:33.880898 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:58:33.881572 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:58:33.881930 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:58:33.882111 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 00:58:33.883504 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:58:33.883720 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 00:58:33.893309 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 00:58:33.893309 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:33.899031 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 00:58:33.899031 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:33.906315 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c] added
May 28 00:58:33.906315 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 00:58:33.906315 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:58:33.906315 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:58:33.906315 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:58:33.906315 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:58:33.906315 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:33.906667 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 00:58:33.906667 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0245(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 00:58:33.906780 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 00:58:33.909537 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c] added
May 28 00:58:33.909537 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 00:58:33.909537 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:58:33.909537 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:58:33.909537 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:58:33.909537 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:58:33.909537 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:33.909770 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 00:58:33.909883 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0262(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 00:58:33.910249 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 00:58:33.933605 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:58:33.933605 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:58:33.933605 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] No VIF found with MAC fa:16:3e:07:50:fa, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 00:58:33.933837 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Using config drive
May 28 00:58:34.375236 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Attempting to attach volume 8969959e-493f-4daf-a2dd-1d0198bab335 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 00:58:34.378151 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] attach device xml: <disk type="block" device="disk">
May 28 00:58:34.378151 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 00:58:34.378151 np0000001577 nova-compute[98319]:   <alias name="ua-8969959e-493f-4daf-a2dd-1d0198bab335"/>
May 28 00:58:34.378151 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-8"/>
May 28 00:58:34.378151 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 00:58:34.378151 np0000001577 nova-compute[98319]:   <serial>8969959e-493f-4daf-a2dd-1d0198bab335</serial>
May 28 00:58:34.378151 np0000001577 nova-compute[98319]: </disk>
May 28 00:58:34.378151 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 00:58:34.442617 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:34.557162 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Creating config drive at /opt/stack/data/nova/instances/a8a28bb4-c3ea-4fb9-9130-1e8239191c5b/disk.config
May 28 00:58:34.561752 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a8a28bb4-c3ea-4fb9-9130-1e8239191c5b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbhthc4zh {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:34.595444 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a8a28bb4-c3ea-4fb9-9130-1e8239191c5b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbhthc4zh" returned: 0 in 0.033s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:58:34.879063 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:34.907259 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 00:58:34.910564 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.startup = manual
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.port = 0
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 00:58:34.918582 np0000001577 nova-compute[98319]: # END RECORD
May 28 00:58:34.918582 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.startup = manual
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.port = 0
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 00:58:34.926614 np0000001577 nova-compute[98319]: # END RECORD
May 28 00:58:34.926614 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:34.932693 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:34.938266 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:34.951541 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:34.951541 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:34.951541 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:34.951541 np0000001577 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:34.951541 np0000001577 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:34.951541 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:34.951541 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:34.951541 np0000001577 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:34.951541 np0000001577 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:34.951541 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:34.951541 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:34.951541 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:34.951541 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:34.951541 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:34.951541 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:58:34.951905 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:34.951905 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:34.951905 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:34.951905 np0000001577 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:34.951905 np0000001577 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:34.951905 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:34.951905 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:34.951905 np0000001577 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:34.951905 np0000001577 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:34.951905 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:34.951905 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:34.951905 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:34.951905 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:34.951905 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:34.951905 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:58:34.958207 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:34.958207 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:34.958207 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:34.958207 np0000001577 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:34.958207 np0000001577 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:34.958207 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:34.958207 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:34.958207 np0000001577 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:34.958207 np0000001577 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:34.958207 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:34.958207 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:34.958207 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:34.958207 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:34.958207 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:34.958207 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:58:34.958207 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:34.958207 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:34.958207 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:34.958207 np0000001577 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:34.958207 np0000001577 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:34.958207 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:34.958207 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:34.958207 np0000001577 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:34.958207 np0000001577 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:34.958207 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:34.958207 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:34.958207 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:34.958207 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:34.958207 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:34.958207 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:58:35.008602 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:35.015236 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c, portal: 192.168.40.100,3260]
May 28 00:58:35.015236 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c, portal: 192.168.40.100,3260] successful.
May 28 00:58:35.015236 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:35.024272 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c, portal: 192.168.50.100,3260]
May 28 00:58:35.024272 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c, portal: 192.168.50.100,3260] successful.
May 28 00:58:35.024272 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:35.030036 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:35.039415 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:35.043316 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:35.054698 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:35.054698 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:35.054698 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:35.054698 np0000001577 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:35.054698 np0000001577 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:35.054698 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:35.054698 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:35.054698 np0000001577 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:35.054698 np0000001577 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:35.054698 np0000001577 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:35.054698 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:35.054698 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:35.054698 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:35.054698 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:35.054698 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:35.054698 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:35.054698 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:58:35.055062 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:35.055062 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:35.055062 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:35.055062 np0000001577 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:35.055062 np0000001577 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:35.055062 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:35.055062 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:35.055062 np0000001577 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:35.055062 np0000001577 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:35.055062 np0000001577 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:35.055062 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:35.055062 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:35.055062 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:35.055062 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:35.055062 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:35.055062 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:35.055062 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:58:35.055357 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:58:35.055357 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 00:58:35.057248 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] HCTL ('21', '-', '-', 0) found on session 19 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 00:58:35.057248 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:35.069915 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:35.069915 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.187s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:58:35.069915 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 00:58:35.070905 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Searching for a device in session 19 and hctl ['21', '*', '*', 0] yield: sdp {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 00:58:35.070947 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '16418261-7c75-4055-8eaf-81fc4861a35c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 00:58:35.072532 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] HCTL ('22', '-', '-', 0) found on session 20 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 00:58:35.072721 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Scanning host 22 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 00:58:35.085329 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Searching for a device in session 20 and hctl ['22', '*', '*', 0] yield: sdq {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 00:58:35.085329 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '16418261-7c75-4055-8eaf-81fc4861a35c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 00:58:35.138088 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:35.306397 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0f7d83d5-9137-4bda-b548-ee2e51134dd9 req-5dc5fc3d-fb06-473d-b596-251f5aa4eeb8 service nova] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Received event network-vif-plugged-73b37d7b-3ec2-45cc-8a9c-22ee6556af87 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:35.306639 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0f7d83d5-9137-4bda-b548-ee2e51134dd9 req-5dc5fc3d-fb06-473d-b596-251f5aa4eeb8 service nova] Acquiring lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:35.307118 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0f7d83d5-9137-4bda-b548-ee2e51134dd9 req-5dc5fc3d-fb06-473d-b596-251f5aa4eeb8 service nova] Lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:35.307652 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0f7d83d5-9137-4bda-b548-ee2e51134dd9 req-5dc5fc3d-fb06-473d-b596-251f5aa4eeb8 service nova] Lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:35.307827 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0f7d83d5-9137-4bda-b548-ee2e51134dd9 req-5dc5fc3d-fb06-473d-b596-251f5aa4eeb8 service nova] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Processing event network-vif-plugged-73b37d7b-3ec2-45cc-8a9c-22ee6556af87 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 00:58:35.392680 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:35.395287 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:35.396453 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:35.421985 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:35.882472 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 00:58:35.884798 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929915.8845139, a8a28bb4-c3ea-4fb9-9130-1e8239191c5b => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:58:35.884989 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] VM Started (Lifecycle Event)
May 28 00:58:35.886635 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 00:58:35.890006 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 00:58:35.892277 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Instance spawned successfully.
May 28 00:58:35.892665 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 00:58:35.913984 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:35.990419 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquiring lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:35.990582 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:35.990758 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Attaching volume d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 to /dev/vdb
May 28 00:58:36.023649 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:58:36.023769 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:58:36.023885 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:58:36.023982 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] No VIF found with MAC fa:16:3e:0c:bd:d9, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 00:58:36.036168 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:58:36.046148 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 00:58:36.064985 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:36.090844 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 00:58:36.091166 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 00:58:36.100926 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 00:58:36.104503 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe2c:d2b6', 'fe80::1c4b:31ff:fe4e:7f0', 'fe80::fc16:3eff:fe3a:fe3d', 'fe80::709d:70ff:fe70:893c', 'fe80::fc16:3eff:fe89:efd4', 'fe80::5801:aff:fe37:eba3', 'fe80::fc16:3eff:fea7:2821', 'fe80::fc16:3eff:fe0c:bdd9', 'fe80::fc11:9dff:fe9e:8235', 'fe80::fc16:3eff:fea2:aca1', 'fe80::9074:35ff:fed3:23bc', 'fe80::fc16:3eff:fe05:ba8e', 'fe80::fc16:3eff:fe14:b715', 'fe80::fc16:3eff:fe67:4cbd', 'fe80::fc16:3eff:fe31:f363', 'fe80::fc16:3eff:fefe:12c6', 'fe80::74a3:c5ff:fe48:a048', 'fe80::fc16:3eff:fe4c:71ca', 'fe80::c061:57ff:feca:6b8e', 'fe80::fc16:3eff:fe0c:393a', 'fe80::40cf:5bff:fe45:e1a0', 'fe80::fc16:3eff:fe07:50fa', 'fe80::349a:eff:fe88:15e5'] 
May 28 00:58:36.104679 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 00:58:36.104860 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 00:58:36.105196 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] <== get_connector_properties: return (68ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:58:36.105499 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Updating existing volume attachment record: 005b2f0e-c405-4ecb-b8f9-7b8fe0067740 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 00:58:36.388221 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:58:36.389752 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:58:36.406073 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:58:36.406195 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:58:36.406538 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:58:36.406812 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:58:36.407075 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:58:36.407321 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:58:36.654003 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 00:58:36.654307 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd2d3e5ca-4e68-4f8d-84af-117ab421d9f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:58:36.654450 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:58:36.894239 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 00:58:36.894741 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929916.894335, a8a28bb4-c3ea-4fb9-9130-1e8239191c5b => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:58:36.894741 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] VM Paused (Lifecycle Event)
May 28 00:58:36.898040 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Found WWN 3300000007ca69e9f for multipath device dm-9 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 00:58:36.898330 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:58:36.899208 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 6.674s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:58:36.900326 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] <== connect_volume: return (7370ms) {'type': 'block', 'scsi_wwn': '3300000007ca69e9f', 'path': '/dev/dm-9', 'multipath_id': '3300000007ca69e9f'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:58:36.900526 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373', 'iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e875c703-e9a0-42eb-8ebf-f69730042373', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 00:58:36.900730 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007ca69e9f', 'path': '/dev/dm-9', 'multipath_id': '3300000007ca69e9f'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 00:58:36.900945 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 00:58:36.914076 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Took 6.61 seconds to spawn the instance on the hypervisor.
May 28 00:58:36.914218 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:58:36.944010 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:36.944010 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:36.944010 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:36.944010 np0000001577 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:36.944010 np0000001577 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:36.944010 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:36.944010 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:36.944010 np0000001577 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:36.944010 np0000001577 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:36.944010 np0000001577 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:36.944010 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:36.944010 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:36.944010 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:36.944010 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:36.944010 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:36.944010 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:36.944010 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:58:36.944340 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:36.944340 np0000001577 nova-compute[98319]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:36.944340 np0000001577 nova-compute[98319]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373 (non-flash)
May 28 00:58:36.944340 np0000001577 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:36.944340 np0000001577 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:36.944340 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:36.944340 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:36.944340 np0000001577 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:36.944340 np0000001577 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:36.944340 np0000001577 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:36.944340 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:36.944340 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:36.944340 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:36.944340 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:36.944340 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:36.944340 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:36.944340 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:58:36.944340 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884', '10'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', '16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce', '8'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884', '9')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 00:58:36.944693 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373', '12')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 00:58:36.948683 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373', '11')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 00:58:36.948683 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c98704942c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373'): ({'sdi'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 00:58:36.948683 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Removing multipathed devices sdh, sdi {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 00:58:36.948683 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Flush multipath device 330000000d4ea86dd {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 00:58:36.986570 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 00:58:37.009474 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:58:37.011558 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:58:37.011558 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:58:37.011558 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:58:37.011558 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:58:37.011558 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:58:37.011558 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:58:37.011558 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:58:37.011558 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 00:58:37.011558 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:58:37.024843 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 00:58:37.082936 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 00:58:37.083047 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 00:58:37.084887 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 00:58:37.094343 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 00:58:37.094503 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 00:58:37.105806 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:37.145526 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373, portal: 192.168.40.100,3260]
May 28 00:58:37.145526 np0000001577 nova-compute[98319]: Logout of [sid: 12, target: iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373, portal: 192.168.40.100,3260] successful.
May 28 00:58:37.145526 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:37.167402 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:37.178938 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:37.215711 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373, portal: 192.168.50.100,3260]
May 28 00:58:37.215711 np0000001577 nova-compute[98319]: Logout of [sid: 11, target: iqn.2023-03.storpool.com:os--volume-e875c703-e9a0-42eb-8ebf-f69730042373, portal: 192.168.50.100,3260] successful.
May 28 00:58:37.215711 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:37.235286 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:37.235505 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:58:37.235680 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] <== disconnect_volume: return (7011ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:58:37.235794 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 00:58:37.237967 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 5.557s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:58:37.238452 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d', 'iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f1ba50c1-ad16-4bf8-a1df-95aa01a1925d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 00:58:37.238775 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 00:58:37.269573 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:37.269573 np0000001577 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:37.269573 np0000001577 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:37.269573 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:37.269573 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:37.269573 np0000001577 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:37.269573 np0000001577 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:37.269573 np0000001577 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:37.269573 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:37.269573 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:37.269573 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:37.269573 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:37.269573 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:37.269573 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:37.269573 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:58:37.269573 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:37.269573 np0000001577 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:37.269573 np0000001577 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d (non-flash)
May 28 00:58:37.269573 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:37.269573 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:37.269573 np0000001577 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:37.269573 np0000001577 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:37.269573 np0000001577 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:37.269573 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:37.269573 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:37.269573 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:37.269573 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:37.269573 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:37.269573 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:37.269573 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:58:37.269573 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', '16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce', '8'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884', '9')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 00:58:37.269573 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d', '13')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 00:58:37.269573 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d', '14')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 00:58:37.269573 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c9870423060>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d'): ({'sdk'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 00:58:37.271129 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Removing multipathed devices sdj, sdk {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 00:58:37.271487 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Flush multipath device 330000000eac6fd34 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 00:58:37.301998 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 00:58:37.352155 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 00:58:37.371194 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d5434473-566f-459d-9d52-7fdeeda16562 req-7a1b2b53-8251-43bf-9979-7279b1af89ae service nova] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Received event network-vif-plugged-73b37d7b-3ec2-45cc-8a9c-22ee6556af87 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:37.371527 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d5434473-566f-459d-9d52-7fdeeda16562 req-7a1b2b53-8251-43bf-9979-7279b1af89ae service nova] Acquiring lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:37.371779 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d5434473-566f-459d-9d52-7fdeeda16562 req-7a1b2b53-8251-43bf-9979-7279b1af89ae service nova] Lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:37.371900 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d5434473-566f-459d-9d52-7fdeeda16562 req-7a1b2b53-8251-43bf-9979-7279b1af89ae service nova] Lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:37.372018 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d5434473-566f-459d-9d52-7fdeeda16562 req-7a1b2b53-8251-43bf-9979-7279b1af89ae service nova] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] No waiting events found dispatching network-vif-plugged-73b37d7b-3ec2-45cc-8a9c-22ee6556af87 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:58:37.372140 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-d5434473-566f-459d-9d52-7fdeeda16562 req-7a1b2b53-8251-43bf-9979-7279b1af89ae service nova] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Received unexpected event network-vif-plugged-73b37d7b-3ec2-45cc-8a9c-22ee6556af87 for instance with vm_state active and task_state None.
May 28 00:58:37.396660 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:58:37.398152 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929917.3979187, a8a28bb4-c3ea-4fb9-9130-1e8239191c5b => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:58:37.398452 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] VM Resumed (Lifecycle Event)
May 28 00:58:37.404001 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 00:58:37.407126 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 00:58:37.407126 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 00:58:37.407512 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T00:58:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-21773514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumemultiattachtest-server-21773514',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938c2829112843edb2054984e80ce7ad',ramdisk_id='',reservation_id='r-ub9dilir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-89204095',owner_user_name='tempest-AttachVolumeMultiAttachTest-89204095-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:58:27Z,user_data=None,user_id='f8586a18edcf42cab0a60028135ae401',uuid=8bca25d8-071e-4b2d-960c-50582381cc75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed09134a-777e-4b64-a80d-4d4e00e3b25a", "address": "fa:16:3e:75:1c:46", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped09134a-77", "ovs_interfaceid": "ed09134a-777e-4b64-a80d-4d4e00e3b25a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 00:58:37.407972 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converting VIF {"id": "ed09134a-777e-4b64-a80d-4d4e00e3b25a", "address": "fa:16:3e:75:1c:46", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped09134a-77", "ovs_interfaceid": "ed09134a-777e-4b64-a80d-4d4e00e3b25a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:58:37.408958 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:1c:46,bridge_name='br-int',has_traffic_filtering=True,id=ed09134a-777e-4b64-a80d-4d4e00e3b25a,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped09134a-77') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:58:37.409805 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lazy-loading 'pci_devices' on Instance uuid 8bca25d8-071e-4b2d-960c-50582381cc75 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:58:37.419425 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 00:58:37.419425 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 00:58:37.425063 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:37.427282 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Took 14.44 seconds to build instance.
May 28 00:58:37.437586 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:37.480951 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d, portal: 192.168.40.100,3260]
May 28 00:58:37.480951 np0000001577 nova-compute[98319]: Logout of [sid: 13, target: iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d, portal: 192.168.40.100,3260] successful.
May 28 00:58:37.480951 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:37.503990 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:37.516292 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:37.516544 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:37.516724 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:37.517458 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:37.517589 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Auditing locally available compute resources for np0000001577 (node: np0000001577) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 00:58:37.553317 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d, portal: 192.168.50.100,3260]
May 28 00:58:37.553317 np0000001577 nova-compute[98319]: Logout of [sid: 14, target: iqn.2023-03.storpool.com:os--volume-f1ba50c1-ad16-4bf8-a1df-95aa01a1925d, portal: 192.168.50.100,3260] successful.
May 28 00:58:37.553317 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:37.571784 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5ebae2f2-6270-4986-9229-17f7129ce673 tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Lock "a84e49f5-0bde-41ee-866e-6b434748077f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.511s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:37.588760 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:37.588760 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:58:37.588760 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] <== disconnect_volume: return (5905ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:58:37.588760 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 00:58:37.589278 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.935s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:58:37.589577 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd2d3e5ca-4e68-4f8d-84af-117ab421d9f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 00:58:37.604966 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:58:37.605415 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:58:37.605857 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:58:37.606007 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 00:58:37.606464 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:58:37.606679 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.startup = automatic
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.port = 0
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.session.scan = manual
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 00:58:37.619939 np0000001577 nova-compute[98319]: # END RECORD
May 28 00:58:37.619939 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.startup = automatic
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.port = 0
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.session.scan = manual
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 00:58:37.630133 np0000001577 nova-compute[98319]: # END RECORD
May 28 00:58:37.630133 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:37.640280 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:37.650039 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:37.661051 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:37.661051 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:37.661051 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:37.661051 np0000001577 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:37.661051 np0000001577 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:37.661051 np0000001577 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:37.661051 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:37.661051 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:37.661051 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:37.661051 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:37.661051 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:37.661051 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:37.661051 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:58:37.661324 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:37.661324 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:37.661324 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:37.661324 np0000001577 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:37.661324 np0000001577 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:37.661324 np0000001577 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:37.661324 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:37.661324 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:37.661324 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:37.661324 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:37.661324 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:37.661324 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:37.661324 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:58:37.661531 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.056s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:58:37.661531 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 00:58:37.662100 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] HCTL ('17', '0', '0', 0) found on session 15 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 00:58:37.662200 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Scanning host 17 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 00:58:37.672048 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Searching for a device in session 15 and hctl ('17', '0', '0', 0) yield: sdl {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 00:58:37.672166 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd2d3e5ca-4e68-4f8d-84af-117ab421d9f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 00:58:37.677536 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:37.677536 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:37.677536 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:37.677536 np0000001577 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:37.677536 np0000001577 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:37.677536 np0000001577 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:37.677536 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:37.677536 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:37.677536 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:37.677536 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:37.677536 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:37.677536 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:37.677536 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:58:37.677862 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:37.677862 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:37.677862 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:37.677862 np0000001577 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:37.677862 np0000001577 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:37.677862 np0000001577 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:37.677862 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:37.677862 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:37.677862 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:37.677862 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:37.677862 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:37.677862 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:37.677862 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:58:37.678049 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.071s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:58:37.678049 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 00:58:37.678731 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] HCTL ('18', '0', '0', 0) found on session 16 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 00:58:37.678827 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Scanning host 18 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 00:58:37.691768 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Searching for a device in session 16 and hctl ('18', '0', '0', 0) yield: sdm {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 00:58:37.691895 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd2d3e5ca-4e68-4f8d-84af-117ab421d9f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 00:58:37.803618 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0635d9ed-2486-4e55-9592-cd5e586c7fe7 tempest-VolumesAssistedSnapshotsTest-1541627436 tempest-VolumesAssistedSnapshotsTest-1541627436-project] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] volume_snapshot_create: create_info: {'snapshot_id': '46f5b486-7ba5-458f-88c0-ab24d7fde52f', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=98319) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3769}}
May 28 00:58:37.805857 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lazy-loading 'flavor' on Instance uuid b1380963-8254-4ad0-95bb-91d24cea00f9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:58:37.810029 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0635d9ed-2486-4e55-9592-cd5e586c7fe7 tempest-VolumesAssistedSnapshotsTest-1541627436 tempest-VolumesAssistedSnapshotsTest-1541627436-project] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] snap xml: <domainsnapshot>
May 28 00:58:37.810029 np0000001577 nova-compute[98319]:   <disks>
May 28 00:58:37.810029 np0000001577 nova-compute[98319]:     <disk name="/dev/dm-8" snapshot="external" type="file">
May 28 00:58:37.810029 np0000001577 nova-compute[98319]:       <source file="/dev/new_file"/>
May 28 00:58:37.810029 np0000001577 nova-compute[98319]:     </disk>
May 28 00:58:37.810029 np0000001577 nova-compute[98319]:     <disk name="vda" snapshot="no"/>
May 28 00:58:37.810029 np0000001577 nova-compute[98319]:     <disk name="hda" snapshot="no"/>
May 28 00:58:37.810029 np0000001577 nova-compute[98319]:   </disks>
May 28 00:58:37.810029 np0000001577 nova-compute[98319]: </domainsnapshot>
May 28 00:58:37.810029 np0000001577 nova-compute[98319]:  {{(pid=98319) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3710}}
May 28 00:58:37.810316 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-0635d9ed-2486-4e55-9592-cd5e586c7fe7 tempest-VolumesAssistedSnapshotsTest-1541627436 tempest-VolumesAssistedSnapshotsTest-1541627436-project] Lazy-loading 'system_metadata' on Instance uuid a84e49f5-0bde-41ee-866e-6b434748077f {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:58:37.854505 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-09809c51-b223-467b-b8f3-e547e30277a9 tempest-VolumesAssistedSnapshotsTest-1541627436 tempest-VolumesAssistedSnapshotsTest-1541627436-project] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] volume_snapshot_delete: delete_info: {'volume_id': '8969959e-493f-4daf-a2dd-1d0198bab335'} {{(pid=98319) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3877}}
May 28 00:58:37.860296 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver [None req-09809c51-b223-467b-b8f3-e547e30277a9 tempest-VolumesAssistedSnapshotsTest-1541627436 tempest-VolumesAssistedSnapshotsTest-1541627436-project] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
May 28 00:58:37.860296 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Traceback (most recent call last):
May 28 00:58:37.860296 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: a84e49f5-0bde-41ee-866e-6b434748077f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 28 00:58:37.860296 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: a84e49f5-0bde-41ee-866e-6b434748077f]     self._volume_snapshot_delete(context, instance, volume_id,
May 28 00:58:37.860296 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: a84e49f5-0bde-41ee-866e-6b434748077f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 28 00:58:37.860296 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: a84e49f5-0bde-41ee-866e-6b434748077f]     if delete_info['type'] != 'qcow2':
May 28 00:58:37.860296 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: a84e49f5-0bde-41ee-866e-6b434748077f]        ~~~~~~~~~~~^^^^^^^^
May 28 00:58:37.860296 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: a84e49f5-0bde-41ee-866e-6b434748077f] KeyError: 'type'
May 28 00:58:37.860296 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: a84e49f5-0bde-41ee-866e-6b434748077f] 
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver [None req-09809c51-b223-467b-b8f3-e547e30277a9 tempest-VolumesAssistedSnapshotsTest-1541627436 tempest-VolumesAssistedSnapshotsTest-1541627436-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver        ~~~~~~~~~~~^^^^^^^^
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver KeyError: 'type'
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver 
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver 
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-e6e5c5b1-7228-4fbc-8b3b-b8e8b01246a7)
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver 
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver 
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
May 28 00:58:37.879090 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver 
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server [None req-09809c51-b223-467b-b8f3-e547e30277a9 tempest-VolumesAssistedSnapshotsTest-1541627436 tempest-VolumesAssistedSnapshotsTest-1541627436-project] Exception during message handling: KeyError: 'type'
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server     raise self.value
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4829, in volume_snapshot_delete
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4053, in volume_snapshot_delete
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server     raise self.value
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server        ~~~~~~~~~~~^^^^^^^^
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server KeyError: 'type'
May 28 00:58:37.887341 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server 
May 28 00:58:37.901483 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:58:37.902704 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:58:37.913429 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] End _get_guest_xml xml=<domain type="qemu">
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:   <uuid>8bca25d8-071e-4b2d-960c-50582381cc75</uuid>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:   <name>instance-00000009</name>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:   <metadata>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       <nova:name>tempest-AttachVolumeMultiAttachTest-server-21773514</nova:name>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 00:58:29</nova:creationTime>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       <nova:image uuid="">
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       </nova:image>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:         <nova:user uuid="f8586a18edcf42cab0a60028135ae401">tempest-AttachVolumeMultiAttachTest-89204095-project-member</nova:user>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:         <nova:project uuid="938c2829112843edb2054984e80ce7ad">tempest-AttachVolumeMultiAttachTest-89204095</nova:project>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:         <nova:port uuid="ed09134a-777e-4b64-a80d-4d4e00e3b25a">
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:         </nova:port>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:   </metadata>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:     <system>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       <entry name="serial">8bca25d8-071e-4b2d-960c-50582381cc75</entry>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       <entry name="uuid">8bca25d8-071e-4b2d-960c-50582381cc75</entry>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:     </system>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:   <os>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:   </os>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:   <features>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:     <acpi/>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:     <tcg>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:     </tcg>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:   </features>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:   <devices>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/8bca25d8-071e-4b2d-960c-50582381cc75/disk.config"/>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:     </disk>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       <alias name="ua-16418261-7c75-4055-8eaf-81fc4861a35c"/>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-9"/>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       <serial>16418261-7c75-4055-8eaf-81fc4861a35c</serial>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       <shareable/>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:     </disk>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:75:1c:46"/>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       <target dev="taped09134a-77"/>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:     </interface>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/8bca25d8-071e-4b2d-960c-50582381cc75/console.log" append="off"/>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:     </serial>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:     <video>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:     </video>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:     </rng>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:     </memballoon>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:   </devices>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]: </domain>
May 28 00:58:37.913429 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 00:58:37.915150 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Preparing to wait for external event network-vif-plugged-ed09134a-777e-4b64-a80d-4d4e00e3b25a {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 00:58:37.915150 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "8bca25d8-071e-4b2d-960c-50582381cc75-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:37.915150 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "8bca25d8-071e-4b2d-960c-50582381cc75-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:37.915150 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "8bca25d8-071e-4b2d-960c-50582381cc75-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:37.920020 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T00:58:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-21773514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumemultiattachtest-server-21773514',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938c2829112843edb2054984e80ce7ad',ramdisk_id='',reservation_id='r-ub9dilir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-89204095',owner_user_name='tempest-AttachVolumeMultiAttachTest-89204095-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:58:27Z,user_data=None,user_id='f8586a18edcf42cab0a60028135ae401',uuid=8bca25d8-071e-4b2d-960c-50582381cc75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed09134a-777e-4b64-a80d-4d4e00e3b25a", "address": "fa:16:3e:75:1c:46", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped09134a-77", "ovs_interfaceid": "ed09134a-777e-4b64-a80d-4d4e00e3b25a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 00:58:37.920299 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converting VIF {"id": "ed09134a-777e-4b64-a80d-4d4e00e3b25a", "address": "fa:16:3e:75:1c:46", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped09134a-77", "ovs_interfaceid": "ed09134a-777e-4b64-a80d-4d4e00e3b25a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:58:37.921240 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:1c:46,bridge_name='br-int',has_traffic_filtering=True,id=ed09134a-777e-4b64-a80d-4d4e00e3b25a,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped09134a-77') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:58:37.921703 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:1c:46,bridge_name='br-int',has_traffic_filtering=True,id=ed09134a-777e-4b64-a80d-4d4e00e3b25a,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped09134a-77') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 00:58:37.922213 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:37.922560 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:37.922827 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 00:58:37.924436 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:37.924668 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b8ca2ac-ef18-5edb-add8-f1021b1cee59', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:37.926653 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:37.927616 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:37.929489 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:37.930759 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3860245f-eb2b-4da6-9b44-bf3e33975a75 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.950s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:37.931555 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:37.931749 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped09134a-77, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:37.932016 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped09134a-77, col_values=(('qos', UUID('7583ef48-7551-4a24-993f-3cde0219dcbd')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:37.932183 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped09134a-77, col_values=(('external_ids', {'iface-id': 'ed09134a-777e-4b64-a80d-4d4e00e3b25a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:1c:46', 'vm-uuid': '8bca25d8-071e-4b2d-960c-50582381cc75'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:37.932916 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:37.934430 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:37.940988 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:37.942004 np0000001577 nova-compute[98319]: INFO os_vif [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:1c:46,bridge_name='br-int',has_traffic_filtering=True,id=ed09134a-777e-4b64-a80d-4d4e00e3b25a,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped09134a-77')
May 28 00:58:38.177402 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lazy-loading 'flavor' on Instance uuid 8783a79a-1374-43cf-8f20-81f1a156a315 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:58:38.314609 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0635d9ed-2486-4e55-9592-cd5e586c7fe7 tempest-VolumesAssistedSnapshotsTest-1541627436 tempest-VolumesAssistedSnapshotsTest-1541627436-project] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Skipping quiescing instance: QEMU guest agent is not enabled.
May 28 00:58:38.322684 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver [None req-0635d9ed-2486-4e55-9592-cd5e586c7fe7 tempest-VolumesAssistedSnapshotsTest-1541627436 tempest-VolumesAssistedSnapshotsTest-1541627436-project] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 00:58:38.322684 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Traceback (most recent call last):
May 28 00:58:38.322684 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: a84e49f5-0bde-41ee-866e-6b434748077f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 28 00:58:38.322684 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: a84e49f5-0bde-41ee-866e-6b434748077f]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 28 00:58:38.322684 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: a84e49f5-0bde-41ee-866e-6b434748077f]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 28 00:58:38.322684 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: a84e49f5-0bde-41ee-866e-6b434748077f]     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 28 00:58:38.322684 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: a84e49f5-0bde-41ee-866e-6b434748077f]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 28 00:58:38.322684 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: a84e49f5-0bde-41ee-866e-6b434748077f]     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 28 00:58:38.322684 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: a84e49f5-0bde-41ee-866e-6b434748077f] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 00:58:38.322684 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: a84e49f5-0bde-41ee-866e-6b434748077f] 
May 28 00:58:38.323340 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver [None req-0635d9ed-2486-4e55-9592-cd5e586c7fe7 tempest-VolumesAssistedSnapshotsTest-1541627436 tempest-VolumesAssistedSnapshotsTest-1541627436-project] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 00:58:38.323340 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Traceback (most recent call last):
May 28 00:58:38.323340 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: a84e49f5-0bde-41ee-866e-6b434748077f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 28 00:58:38.323340 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: a84e49f5-0bde-41ee-866e-6b434748077f]     self._volume_snapshot_create(context, instance, guest,
May 28 00:58:38.323340 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: a84e49f5-0bde-41ee-866e-6b434748077f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 28 00:58:38.323340 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: a84e49f5-0bde-41ee-866e-6b434748077f]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 28 00:58:38.323340 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: a84e49f5-0bde-41ee-866e-6b434748077f]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 28 00:58:38.323340 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: a84e49f5-0bde-41ee-866e-6b434748077f]     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 28 00:58:38.323340 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: a84e49f5-0bde-41ee-866e-6b434748077f]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 28 00:58:38.323340 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: a84e49f5-0bde-41ee-866e-6b434748077f]     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 28 00:58:38.323340 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: a84e49f5-0bde-41ee-866e-6b434748077f] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 00:58:38.323340 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: a84e49f5-0bde-41ee-866e-6b434748077f] 
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver [None req-0635d9ed-2486-4e55-9592-cd5e586c7fe7 tempest-VolumesAssistedSnapshotsTest-1541627436 tempest-VolumesAssistedSnapshotsTest-1541627436-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 46f5b486-7ba5-458f-88c0-ab24d7fde52f could not be found.
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver 
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver 
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 46f5b486-7ba5-458f-88c0-ab24d7fde52f could not be found. (HTTP 404) (Request-ID: req-1f963227-1ba6-42f0-9e16-519716ba37c0)
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver 
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver 
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 46f5b486-7ba5-458f-88c0-ab24d7fde52f could not be found.
May 28 00:58:38.346927 np0000001577 nova-compute[98319]: ERROR nova.virt.libvirt.driver 
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server [None req-0635d9ed-2486-4e55-9592-cd5e586c7fe7 tempest-VolumesAssistedSnapshotsTest-1541627436 tempest-VolumesAssistedSnapshotsTest-1541627436-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server     raise self.value
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4817, in volume_snapshot_create
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3790, in volume_snapshot_create
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server     raise self.value
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 00:58:38.350454 np0000001577 nova-compute[98319]: ERROR oslo_messaging.rpc.server 
May 28 00:58:38.497848 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a0392d72-c054-4f75-8e31-e80bb974be5b req-b21b5592-8a9a-4147-ab7b-5086bed1ec5c service nova] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Received event network-changed-73b37d7b-3ec2-45cc-8a9c-22ee6556af87 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:38.497848 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a0392d72-c054-4f75-8e31-e80bb974be5b req-b21b5592-8a9a-4147-ab7b-5086bed1ec5c service nova] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Refreshing instance network info cache due to event network-changed-73b37d7b-3ec2-45cc-8a9c-22ee6556af87. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:58:38.497848 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a0392d72-c054-4f75-8e31-e80bb974be5b req-b21b5592-8a9a-4147-ab7b-5086bed1ec5c service nova] Acquiring lock "refresh_cache-a8a28bb4-c3ea-4fb9-9130-1e8239191c5b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:58:38.497848 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a0392d72-c054-4f75-8e31-e80bb974be5b req-b21b5592-8a9a-4147-ab7b-5086bed1ec5c service nova] Acquired lock "refresh_cache-a8a28bb4-c3ea-4fb9-9130-1e8239191c5b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:58:38.497848 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-a0392d72-c054-4f75-8e31-e80bb974be5b req-b21b5592-8a9a-4147-ab7b-5086bed1ec5c service nova] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Refreshing network info cache for port 73b37d7b-3ec2-45cc-8a9c-22ee6556af87 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:58:38.542779 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Acquiring lock "interface-b1380963-8254-4ad0-95bb-91d24cea00f9-ec4fad7e-3a01-4591-ae8f-0b8fe30d60de" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:38.542930 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "interface-b1380963-8254-4ad0-95bb-91d24cea00f9-ec4fad7e-3a01-4591-ae8f-0b8fe30d60de" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:38.552106 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8783a79a-1374-43cf-8f20-81f1a156a315/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:38.608057 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 00:58:38.623055 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8783a79a-1374-43cf-8f20-81f1a156a315/disk --force-share --output=json" returned: 0 in 0.071s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:58:38.626565 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8783a79a-1374-43cf-8f20-81f1a156a315/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:38.691163 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8783a79a-1374-43cf-8f20-81f1a156a315/disk --force-share --output=json" returned: 0 in 0.067s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:58:38.693987 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 00:58:38.694213 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 00:58:38.694444 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-4 (vdc) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 00:58:38.695934 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:38.764298 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Acquiring lock "a84e49f5-0bde-41ee-866e-6b434748077f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:38.764733 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Lock "a84e49f5-0bde-41ee-866e-6b434748077f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:38.766129 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/disk --force-share --output=json" returned: 0 in 0.070s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:58:38.769576 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:38.850098 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:58:38.854561 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0928917f-0c8c-4019-aef4-083ba8224ce0/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:38.930884 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0928917f-0c8c-4019-aef4-083ba8224ce0/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:58:38.934671 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0928917f-0c8c-4019-aef4-083ba8224ce0/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:39.003437 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-a0392d72-c054-4f75-8e31-e80bb974be5b req-b21b5592-8a9a-4147-ab7b-5086bed1ec5c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:39.023782 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0928917f-0c8c-4019-aef4-083ba8224ce0/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:58:39.024915 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 00:58:39.030682 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fdf336e-65c1-4180-92eb-5f8ca0ebc526/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:39.054951 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lazy-loading 'flavor' on Instance uuid b1380963-8254-4ad0-95bb-91d24cea00f9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:58:39.120123 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fdf336e-65c1-4180-92eb-5f8ca0ebc526/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:58:39.120417 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fdf336e-65c1-4180-92eb-5f8ca0ebc526/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:39.188901 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-939fdb15-59c2-479e-812c-c4132ff9d4c0 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "8783a79a-1374-43cf-8f20-81f1a156a315" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 8.213s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:39.215801 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fdf336e-65c1-4180-92eb-5f8ca0ebc526/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:58:39.219189 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a28bb4-c3ea-4fb9-9130-1e8239191c5b/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:39.267794 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Detaching volume 8969959e-493f-4daf-a2dd-1d0198bab335
May 28 00:58:39.305173 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a28bb4-c3ea-4fb9-9130-1e8239191c5b/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:58:39.306722 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a28bb4-c3ea-4fb9-9130-1e8239191c5b/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:39.329581 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Attempting to driver detach volume 8969959e-493f-4daf-a2dd-1d0198bab335 from mountpoint /dev/vdb
May 28 00:58:39.329581 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-09a96fa6-5c8e-4423-8742-62237e81f27a tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "b1380963-8254-4ad0-95bb-91d24cea00f9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 10.157s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:39.336769 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Found disk vdb by alias ua-8969959e-493f-4daf-a2dd-1d0198bab335 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 00:58:39.338279 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Found disk vdb by alias ua-8969959e-493f-4daf-a2dd-1d0198bab335 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 00:58:39.338411 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Attempting to detach device vdb from instance a84e49f5-0bde-41ee-866e-6b434748077f from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 00:58:39.338769 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] detach device xml: <disk type="block" device="disk">
May 28 00:58:39.338769 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 00:58:39.338769 np0000001577 nova-compute[98319]:   <alias name="ua-8969959e-493f-4daf-a2dd-1d0198bab335"/>
May 28 00:58:39.338769 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-8"/>
May 28 00:58:39.338769 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 00:58:39.338769 np0000001577 nova-compute[98319]:   <serial>8969959e-493f-4daf-a2dd-1d0198bab335</serial>
May 28 00:58:39.338769 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 00:58:39.338769 np0000001577 nova-compute[98319]: </disk>
May 28 00:58:39.338769 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 00:58:39.344908 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Successfully detached device vdb from instance a84e49f5-0bde-41ee-866e-6b434748077f from the persistent domain config.
May 28 00:58:39.345062 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] (1/8): Attempting to detach device vdb with device alias ua-8969959e-493f-4daf-a2dd-1d0198bab335 from instance a84e49f5-0bde-41ee-866e-6b434748077f from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 00:58:39.346615 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] detach device xml: <disk type="block" device="disk">
May 28 00:58:39.346615 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 00:58:39.346615 np0000001577 nova-compute[98319]:   <alias name="ua-8969959e-493f-4daf-a2dd-1d0198bab335"/>
May 28 00:58:39.346615 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-8"/>
May 28 00:58:39.346615 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 00:58:39.346615 np0000001577 nova-compute[98319]:   <serial>8969959e-493f-4daf-a2dd-1d0198bab335</serial>
May 28 00:58:39.346615 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 00:58:39.346615 np0000001577 nova-compute[98319]: </disk>
May 28 00:58:39.346615 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 00:58:39.390308 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a28bb4-c3ea-4fb9-9130-1e8239191c5b/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:58:39.393215 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84e49f5-0bde-41ee-866e-6b434748077f/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:39.434586 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-a0392d72-c054-4f75-8e31-e80bb974be5b req-b21b5592-8a9a-4147-ab7b-5086bed1ec5c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:39.462045 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:58:39.462179 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:58:39.462308 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No VIF found with MAC fa:16:3e:75:1c:46, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 00:58:39.462851 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Using config drive
May 28 00:58:39.472963 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84e49f5-0bde-41ee-866e-6b434748077f/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:58:39.473615 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84e49f5-0bde-41ee-866e-6b434748077f/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:39.510596 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2a944823-06e5-4296-a811-7c65568c3c12 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Acquiring lock "8783a79a-1374-43cf-8f20-81f1a156a315" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:39.510596 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2a944823-06e5-4296-a811-7c65568c3c12 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "8783a79a-1374-43cf-8f20-81f1a156a315" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:39.510848 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2a944823-06e5-4296-a811-7c65568c3c12 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Acquiring lock "8783a79a-1374-43cf-8f20-81f1a156a315-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:39.511268 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2a944823-06e5-4296-a811-7c65568c3c12 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "8783a79a-1374-43cf-8f20-81f1a156a315-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:39.511851 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2a944823-06e5-4296-a811-7c65568c3c12 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "8783a79a-1374-43cf-8f20-81f1a156a315-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:39.518250 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-2a944823-06e5-4296-a811-7c65568c3c12 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Terminating instance
May 28 00:58:39.560063 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1446893669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1446893669',id=2,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgdSzXGUKNMMeuA2Cyvm6EZFtiJzxD7NWnlARJicpzFqN2FImWG3sU3198MgahdHOMaJqdmKUE8nRVq4d1z2/aQ8GRY/yfj1gslPX4PwbxVdsepP0DFICVmWgbQsQGwKA==',key_name='tempest-keypair-1022143858',keypairs=<?>,launch_index=0,launched_at=2026-05-28T00:57:26Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='355551e9b29346059ddbe389bc51efa8',ramdisk_id='',reservation_id='r-nlwfuhg8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-585237783',owner_user_name='tempest-TaggedAttachmentsTest-585237783-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T00:57:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4ab7230b24d4ebf9090a752493983fb',uuid=b1380963-8254-4ad0-95bb-91d24cea00f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec4fad7e-3a01-4591-ae8f-0b8fe30d60de", "address": "fa:16:3e:0c:39:3a", "network": {"id": "65e0ba59-7e4f-47d7-94c5-e32485b75aeb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1157326562", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "355551e9b29346059ddbe389bc51efa8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4fad7e-3a", "ovs_interfaceid": "ec4fad7e-3a01-4591-ae8f-0b8fe30d60de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 00:58:39.560292 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Converting VIF {"id": "ec4fad7e-3a01-4591-ae8f-0b8fe30d60de", "address": "fa:16:3e:0c:39:3a", "network": {"id": "65e0ba59-7e4f-47d7-94c5-e32485b75aeb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1157326562", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "355551e9b29346059ddbe389bc51efa8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4fad7e-3a", "ovs_interfaceid": "ec4fad7e-3a01-4591-ae8f-0b8fe30d60de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:58:39.561235 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:39:3a,bridge_name='br-int',has_traffic_filtering=True,id=ec4fad7e-3a01-4591-ae8f-0b8fe30d60de,network=Network(65e0ba59-7e4f-47d7-94c5-e32485b75aeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4fad7e-3a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:58:39.563983 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0c:39:3a"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tapec4fad7e-3a"/></interface> {{(pid=98319) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 28 00:58:39.566396 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0c:39:3a"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tapec4fad7e-3a"/></interface> {{(pid=98319) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 28 00:58:39.568142 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Attempting to detach device tapec4fad7e-3a from instance b1380963-8254-4ad0-95bb-91d24cea00f9 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 00:58:39.568437 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] detach device xml: <interface type="ethernet">
May 28 00:58:39.568437 np0000001577 nova-compute[98319]:   <mac address="fa:16:3e:0c:39:3a"/>
May 28 00:58:39.568437 np0000001577 nova-compute[98319]:   <model type="virtio"/>
May 28 00:58:39.568437 np0000001577 nova-compute[98319]:   <driver name="qemu"/>
May 28 00:58:39.568437 np0000001577 nova-compute[98319]:   <mtu size="1372"/>
May 28 00:58:39.568437 np0000001577 nova-compute[98319]:   <target dev="tapec4fad7e-3a"/>
May 28 00:58:39.568437 np0000001577 nova-compute[98319]: </interface>
May 28 00:58:39.568437 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 00:58:39.571995 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a84e49f5-0bde-41ee-866e-6b434748077f/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:58:39.572297 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-8 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 00:58:39.573620 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0c:39:3a"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tapec4fad7e-3a"/></interface> {{(pid=98319) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 28 00:58:39.574339 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 00:58:39.575229 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:39.590181 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:0c:39:3a"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tapec4fad7e-3a"/></interface>not found in domain: <domain type='qemu' id='2'>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   <name>instance-00000002</name>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   <uuid>b1380963-8254-4ad0-95bb-91d24cea00f9</uuid>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   <metadata>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   <nova:package version="33.1.0"/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   <nova:name>tempest-device-tagging-server-1446893669</nova:name>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   <nova:creationTime>2026-05-28 00:58:14</nova:creationTime>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   <nova:flavor name="m1.nano" id="42">
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <nova:memory>192</nova:memory>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <nova:disk>1</nova:disk>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <nova:swap>0</nova:swap>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <nova:ephemeral>0</nova:ephemeral>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <nova:vcpus>1</nova:vcpus>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <nova:extraSpecs>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     </nova:extraSpecs>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   </nova:flavor>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <nova:minDisk>1</nova:minDisk>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <nova:minRam>0</nova:minRam>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <nova:properties>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     </nova:properties>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   </nova:image>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   <nova:owner>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <nova:user uuid="b4ab7230b24d4ebf9090a752493983fb">tempest-TaggedAttachmentsTest-585237783-project-member</nova:user>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <nova:project uuid="355551e9b29346059ddbe389bc51efa8">tempest-TaggedAttachmentsTest-585237783</nova:project>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   </nova:owner>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   <nova:ports>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <nova:port uuid="5dc9c0c0-6ee4-4266-8024-0f8313319a2c">
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     </nova:port>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <nova:port uuid="ec4fad7e-3a01-4591-ae8f-0b8fe30d60de">
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <nova:ip type="fixed" address="10.10.10.175" ipVersion="4"/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     </nova:port>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   </nova:ports>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]: </nova:instance>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   </metadata>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   <memory unit='KiB'>196608</memory>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   <currentMemory unit='KiB'>196608</currentMemory>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   <vcpu placement='static'>1</vcpu>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   <resource>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <partition>/machine</partition>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   </resource>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   <sysinfo type='smbios'>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <system>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <entry name='product'>OpenStack Nova</entry>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <entry name='version'>33.1.0</entry>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <entry name='serial'>b1380963-8254-4ad0-95bb-91d24cea00f9</entry>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <entry name='uuid'>b1380963-8254-4ad0-95bb-91d24cea00f9</entry>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <entry name='family'>Virtual Machine</entry>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     </system>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   <os>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <boot dev='hd'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <smbios mode='sysinfo'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   </os>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   <features>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <acpi/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <vmcoreinfo state='on'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <tcg>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <tb-cache unit='KiB'>131072</tb-cache>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     </tcg>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   </features>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   <cpu mode='custom' match='exact' check='full'>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <model fallback='forbid'>Nehalem</model>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <feature policy='require' name='hypervisor'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   <clock offset='utc'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   <on_poweroff>destroy</on_poweroff>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   <on_reboot>restart</on_reboot>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   <on_crash>destroy</on_crash>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   <devices>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <disk type='file' device='disk'>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <driver name='qemu' type='qcow2' cache='none'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <source file='/opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/disk' index='2'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <backingStore type='file' index='3'>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:         <format type='raw'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:         <source file='/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:         <backingStore/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       </backingStore>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <target dev='vda' bus='virtio'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <alias name='virtio-disk0'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     </disk>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <disk type='file' device='cdrom'>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <driver name='qemu' type='raw' cache='none'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <source file='/opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/disk.config' index='1'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <backingStore/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <target dev='hda' bus='ide'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <readonly/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <alias name='ide0-0-0'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     </disk>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <controller type='usb' index='0' model='none'>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <alias name='usb'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     </controller>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <controller type='pci' index='0' model='pci-root'>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <alias name='pci.0'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     </controller>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <controller type='ide' index='0'>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <alias name='ide'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     </controller>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <interface type='ethernet'>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <mac address='fa:16:3e:3a:fe:3d'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <target dev='tap5dc9c0c0-6e'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <model type='virtio'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <driver name='qemu'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <mtu size='1372'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <alias name='net0'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     </interface>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <interface type='ethernet'>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <mac address='fa:16:3e:0c:39:3a'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <target dev='tapec4fad7e-3a'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <model type='virtio'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <driver name='qemu'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <mtu size='1372'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <alias name='net1'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     </interface>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <serial type='pty'>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <source path='/dev/pts/1'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <log file='/opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/console.log' append='off'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <target type='isa-serial' port='0'>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:         <model name='isa-serial'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       </target>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <alias name='serial0'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     </serial>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <console type='pty' tty='/dev/pts/1'>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <source path='/dev/pts/1'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <log file='/opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/console.log' append='off'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <target type='serial' port='0'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <alias name='serial0'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     </console>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <input type='mouse' bus='ps2'>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <alias name='input0'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     </input>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <input type='keyboard' bus='ps2'>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <alias name='input1'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     </input>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <graphics type='vnc' port='5901' autoport='yes' listen='0.0.0.0'>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <listen type='address' address='0.0.0.0'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <audio id='1' type='none'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <video>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <model type='virtio' heads='1' primary='yes'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <alias name='video0'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     </video>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <stats period='10'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <alias name='balloon0'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     </memballoon>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <rng model='virtio'>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <backend model='random'>/dev/urandom</backend>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <alias name='rng0'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     </rng>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   </devices>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <label>libvirt-b1380963-8254-4ad0-95bb-91d24cea00f9</label>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <imagelabel>libvirt-b1380963-8254-4ad0-95bb-91d24cea00f9</imagelabel>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   </seclabel>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <label>+64055:+993</label>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:     <imagelabel>+64055:+993</imagelabel>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:   </seclabel>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]: </domain>
May 28 00:58:39.590181 np0000001577 nova-compute[98319]:  {{(pid=98319) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 28 00:58:39.593907 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Successfully detached device tapec4fad7e-3a from instance b1380963-8254-4ad0-95bb-91d24cea00f9 from the persistent domain config.
May 28 00:58:39.593907 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] (1/8): Attempting to detach device tapec4fad7e-3a with device alias net1 from instance b1380963-8254-4ad0-95bb-91d24cea00f9 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 00:58:39.593907 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] detach device xml: <interface type="ethernet">
May 28 00:58:39.593907 np0000001577 nova-compute[98319]:   <mac address="fa:16:3e:0c:39:3a"/>
May 28 00:58:39.593907 np0000001577 nova-compute[98319]:   <model type="virtio"/>
May 28 00:58:39.593907 np0000001577 nova-compute[98319]:   <driver name="qemu"/>
May 28 00:58:39.593907 np0000001577 nova-compute[98319]:   <mtu size="1372"/>
May 28 00:58:39.593907 np0000001577 nova-compute[98319]:   <target dev="tapec4fad7e-3a"/>
May 28 00:58:39.593907 np0000001577 nova-compute[98319]: </interface>
May 28 00:58:39.593907 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 00:58:39.608113 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-a0392d72-c054-4f75-8e31-e80bb974be5b req-b21b5592-8a9a-4147-ab7b-5086bed1ec5c service nova] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Updated VIF entry in instance network info cache for port 73b37d7b-3ec2-45cc-8a9c-22ee6556af87. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 00:58:39.608864 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "env LANG=C uptime" returned: 0 in 0.033s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:58:39.610213 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-a0392d72-c054-4f75-8e31-e80bb974be5b req-b21b5592-8a9a-4147-ab7b-5086bed1ec5c service nova] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Updating instance_info_cache with network_info: [{"id": "73b37d7b-3ec2-45cc-8a9c-22ee6556af87", "address": "fa:16:3e:07:50:fa", "network": {"id": "0dbd83f8-e813-4259-a5a9-71f615374a48", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1523117392-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07e72ea70b9147f68a0d66cd524ae614", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b37d7b-3e", "ovs_interfaceid": "73b37d7b-3ec2-45cc-8a9c-22ee6556af87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:58:39.610865 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Hypervisor/Node resource view: name=np0000001577 free_ram=12325MB free_disk=74.53282165527344GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 00:58:39.611014 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:39.611234 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:39.629482 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Found WWN 3300000001491b408 for multipath device dm-7 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 00:58:39.629482 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.040s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:58:39.629785 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] <== connect_volume: return (2974ms) {'type': 'block', 'scsi_wwn': '3300000001491b408', 'path': '/dev/dm-7', 'multipath_id': '3300000001491b408'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:58:39.629785 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001491b408', 'path': '/dev/dm-7', 'multipath_id': '3300000001491b408'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 00:58:39.631903 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lazy-loading 'flavor' on Instance uuid 7fdf336e-65c1-4180-92eb-5f8ca0ebc526 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:58:39.900431 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779929919.9000602, a84e49f5-0bde-41ee-866e-6b434748077f => ua-8969959e-493f-4daf-a2dd-1d0198bab335> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 00:58:39.901526 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias ua-8969959e-493f-4daf-a2dd-1d0198bab335 for instance a84e49f5-0bde-41ee-866e-6b434748077f {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 00:58:39.903295 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Successfully detached device vdb from instance a84e49f5-0bde-41ee-866e-6b434748077f from the live domain config.
May 28 00:58:39.904041 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 00:58:39.904555 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335', 'iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8969959e-493f-4daf-a2dd-1d0198bab335', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:58:39.904868 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:58:39.905317 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:58:39.905710 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335', 'iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8969959e-493f-4daf-a2dd-1d0198bab335', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 00:58:39.905888 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 00:58:39.935234 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:39.935234 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:39.935234 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:39.935234 np0000001577 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:39.935234 np0000001577 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:39.935234 np0000001577 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:39.935234 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:39.935234 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:39.935234 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:39.935234 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:39.935234 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:39.935234 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:39.935234 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:58:39.936020 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:39.936020 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:39.936020 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:39.936020 np0000001577 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:39.936020 np0000001577 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335 (non-flash)
May 28 00:58:39.936020 np0000001577 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:39.936020 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:39.936020 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:39.936020 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:39.936020 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:39.936020 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:39.936020 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:39.936020 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:58:39.936020 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', '16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce', '8'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884', '9')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 00:58:39.936020 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335', '18')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 00:58:39.936621 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335', '17')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 00:58:39.937396 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c988c01fba0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335'): ({'sdo'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335'): ({'sdn'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 00:58:39.937598 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Removing multipathed devices sdo, sdn {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 00:58:39.937831 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Flush multipath device 3300000005f2e0bc5 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 00:58:39.970034 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:39.973395 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 00:58:40.019407 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 00:58:40.025746 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-2a944823-06e5-4296-a811-7c65568c3c12 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 00:58:40.056677 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:40.062122 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:40.074774 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Checking to see if SCSI volumes sdo, sdn have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 00:58:40.074955 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] SCSI volumes sdo, sdn have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 00:58:40.076713 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Checking to see if device paths {'sdo', 'sdn'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 00:58:40.089602 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:40.091637 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:40.095254 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Device paths {'sdo', 'sdn'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 00:58:40.095527 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 00:58:40.110443 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:40.113512 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a0392d72-c054-4f75-8e31-e80bb974be5b req-b21b5592-8a9a-4147-ab7b-5086bed1ec5c service nova] Releasing lock "refresh_cache-a8a28bb4-c3ea-4fb9-9130-1e8239191c5b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:58:40.113757 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:40.123075 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Creating config drive at /opt/stack/data/nova/instances/8bca25d8-071e-4b2d-960c-50582381cc75/disk.config
May 28 00:58:40.127692 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8bca25d8-071e-4b2d-960c-50582381cc75/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgel4qwnf {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:40.127963 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:40.155690 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Attempting to attach volume d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 00:58:40.158578 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] attach device xml: <disk type="block" device="disk">
May 28 00:58:40.158578 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 00:58:40.158578 np0000001577 nova-compute[98319]:   <alias name="ua-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5"/>
May 28 00:58:40.158578 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-7"/>
May 28 00:58:40.158578 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 00:58:40.158578 np0000001577 nova-compute[98319]:   <serial>d2d3e5ca-4e68-4f8d-84af-117ab421d9f5</serial>
May 28 00:58:40.158578 np0000001577 nova-compute[98319]:   <shareable/>
May 28 00:58:40.158578 np0000001577 nova-compute[98319]: </disk>
May 28 00:58:40.158578 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 00:58:40.159750 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335, portal: 192.168.40.100,3260]
May 28 00:58:40.159750 np0000001577 nova-compute[98319]: Logout of [sid: 18, target: iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335, portal: 192.168.40.100,3260] successful.
May 28 00:58:40.159750 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:40.179910 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8bca25d8-071e-4b2d-960c-50582381cc75/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgel4qwnf" returned: 0 in 0.052s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:58:40.183652 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:40.197104 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:40.246509 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335, portal: 192.168.50.100,3260]
May 28 00:58:40.246509 np0000001577 nova-compute[98319]: Logout of [sid: 17, target: iqn.2023-03.storpool.com:os--volume-8969959e-493f-4daf-a2dd-1d0198bab335, portal: 192.168.50.100,3260] successful.
May 28 00:58:40.246509 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:40.269524 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:40.269923 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:58:40.270147 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] <== disconnect_volume: return (365ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:58:40.270387 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 00:58:40.359651 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e5d4e717-6b01-4923-b6a6-01594edaa407 req-49d9f620-669b-44fd-82bf-732b6b75742b service nova] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Received event network-vif-unplugged-510c8fcb-a3ae-4a4b-b064-145dea29c584 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:40.359955 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e5d4e717-6b01-4923-b6a6-01594edaa407 req-49d9f620-669b-44fd-82bf-732b6b75742b service nova] Acquiring lock "8783a79a-1374-43cf-8f20-81f1a156a315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:40.360192 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e5d4e717-6b01-4923-b6a6-01594edaa407 req-49d9f620-669b-44fd-82bf-732b6b75742b service nova] Lock "8783a79a-1374-43cf-8f20-81f1a156a315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:40.360343 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e5d4e717-6b01-4923-b6a6-01594edaa407 req-49d9f620-669b-44fd-82bf-732b6b75742b service nova] Lock "8783a79a-1374-43cf-8f20-81f1a156a315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:40.360515 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e5d4e717-6b01-4923-b6a6-01594edaa407 req-49d9f620-669b-44fd-82bf-732b6b75742b service nova] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] No waiting events found dispatching network-vif-unplugged-510c8fcb-a3ae-4a4b-b064-145dea29c584 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:58:40.360689 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e5d4e717-6b01-4923-b6a6-01594edaa407 req-49d9f620-669b-44fd-82bf-732b6b75742b service nova] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Received event network-vif-unplugged-510c8fcb-a3ae-4a4b-b064-145dea29c584 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:58:40.497776 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779929920.4973938, b1380963-8254-4ad0-95bb-91d24cea00f9 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 00:58:40.499314 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Start waiting for the detach event from libvirt for device tapec4fad7e-3a with device alias net1 for instance b1380963-8254-4ad0-95bb-91d24cea00f9 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 00:58:40.503049 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0c:39:3a"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tapec4fad7e-3a"/></interface> {{(pid=98319) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 28 00:58:40.511749 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:0c:39:3a"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tapec4fad7e-3a"/></interface>not found in domain: <domain type='qemu' id='2'>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   <name>instance-00000002</name>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   <uuid>b1380963-8254-4ad0-95bb-91d24cea00f9</uuid>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   <metadata>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   <nova:package version="33.1.0"/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   <nova:name>tempest-device-tagging-server-1446893669</nova:name>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   <nova:creationTime>2026-05-28 00:58:14</nova:creationTime>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   <nova:flavor name="m1.nano" id="42">
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <nova:memory>192</nova:memory>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <nova:disk>1</nova:disk>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <nova:swap>0</nova:swap>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <nova:ephemeral>0</nova:ephemeral>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <nova:vcpus>1</nova:vcpus>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <nova:extraSpecs>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     </nova:extraSpecs>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   </nova:flavor>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <nova:minDisk>1</nova:minDisk>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <nova:minRam>0</nova:minRam>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <nova:properties>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     </nova:properties>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   </nova:image>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   <nova:owner>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <nova:user uuid="b4ab7230b24d4ebf9090a752493983fb">tempest-TaggedAttachmentsTest-585237783-project-member</nova:user>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <nova:project uuid="355551e9b29346059ddbe389bc51efa8">tempest-TaggedAttachmentsTest-585237783</nova:project>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   </nova:owner>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   <nova:ports>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <nova:port uuid="5dc9c0c0-6ee4-4266-8024-0f8313319a2c">
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     </nova:port>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <nova:port uuid="ec4fad7e-3a01-4591-ae8f-0b8fe30d60de">
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <nova:ip type="fixed" address="10.10.10.175" ipVersion="4"/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     </nova:port>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   </nova:ports>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]: </nova:instance>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   </metadata>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   <memory unit='KiB'>196608</memory>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   <currentMemory unit='KiB'>196608</currentMemory>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   <vcpu placement='static'>1</vcpu>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   <resource>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <partition>/machine</partition>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   </resource>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   <sysinfo type='smbios'>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <system>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <entry name='product'>OpenStack Nova</entry>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <entry name='version'>33.1.0</entry>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <entry name='serial'>b1380963-8254-4ad0-95bb-91d24cea00f9</entry>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <entry name='uuid'>b1380963-8254-4ad0-95bb-91d24cea00f9</entry>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <entry name='family'>Virtual Machine</entry>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     </system>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   <os>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <boot dev='hd'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <smbios mode='sysinfo'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   </os>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   <features>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <acpi/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <vmcoreinfo state='on'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <tcg>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <tb-cache unit='KiB'>131072</tb-cache>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     </tcg>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   </features>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   <cpu mode='custom' match='exact' check='full'>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <model fallback='forbid'>Nehalem</model>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <feature policy='require' name='hypervisor'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   <clock offset='utc'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   <on_poweroff>destroy</on_poweroff>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   <on_reboot>restart</on_reboot>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   <on_crash>destroy</on_crash>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   <devices>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <disk type='file' device='disk'>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <driver name='qemu' type='qcow2' cache='none'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <source file='/opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/disk' index='2'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <backingStore type='file' index='3'>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:         <format type='raw'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:         <source file='/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:         <backingStore/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       </backingStore>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <target dev='vda' bus='virtio'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <alias name='virtio-disk0'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     </disk>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <disk type='file' device='cdrom'>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <driver name='qemu' type='raw' cache='none'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <source file='/opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/disk.config' index='1'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <backingStore/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <target dev='hda' bus='ide'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <readonly/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <alias name='ide0-0-0'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     </disk>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <controller type='usb' index='0' model='none'>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <alias name='usb'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     </controller>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <controller type='pci' index='0' model='pci-root'>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <alias name='pci.0'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     </controller>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <controller type='ide' index='0'>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <alias name='ide'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     </controller>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <interface type='ethernet'>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <mac address='fa:16:3e:3a:fe:3d'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <target dev='tap5dc9c0c0-6e'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <model type='virtio'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <driver name='qemu'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <mtu size='1372'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <alias name='net0'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     </interface>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <serial type='pty'>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <source path='/dev/pts/1'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <log file='/opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/console.log' append='off'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <target type='isa-serial' port='0'>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:         <model name='isa-serial'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       </target>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <alias name='serial0'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     </serial>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <console type='pty' tty='/dev/pts/1'>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <source path='/dev/pts/1'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <log file='/opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/console.log' append='off'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <target type='serial' port='0'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <alias name='serial0'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     </console>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <input type='mouse' bus='ps2'>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <alias name='input0'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     </input>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <input type='keyboard' bus='ps2'>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <alias name='input1'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     </input>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <graphics type='vnc' port='5901' autoport='yes' listen='0.0.0.0'>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <listen type='address' address='0.0.0.0'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <audio id='1' type='none'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <video>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <model type='virtio' heads='1' primary='yes'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <alias name='video0'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     </video>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <stats period='10'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <alias name='balloon0'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     </memballoon>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <rng model='virtio'>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <backend model='random'>/dev/urandom</backend>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <alias name='rng0'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     </rng>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   </devices>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <label>libvirt-b1380963-8254-4ad0-95bb-91d24cea00f9</label>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <imagelabel>libvirt-b1380963-8254-4ad0-95bb-91d24cea00f9</imagelabel>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   </seclabel>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <label>+64055:+993</label>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:     <imagelabel>+64055:+993</imagelabel>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:   </seclabel>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]: </domain>
May 28 00:58:40.511749 np0000001577 nova-compute[98319]:  {{(pid=98319) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 28 00:58:40.511749 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Successfully detached device tapec4fad7e-3a from instance b1380963-8254-4ad0-95bb-91d24cea00f9 from the live domain config.
May 28 00:58:40.511749 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1446893669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1446893669',id=2,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgdSzXGUKNMMeuA2Cyvm6EZFtiJzxD7NWnlARJicpzFqN2FImWG3sU3198MgahdHOMaJqdmKUE8nRVq4d1z2/aQ8GRY/yfj1gslPX4PwbxVdsepP0DFICVmWgbQsQGwKA==',key_name='tempest-keypair-1022143858',keypairs=<?>,launch_index=0,launched_at=2026-05-28T00:57:26Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='355551e9b29346059ddbe389bc51efa8',ramdisk_id='',reservation_id='r-nlwfuhg8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-585237783',owner_user_name='tempest-TaggedAttachmentsTest-585237783-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T00:57:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4ab7230b24d4ebf9090a752493983fb',uuid=b1380963-8254-4ad0-95bb-91d24cea00f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec4fad7e-3a01-4591-ae8f-0b8fe30d60de", "address": "fa:16:3e:0c:39:3a", "network": {"id": "65e0ba59-7e4f-47d7-94c5-e32485b75aeb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1157326562", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "355551e9b29346059ddbe389bc51efa8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4fad7e-3a", "ovs_interfaceid": "ec4fad7e-3a01-4591-ae8f-0b8fe30d60de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 00:58:40.511749 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Converting VIF {"id": "ec4fad7e-3a01-4591-ae8f-0b8fe30d60de", "address": "fa:16:3e:0c:39:3a", "network": {"id": "65e0ba59-7e4f-47d7-94c5-e32485b75aeb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1157326562", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "355551e9b29346059ddbe389bc51efa8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4fad7e-3a", "ovs_interfaceid": "ec4fad7e-3a01-4591-ae8f-0b8fe30d60de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:58:40.511749 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:39:3a,bridge_name='br-int',has_traffic_filtering=True,id=ec4fad7e-3a01-4591-ae8f-0b8fe30d60de,network=Network(65e0ba59-7e4f-47d7-94c5-e32485b75aeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4fad7e-3a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:58:40.518084 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:39:3a,bridge_name='br-int',has_traffic_filtering=True,id=ec4fad7e-3a01-4591-ae8f-0b8fe30d60de,network=Network(65e0ba59-7e4f-47d7-94c5-e32485b75aeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4fad7e-3a') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 00:58:40.518084 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:40.518768 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec4fad7e-3a, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:40.521255 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:40.522315 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:40.561052 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999710762999939 future=<Future at 0x7c988c1d4a70 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:58:40.564682 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.996164153999871 future=<Future at 0x7c988c1d4a70 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:58:40.564801 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.995979430000034 future=<Future at 0x7c988c1d4a70 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:58:40.570794 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:40.572930 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Instance destroyed successfully.
May 28 00:58:40.573727 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-2a944823-06e5-4296-a811-7c65568c3c12 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lazy-loading 'resources' on Instance uuid 8783a79a-1374-43cf-8f20-81f1a156a315 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:58:40.616258 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:40.618517 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:40.619068 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dd500cbb-275d-4b1b-a0cc-d6a1bc5aef99) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:40.620804 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:40.621323 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:40.632794 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:40.648080 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:40.652997 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:40.680264 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:40.685832 np0000001577 nova-compute[98319]: INFO os_vif [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:39:3a,bridge_name='br-int',has_traffic_filtering=True,id=ec4fad7e-3a01-4591-ae8f-0b8fe30d60de,network=Network(65e0ba59-7e4f-47d7-94c5-e32485b75aeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4fad7e-3a')
May 28 00:58:40.685832 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1446893669', uuid='b1380963-8254-4ad0-95bb-91d24cea00f9'), owner=OwnerMeta(userid='b4ab7230b24d4ebf9090a752493983fb', username='tempest-TaggedAttachmentsTest-585237783-project-member', projectid='355551e9b29346059ddbe389bc51efa8', projectname='tempest-TaggedAttachmentsTest-585237783'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "address": "fa:16:3e:3a:fe:3d", "network": {"id": "3ceee21d-d4b4-4c77-8ac9-f2338f96e022", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-960987788-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "355551e9b29346059ddbe389bc51efa8", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc9c0c0-6e", "ovs_interfaceid": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779929920.6848419) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 00:58:40.685832 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:   <nova:package version="33.1.0"/>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:   <nova:name>tempest-device-tagging-server-1446893669</nova:name>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:   <nova:creationTime>2026-05-28 00:58:40</nova:creationTime>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:   <nova:flavor name="m1.nano" id="42">
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:     <nova:memory>192</nova:memory>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:     <nova:disk>1</nova:disk>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:     <nova:swap>0</nova:swap>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:     <nova:ephemeral>0</nova:ephemeral>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:     <nova:vcpus>1</nova:vcpus>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:     <nova:extraSpecs>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:     </nova:extraSpecs>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:   </nova:flavor>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:   <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:     <nova:minDisk>1</nova:minDisk>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:     <nova:minRam>0</nova:minRam>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:     <nova:properties>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:     </nova:properties>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:   </nova:image>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:   <nova:owner>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:     <nova:user uuid="b4ab7230b24d4ebf9090a752493983fb">tempest-TaggedAttachmentsTest-585237783-project-member</nova:user>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:     <nova:project uuid="355551e9b29346059ddbe389bc51efa8">tempest-TaggedAttachmentsTest-585237783</nova:project>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:   </nova:owner>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:   <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:   <nova:ports>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:     <nova:port uuid="5dc9c0c0-6ee4-4266-8024-0f8313319a2c">
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:       <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:     </nova:port>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:   </nova:ports>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]: </nova:instance>
May 28 00:58:40.685832 np0000001577 nova-compute[98319]:  {{(pid=98319) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 28 00:58:40.689200 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:40.689477 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:40.709796 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 8783a79a-1374-43cf-8f20-81f1a156a315 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 00:58:40.709937 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance b1380963-8254-4ad0-95bb-91d24cea00f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 00:58:40.710231 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 0928917f-0c8c-4019-aef4-083ba8224ce0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 00:58:40.710231 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 7fdf336e-65c1-4180-92eb-5f8ca0ebc526 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 00:58:40.710231 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance a84e49f5-0bde-41ee-866e-6b434748077f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 00:58:40.710359 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 9d7f874a-9bd5-4e26-abda-5978493313cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 00:58:40.710359 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 8bca25d8-071e-4b2d-960c-50582381cc75 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 00:58:40.710429 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance a8a28bb4-c3ea-4fb9-9130-1e8239191c5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 00:58:40.710771 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 00:58:40.712226 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Final resource view: name=np0000001577 phys_ram=24030MB used_ram=2048MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 00:58:39 up 30 min,  2 users,  load average: 8.48, 4.03, 1.84\n', 'num_instances': '8', 'num_vm_active': '7', 'num_task_deleting': '1', 'num_os_type_None': '8', 'num_proj_2baedfd7036c444caea4b26edc31c870': '1', 'io_workload': '1', 'num_task_None': '6', 'num_proj_355551e9b29346059ddbe389bc51efa8': '1', 'num_proj_df45e1c2b903482aa7e61c55b1f3f45b': '2', 'num_proj_365a56f393cf409d8d1562e6be8318fa': '1', 'num_proj_3b9278238dfa4e86ad7904a4a76caf6b': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_938c2829112843edb2054984e80ce7ad': '1', 'num_proj_07e72ea70b9147f68a0d66cd524ae614': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 00:58:40.773938 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a7ef3e32-786d-4f64-8c96-481de19b7257 req-2fd733f9-610d-4f5c-a879-e4fd73425280 service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Received event network-vif-unplugged-ec4fad7e-3a01-4591-ae8f-0b8fe30d60de {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:40.774234 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a7ef3e32-786d-4f64-8c96-481de19b7257 req-2fd733f9-610d-4f5c-a879-e4fd73425280 service nova] Acquiring lock "b1380963-8254-4ad0-95bb-91d24cea00f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:40.774234 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a7ef3e32-786d-4f64-8c96-481de19b7257 req-2fd733f9-610d-4f5c-a879-e4fd73425280 service nova] Lock "b1380963-8254-4ad0-95bb-91d24cea00f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:40.774385 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a7ef3e32-786d-4f64-8c96-481de19b7257 req-2fd733f9-610d-4f5c-a879-e4fd73425280 service nova] Lock "b1380963-8254-4ad0-95bb-91d24cea00f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:40.774482 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a7ef3e32-786d-4f64-8c96-481de19b7257 req-2fd733f9-610d-4f5c-a879-e4fd73425280 service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] No waiting events found dispatching network-vif-unplugged-ec4fad7e-3a01-4591-ae8f-0b8fe30d60de {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:58:40.774610 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-a7ef3e32-786d-4f64-8c96-481de19b7257 req-2fd733f9-610d-4f5c-a879-e4fd73425280 service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Received unexpected event network-vif-unplugged-ec4fad7e-3a01-4591-ae8f-0b8fe30d60de for instance with vm_state active and task_state None.
May 28 00:58:40.893362 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Lazy-loading 'flavor' on Instance uuid a84e49f5-0bde-41ee-866e-6b434748077f {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:58:40.906218 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:40.956801 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:41.062711 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:41.081750 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-2a944823-06e5-4296-a811-7c65568c3c12 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2067469200',display_name='tempest-AttachSCSIVolumeTestJSON-server-2067469200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachscsivolumetestjson-server-2067469200',id=1,image_ref='ac1895ec-fe7d-4daa-a504-820cce8782b9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKESDRQL/lrq2YjNFEEjSyExoIkPgrzVv3INO31LyP/mNcVKvbL2WLese1271skeIZVqvkqvGayeH7V23cyCCPsTOXGe6H0qXAJagTvjPCiVcyZ0kwSIgKpv6dpgX/AS6A==',key_name='tempest-keypair-912573267',keypairs=<?>,launch_index=0,launched_at=2026-05-28T00:57:37Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2baedfd7036c444caea4b26edc31c870',ramdisk_id='',reservation_id='r-5omvsmsc',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ac1895ec-fe7d-4daa-a504-820cce8782b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1126953535',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1126953535-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T00:57:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f43ede1febc4364810902b8b6fb3ebb',uuid=8783a79a-1374-43cf-8f20-81f1a156a315,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "510c8fcb-a3ae-4a4b-b064-145dea29c584", "address": "fa:16:3e:2c:d2:b6", "network": {"id": "a3d13ae7-524a-4a4d-ac9b-3b364b3e2832", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-408863509-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2baedfd7036c444caea4b26edc31c870", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap510c8fcb-a3", "ovs_interfaceid": "510c8fcb-a3ae-4a4b-b064-145dea29c584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 00:58:41.081955 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-2a944823-06e5-4296-a811-7c65568c3c12 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Converting VIF {"id": "510c8fcb-a3ae-4a4b-b064-145dea29c584", "address": "fa:16:3e:2c:d2:b6", "network": {"id": "a3d13ae7-524a-4a4d-ac9b-3b364b3e2832", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-408863509-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2baedfd7036c444caea4b26edc31c870", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap510c8fcb-a3", "ovs_interfaceid": "510c8fcb-a3ae-4a4b-b064-145dea29c584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:58:41.082473 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-2a944823-06e5-4296-a811-7c65568c3c12 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:d2:b6,bridge_name='br-int',has_traffic_filtering=True,id=510c8fcb-a3ae-4a4b-b064-145dea29c584,network=Network(a3d13ae7-524a-4a4d-ac9b-3b364b3e2832),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap510c8fcb-a3') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:58:41.082688 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-2a944823-06e5-4296-a811-7c65568c3c12 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:d2:b6,bridge_name='br-int',has_traffic_filtering=True,id=510c8fcb-a3ae-4a4b-b064-145dea29c584,network=Network(a3d13ae7-524a-4a4d-ac9b-3b364b3e2832),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap510c8fcb-a3') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 00:58:41.084411 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:41.084411 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap510c8fcb-a3, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:41.087200 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:41.088648 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:41.089856 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:41.089856 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff0fe67a-1cd8-4bc6-ac8e-8ca421e004d7) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:41.090753 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:41.090753 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:41.095041 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:41.099996 np0000001577 nova-compute[98319]: INFO os_vif [None req-2a944823-06e5-4296-a811-7c65568c3c12 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:d2:b6,bridge_name='br-int',has_traffic_filtering=True,id=510c8fcb-a3ae-4a4b-b064-145dea29c584,network=Network(a3d13ae7-524a-4a4d-ac9b-3b364b3e2832),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap510c8fcb-a3')
May 28 00:58:41.100374 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2a944823-06e5-4296-a811-7c65568c3c12 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Deleting instance files /opt/stack/data/nova/instances/8783a79a-1374-43cf-8f20-81f1a156a315_del
May 28 00:58:41.101217 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2a944823-06e5-4296-a811-7c65568c3c12 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Deletion of /opt/stack/data/nova/instances/8783a79a-1374-43cf-8f20-81f1a156a315_del complete
May 28 00:58:41.247032 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:58:41.247216 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:58:41.307669 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:41.309755 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:41.313593 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:41.313593 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:41.337304 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:41.615226 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-2a944823-06e5-4296-a811-7c65568c3c12 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Took 1.59 seconds to destroy the instance on the hypervisor.
May 28 00:58:41.615908 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-2a944823-06e5-4296-a811-7c65568c3c12 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 00:58:41.616087 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 00:58:41.616198 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 00:58:41.616504 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:41.687370 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:41.750890 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:58:41.823089 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:58:41.823191 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:58:41.823242 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:58:41.823332 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] No VIF found with MAC fa:16:3e:a7:28:21, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 00:58:41.835579 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929921.8352597, 8bca25d8-071e-4b2d-960c-50582381cc75 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:58:41.835739 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] VM Started (Lifecycle Event)
May 28 00:58:41.904983 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d8966e1e-37a2-4adb-b87e-ceb46d8b986e tempest-VolumesAssistedSnapshotsTest-1421910567 tempest-VolumesAssistedSnapshotsTest-1421910567-project-admin] Lock "a84e49f5-0bde-41ee-866e-6b434748077f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.140s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:42.260051 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Compute_service record updated for np0000001577:np0000001577 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 00:58:42.260562 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.649s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:42.260562 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 47.72 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 00:58:42.337866 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:58:42.339111 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929922.3389194, 8bca25d8-071e-4b2d-960c-50582381cc75 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:58:42.339197 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] VM Paused (Lifecycle Event)
May 28 00:58:42.430014 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-64f3918a-54ec-4844-954d-8a162e62c142 req-5557d612-27a8-4357-b82e-2a8101618ca5 service nova] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Received event network-vif-unplugged-510c8fcb-a3ae-4a4b-b064-145dea29c584 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:42.430149 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-64f3918a-54ec-4844-954d-8a162e62c142 req-5557d612-27a8-4357-b82e-2a8101618ca5 service nova] Acquiring lock "8783a79a-1374-43cf-8f20-81f1a156a315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:42.430279 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-64f3918a-54ec-4844-954d-8a162e62c142 req-5557d612-27a8-4357-b82e-2a8101618ca5 service nova] Lock "8783a79a-1374-43cf-8f20-81f1a156a315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:42.430399 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-64f3918a-54ec-4844-954d-8a162e62c142 req-5557d612-27a8-4357-b82e-2a8101618ca5 service nova] Lock "8783a79a-1374-43cf-8f20-81f1a156a315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:42.430501 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-64f3918a-54ec-4844-954d-8a162e62c142 req-5557d612-27a8-4357-b82e-2a8101618ca5 service nova] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] No waiting events found dispatching network-vif-unplugged-510c8fcb-a3ae-4a4b-b064-145dea29c584 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:58:42.430621 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-64f3918a-54ec-4844-954d-8a162e62c142 req-5557d612-27a8-4357-b82e-2a8101618ca5 service nova] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Received event network-vif-unplugged-510c8fcb-a3ae-4a4b-b064-145dea29c584 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:58:42.430717 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-64f3918a-54ec-4844-954d-8a162e62c142 req-5557d612-27a8-4357-b82e-2a8101618ca5 service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Received event network-vif-deleted-ec4fad7e-3a01-4591-ae8f-0b8fe30d60de {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:42.431140 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-64f3918a-54ec-4844-954d-8a162e62c142 req-5557d612-27a8-4357-b82e-2a8101618ca5 service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Neutron deleted interface ec4fad7e-3a01-4591-ae8f-0b8fe30d60de; detaching it from the instance and deleting it from the info cache
May 28 00:58:42.434195 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [req-64f3918a-54ec-4844-954d-8a162e62c142 req-5557d612-27a8-4357-b82e-2a8101618ca5 service nova] Lazy-loading 'system_metadata' on Instance uuid b1380963-8254-4ad0-95bb-91d24cea00f9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:58:42.654731 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:58:42.721745 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Acquiring lock "refresh_cache-b1380963-8254-4ad0-95bb-91d24cea00f9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:58:42.721885 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Acquired lock "refresh_cache-b1380963-8254-4ad0-95bb-91d24cea00f9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:58:42.722070 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 00:58:42.845284 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:58:42.851044 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:58:42.880413 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:42.884149 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8a55504d-24a6-4e06-971a-2dbf04e3b4d9 req-d2cf7caf-7263-4286-ab6c-029cbbb48682 service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Received event network-vif-unplugged-ec4fad7e-3a01-4591-ae8f-0b8fe30d60de {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:42.889294 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8a55504d-24a6-4e06-971a-2dbf04e3b4d9 req-d2cf7caf-7263-4286-ab6c-029cbbb48682 service nova] Acquiring lock "b1380963-8254-4ad0-95bb-91d24cea00f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:42.889472 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8a55504d-24a6-4e06-971a-2dbf04e3b4d9 req-d2cf7caf-7263-4286-ab6c-029cbbb48682 service nova] Lock "b1380963-8254-4ad0-95bb-91d24cea00f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:42.889636 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8a55504d-24a6-4e06-971a-2dbf04e3b4d9 req-d2cf7caf-7263-4286-ab6c-029cbbb48682 service nova] Lock "b1380963-8254-4ad0-95bb-91d24cea00f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:42.889806 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8a55504d-24a6-4e06-971a-2dbf04e3b4d9 req-d2cf7caf-7263-4286-ab6c-029cbbb48682 service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] No waiting events found dispatching network-vif-unplugged-ec4fad7e-3a01-4591-ae8f-0b8fe30d60de {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:58:42.889866 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-8a55504d-24a6-4e06-971a-2dbf04e3b4d9 req-d2cf7caf-7263-4286-ab6c-029cbbb48682 service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Received unexpected event network-vif-unplugged-ec4fad7e-3a01-4591-ae8f-0b8fe30d60de for instance with vm_state active and task_state None.
May 28 00:58:42.936849 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [req-64f3918a-54ec-4844-954d-8a162e62c142 req-5557d612-27a8-4357-b82e-2a8101618ca5 service nova] Lazy-loading 'flavor' on Instance uuid b1380963-8254-4ad0-95bb-91d24cea00f9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:58:43.156530 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Took 1.54 seconds to deallocate network for instance.
May 28 00:58:43.201898 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-422dd66e-219f-4bd5-ad09-ab83fbc5e49f tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Acquiring lock "a84e49f5-0bde-41ee-866e-6b434748077f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:43.202611 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-422dd66e-219f-4bd5-ad09-ab83fbc5e49f tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Lock "a84e49f5-0bde-41ee-866e-6b434748077f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:43.202611 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-422dd66e-219f-4bd5-ad09-ab83fbc5e49f tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Acquiring lock "a84e49f5-0bde-41ee-866e-6b434748077f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:43.202611 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-422dd66e-219f-4bd5-ad09-ab83fbc5e49f tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Lock "a84e49f5-0bde-41ee-866e-6b434748077f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:43.202611 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-422dd66e-219f-4bd5-ad09-ab83fbc5e49f tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Lock "a84e49f5-0bde-41ee-866e-6b434748077f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:43.204222 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-422dd66e-219f-4bd5-ad09-ab83fbc5e49f tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Terminating instance
May 28 00:58:43.225151 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:43.355575 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 00:58:43.402890 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3232509a-df5d-491b-a4d4-b0d5965a0951 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.412s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:43.439876 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [req-64f3918a-54ec-4844-954d-8a162e62c142 req-5557d612-27a8-4357-b82e-2a8101618ca5 service nova] Object Instance<b1380963-8254-4ad0-95bb-91d24cea00f9> lazy-loaded attributes: system_metadata,flavor {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 00:58:43.440771 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [req-64f3918a-54ec-4844-954d-8a162e62c142 req-5557d612-27a8-4357-b82e-2a8101618ca5 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1446893669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1446893669',id=2,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgdSzXGUKNMMeuA2Cyvm6EZFtiJzxD7NWnlARJicpzFqN2FImWG3sU3198MgahdHOMaJqdmKUE8nRVq4d1z2/aQ8GRY/yfj1gslPX4PwbxVdsepP0DFICVmWgbQsQGwKA==',key_name='tempest-keypair-1022143858',keypairs=<?>,launch_index=0,launched_at=2026-05-28T00:57:26Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata=<?>,migration_context=None,new_flavor=None,node='np0000001577',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='355551e9b29346059ddbe389bc51efa8',ramdisk_id='',reservation_id='r-nlwfuhg8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-585237783',owner_user_name='tempest-TaggedAttachmentsTest-585237783-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T00:57:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4ab7230b24d4ebf9090a752493983fb',uuid=b1380963-8254-4ad0-95bb-91d24cea00f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec4fad7e-3a01-4591-ae8f-0b8fe30d60de", "address": "fa:16:3e:0c:39:3a", "network": {"id": "65e0ba59-7e4f-47d7-94c5-e32485b75aeb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1157326562", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "355551e9b29346059ddbe389bc51efa8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4fad7e-3a", "ovs_interfaceid": "ec4fad7e-3a01-4591-ae8f-0b8fe30d60de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 00:58:43.440965 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [req-64f3918a-54ec-4844-954d-8a162e62c142 req-5557d612-27a8-4357-b82e-2a8101618ca5 service nova] Converting VIF {"id": "ec4fad7e-3a01-4591-ae8f-0b8fe30d60de", "address": "fa:16:3e:0c:39:3a", "network": {"id": "65e0ba59-7e4f-47d7-94c5-e32485b75aeb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1157326562", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "355551e9b29346059ddbe389bc51efa8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4fad7e-3a", "ovs_interfaceid": "ec4fad7e-3a01-4591-ae8f-0b8fe30d60de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:58:43.441668 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [req-64f3918a-54ec-4844-954d-8a162e62c142 req-5557d612-27a8-4357-b82e-2a8101618ca5 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:39:3a,bridge_name='br-int',has_traffic_filtering=True,id=ec4fad7e-3a01-4591-ae8f-0b8fe30d60de,network=Network(65e0ba59-7e4f-47d7-94c5-e32485b75aeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4fad7e-3a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:58:43.443314 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [req-64f3918a-54ec-4844-954d-8a162e62c142 req-5557d612-27a8-4357-b82e-2a8101618ca5 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0c:39:3a"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tapec4fad7e-3a"/></interface> {{(pid=98319) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 28 00:58:43.445074 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [req-64f3918a-54ec-4844-954d-8a162e62c142 req-5557d612-27a8-4357-b82e-2a8101618ca5 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:0c:39:3a"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tapec4fad7e-3a"/></interface>not found in domain: <domain type='qemu' id='2'>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   <name>instance-00000002</name>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   <uuid>b1380963-8254-4ad0-95bb-91d24cea00f9</uuid>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   <metadata>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   <nova:package version="33.1.0"/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   <nova:name>tempest-device-tagging-server-1446893669</nova:name>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   <nova:creationTime>2026-05-28 00:58:40</nova:creationTime>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   <nova:flavor name="m1.nano" id="42">
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <nova:memory>192</nova:memory>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <nova:disk>1</nova:disk>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <nova:swap>0</nova:swap>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <nova:ephemeral>0</nova:ephemeral>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <nova:vcpus>1</nova:vcpus>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <nova:extraSpecs>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     </nova:extraSpecs>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   </nova:flavor>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <nova:minDisk>1</nova:minDisk>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <nova:minRam>0</nova:minRam>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <nova:properties>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     </nova:properties>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   </nova:image>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   <nova:owner>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <nova:user uuid="b4ab7230b24d4ebf9090a752493983fb">tempest-TaggedAttachmentsTest-585237783-project-member</nova:user>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <nova:project uuid="355551e9b29346059ddbe389bc51efa8">tempest-TaggedAttachmentsTest-585237783</nova:project>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   </nova:owner>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   <nova:ports>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <nova:port uuid="5dc9c0c0-6ee4-4266-8024-0f8313319a2c">
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     </nova:port>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   </nova:ports>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]: </nova:instance>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   </metadata>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   <memory unit='KiB'>196608</memory>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   <currentMemory unit='KiB'>196608</currentMemory>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   <vcpu placement='static'>1</vcpu>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   <resource>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <partition>/machine</partition>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   </resource>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   <sysinfo type='smbios'>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <system>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <entry name='product'>OpenStack Nova</entry>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <entry name='version'>33.1.0</entry>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <entry name='serial'>b1380963-8254-4ad0-95bb-91d24cea00f9</entry>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <entry name='uuid'>b1380963-8254-4ad0-95bb-91d24cea00f9</entry>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <entry name='family'>Virtual Machine</entry>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     </system>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   <os>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <boot dev='hd'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <smbios mode='sysinfo'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   </os>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   <features>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <acpi/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <vmcoreinfo state='on'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <tcg>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <tb-cache unit='KiB'>131072</tb-cache>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     </tcg>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   </features>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   <cpu mode='custom' match='exact' check='full'>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <model fallback='forbid'>Nehalem</model>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <feature policy='require' name='hypervisor'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   <clock offset='utc'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   <on_poweroff>destroy</on_poweroff>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   <on_reboot>restart</on_reboot>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   <on_crash>destroy</on_crash>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   <devices>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <disk type='file' device='disk'>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <driver name='qemu' type='qcow2' cache='none'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <source file='/opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/disk' index='2'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <backingStore type='file' index='3'>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:         <format type='raw'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:         <source file='/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:         <backingStore/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       </backingStore>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <target dev='vda' bus='virtio'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <alias name='virtio-disk0'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     </disk>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <disk type='file' device='cdrom'>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <driver name='qemu' type='raw' cache='none'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <source file='/opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/disk.config' index='1'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <backingStore/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <target dev='hda' bus='ide'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <readonly/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <alias name='ide0-0-0'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     </disk>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <controller type='usb' index='0' model='none'>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <alias name='usb'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     </controller>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <controller type='pci' index='0' model='pci-root'>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <alias name='pci.0'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     </controller>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <controller type='ide' index='0'>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <alias name='ide'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     </controller>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <interface type='ethernet'>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <mac address='fa:16:3e:3a:fe:3d'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <target dev='tap5dc9c0c0-6e'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <model type='virtio'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <driver name='qemu'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <mtu size='1372'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <alias name='net0'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     </interface>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <serial type='pty'>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <source path='/dev/pts/1'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <log file='/opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/console.log' append='off'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <target type='isa-serial' port='0'>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:         <model name='isa-serial'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       </target>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <alias name='serial0'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     </serial>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <console type='pty' tty='/dev/pts/1'>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <source path='/dev/pts/1'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <log file='/opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/console.log' append='off'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <target type='serial' port='0'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <alias name='serial0'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     </console>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <input type='mouse' bus='ps2'>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <alias name='input0'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     </input>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <input type='keyboard' bus='ps2'>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <alias name='input1'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     </input>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <graphics type='vnc' port='5901' autoport='yes' listen='0.0.0.0'>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <listen type='address' address='0.0.0.0'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <audio id='1' type='none'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <video>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <model type='virtio' heads='1' primary='yes'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <alias name='video0'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     </video>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <stats period='10'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <alias name='balloon0'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     </memballoon>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <rng model='virtio'>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <backend model='random'>/dev/urandom</backend>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <alias name='rng0'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     </rng>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   </devices>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <label>libvirt-b1380963-8254-4ad0-95bb-91d24cea00f9</label>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <imagelabel>libvirt-b1380963-8254-4ad0-95bb-91d24cea00f9</imagelabel>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   </seclabel>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <label>+64055:+993</label>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:     <imagelabel>+64055:+993</imagelabel>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:   </seclabel>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]: </domain>
May 28 00:58:43.445074 np0000001577 nova-compute[98319]:  {{(pid=98319) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 28 00:58:43.449183 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [req-64f3918a-54ec-4844-954d-8a162e62c142 req-5557d612-27a8-4357-b82e-2a8101618ca5 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0c:39:3a"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tapec4fad7e-3a"/></interface> {{(pid=98319) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 28 00:58:43.449183 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [req-64f3918a-54ec-4844-954d-8a162e62c142 req-5557d612-27a8-4357-b82e-2a8101618ca5 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:0c:39:3a"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tapec4fad7e-3a"/></interface>not found in domain: <domain type='qemu' id='2'>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   <name>instance-00000002</name>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   <uuid>b1380963-8254-4ad0-95bb-91d24cea00f9</uuid>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   <metadata>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   <nova:package version="33.1.0"/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   <nova:name>tempest-device-tagging-server-1446893669</nova:name>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   <nova:creationTime>2026-05-28 00:58:40</nova:creationTime>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   <nova:flavor name="m1.nano" id="42">
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <nova:memory>192</nova:memory>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <nova:disk>1</nova:disk>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <nova:swap>0</nova:swap>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <nova:ephemeral>0</nova:ephemeral>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <nova:vcpus>1</nova:vcpus>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <nova:extraSpecs>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     </nova:extraSpecs>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   </nova:flavor>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <nova:minDisk>1</nova:minDisk>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <nova:minRam>0</nova:minRam>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <nova:properties>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     </nova:properties>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   </nova:image>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   <nova:owner>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <nova:user uuid="b4ab7230b24d4ebf9090a752493983fb">tempest-TaggedAttachmentsTest-585237783-project-member</nova:user>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <nova:project uuid="355551e9b29346059ddbe389bc51efa8">tempest-TaggedAttachmentsTest-585237783</nova:project>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   </nova:owner>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   <nova:ports>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <nova:port uuid="5dc9c0c0-6ee4-4266-8024-0f8313319a2c">
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     </nova:port>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   </nova:ports>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]: </nova:instance>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   </metadata>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   <memory unit='KiB'>196608</memory>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   <currentMemory unit='KiB'>196608</currentMemory>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   <vcpu placement='static'>1</vcpu>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   <resource>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <partition>/machine</partition>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   </resource>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   <sysinfo type='smbios'>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <system>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <entry name='product'>OpenStack Nova</entry>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <entry name='version'>33.1.0</entry>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <entry name='serial'>b1380963-8254-4ad0-95bb-91d24cea00f9</entry>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <entry name='uuid'>b1380963-8254-4ad0-95bb-91d24cea00f9</entry>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <entry name='family'>Virtual Machine</entry>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     </system>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   <os>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <boot dev='hd'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <smbios mode='sysinfo'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   </os>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   <features>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <acpi/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <vmcoreinfo state='on'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <tcg>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <tb-cache unit='KiB'>131072</tb-cache>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     </tcg>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   </features>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   <cpu mode='custom' match='exact' check='full'>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <model fallback='forbid'>Nehalem</model>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <feature policy='require' name='hypervisor'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   <clock offset='utc'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   <on_poweroff>destroy</on_poweroff>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   <on_reboot>restart</on_reboot>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   <on_crash>destroy</on_crash>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   <devices>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <disk type='file' device='disk'>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <driver name='qemu' type='qcow2' cache='none'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <source file='/opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/disk' index='2'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <backingStore type='file' index='3'>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:         <format type='raw'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:         <source file='/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:         <backingStore/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       </backingStore>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <target dev='vda' bus='virtio'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <alias name='virtio-disk0'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     </disk>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <disk type='file' device='cdrom'>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <driver name='qemu' type='raw' cache='none'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <source file='/opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/disk.config' index='1'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <backingStore/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <target dev='hda' bus='ide'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <readonly/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <alias name='ide0-0-0'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     </disk>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <controller type='usb' index='0' model='none'>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <alias name='usb'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     </controller>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <controller type='pci' index='0' model='pci-root'>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <alias name='pci.0'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     </controller>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <controller type='ide' index='0'>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <alias name='ide'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     </controller>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <interface type='ethernet'>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <mac address='fa:16:3e:3a:fe:3d'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <target dev='tap5dc9c0c0-6e'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <model type='virtio'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <driver name='qemu'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <mtu size='1372'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <alias name='net0'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     </interface>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <serial type='pty'>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <source path='/dev/pts/1'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <log file='/opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/console.log' append='off'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <target type='isa-serial' port='0'>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:         <model name='isa-serial'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       </target>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <alias name='serial0'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     </serial>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <console type='pty' tty='/dev/pts/1'>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <source path='/dev/pts/1'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <log file='/opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9/console.log' append='off'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <target type='serial' port='0'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <alias name='serial0'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     </console>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <input type='mouse' bus='ps2'>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <alias name='input0'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     </input>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <input type='keyboard' bus='ps2'>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <alias name='input1'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     </input>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <graphics type='vnc' port='5901' autoport='yes' listen='0.0.0.0'>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <listen type='address' address='0.0.0.0'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     </graphics>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <audio id='1' type='none'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <video>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <model type='virtio' heads='1' primary='yes'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <alias name='video0'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     </video>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <stats period='10'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <alias name='balloon0'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     </memballoon>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <rng model='virtio'>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <backend model='random'>/dev/urandom</backend>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <alias name='rng0'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     </rng>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   </devices>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <label>libvirt-b1380963-8254-4ad0-95bb-91d24cea00f9</label>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <imagelabel>libvirt-b1380963-8254-4ad0-95bb-91d24cea00f9</imagelabel>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   </seclabel>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <label>+64055:+993</label>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:     <imagelabel>+64055:+993</imagelabel>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:   </seclabel>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]: </domain>
May 28 00:58:43.449183 np0000001577 nova-compute[98319]:  {{(pid=98319) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 28 00:58:43.449183 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [req-64f3918a-54ec-4844-954d-8a162e62c142 req-5557d612-27a8-4357-b82e-2a8101618ca5 service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Detaching interface fa:16:3e:0c:39:3a failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapec4fad7e-3a' not found.
May 28 00:58:43.449183 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [req-64f3918a-54ec-4844-954d-8a162e62c142 req-5557d612-27a8-4357-b82e-2a8101618ca5 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1446893669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1446893669',id=2,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgdSzXGUKNMMeuA2Cyvm6EZFtiJzxD7NWnlARJicpzFqN2FImWG3sU3198MgahdHOMaJqdmKUE8nRVq4d1z2/aQ8GRY/yfj1gslPX4PwbxVdsepP0DFICVmWgbQsQGwKA==',key_name='tempest-keypair-1022143858',keypairs=<?>,launch_index=0,launched_at=2026-05-28T00:57:26Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata=<?>,migration_context=None,new_flavor=None,node='np0000001577',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='355551e9b29346059ddbe389bc51efa8',ramdisk_id='',reservation_id='r-nlwfuhg8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-585237783',owner_user_name='tempest-TaggedAttachmentsTest-585237783-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T00:57:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4ab7230b24d4ebf9090a752493983fb',uuid=b1380963-8254-4ad0-95bb-91d24cea00f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec4fad7e-3a01-4591-ae8f-0b8fe30d60de", "address": "fa:16:3e:0c:39:3a", "network": {"id": "65e0ba59-7e4f-47d7-94c5-e32485b75aeb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1157326562", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "355551e9b29346059ddbe389bc51efa8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4fad7e-3a", "ovs_interfaceid": "ec4fad7e-3a01-4591-ae8f-0b8fe30d60de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 00:58:43.449183 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [req-64f3918a-54ec-4844-954d-8a162e62c142 req-5557d612-27a8-4357-b82e-2a8101618ca5 service nova] Converting VIF {"id": "ec4fad7e-3a01-4591-ae8f-0b8fe30d60de", "address": "fa:16:3e:0c:39:3a", "network": {"id": "65e0ba59-7e4f-47d7-94c5-e32485b75aeb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1157326562", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "355551e9b29346059ddbe389bc51efa8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec4fad7e-3a", "ovs_interfaceid": "ec4fad7e-3a01-4591-ae8f-0b8fe30d60de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:58:43.449183 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [req-64f3918a-54ec-4844-954d-8a162e62c142 req-5557d612-27a8-4357-b82e-2a8101618ca5 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:39:3a,bridge_name='br-int',has_traffic_filtering=True,id=ec4fad7e-3a01-4591-ae8f-0b8fe30d60de,network=Network(65e0ba59-7e4f-47d7-94c5-e32485b75aeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4fad7e-3a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:58:43.454631 np0000001577 nova-compute[98319]: DEBUG os_vif [req-64f3918a-54ec-4844-954d-8a162e62c142 req-5557d612-27a8-4357-b82e-2a8101618ca5 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:39:3a,bridge_name='br-int',has_traffic_filtering=True,id=ec4fad7e-3a01-4591-ae8f-0b8fe30d60de,network=Network(65e0ba59-7e4f-47d7-94c5-e32485b75aeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4fad7e-3a') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 00:58:43.454631 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:43.454631 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec4fad7e-3a, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:43.454631 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 00:58:43.454631 np0000001577 nova-compute[98319]: INFO os_vif [req-64f3918a-54ec-4844-954d-8a162e62c142 req-5557d612-27a8-4357-b82e-2a8101618ca5 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:39:3a,bridge_name='br-int',has_traffic_filtering=True,id=ec4fad7e-3a01-4591-ae8f-0b8fe30d60de,network=Network(65e0ba59-7e4f-47d7-94c5-e32485b75aeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec4fad7e-3a')
May 28 00:58:43.454631 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [req-64f3918a-54ec-4844-954d-8a162e62c142 req-5557d612-27a8-4357-b82e-2a8101618ca5 service nova] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1446893669', uuid='b1380963-8254-4ad0-95bb-91d24cea00f9'), owner=OwnerMeta(userid='b4ab7230b24d4ebf9090a752493983fb', username='tempest-TaggedAttachmentsTest-585237783-project-member', projectid='355551e9b29346059ddbe389bc51efa8', projectname='tempest-TaggedAttachmentsTest-585237783'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "address": "fa:16:3e:3a:fe:3d", "network": {"id": "3ceee21d-d4b4-4c77-8ac9-f2338f96e022", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-960987788-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "355551e9b29346059ddbe389bc51efa8", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc9c0c0-6e", "ovs_interfaceid": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779929923.453365) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 00:58:43.454631 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [req-64f3918a-54ec-4844-954d-8a162e62c142 req-5557d612-27a8-4357-b82e-2a8101618ca5 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:   <nova:package version="33.1.0"/>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:   <nova:name>tempest-device-tagging-server-1446893669</nova:name>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:   <nova:creationTime>2026-05-28 00:58:43</nova:creationTime>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:   <nova:flavor name="m1.nano" id="42">
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:     <nova:memory>192</nova:memory>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:     <nova:disk>1</nova:disk>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:     <nova:swap>0</nova:swap>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:     <nova:ephemeral>0</nova:ephemeral>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:     <nova:vcpus>1</nova:vcpus>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:     <nova:extraSpecs>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:     </nova:extraSpecs>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:   </nova:flavor>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:   <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:     <nova:minDisk>1</nova:minDisk>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:     <nova:minRam>0</nova:minRam>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:     <nova:properties>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:     </nova:properties>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:   </nova:image>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:   <nova:owner>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:     <nova:user uuid="b4ab7230b24d4ebf9090a752493983fb">tempest-TaggedAttachmentsTest-585237783-project-member</nova:user>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:     <nova:project uuid="355551e9b29346059ddbe389bc51efa8">tempest-TaggedAttachmentsTest-585237783</nova:project>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:   </nova:owner>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:   <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:   <nova:ports>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:     <nova:port uuid="5dc9c0c0-6ee4-4266-8024-0f8313319a2c">
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:       <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:     </nova:port>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:   </nova:ports>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]: </nova:instance>
May 28 00:58:43.454631 np0000001577 nova-compute[98319]:  {{(pid=98319) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 28 00:58:43.455805 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-64f3918a-54ec-4844-954d-8a162e62c142 req-5557d612-27a8-4357-b82e-2a8101618ca5 service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Updating instance_info_cache with network_info: [{"id": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "address": "fa:16:3e:3a:fe:3d", "network": {"id": "3ceee21d-d4b4-4c77-8ac9-f2338f96e022", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-960987788-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "355551e9b29346059ddbe389bc51efa8", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc9c0c0-6e", "ovs_interfaceid": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:58:43.546335 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:43.664107 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2a944823-06e5-4296-a811-7c65568c3c12 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:43.664466 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2a944823-06e5-4296-a811-7c65568c3c12 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:43.707235 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-422dd66e-219f-4bd5-ad09-ab83fbc5e49f tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 00:58:43.734074 np0000001577 nova-compute[98319]: INFO nova.network.neutron [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Port ec4fad7e-3a01-4591-ae8f-0b8fe30d60de from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
May 28 00:58:43.734308 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Updating instance_info_cache with network_info: [{"id": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "address": "fa:16:3e:3a:fe:3d", "network": {"id": "3ceee21d-d4b4-4c77-8ac9-f2338f96e022", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-960987788-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "355551e9b29346059ddbe389bc51efa8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc9c0c0-6e", "ovs_interfaceid": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:58:43.736425 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:43.759202 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:43.760487 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:43.787095 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:43.958960 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-64f3918a-54ec-4844-954d-8a162e62c142 req-5557d612-27a8-4357-b82e-2a8101618ca5 service nova] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Received event network-vif-deleted-510c8fcb-a3ae-4a4b-b064-145dea29c584 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:43.958960 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-64f3918a-54ec-4844-954d-8a162e62c142 req-5557d612-27a8-4357-b82e-2a8101618ca5 service nova] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Neutron deleted interface 510c8fcb-a3ae-4a4b-b064-145dea29c584; detaching it from the instance and deleting it from the info cache
May 28 00:58:43.965203 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-64f3918a-54ec-4844-954d-8a162e62c142 req-5557d612-27a8-4357-b82e-2a8101618ca5 service nova] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Detach interface failed, port_id=510c8fcb-a3ae-4a4b-b064-145dea29c584, reason: Instance 8783a79a-1374-43cf-8f20-81f1a156a315 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 00:58:44.029191 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:44.042082 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:44.063359 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999753712000029 future=<Future at 0x7c987058bad0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:58:44.068658 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Instance destroyed successfully.
May 28 00:58:44.069140 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-422dd66e-219f-4bd5-ad09-ab83fbc5e49f tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Lazy-loading 'resources' on Instance uuid a84e49f5-0bde-41ee-866e-6b434748077f {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:58:44.237492 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Releasing lock "refresh_cache-b1380963-8254-4ad0-95bb-91d24cea00f9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:58:44.341795 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2a944823-06e5-4296-a811-7c65568c3c12 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:58:44.342057 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-2a944823-06e5-4296-a811-7c65568c3c12 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:58:44.450282 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-244d8aa8-4e46-495e-bbdd-7863507cd852 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquiring lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:44.450722 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-244d8aa8-4e46-495e-bbdd-7863507cd852 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:44.520736 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ba22a4b1-af4d-45c4-88c4-436c3a1b42a7 req-aa2b7042-96dc-46ed-9100-6bf1801169db service nova] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Received event network-vif-plugged-ed09134a-777e-4b64-a80d-4d4e00e3b25a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:44.523641 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ba22a4b1-af4d-45c4-88c4-436c3a1b42a7 req-aa2b7042-96dc-46ed-9100-6bf1801169db service nova] Acquiring lock "8bca25d8-071e-4b2d-960c-50582381cc75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:44.523641 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ba22a4b1-af4d-45c4-88c4-436c3a1b42a7 req-aa2b7042-96dc-46ed-9100-6bf1801169db service nova] Lock "8bca25d8-071e-4b2d-960c-50582381cc75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:44.523641 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ba22a4b1-af4d-45c4-88c4-436c3a1b42a7 req-aa2b7042-96dc-46ed-9100-6bf1801169db service nova] Lock "8bca25d8-071e-4b2d-960c-50582381cc75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:44.523641 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ba22a4b1-af4d-45c4-88c4-436c3a1b42a7 req-aa2b7042-96dc-46ed-9100-6bf1801169db service nova] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Processing event network-vif-plugged-ed09134a-777e-4b64-a80d-4d4e00e3b25a {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 00:58:44.523641 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ba22a4b1-af4d-45c4-88c4-436c3a1b42a7 req-aa2b7042-96dc-46ed-9100-6bf1801169db service nova] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Received event network-vif-plugged-ed09134a-777e-4b64-a80d-4d4e00e3b25a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:44.523641 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ba22a4b1-af4d-45c4-88c4-436c3a1b42a7 req-aa2b7042-96dc-46ed-9100-6bf1801169db service nova] Acquiring lock "8bca25d8-071e-4b2d-960c-50582381cc75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:44.523641 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ba22a4b1-af4d-45c4-88c4-436c3a1b42a7 req-aa2b7042-96dc-46ed-9100-6bf1801169db service nova] Lock "8bca25d8-071e-4b2d-960c-50582381cc75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:44.523641 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ba22a4b1-af4d-45c4-88c4-436c3a1b42a7 req-aa2b7042-96dc-46ed-9100-6bf1801169db service nova] Lock "8bca25d8-071e-4b2d-960c-50582381cc75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:44.523641 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ba22a4b1-af4d-45c4-88c4-436c3a1b42a7 req-aa2b7042-96dc-46ed-9100-6bf1801169db service nova] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] No waiting events found dispatching network-vif-plugged-ed09134a-777e-4b64-a80d-4d4e00e3b25a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:58:44.523641 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-ba22a4b1-af4d-45c4-88c4-436c3a1b42a7 req-aa2b7042-96dc-46ed-9100-6bf1801169db service nova] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Received unexpected event network-vif-plugged-ed09134a-777e-4b64-a80d-4d4e00e3b25a for instance with vm_state building and task_state spawning.
May 28 00:58:44.523641 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ba22a4b1-af4d-45c4-88c4-436c3a1b42a7 req-aa2b7042-96dc-46ed-9100-6bf1801169db service nova] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Received event network-vif-unplugged-68c38c36-a152-4495-aa91-3a05281c5da6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:44.523641 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ba22a4b1-af4d-45c4-88c4-436c3a1b42a7 req-aa2b7042-96dc-46ed-9100-6bf1801169db service nova] Acquiring lock "a84e49f5-0bde-41ee-866e-6b434748077f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:44.523641 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ba22a4b1-af4d-45c4-88c4-436c3a1b42a7 req-aa2b7042-96dc-46ed-9100-6bf1801169db service nova] Lock "a84e49f5-0bde-41ee-866e-6b434748077f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:44.523641 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ba22a4b1-af4d-45c4-88c4-436c3a1b42a7 req-aa2b7042-96dc-46ed-9100-6bf1801169db service nova] Lock "a84e49f5-0bde-41ee-866e-6b434748077f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:44.523641 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ba22a4b1-af4d-45c4-88c4-436c3a1b42a7 req-aa2b7042-96dc-46ed-9100-6bf1801169db service nova] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] No waiting events found dispatching network-vif-unplugged-68c38c36-a152-4495-aa91-3a05281c5da6 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:58:44.524642 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ba22a4b1-af4d-45c4-88c4-436c3a1b42a7 req-aa2b7042-96dc-46ed-9100-6bf1801169db service nova] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Received event network-vif-unplugged-68c38c36-a152-4495-aa91-3a05281c5da6 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:58:44.524843 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ba22a4b1-af4d-45c4-88c4-436c3a1b42a7 req-aa2b7042-96dc-46ed-9100-6bf1801169db service nova] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Received event network-vif-unplugged-68c38c36-a152-4495-aa91-3a05281c5da6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:44.525273 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 00:58:44.525507 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ba22a4b1-af4d-45c4-88c4-436c3a1b42a7 req-aa2b7042-96dc-46ed-9100-6bf1801169db service nova] Acquiring lock "a84e49f5-0bde-41ee-866e-6b434748077f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:44.525748 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ba22a4b1-af4d-45c4-88c4-436c3a1b42a7 req-aa2b7042-96dc-46ed-9100-6bf1801169db service nova] Lock "a84e49f5-0bde-41ee-866e-6b434748077f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:44.526000 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ba22a4b1-af4d-45c4-88c4-436c3a1b42a7 req-aa2b7042-96dc-46ed-9100-6bf1801169db service nova] Lock "a84e49f5-0bde-41ee-866e-6b434748077f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:44.526215 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ba22a4b1-af4d-45c4-88c4-436c3a1b42a7 req-aa2b7042-96dc-46ed-9100-6bf1801169db service nova] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] No waiting events found dispatching network-vif-unplugged-68c38c36-a152-4495-aa91-3a05281c5da6 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:58:44.526597 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ba22a4b1-af4d-45c4-88c4-436c3a1b42a7 req-aa2b7042-96dc-46ed-9100-6bf1801169db service nova] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Received event network-vif-unplugged-68c38c36-a152-4495-aa91-3a05281c5da6 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:58:44.527628 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929924.5273309, 8bca25d8-071e-4b2d-960c-50582381cc75 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:58:44.527827 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] VM Resumed (Lifecycle Event)
May 28 00:58:44.530826 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 00:58:44.533705 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Instance spawned successfully.
May 28 00:58:44.533705 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 00:58:44.572259 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-422dd66e-219f-4bd5-ad09-ab83fbc5e49f tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1241877714',display_name='tempest-VolumesAssistedSnapshotsTest-server-1241877714',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumesassistedsnapshotstest-server-1241877714',id=5,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKoi45xQqSLL/Mm3DQ42vdrhoIMB95QcjFwohXwAr3szxbrD+5sdQF/lw7VYI8BvM1lLn6wg2cO9HmwptoTke77g8/9Al5VWqGtUWy1fHnak/nxZoPU3a1p9TR44DqOsw==',key_name='tempest-keypair-2048352764',keypairs=<?>,launch_index=0,launched_at=2026-05-28T00:57:46Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='365a56f393cf409d8d1562e6be8318fa',ramdisk_id='',reservation_id='r-acywytrp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-926722075',owner_user_name='tempest-VolumesAssistedSnapshotsTest-926722075-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T00:57:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32c3fd5d3b604c77b6ccc0284ea33a11',uuid=a84e49f5-0bde-41ee-866e-6b434748077f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68c38c36-a152-4495-aa91-3a05281c5da6", "address": "fa:16:3e:0c:bd:d9", "network": {"id": "51c8a614-2632-4bfd-802a-f2e7e95980dc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-624499010-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "365a56f393cf409d8d1562e6be8318fa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap68c38c36-a1", "ovs_interfaceid": "68c38c36-a152-4495-aa91-3a05281c5da6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 00:58:44.572584 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-422dd66e-219f-4bd5-ad09-ab83fbc5e49f tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Converting VIF {"id": "68c38c36-a152-4495-aa91-3a05281c5da6", "address": "fa:16:3e:0c:bd:d9", "network": {"id": "51c8a614-2632-4bfd-802a-f2e7e95980dc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-624499010-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "365a56f393cf409d8d1562e6be8318fa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap68c38c36-a1", "ovs_interfaceid": "68c38c36-a152-4495-aa91-3a05281c5da6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:58:44.573213 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-422dd66e-219f-4bd5-ad09-ab83fbc5e49f tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:bd:d9,bridge_name='br-int',has_traffic_filtering=True,id=68c38c36-a152-4495-aa91-3a05281c5da6,network=Network(51c8a614-2632-4bfd-802a-f2e7e95980dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68c38c36-a1') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:58:44.573534 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-422dd66e-219f-4bd5-ad09-ab83fbc5e49f tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:bd:d9,bridge_name='br-int',has_traffic_filtering=True,id=68c38c36-a152-4495-aa91-3a05281c5da6,network=Network(51c8a614-2632-4bfd-802a-f2e7e95980dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68c38c36-a1') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 00:58:44.574475 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:44.574713 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68c38c36-a1, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:44.578685 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:44.579619 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:44.580390 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:44.580583 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a9ecffa-53e5-4e31-920b-433e2538d470) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:44.581769 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:44.583393 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:44.588126 np0000001577 nova-compute[98319]: INFO os_vif [None req-422dd66e-219f-4bd5-ad09-ab83fbc5e49f tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:bd:d9,bridge_name='br-int',has_traffic_filtering=True,id=68c38c36-a152-4495-aa91-3a05281c5da6,network=Network(51c8a614-2632-4bfd-802a-f2e7e95980dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68c38c36-a1')
May 28 00:58:44.588716 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-422dd66e-219f-4bd5-ad09-ab83fbc5e49f tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Deleting instance files /opt/stack/data/nova/instances/a84e49f5-0bde-41ee-866e-6b434748077f_del
May 28 00:58:44.591248 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-422dd66e-219f-4bd5-ad09-ab83fbc5e49f tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Deletion of /opt/stack/data/nova/instances/a84e49f5-0bde-41ee-866e-6b434748077f_del complete
May 28 00:58:44.742374 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5b5962ee-b481-4a5a-aac8-97cf464f8783 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "interface-b1380963-8254-4ad0-95bb-91d24cea00f9-ec4fad7e-3a01-4591-ae8f-0b8fe30d60de" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 6.199s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:44.844958 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-2a944823-06e5-4296-a811-7c65568c3c12 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:58:44.953116 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-244d8aa8-4e46-495e-bbdd-7863507cd852 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Detaching volume d2d3e5ca-4e68-4f8d-84af-117ab421d9f5
May 28 00:58:45.002218 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-244d8aa8-4e46-495e-bbdd-7863507cd852 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Attempting to driver detach volume d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 from mountpoint /dev/vdb
May 28 00:58:45.004837 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-244d8aa8-4e46-495e-bbdd-7863507cd852 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Found disk vdb by alias ua-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 00:58:45.005792 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-244d8aa8-4e46-495e-bbdd-7863507cd852 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Found disk vdb by alias ua-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 00:58:45.005931 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-244d8aa8-4e46-495e-bbdd-7863507cd852 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Attempting to detach device vdb from instance 7fdf336e-65c1-4180-92eb-5f8ca0ebc526 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 00:58:45.006161 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-244d8aa8-4e46-495e-bbdd-7863507cd852 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] detach device xml: <disk type="block" device="disk">
May 28 00:58:45.006161 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 00:58:45.006161 np0000001577 nova-compute[98319]:   <alias name="ua-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5"/>
May 28 00:58:45.006161 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-7"/>
May 28 00:58:45.006161 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 00:58:45.006161 np0000001577 nova-compute[98319]:   <serial>d2d3e5ca-4e68-4f8d-84af-117ab421d9f5</serial>
May 28 00:58:45.006161 np0000001577 nova-compute[98319]:   <shareable/>
May 28 00:58:45.006161 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 00:58:45.006161 np0000001577 nova-compute[98319]: </disk>
May 28 00:58:45.006161 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 00:58:45.012310 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-244d8aa8-4e46-495e-bbdd-7863507cd852 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Successfully detached device vdb from instance 7fdf336e-65c1-4180-92eb-5f8ca0ebc526 from the persistent domain config.
May 28 00:58:45.012310 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-244d8aa8-4e46-495e-bbdd-7863507cd852 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] (1/8): Attempting to detach device vdb with device alias ua-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 from instance 7fdf336e-65c1-4180-92eb-5f8ca0ebc526 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 00:58:45.012310 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-244d8aa8-4e46-495e-bbdd-7863507cd852 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] detach device xml: <disk type="block" device="disk">
May 28 00:58:45.012310 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 00:58:45.012310 np0000001577 nova-compute[98319]:   <alias name="ua-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5"/>
May 28 00:58:45.012310 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-7"/>
May 28 00:58:45.012310 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 00:58:45.012310 np0000001577 nova-compute[98319]:   <serial>d2d3e5ca-4e68-4f8d-84af-117ab421d9f5</serial>
May 28 00:58:45.012310 np0000001577 nova-compute[98319]:   <shareable/>
May 28 00:58:45.012310 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 00:58:45.012310 np0000001577 nova-compute[98319]: </disk>
May 28 00:58:45.012310 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 00:58:45.033002 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:58:45.034471 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:58:45.041214 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:58:45.041214 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:58:45.041325 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:58:45.041486 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:58:45.041695 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:58:45.041907 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:58:45.095440 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-422dd66e-219f-4bd5-ad09-ab83fbc5e49f tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Took 1.39 seconds to destroy the instance on the hypervisor.
May 28 00:58:45.096053 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-422dd66e-219f-4bd5-ad09-ab83fbc5e49f tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 00:58:45.096496 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 00:58:45.096759 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 00:58:45.096920 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:45.213226 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:45.352531 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2a944823-06e5-4296-a811-7c65568c3c12 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.688s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:45.421419 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-2a944823-06e5-4296-a811-7c65568c3c12 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Deleted allocations for instance 8783a79a-1374-43cf-8f20-81f1a156a315
May 28 00:58:45.536810 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 00:58:45.543053 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779929925.5426733, 7fdf336e-65c1-4180-92eb-5f8ca0ebc526 => ua-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 00:58:45.543516 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-244d8aa8-4e46-495e-bbdd-7863507cd852 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 for instance 7fdf336e-65c1-4180-92eb-5f8ca0ebc526 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 00:58:45.546456 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Took 16.03 seconds to spawn the instance on the hypervisor.
May 28 00:58:45.546640 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:58:45.547299 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-244d8aa8-4e46-495e-bbdd-7863507cd852 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Successfully detached device vdb from instance 7fdf336e-65c1-4180-92eb-5f8ca0ebc526 from the live domain config.
May 28 00:58:45.961130 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:46.063605 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Took 23.28 seconds to build instance.
May 28 00:58:46.114960 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-244d8aa8-4e46-495e-bbdd-7863507cd852 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Detected multiple connections on this host for volume: d2d3e5ca-4e68-4f8d-84af-117ab421d9f5, skipping target disconnect.
May 28 00:58:46.178185 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "ebae9109-a600-4788-9008-74a8c320b803" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:46.178587 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "ebae9109-a600-4788-9008-74a8c320b803" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:46.188744 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:58:46.431245 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2a944823-06e5-4296-a811-7c65568c3c12 tempest-AttachSCSIVolumeTestJSON-1126953535 tempest-AttachSCSIVolumeTestJSON-1126953535-project-member] Lock "8783a79a-1374-43cf-8f20-81f1a156a315" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.921s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:46.475279 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-230e561b-3c07-45de-a784-e42441d786d1 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Acquiring lock "b1380963-8254-4ad0-95bb-91d24cea00f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:46.475775 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-230e561b-3c07-45de-a784-e42441d786d1 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "b1380963-8254-4ad0-95bb-91d24cea00f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:46.475978 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-230e561b-3c07-45de-a784-e42441d786d1 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Acquiring lock "b1380963-8254-4ad0-95bb-91d24cea00f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:46.476143 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-230e561b-3c07-45de-a784-e42441d786d1 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "b1380963-8254-4ad0-95bb-91d24cea00f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:46.476395 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-230e561b-3c07-45de-a784-e42441d786d1 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "b1380963-8254-4ad0-95bb-91d24cea00f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:46.478943 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-230e561b-3c07-45de-a784-e42441d786d1 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Terminating instance
May 28 00:58:46.567591 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-465cb5f7-d26d-43d2-acc4-f3cc7540fb1b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "8bca25d8-071e-4b2d-960c-50582381cc75" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.796s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:46.659428 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-765b7a18-daca-4723-9fc5-369e5e6661af req-4dbafd3c-77f1-4387-84f5-f3d6ad3bc908 service nova] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Received event network-vif-deleted-68c38c36-a152-4495-aa91-3a05281c5da6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:46.674970 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-244d8aa8-4e46-495e-bbdd-7863507cd852 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lazy-loading 'flavor' on Instance uuid 7fdf336e-65c1-4180-92eb-5f8ca0ebc526 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:58:46.681760 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 00:58:46.690606 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Took 1.59 seconds to deallocate network for instance.
May 28 00:58:46.984060 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-230e561b-3c07-45de-a784-e42441d786d1 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 00:58:47.007703 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:47.013831 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:47.033224 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:47.033374 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:47.033532 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:47.033663 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:47.033782 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:47.037029 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:47.039199 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Terminating instance
May 28 00:58:47.069585 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:47.071378 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:47.196255 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-422dd66e-219f-4bd5-ad09-ab83fbc5e49f tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:47.196459 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-422dd66e-219f-4bd5-ad09-ab83fbc5e49f tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:47.257068 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:47.305070 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:47.341644 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:47.345258 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999730628999941 future=<Future at 0x7c987042f320 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:58:47.349681 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Instance destroyed successfully.
May 28 00:58:47.349681 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-230e561b-3c07-45de-a784-e42441d786d1 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lazy-loading 'resources' on Instance uuid b1380963-8254-4ad0-95bb-91d24cea00f9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:58:47.542724 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 00:58:47.586486 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:47.592154 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:47.628616 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:47.654766 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:47.664694 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:47.678362 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:47.680920 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-244d8aa8-4e46-495e-bbdd-7863507cd852 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.230s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:47.716750 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-422dd66e-219f-4bd5-ad09-ab83fbc5e49f tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:58:47.716974 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-422dd66e-219f-4bd5-ad09-ab83fbc5e49f tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:58:47.737168 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:47.743205 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:47.746050 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:47.824141 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-91b42d80-6d43-41d4-8c53-cd6feedc6420 req-05b9cefa-13ff-452f-8cda-309c1af8219b service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-unplugged-61af54f4-c2a8-49db-8074-3f601131d7e3 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:47.824141 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-91b42d80-6d43-41d4-8c53-cd6feedc6420 req-05b9cefa-13ff-452f-8cda-309c1af8219b service nova] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:47.824141 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-91b42d80-6d43-41d4-8c53-cd6feedc6420 req-05b9cefa-13ff-452f-8cda-309c1af8219b service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:47.824141 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-91b42d80-6d43-41d4-8c53-cd6feedc6420 req-05b9cefa-13ff-452f-8cda-309c1af8219b service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:47.824141 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-91b42d80-6d43-41d4-8c53-cd6feedc6420 req-05b9cefa-13ff-452f-8cda-309c1af8219b service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] No waiting events found dispatching network-vif-unplugged-61af54f4-c2a8-49db-8074-3f601131d7e3 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:58:47.825502 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-91b42d80-6d43-41d4-8c53-cd6feedc6420 req-05b9cefa-13ff-452f-8cda-309c1af8219b service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-unplugged-61af54f4-c2a8-49db-8074-3f601131d7e3 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:58:47.832515 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:47.841006 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:47.851716 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-230e561b-3c07-45de-a784-e42441d786d1 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1446893669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1446893669',id=2,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgdSzXGUKNMMeuA2Cyvm6EZFtiJzxD7NWnlARJicpzFqN2FImWG3sU3198MgahdHOMaJqdmKUE8nRVq4d1z2/aQ8GRY/yfj1gslPX4PwbxVdsepP0DFICVmWgbQsQGwKA==',key_name='tempest-keypair-1022143858',keypairs=<?>,launch_index=0,launched_at=2026-05-28T00:57:26Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='355551e9b29346059ddbe389bc51efa8',ramdisk_id='',reservation_id='r-nlwfuhg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-585237783',owner_user_name='tempest-TaggedAttachmentsTest-585237783-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T00:57:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4ab7230b24d4ebf9090a752493983fb',uuid=b1380963-8254-4ad0-95bb-91d24cea00f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "address": "fa:16:3e:3a:fe:3d", "network": {"id": "3ceee21d-d4b4-4c77-8ac9-f2338f96e022", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-960987788-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "355551e9b29346059ddbe389bc51efa8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc9c0c0-6e", "ovs_interfaceid": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 00:58:47.851867 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-230e561b-3c07-45de-a784-e42441d786d1 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Converting VIF {"id": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "address": "fa:16:3e:3a:fe:3d", "network": {"id": "3ceee21d-d4b4-4c77-8ac9-f2338f96e022", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-960987788-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "355551e9b29346059ddbe389bc51efa8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dc9c0c0-6e", "ovs_interfaceid": "5dc9c0c0-6ee4-4266-8024-0f8313319a2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:58:47.852356 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-230e561b-3c07-45de-a784-e42441d786d1 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:fe:3d,bridge_name='br-int',has_traffic_filtering=True,id=5dc9c0c0-6ee4-4266-8024-0f8313319a2c,network=Network(3ceee21d-d4b4-4c77-8ac9-f2338f96e022),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dc9c0c0-6e') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:58:47.852557 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-230e561b-3c07-45de-a784-e42441d786d1 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:fe:3d,bridge_name='br-int',has_traffic_filtering=True,id=5dc9c0c0-6ee4-4266-8024-0f8313319a2c,network=Network(3ceee21d-d4b4-4c77-8ac9-f2338f96e022),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dc9c0c0-6e') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 00:58:47.853525 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:47.853734 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5dc9c0c0-6e, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:47.855480 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:47.856534 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:47.880817 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:47.930952 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:47.945820 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:47.947284 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:47.947284 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=816bc893-1b44-46a7-8b48-be489c25fb89) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:47.948756 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:47.949890 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:47.980094 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:47.986710 np0000001577 nova-compute[98319]: INFO os_vif [None req-230e561b-3c07-45de-a784-e42441d786d1 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:fe:3d,bridge_name='br-int',has_traffic_filtering=True,id=5dc9c0c0-6ee4-4266-8024-0f8313319a2c,network=Network(3ceee21d-d4b4-4c77-8ac9-f2338f96e022),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dc9c0c0-6e')
May 28 00:58:47.987000 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-230e561b-3c07-45de-a784-e42441d786d1 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Deleting instance files /opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9_del
May 28 00:58:47.987690 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-230e561b-3c07-45de-a784-e42441d786d1 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Deletion of /opt/stack/data/nova/instances/b1380963-8254-4ad0-95bb-91d24cea00f9_del complete
May 28 00:58:48.042718 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.120143 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.204844 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.215694 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999617409000166 future=<Future at 0x7c9870448560 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:58:48.220116 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Instance destroyed successfully.
May 28 00:58:48.220116 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lazy-loading 'resources' on Instance uuid 9d7f874a-9bd5-4e26-abda-5978493313cf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:58:48.223272 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-422dd66e-219f-4bd5-ad09-ab83fbc5e49f tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:58:48.236860 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.287559 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.353650 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.390745 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.430441 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.498883 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-230e561b-3c07-45de-a784-e42441d786d1 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Took 1.51 seconds to destroy the instance on the hypervisor.
May 28 00:58:48.499959 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-230e561b-3c07-45de-a784-e42441d786d1 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 00:58:48.502637 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 00:58:48.502637 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 00:58:48.502637 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:48.517639 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.568163 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.569740 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.635084 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:48.709675 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-95258608-b60f-4c74-957a-af9df4323f63 req-501dbfba-3968-4ad5-a68c-8b0f76086b1f service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Received event network-vif-unplugged-5dc9c0c0-6ee4-4266-8024-0f8313319a2c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:48.710932 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95258608-b60f-4c74-957a-af9df4323f63 req-501dbfba-3968-4ad5-a68c-8b0f76086b1f service nova] Acquiring lock "b1380963-8254-4ad0-95bb-91d24cea00f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:48.711072 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95258608-b60f-4c74-957a-af9df4323f63 req-501dbfba-3968-4ad5-a68c-8b0f76086b1f service nova] Lock "b1380963-8254-4ad0-95bb-91d24cea00f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:48.711173 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95258608-b60f-4c74-957a-af9df4323f63 req-501dbfba-3968-4ad5-a68c-8b0f76086b1f service nova] Lock "b1380963-8254-4ad0-95bb-91d24cea00f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:48.711288 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-95258608-b60f-4c74-957a-af9df4323f63 req-501dbfba-3968-4ad5-a68c-8b0f76086b1f service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] No waiting events found dispatching network-vif-unplugged-5dc9c0c0-6ee4-4266-8024-0f8313319a2c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:58:48.711407 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-95258608-b60f-4c74-957a-af9df4323f63 req-501dbfba-3968-4ad5-a68c-8b0f76086b1f service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Received event network-vif-unplugged-5dc9c0c0-6ee4-4266-8024-0f8313319a2c for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:58:48.727078 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-089090ce-6817-43dd-acc0-1d6f0e1a4f0a req-ef793df4-be19-4935-b9b0-552f76223fba service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-unplugged-97517937-1acb-4d47-93fb-fd89085e4f62 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:48.728691 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-089090ce-6817-43dd-acc0-1d6f0e1a4f0a req-ef793df4-be19-4935-b9b0-552f76223fba service nova] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:48.728911 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-089090ce-6817-43dd-acc0-1d6f0e1a4f0a req-ef793df4-be19-4935-b9b0-552f76223fba service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:48.729069 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-089090ce-6817-43dd-acc0-1d6f0e1a4f0a req-ef793df4-be19-4935-b9b0-552f76223fba service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:48.734564 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-422dd66e-219f-4bd5-ad09-ab83fbc5e49f tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.534s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:48.734564 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872562561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1872562561',id=6,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPFecLIkLO5JTpGTObnYg1RtXOmtHpmcbB2B5euCdvCluRUc/DGskJJ3Y7sH4gsT6zfiT27zUbmA54IyG2Y0IducAkauw44DZU+1vJGF6ABjE9kQDlfmB7D3IJLj/JxnQ==',key_name='tempest-keypair-1485494395',keypairs=<?>,launch_index=0,launched_at=2026-05-28T00:58:03Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b9278238dfa4e86ad7904a4a76caf6b',ramdisk_id='',reservation_id='r-t45dlllu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1598854432',owner_user_name='tempest-TaggedBootDevicesTest-1598854432-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T00:58:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c58dcd3aae234c4dbc1260fbeb278f90',uuid=9d7f874a-9bd5-4e26-abda-5978493313cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97517937-1acb-4d47-93fb-fd89085e4f62", "address": "fa:16:3e:a2:ac:a1", "network": {"id": "f6da0cc2-457d-4d21-9646-f2139a582801", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1600296736-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap97517937-1a", "ovs_interfaceid": "97517937-1acb-4d47-93fb-fd89085e4f62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 00:58:48.734564 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-089090ce-6817-43dd-acc0-1d6f0e1a4f0a req-ef793df4-be19-4935-b9b0-552f76223fba service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] No waiting events found dispatching network-vif-unplugged-97517937-1acb-4d47-93fb-fd89085e4f62 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:58:48.734564 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.475s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:48.734564 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converting VIF {"id": "97517937-1acb-4d47-93fb-fd89085e4f62", "address": "fa:16:3e:a2:ac:a1", "network": {"id": "f6da0cc2-457d-4d21-9646-f2139a582801", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1600296736-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap97517937-1a", "ovs_interfaceid": "97517937-1acb-4d47-93fb-fd89085e4f62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:58:48.735045 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-089090ce-6817-43dd-acc0-1d6f0e1a4f0a req-ef793df4-be19-4935-b9b0-552f76223fba service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-unplugged-97517937-1acb-4d47-93fb-fd89085e4f62 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:58:48.735381 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:ac:a1,bridge_name='br-int',has_traffic_filtering=True,id=97517937-1acb-4d47-93fb-fd89085e4f62,network=Network(f6da0cc2-457d-4d21-9646-f2139a582801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97517937-1a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:58:48.735600 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:ac:a1,bridge_name='br-int',has_traffic_filtering=True,id=97517937-1acb-4d47-93fb-fd89085e4f62,network=Network(f6da0cc2-457d-4d21-9646-f2139a582801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97517937-1a') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 00:58:48.738855 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-089090ce-6817-43dd-acc0-1d6f0e1a4f0a req-ef793df4-be19-4935-b9b0-552f76223fba service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-unplugged-97517937-1acb-4d47-93fb-fd89085e4f62 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:48.739072 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-089090ce-6817-43dd-acc0-1d6f0e1a4f0a req-ef793df4-be19-4935-b9b0-552f76223fba service nova] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:48.739536 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-089090ce-6817-43dd-acc0-1d6f0e1a4f0a req-ef793df4-be19-4935-b9b0-552f76223fba service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:48.739724 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-089090ce-6817-43dd-acc0-1d6f0e1a4f0a req-ef793df4-be19-4935-b9b0-552f76223fba service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:48.739916 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-089090ce-6817-43dd-acc0-1d6f0e1a4f0a req-ef793df4-be19-4935-b9b0-552f76223fba service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] No waiting events found dispatching network-vif-unplugged-97517937-1acb-4d47-93fb-fd89085e4f62 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:58:48.740074 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-089090ce-6817-43dd-acc0-1d6f0e1a4f0a req-ef793df4-be19-4935-b9b0-552f76223fba service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-unplugged-97517937-1acb-4d47-93fb-fd89085e4f62 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:58:48.740245 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-089090ce-6817-43dd-acc0-1d6f0e1a4f0a req-ef793df4-be19-4935-b9b0-552f76223fba service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-unplugged-43668618-5b61-4949-9f06-e291b8f68cce {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:48.743804 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 00:58:48.743971 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Claim successful on node np0000001577
May 28 00:58:48.746819 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-089090ce-6817-43dd-acc0-1d6f0e1a4f0a req-ef793df4-be19-4935-b9b0-552f76223fba service nova] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:48.750002 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.750597 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-089090ce-6817-43dd-acc0-1d6f0e1a4f0a req-ef793df4-be19-4935-b9b0-552f76223fba service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:48.750786 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-089090ce-6817-43dd-acc0-1d6f0e1a4f0a req-ef793df4-be19-4935-b9b0-552f76223fba service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:48.750962 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-089090ce-6817-43dd-acc0-1d6f0e1a4f0a req-ef793df4-be19-4935-b9b0-552f76223fba service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] No waiting events found dispatching network-vif-unplugged-43668618-5b61-4949-9f06-e291b8f68cce {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:58:48.751131 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-089090ce-6817-43dd-acc0-1d6f0e1a4f0a req-ef793df4-be19-4935-b9b0-552f76223fba service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-unplugged-43668618-5b61-4949-9f06-e291b8f68cce for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:58:48.751665 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-089090ce-6817-43dd-acc0-1d6f0e1a4f0a req-ef793df4-be19-4935-b9b0-552f76223fba service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-unplugged-43668618-5b61-4949-9f06-e291b8f68cce {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:48.751858 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-089090ce-6817-43dd-acc0-1d6f0e1a4f0a req-ef793df4-be19-4935-b9b0-552f76223fba service nova] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:48.752029 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-089090ce-6817-43dd-acc0-1d6f0e1a4f0a req-ef793df4-be19-4935-b9b0-552f76223fba service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:48.752166 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-089090ce-6817-43dd-acc0-1d6f0e1a4f0a req-ef793df4-be19-4935-b9b0-552f76223fba service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:48.752306 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-089090ce-6817-43dd-acc0-1d6f0e1a4f0a req-ef793df4-be19-4935-b9b0-552f76223fba service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] No waiting events found dispatching network-vif-unplugged-43668618-5b61-4949-9f06-e291b8f68cce {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:58:48.752462 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-089090ce-6817-43dd-acc0-1d6f0e1a4f0a req-ef793df4-be19-4935-b9b0-552f76223fba service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-unplugged-43668618-5b61-4949-9f06-e291b8f68cce for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:58:48.754645 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97517937-1a, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:48.767453 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.767453 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:48.789796 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-422dd66e-219f-4bd5-ad09-ab83fbc5e49f tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Deleted allocations for instance a84e49f5-0bde-41ee-866e-6b434748077f
May 28 00:58:48.795237 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.796750 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.797035 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e3a17967-8710-4049-8df1-f92e60cab612) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:48.798266 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:48.827033 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.829140 np0000001577 nova-compute[98319]: INFO os_vif [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:ac:a1,bridge_name='br-int',has_traffic_filtering=True,id=97517937-1acb-4d47-93fb-fd89085e4f62,network=Network(f6da0cc2-457d-4d21-9646-f2139a582801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97517937-1a')
May 28 00:58:48.829812 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872562561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1872562561',id=6,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPFecLIkLO5JTpGTObnYg1RtXOmtHpmcbB2B5euCdvCluRUc/DGskJJ3Y7sH4gsT6zfiT27zUbmA54IyG2Y0IducAkauw44DZU+1vJGF6ABjE9kQDlfmB7D3IJLj/JxnQ==',key_name='tempest-keypair-1485494395',keypairs=<?>,launch_index=0,launched_at=2026-05-28T00:58:03Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b9278238dfa4e86ad7904a4a76caf6b',ramdisk_id='',reservation_id='r-t45dlllu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1598854432',owner_user_name='tempest-TaggedBootDevicesTest-1598854432-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T00:58:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c58dcd3aae234c4dbc1260fbeb278f90',uuid=9d7f874a-9bd5-4e26-abda-5978493313cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61af54f4-c2a8-49db-8074-3f601131d7e3", "address": "fa:16:3e:05:ba:8e", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61af54f4-c2", "ovs_interfaceid": "61af54f4-c2a8-49db-8074-3f601131d7e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 00:58:48.829956 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converting VIF {"id": "61af54f4-c2a8-49db-8074-3f601131d7e3", "address": "fa:16:3e:05:ba:8e", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap61af54f4-c2", "ovs_interfaceid": "61af54f4-c2a8-49db-8074-3f601131d7e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:58:48.830446 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:ba:8e,bridge_name='br-int',has_traffic_filtering=True,id=61af54f4-c2a8-49db-8074-3f601131d7e3,network=Network(5240346f-576d-4813-ae69-2c6157a9a77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap61af54f4-c2') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:58:48.830665 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:ba:8e,bridge_name='br-int',has_traffic_filtering=True,id=61af54f4-c2a8-49db-8074-3f601131d7e3,network=Network(5240346f-576d-4813-ae69-2c6157a9a77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap61af54f4-c2') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 00:58:48.832028 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.832028 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61af54f4-c2, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:48.833079 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.833884 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:48.860534 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.863689 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.863689 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e8aaeb24-1674-4008-ad81-89c8595e5f10) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:48.865791 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:48.889404 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.890809 np0000001577 nova-compute[98319]: INFO os_vif [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:ba:8e,bridge_name='br-int',has_traffic_filtering=True,id=61af54f4-c2a8-49db-8074-3f601131d7e3,network=Network(5240346f-576d-4813-ae69-2c6157a9a77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap61af54f4-c2')
May 28 00:58:48.891665 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872562561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1872562561',id=6,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPFecLIkLO5JTpGTObnYg1RtXOmtHpmcbB2B5euCdvCluRUc/DGskJJ3Y7sH4gsT6zfiT27zUbmA54IyG2Y0IducAkauw44DZU+1vJGF6ABjE9kQDlfmB7D3IJLj/JxnQ==',key_name='tempest-keypair-1485494395',keypairs=<?>,launch_index=0,launched_at=2026-05-28T00:58:03Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b9278238dfa4e86ad7904a4a76caf6b',ramdisk_id='',reservation_id='r-t45dlllu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1598854432',owner_user_name='tempest-TaggedBootDevicesTest-1598854432-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T00:58:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c58dcd3aae234c4dbc1260fbeb278f90',uuid=9d7f874a-9bd5-4e26-abda-5978493313cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8eb6e856-e081-4dd7-b047-d48fd42c12f3", "address": "fa:16:3e:14:b7:15", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb6e856-e0", "ovs_interfaceid": "8eb6e856-e081-4dd7-b047-d48fd42c12f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 00:58:48.891876 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converting VIF {"id": "8eb6e856-e081-4dd7-b047-d48fd42c12f3", "address": "fa:16:3e:14:b7:15", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb6e856-e0", "ovs_interfaceid": "8eb6e856-e081-4dd7-b047-d48fd42c12f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:58:48.892408 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:b7:15,bridge_name='br-int',has_traffic_filtering=True,id=8eb6e856-e081-4dd7-b047-d48fd42c12f3,network=Network(5240346f-576d-4813-ae69-2c6157a9a77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8eb6e856-e0') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:58:48.892653 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:b7:15,bridge_name='br-int',has_traffic_filtering=True,id=8eb6e856-e081-4dd7-b047-d48fd42c12f3,network=Network(5240346f-576d-4813-ae69-2c6157a9a77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8eb6e856-e0') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 00:58:48.894040 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.894040 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8eb6e856-e0, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:48.894752 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.895487 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:48.915832 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.917085 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.917293 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=754f34d2-b7be-4bff-a5ce-af77cd9907d7) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:48.918189 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.918854 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:48.936588 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.939426 np0000001577 nova-compute[98319]: INFO os_vif [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:b7:15,bridge_name='br-int',has_traffic_filtering=True,id=8eb6e856-e081-4dd7-b047-d48fd42c12f3,network=Network(5240346f-576d-4813-ae69-2c6157a9a77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8eb6e856-e0')
May 28 00:58:48.940041 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872562561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1872562561',id=6,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPFecLIkLO5JTpGTObnYg1RtXOmtHpmcbB2B5euCdvCluRUc/DGskJJ3Y7sH4gsT6zfiT27zUbmA54IyG2Y0IducAkauw44DZU+1vJGF6ABjE9kQDlfmB7D3IJLj/JxnQ==',key_name='tempest-keypair-1485494395',keypairs=<?>,launch_index=0,launched_at=2026-05-28T00:58:03Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b9278238dfa4e86ad7904a4a76caf6b',ramdisk_id='',reservation_id='r-t45dlllu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1598854432',owner_user_name='tempest-TaggedBootDevicesTest-1598854432-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T00:58:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c58dcd3aae234c4dbc1260fbeb278f90',uuid=9d7f874a-9bd5-4e26-abda-5978493313cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee97d14e-f88b-4516-a3a7-c7e4f7ae6483", "address": "fa:16:3e:67:4c:bd", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee97d14e-f8", "ovs_interfaceid": "ee97d14e-f88b-4516-a3a7-c7e4f7ae6483", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 00:58:48.940204 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converting VIF {"id": "ee97d14e-f88b-4516-a3a7-c7e4f7ae6483", "address": "fa:16:3e:67:4c:bd", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee97d14e-f8", "ovs_interfaceid": "ee97d14e-f88b-4516-a3a7-c7e4f7ae6483", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:58:48.940743 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:4c:bd,bridge_name='br-int',has_traffic_filtering=True,id=ee97d14e-f88b-4516-a3a7-c7e4f7ae6483,network=Network(5240346f-576d-4813-ae69-2c6157a9a77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee97d14e-f8') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:58:48.940934 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:4c:bd,bridge_name='br-int',has_traffic_filtering=True,id=ee97d14e-f88b-4516-a3a7-c7e4f7ae6483,network=Network(5240346f-576d-4813-ae69-2c6157a9a77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee97d14e-f8') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 00:58:48.941778 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.943000 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee97d14e-f8, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:48.944102 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:48.944892 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquiring lock "0928917f-0c8c-4019-aef4-083ba8224ce0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:48.945104 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "0928917f-0c8c-4019-aef4-083ba8224ce0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:48.962058 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.963354 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.963648 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9056b02-5740-4c27-aa41-0a47a7ed4238) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:48.964495 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.965261 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:48.979109 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.980697 np0000001577 nova-compute[98319]: INFO os_vif [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:4c:bd,bridge_name='br-int',has_traffic_filtering=True,id=ee97d14e-f88b-4516-a3a7-c7e4f7ae6483,network=Network(5240346f-576d-4813-ae69-2c6157a9a77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee97d14e-f8')
May 28 00:58:48.981330 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872562561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1872562561',id=6,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPFecLIkLO5JTpGTObnYg1RtXOmtHpmcbB2B5euCdvCluRUc/DGskJJ3Y7sH4gsT6zfiT27zUbmA54IyG2Y0IducAkauw44DZU+1vJGF6ABjE9kQDlfmB7D3IJLj/JxnQ==',key_name='tempest-keypair-1485494395',keypairs=<?>,launch_index=0,launched_at=2026-05-28T00:58:03Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b9278238dfa4e86ad7904a4a76caf6b',ramdisk_id='',reservation_id='r-t45dlllu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1598854432',owner_user_name='tempest-TaggedBootDevicesTest-1598854432-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T00:58:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c58dcd3aae234c4dbc1260fbeb278f90',uuid=9d7f874a-9bd5-4e26-abda-5978493313cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea9f7c06-6d37-45ce-b730-7abdf1004095", "address": "fa:16:3e:31:f3:63", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9f7c06-6d", "ovs_interfaceid": "ea9f7c06-6d37-45ce-b730-7abdf1004095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 00:58:48.981505 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converting VIF {"id": "ea9f7c06-6d37-45ce-b730-7abdf1004095", "address": "fa:16:3e:31:f3:63", "network": {"id": "5240346f-576d-4813-ae69-2c6157a9a77a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1424612697", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea9f7c06-6d", "ovs_interfaceid": "ea9f7c06-6d37-45ce-b730-7abdf1004095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:58:48.981987 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:f3:63,bridge_name='br-int',has_traffic_filtering=True,id=ea9f7c06-6d37-45ce-b730-7abdf1004095,network=Network(5240346f-576d-4813-ae69-2c6157a9a77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea9f7c06-6d') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:58:48.982166 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:f3:63,bridge_name='br-int',has_traffic_filtering=True,id=ea9f7c06-6d37-45ce-b730-7abdf1004095,network=Network(5240346f-576d-4813-ae69-2c6157a9a77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea9f7c06-6d') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 00:58:48.984971 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.984971 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea9f7c06-6d, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:48.986403 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:48.995365 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.997017 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.997017 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0cecbaf1-5a91-44a1-a8d1-2f3ddb6334c0) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:48.997741 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:48.998508 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:49.008727 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:49.010400 np0000001577 nova-compute[98319]: INFO os_vif [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:f3:63,bridge_name='br-int',has_traffic_filtering=True,id=ea9f7c06-6d37-45ce-b730-7abdf1004095,network=Network(5240346f-576d-4813-ae69-2c6157a9a77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea9f7c06-6d')
May 28 00:58:49.011236 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872562561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1872562561',id=6,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPFecLIkLO5JTpGTObnYg1RtXOmtHpmcbB2B5euCdvCluRUc/DGskJJ3Y7sH4gsT6zfiT27zUbmA54IyG2Y0IducAkauw44DZU+1vJGF6ABjE9kQDlfmB7D3IJLj/JxnQ==',key_name='tempest-keypair-1485494395',keypairs=<?>,launch_index=0,launched_at=2026-05-28T00:58:03Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b9278238dfa4e86ad7904a4a76caf6b',ramdisk_id='',reservation_id='r-t45dlllu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1598854432',owner_user_name='tempest-TaggedBootDevicesTest-1598854432-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T00:58:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c58dcd3aae234c4dbc1260fbeb278f90',uuid=9d7f874a-9bd5-4e26-abda-5978493313cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "232f9df8-2737-4ab4-9028-7ba9060284c4", "address": "fa:16:3e:fe:12:c6", "network": {"id": "d07566c3-0394-4dc6-ad3c-0d4f13f7703d", "bridge": "br-int", "label": "tempest-device-tagging-net2-2113905332", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap232f9df8-27", "ovs_interfaceid": "232f9df8-2737-4ab4-9028-7ba9060284c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 00:58:49.011438 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converting VIF {"id": "232f9df8-2737-4ab4-9028-7ba9060284c4", "address": "fa:16:3e:fe:12:c6", "network": {"id": "d07566c3-0394-4dc6-ad3c-0d4f13f7703d", "bridge": "br-int", "label": "tempest-device-tagging-net2-2113905332", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap232f9df8-27", "ovs_interfaceid": "232f9df8-2737-4ab4-9028-7ba9060284c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:58:49.012000 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:12:c6,bridge_name='br-int',has_traffic_filtering=True,id=232f9df8-2737-4ab4-9028-7ba9060284c4,network=Network(d07566c3-0394-4dc6-ad3c-0d4f13f7703d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap232f9df8-27') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:58:49.012219 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:12:c6,bridge_name='br-int',has_traffic_filtering=True,id=232f9df8-2737-4ab4-9028-7ba9060284c4,network=Network(d07566c3-0394-4dc6-ad3c-0d4f13f7703d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap232f9df8-27') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 00:58:49.014199 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:49.014199 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap232f9df8-27, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:49.015363 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:49.020142 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:49.020896 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:49.020896 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ca3938f-a768-4afd-8277-e37f16609ec8) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:49.021446 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:49.022086 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:49.027375 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:49.030641 np0000001577 nova-compute[98319]: INFO os_vif [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:12:c6,bridge_name='br-int',has_traffic_filtering=True,id=232f9df8-2737-4ab4-9028-7ba9060284c4,network=Network(d07566c3-0394-4dc6-ad3c-0d4f13f7703d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap232f9df8-27')
May 28 00:58:49.031418 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872562561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1872562561',id=6,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPFecLIkLO5JTpGTObnYg1RtXOmtHpmcbB2B5euCdvCluRUc/DGskJJ3Y7sH4gsT6zfiT27zUbmA54IyG2Y0IducAkauw44DZU+1vJGF6ABjE9kQDlfmB7D3IJLj/JxnQ==',key_name='tempest-keypair-1485494395',keypairs=<?>,launch_index=0,launched_at=2026-05-28T00:58:03Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b9278238dfa4e86ad7904a4a76caf6b',ramdisk_id='',reservation_id='r-t45dlllu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1598854432',owner_user_name='tempest-TaggedBootDevicesTest-1598854432-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T00:58:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c58dcd3aae234c4dbc1260fbeb278f90',uuid=9d7f874a-9bd5-4e26-abda-5978493313cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43668618-5b61-4949-9f06-e291b8f68cce", "address": "fa:16:3e:4c:71:ca", "network": {"id": "d07566c3-0394-4dc6-ad3c-0d4f13f7703d", "bridge": "br-int", "label": "tempest-device-tagging-net2-2113905332", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43668618-5b", "ovs_interfaceid": "43668618-5b61-4949-9f06-e291b8f68cce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 00:58:49.031738 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converting VIF {"id": "43668618-5b61-4949-9f06-e291b8f68cce", "address": "fa:16:3e:4c:71:ca", "network": {"id": "d07566c3-0394-4dc6-ad3c-0d4f13f7703d", "bridge": "br-int", "label": "tempest-device-tagging-net2-2113905332", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b9278238dfa4e86ad7904a4a76caf6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43668618-5b", "ovs_interfaceid": "43668618-5b61-4949-9f06-e291b8f68cce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:58:49.032287 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:71:ca,bridge_name='br-int',has_traffic_filtering=True,id=43668618-5b61-4949-9f06-e291b8f68cce,network=Network(d07566c3-0394-4dc6-ad3c-0d4f13f7703d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43668618-5b') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:58:49.032539 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:71:ca,bridge_name='br-int',has_traffic_filtering=True,id=43668618-5b61-4949-9f06-e291b8f68cce,network=Network(d07566c3-0394-4dc6-ad3c-0d4f13f7703d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43668618-5b') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 00:58:49.033967 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:49.033967 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43668618-5b, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:49.034906 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:49.036359 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:49.037190 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:49.037449 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f22ec5f-ce1b-4a38-a169-b4890f512917) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:49.039018 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:49.040639 np0000001577 nova-compute[98319]: INFO os_vif [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:71:ca,bridge_name='br-int',has_traffic_filtering=True,id=43668618-5b61-4949-9f06-e291b8f68cce,network=Network(d07566c3-0394-4dc6-ad3c-0d4f13f7703d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43668618-5b')
May 28 00:58:49.041539 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 00:58:49.041894 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098', 'iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7a0275e-e153-4b68-b49f-8ca9266df098', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:58:49.042408 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:58:49.042408 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:58:49.042794 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098', 'iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7a0275e-e153-4b68-b49f-8ca9266df098', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 00:58:49.042968 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 00:58:49.075679 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:49.075679 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:49.075679 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:49.075679 np0000001577 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:49.075679 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:49.075679 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:49.075679 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:49.075679 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:49.075679 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:49.075679 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:49.075679 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:58:49.075679 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:49.075679 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:49.075679 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:49.075679 np0000001577 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:49.075679 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:49.075679 np0000001577 nova-compute[98319]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:49.075679 np0000001577 nova-compute[98319]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098 (non-flash)
May 28 00:58:49.075679 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:49.075679 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:49.075679 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:49.075679 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:58:49.075679 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce', '8'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884', '9')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 00:58:49.075679 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098', '5')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 00:58:49.076623 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098', '6')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 00:58:49.083864 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c987044cb80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098'): ({'sdc'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 00:58:49.083864 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 00:58:49.083864 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Flush multipath device 330000000ca29251c {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 00:58:49.135539 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 00:58:49.189261 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 00:58:49.238124 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 00:58:49.238354 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 00:58:49.239467 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 00:58:49.250973 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 00:58:49.251097 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 00:58:49.264309 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:49.297419 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098, portal: 192.168.40.100,3260]
May 28 00:58:49.297419 np0000001577 nova-compute[98319]: Logout of [sid: 5, target: iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098, portal: 192.168.40.100,3260] successful.
May 28 00:58:49.297419 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:49.321779 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:49.330786 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:49.363064 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098, portal: 192.168.50.100,3260]
May 28 00:58:49.363064 np0000001577 nova-compute[98319]: Logout of [sid: 6, target: iqn.2023-03.storpool.com:os--volume-a7a0275e-e153-4b68-b49f-8ca9266df098, portal: 192.168.50.100,3260] successful.
May 28 00:58:49.363064 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:49.380217 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:49.380217 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:58:49.380217 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] <== disconnect_volume: return (338ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:58:49.380217 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 00:58:49.382362 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 00:58:49.382362 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce', 'iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '143fa2be-a5e9-4162-804b-8146030f3bce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:58:49.382362 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:58:49.382362 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:58:49.382362 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce', 'iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '143fa2be-a5e9-4162-804b-8146030f3bce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 00:58:49.382362 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 00:58:49.414155 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:49.414155 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:49.414155 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:49.414155 np0000001577 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:49.414155 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:49.414155 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:49.414155 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:49.414155 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:49.414155 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:58:49.414857 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:49.414857 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:49.414857 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:49.414857 np0000001577 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:49.414857 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:49.414857 np0000001577 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:49.414857 np0000001577 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce (non-flash)
May 28 00:58:49.414857 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:49.414857 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:58:49.415234 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce', '8'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884', '9')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 00:58:49.415466 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce', '7')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 00:58:49.416391 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce', '8')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 00:58:49.417727 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c98704954e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce'): ({'sde'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 00:58:49.417727 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Removing multipathed devices sde, sdd {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 00:58:49.417727 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Flush multipath device 330000000f6482198 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 00:58:49.447276 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Detaching volume d2d3e5ca-4e68-4f8d-84af-117ab421d9f5
May 28 00:58:49.454425 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 00:58:49.489861 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Attempting to driver detach volume d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 from mountpoint /dev/vdb
May 28 00:58:49.495422 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Found disk vdb by alias ua-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 00:58:49.497693 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 00:58:49.498769 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Found disk vdb by alias ua-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 00:58:49.498916 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Attempting to detach device vdb from instance 0928917f-0c8c-4019-aef4-083ba8224ce0 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 00:58:49.499151 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] detach device xml: <disk type="block" device="disk">
May 28 00:58:49.499151 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 00:58:49.499151 np0000001577 nova-compute[98319]:   <alias name="ua-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5"/>
May 28 00:58:49.499151 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-7"/>
May 28 00:58:49.499151 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 00:58:49.499151 np0000001577 nova-compute[98319]:   <serial>d2d3e5ca-4e68-4f8d-84af-117ab421d9f5</serial>
May 28 00:58:49.499151 np0000001577 nova-compute[98319]:   <shareable/>
May 28 00:58:49.499151 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 00:58:49.499151 np0000001577 nova-compute[98319]: </disk>
May 28 00:58:49.499151 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 00:58:49.504916 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Successfully detached device vdb from instance 0928917f-0c8c-4019-aef4-083ba8224ce0 from the persistent domain config.
May 28 00:58:49.505128 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] (1/8): Attempting to detach device vdb with device alias ua-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 from instance 0928917f-0c8c-4019-aef4-083ba8224ce0 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 00:58:49.509243 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] detach device xml: <disk type="block" device="disk">
May 28 00:58:49.509243 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 00:58:49.509243 np0000001577 nova-compute[98319]:   <alias name="ua-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5"/>
May 28 00:58:49.509243 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-7"/>
May 28 00:58:49.509243 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 00:58:49.509243 np0000001577 nova-compute[98319]:   <serial>d2d3e5ca-4e68-4f8d-84af-117ab421d9f5</serial>
May 28 00:58:49.509243 np0000001577 nova-compute[98319]:   <shareable/>
May 28 00:58:49.509243 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 00:58:49.509243 np0000001577 nova-compute[98319]: </disk>
May 28 00:58:49.509243 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 00:58:49.541114 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 00:58:49.541114 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 00:58:49.541114 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 00:58:49.554601 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 00:58:49.554951 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 00:58:49.570850 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:49.607669 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce, portal: 192.168.40.100,3260]
May 28 00:58:49.607669 np0000001577 nova-compute[98319]: Logout of [sid: 7, target: iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce, portal: 192.168.40.100,3260] successful.
May 28 00:58:49.607669 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:49.626492 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:49.639449 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:49.672461 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce, portal: 192.168.50.100,3260]
May 28 00:58:49.672461 np0000001577 nova-compute[98319]: Logout of [sid: 8, target: iqn.2023-03.storpool.com:os--volume-143fa2be-a5e9-4162-804b-8146030f3bce, portal: 192.168.50.100,3260] successful.
May 28 00:58:49.672461 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:49.691055 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:49.691055 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:58:49.691055 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] <== disconnect_volume: return (309ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:58:49.691055 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 00:58:49.694221 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 00:58:49.694221 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884', 'iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '54210675-051f-4f9e-83c6-97577ccdf884', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:58:49.694221 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:58:49.694221 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:58:49.694221 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884', 'iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '54210675-051f-4f9e-83c6-97577ccdf884', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 00:58:49.694221 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 00:58:49.728521 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:49.728521 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:49.728521 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:49.728521 np0000001577 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:49.728521 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:49.728521 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:49.728521 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:58:49.728521 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:49.728521 np0000001577 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:49.728521 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:49.728521 np0000001577 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:49.728521 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:49.728521 np0000001577 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884 (non-flash)
May 28 00:58:49.728521 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:58:49.728521 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884', '9')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 00:58:49.728521 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884', '9')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 00:58:49.731857 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884', '10')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 00:58:49.732782 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c98704dbba0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884'): ({'sdg'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 00:58:49.732927 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Removing multipathed devices sdf, sdg {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 00:58:49.733140 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Flush multipath device 3300000008fe36b99 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 00:58:49.777198 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 00:58:49.802339 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-422dd66e-219f-4bd5-ad09-ab83fbc5e49f tempest-VolumesAssistedSnapshotsTest-926722075 tempest-VolumesAssistedSnapshotsTest-926722075-project-member] Lock "a84e49f5-0bde-41ee-866e-6b434748077f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.600s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:49.815722 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 00:58:49.860438 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 00:58:49.860667 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 00:58:49.861538 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 00:58:49.874418 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "d09e5674-c5ab-4ace-9952-554361002541" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:49.875022 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d09e5674-c5ab-4ace-9952-554361002541" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:49.882579 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 00:58:49.882579 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 00:58:49.897523 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:49.918648 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-636d913b-cff7-44f0-8104-22fcf5a8afc8 req-3d2b7a51-7f9f-400c-b0b0-fa5c96a056f3 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-unplugged-61af54f4-c2a8-49db-8074-3f601131d7e3 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:49.918802 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-636d913b-cff7-44f0-8104-22fcf5a8afc8 req-3d2b7a51-7f9f-400c-b0b0-fa5c96a056f3 service nova] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:49.918934 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-636d913b-cff7-44f0-8104-22fcf5a8afc8 req-3d2b7a51-7f9f-400c-b0b0-fa5c96a056f3 service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:49.919036 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-636d913b-cff7-44f0-8104-22fcf5a8afc8 req-3d2b7a51-7f9f-400c-b0b0-fa5c96a056f3 service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:49.919153 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-636d913b-cff7-44f0-8104-22fcf5a8afc8 req-3d2b7a51-7f9f-400c-b0b0-fa5c96a056f3 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] No waiting events found dispatching network-vif-unplugged-61af54f4-c2a8-49db-8074-3f601131d7e3 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:58:49.919247 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-636d913b-cff7-44f0-8104-22fcf5a8afc8 req-3d2b7a51-7f9f-400c-b0b0-fa5c96a056f3 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-unplugged-61af54f4-c2a8-49db-8074-3f601131d7e3 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:58:49.919362 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-636d913b-cff7-44f0-8104-22fcf5a8afc8 req-3d2b7a51-7f9f-400c-b0b0-fa5c96a056f3 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-unplugged-ee97d14e-f88b-4516-a3a7-c7e4f7ae6483 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:49.919475 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-636d913b-cff7-44f0-8104-22fcf5a8afc8 req-3d2b7a51-7f9f-400c-b0b0-fa5c96a056f3 service nova] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:49.919593 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-636d913b-cff7-44f0-8104-22fcf5a8afc8 req-3d2b7a51-7f9f-400c-b0b0-fa5c96a056f3 service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:49.920561 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-636d913b-cff7-44f0-8104-22fcf5a8afc8 req-3d2b7a51-7f9f-400c-b0b0-fa5c96a056f3 service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:49.920561 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-636d913b-cff7-44f0-8104-22fcf5a8afc8 req-3d2b7a51-7f9f-400c-b0b0-fa5c96a056f3 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] No waiting events found dispatching network-vif-unplugged-ee97d14e-f88b-4516-a3a7-c7e4f7ae6483 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:58:49.920561 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-636d913b-cff7-44f0-8104-22fcf5a8afc8 req-3d2b7a51-7f9f-400c-b0b0-fa5c96a056f3 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-unplugged-ee97d14e-f88b-4516-a3a7-c7e4f7ae6483 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:58:49.920561 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-636d913b-cff7-44f0-8104-22fcf5a8afc8 req-3d2b7a51-7f9f-400c-b0b0-fa5c96a056f3 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-unplugged-ee97d14e-f88b-4516-a3a7-c7e4f7ae6483 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:49.920561 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-636d913b-cff7-44f0-8104-22fcf5a8afc8 req-3d2b7a51-7f9f-400c-b0b0-fa5c96a056f3 service nova] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:49.921977 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-636d913b-cff7-44f0-8104-22fcf5a8afc8 req-3d2b7a51-7f9f-400c-b0b0-fa5c96a056f3 service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:49.922959 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-636d913b-cff7-44f0-8104-22fcf5a8afc8 req-3d2b7a51-7f9f-400c-b0b0-fa5c96a056f3 service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:49.923096 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-636d913b-cff7-44f0-8104-22fcf5a8afc8 req-3d2b7a51-7f9f-400c-b0b0-fa5c96a056f3 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] No waiting events found dispatching network-vif-unplugged-ee97d14e-f88b-4516-a3a7-c7e4f7ae6483 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:58:49.923223 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-636d913b-cff7-44f0-8104-22fcf5a8afc8 req-3d2b7a51-7f9f-400c-b0b0-fa5c96a056f3 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-unplugged-ee97d14e-f88b-4516-a3a7-c7e4f7ae6483 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:58:49.931568 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884, portal: 192.168.40.100,3260]
May 28 00:58:49.931568 np0000001577 nova-compute[98319]: Logout of [sid: 9, target: iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884, portal: 192.168.40.100,3260] successful.
May 28 00:58:49.931568 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:49.946286 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:49.957079 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:49.987470 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884, portal: 192.168.50.100,3260]
May 28 00:58:49.987470 np0000001577 nova-compute[98319]: Logout of [sid: 10, target: iqn.2023-03.storpool.com:os--volume-54210675-051f-4f9e-83c6-97577ccdf884, portal: 192.168.50.100,3260] successful.
May 28 00:58:49.987470 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:50.019279 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:50.019279 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:58:50.019279 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] <== disconnect_volume: return (323ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:58:50.019279 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 00:58:50.019279 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Deleting instance files /opt/stack/data/nova/instances/9d7f874a-9bd5-4e26-abda-5978493313cf_del
May 28 00:58:50.019279 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Deletion of /opt/stack/data/nova/instances/9d7f874a-9bd5-4e26-abda-5978493313cf_del complete
May 28 00:58:50.231942 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:58:50.232210 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:58:50.382863 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 00:58:50.501528 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:50.524064 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Took 2.98 seconds to destroy the instance on the hypervisor.
May 28 00:58:50.524613 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 00:58:50.524868 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 00:58:50.526447 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 00:58:50.526447 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:50.584664 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:58:50.664285 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:50.734645 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:58:50.786338 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Received event network-vif-unplugged-5dc9c0c0-6ee4-4266-8024-0f8313319a2c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:50.786515 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] Acquiring lock "b1380963-8254-4ad0-95bb-91d24cea00f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:50.786719 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] Lock "b1380963-8254-4ad0-95bb-91d24cea00f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:50.786859 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] Lock "b1380963-8254-4ad0-95bb-91d24cea00f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:50.787020 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] No waiting events found dispatching network-vif-unplugged-5dc9c0c0-6ee4-4266-8024-0f8313319a2c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:58:50.787184 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Received event network-vif-unplugged-5dc9c0c0-6ee4-4266-8024-0f8313319a2c for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:58:50.787342 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-unplugged-8eb6e856-e081-4dd7-b047-d48fd42c12f3 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:50.787501 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:50.792578 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:50.792578 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:50.792578 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] No waiting events found dispatching network-vif-unplugged-8eb6e856-e081-4dd7-b047-d48fd42c12f3 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:58:50.792993 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-unplugged-8eb6e856-e081-4dd7-b047-d48fd42c12f3 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:58:50.792993 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Received event network-vif-deleted-5dc9c0c0-6ee4-4266-8024-0f8313319a2c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:50.792993 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-unplugged-8eb6e856-e081-4dd7-b047-d48fd42c12f3 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:50.792993 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:50.793219 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:50.793219 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:50.793365 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] No waiting events found dispatching network-vif-unplugged-8eb6e856-e081-4dd7-b047-d48fd42c12f3 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:58:50.793462 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-unplugged-8eb6e856-e081-4dd7-b047-d48fd42c12f3 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:58:50.793646 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-unplugged-232f9df8-2737-4ab4-9028-7ba9060284c4 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:50.793778 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:50.793928 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:50.794146 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:50.794146 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] No waiting events found dispatching network-vif-unplugged-232f9df8-2737-4ab4-9028-7ba9060284c4 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:58:50.794370 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-unplugged-232f9df8-2737-4ab4-9028-7ba9060284c4 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:58:50.794370 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-unplugged-232f9df8-2737-4ab4-9028-7ba9060284c4 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:50.794486 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:50.794592 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:50.794650 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:50.794749 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] No waiting events found dispatching network-vif-unplugged-232f9df8-2737-4ab4-9028-7ba9060284c4 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:58:50.794840 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-unplugged-232f9df8-2737-4ab4-9028-7ba9060284c4 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:58:50.795121 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-unplugged-ea9f7c06-6d37-45ce-b730-7abdf1004095 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:50.795940 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:50.796205 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:50.796351 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:50.796487 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] No waiting events found dispatching network-vif-unplugged-ea9f7c06-6d37-45ce-b730-7abdf1004095 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:58:50.796647 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a0fa3f37-f990-4375-b5e2-b1780fb58531 req-0f911173-f040-4d44-85a0-996232d39921 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-unplugged-ea9f7c06-6d37-45ce-b730-7abdf1004095 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:58:50.932432 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:50.963178 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:51.087021 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Took 2.59 seconds to deallocate network for instance.
May 28 00:58:51.242931 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.511s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:51.247596 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.314s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:51.247815 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 00:58:51.255911 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 00:58:51.256055 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Claim successful on node np0000001577
May 28 00:58:51.583515 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779929931.5831032, 0928917f-0c8c-4019-aef4-083ba8224ce0 => ua-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 00:58:51.585827 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 for instance 0928917f-0c8c-4019-aef4-083ba8224ce0 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 00:58:51.588397 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Successfully detached device vdb from instance 0928917f-0c8c-4019-aef4-083ba8224ce0 from the live domain config.
May 28 00:58:51.600257 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-230e561b-3c07-45de-a784-e42441d786d1 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:51.640784 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 00:58:51.641047 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd2d3e5ca-4e68-4f8d-84af-117ab421d9f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:58:51.641182 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:58:51.641497 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:58:51.641772 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd2d3e5ca-4e68-4f8d-84af-117ab421d9f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 00:58:51.641907 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 00:58:51.668572 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:51.668572 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:51.668572 np0000001577 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:51.668572 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:51.668572 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:58:51.669134 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsi session list stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:51.669134 np0000001577 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5 (non-flash)
May 28 00:58:51.669134 np0000001577 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:51.669134 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:58:51.669134 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:58:51.669134 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 00:58:51.669134 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', '15')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 00:58:51.669711 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5', '16')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 00:58:51.670154 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c987044dd00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5'): ({'sdm'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 00:58:51.670383 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Removing multipathed devices sdm, sdl {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 00:58:51.670530 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Flush multipath device 3300000001491b408 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 00:58:51.703097 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 00:58:51.747398 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 00:58:51.754213 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 00:58:51.754403 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 00:58:51.754641 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:51.755245 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:51.796195 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 00:58:51.796366 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 00:58:51.797799 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 00:58:51.808040 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 00:58:51.808221 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 00:58:51.820671 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:51.853722 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5, portal: 192.168.40.100,3260]
May 28 00:58:51.853722 np0000001577 nova-compute[98319]: Logout of [sid: 15, target: iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5, portal: 192.168.40.100,3260] successful.
May 28 00:58:51.853722 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:51.867197 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:51.874662 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f43f6f5427ba4a5b896019555a2ef47a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b80759164bf4465b0bd873db74c9c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 00:58:51.887998 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:51.913939 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5, portal: 192.168.50.100,3260]
May 28 00:58:51.913939 np0000001577 nova-compute[98319]: Logout of [sid: 16, target: iqn.2023-03.storpool.com:os--volume-d2d3e5ca-4e68-4f8d-84af-117ab421d9f5, portal: 192.168.50.100,3260] successful.
May 28 00:58:51.913939 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:51.928011 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:58:51.928279 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:58:51.928373 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] <== disconnect_volume: return (286ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:58:51.928480 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 00:58:52.149293 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:52.257429 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 00:58:52.407404 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:52.489824 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lazy-loading 'flavor' on Instance uuid 0928917f-0c8c-4019-aef4-083ba8224ce0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:58:52.624923 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Successfully created port: d13e4109-188d-4b19-916a-486f62a27eea {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 00:58:52.752434 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:58:52.752957 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:58:52.761887 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 00:58:53.003997 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0592a5fa-d7d4-4cf8-a67c-1555e5d48b99 req-995094b5-931f-4b31-b264-79647c62a2e7 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-unplugged-ea9f7c06-6d37-45ce-b730-7abdf1004095 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:53.004165 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0592a5fa-d7d4-4cf8-a67c-1555e5d48b99 req-995094b5-931f-4b31-b264-79647c62a2e7 service nova] Acquiring lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:53.006387 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0592a5fa-d7d4-4cf8-a67c-1555e5d48b99 req-995094b5-931f-4b31-b264-79647c62a2e7 service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:53.007813 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0592a5fa-d7d4-4cf8-a67c-1555e5d48b99 req-995094b5-931f-4b31-b264-79647c62a2e7 service nova] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:53.008068 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0592a5fa-d7d4-4cf8-a67c-1555e5d48b99 req-995094b5-931f-4b31-b264-79647c62a2e7 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] No waiting events found dispatching network-vif-unplugged-ea9f7c06-6d37-45ce-b730-7abdf1004095 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:58:53.008282 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0592a5fa-d7d4-4cf8-a67c-1555e5d48b99 req-995094b5-931f-4b31-b264-79647c62a2e7 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-unplugged-ea9f7c06-6d37-45ce-b730-7abdf1004095 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:58:53.008488 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0592a5fa-d7d4-4cf8-a67c-1555e5d48b99 req-995094b5-931f-4b31-b264-79647c62a2e7 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-deleted-43668618-5b61-4949-9f06-e291b8f68cce {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:53.008669 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-0592a5fa-d7d4-4cf8-a67c-1555e5d48b99 req-995094b5-931f-4b31-b264-79647c62a2e7 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Neutron deleted interface 43668618-5b61-4949-9f06-e291b8f68cce; detaching it from the instance and deleting it from the info cache
May 28 00:58:53.015200 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0592a5fa-d7d4-4cf8-a67c-1555e5d48b99 req-995094b5-931f-4b31-b264-79647c62a2e7 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Detach interface failed, port_id=43668618-5b61-4949-9f06-e291b8f68cce, reason: Instance 9d7f874a-9bd5-4e26-abda-5978493313cf could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 00:58:53.015375 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0592a5fa-d7d4-4cf8-a67c-1555e5d48b99 req-995094b5-931f-4b31-b264-79647c62a2e7 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-deleted-97517937-1acb-4d47-93fb-fd89085e4f62 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:53.015530 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-0592a5fa-d7d4-4cf8-a67c-1555e5d48b99 req-995094b5-931f-4b31-b264-79647c62a2e7 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Neutron deleted interface 97517937-1acb-4d47-93fb-fd89085e4f62; detaching it from the instance and deleting it from the info cache
May 28 00:58:53.017093 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0592a5fa-d7d4-4cf8-a67c-1555e5d48b99 req-995094b5-931f-4b31-b264-79647c62a2e7 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Detach interface failed, port_id=97517937-1acb-4d47-93fb-fd89085e4f62, reason: Instance 9d7f874a-9bd5-4e26-abda-5978493313cf could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 00:58:53.256511 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:58:53.315626 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a44de96d-b22e-4fec-8db0-71525e2b3998 req-805e6009-be80-45f5-8977-32ea3fdd5fbd service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-deleted-ea9f7c06-6d37-45ce-b730-7abdf1004095 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:53.317632 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-a44de96d-b22e-4fec-8db0-71525e2b3998 req-805e6009-be80-45f5-8977-32ea3fdd5fbd service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Neutron deleted interface ea9f7c06-6d37-45ce-b730-7abdf1004095; detaching it from the instance and deleting it from the info cache
May 28 00:58:53.322242 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a44de96d-b22e-4fec-8db0-71525e2b3998 req-805e6009-be80-45f5-8977-32ea3fdd5fbd service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Detach interface failed, port_id=ea9f7c06-6d37-45ce-b730-7abdf1004095, reason: Instance 9d7f874a-9bd5-4e26-abda-5978493313cf could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 00:58:53.390471 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Successfully updated port: d13e4109-188d-4b19-916a-486f62a27eea {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 00:58:53.497035 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-744c4607-b72a-45e2-a098-f4c6e6099571 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "0928917f-0c8c-4019-aef4-083ba8224ce0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.552s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:53.764953 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.519s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:53.765298 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 00:58:53.767522 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-230e561b-3c07-45de-a784-e42441d786d1 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.167s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:53.774092 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 00:58:53.776591 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 00:58:53.776788 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Creating image(s)
May 28 00:58:53.781288 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "/opt/stack/data/nova/instances/ebae9109-a600-4788-9008-74a8c320b803/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:53.781467 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "/opt/stack/data/nova/instances/ebae9109-a600-4788-9008-74a8c320b803/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:53.782584 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "/opt/stack/data/nova/instances/ebae9109-a600-4788-9008-74a8c320b803/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:53.783158 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:58:53.795432 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:58:53.799754 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:53.876887 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.077s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:58:53.877428 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:53.877966 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:53.878499 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:58:53.884796 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:58:53.886004 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:53.908633 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "refresh_cache-ebae9109-a600-4788-9008-74a8c320b803" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:58:53.913110 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquired lock "refresh_cache-ebae9109-a600-4788-9008-74a8c320b803" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:58:53.913472 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 00:58:53.982002 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.094s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:58:53.982002 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/ebae9109-a600-4788-9008-74a8c320b803/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:54.000726 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:58:54.033188 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/ebae9109-a600-4788-9008-74a8c320b803/disk 1073741824" returned: 0 in 0.051s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:58:54.033188 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.155s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:54.033619 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:54.050229 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:54.123832 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:58:54.123832 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ebae9109-a600-4788-9008-74a8c320b803/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 00:58:54.123994 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebae9109-a600-4788-9008-74a8c320b803/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:54.195423 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebae9109-a600-4788-9008-74a8c320b803/disk --force-share --output=json" returned: 0 in 0.071s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:58:54.195920 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Cannot resize image /opt/stack/data/nova/instances/ebae9109-a600-4788-9008-74a8c320b803/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 00:58:54.196633 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 00:58:54.197565 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Ensure instance console log exists: /opt/stack/data/nova/instances/ebae9109-a600-4788-9008-74a8c320b803/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 00:58:54.198918 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:54.199073 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:54.199250 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:54.284743 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 00:58:54.287965 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 00:58:54.288559 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:54.288845 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:54.335173 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a9fcbfbb-d416-4df0-a115-9b0773260b26 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquiring lock "0928917f-0c8c-4019-aef4-083ba8224ce0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:54.335323 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a9fcbfbb-d416-4df0-a115-9b0773260b26 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "0928917f-0c8c-4019-aef4-083ba8224ce0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:54.335503 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a9fcbfbb-d416-4df0-a115-9b0773260b26 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquiring lock "0928917f-0c8c-4019-aef4-083ba8224ce0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:54.335652 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a9fcbfbb-d416-4df0-a115-9b0773260b26 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "0928917f-0c8c-4019-aef4-083ba8224ce0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:54.335758 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a9fcbfbb-d416-4df0-a115-9b0773260b26 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "0928917f-0c8c-4019-aef4-083ba8224ce0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:54.338260 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-a9fcbfbb-d416-4df0-a115-9b0773260b26 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Terminating instance
May 28 00:58:54.406205 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8586a18edcf42cab0a60028135ae401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938c2829112843edb2054984e80ce7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 00:58:54.417658 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-230e561b-3c07-45de-a784-e42441d786d1 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:58:54.421298 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-230e561b-3c07-45de-a784-e42441d786d1 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:58:54.434862 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-87e5f1a7-3143-44ab-8d26-addd66e6fa04 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquiring lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:54.434862 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-87e5f1a7-3143-44ab-8d26-addd66e6fa04 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:54.434991 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-87e5f1a7-3143-44ab-8d26-addd66e6fa04 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquiring lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:54.435726 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-87e5f1a7-3143-44ab-8d26-addd66e6fa04 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:54.435726 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-87e5f1a7-3143-44ab-8d26-addd66e6fa04 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:54.438667 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-87e5f1a7-3143-44ab-8d26-addd66e6fa04 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Terminating instance
May 28 00:58:54.500935 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:58:54.511020 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Took 3.99 seconds to deallocate network for instance.
May 28 00:58:54.521609 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:54.677411 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:54.784781 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 00:58:54.841412 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-a9fcbfbb-d416-4df0-a115-9b0773260b26 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 00:58:54.855136 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Updating instance_info_cache with network_info: [{"id": "d13e4109-188d-4b19-916a-486f62a27eea", "address": "fa:16:3e:85:df:78", "network": {"id": "be63e483-23b8-4753-b2fa-d9fc516b53f9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-518223995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b80759164bf4465b0bd873db74c9c49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13e4109-18", "ovs_interfaceid": "d13e4109-188d-4b19-916a-486f62a27eea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:58:54.866785 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:54.894053 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:54.911430 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Successfully created port: 27b0856b-fab8-4285-8856-b3cabb6c5437 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 00:58:54.928775 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-230e561b-3c07-45de-a784-e42441d786d1 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:58:54.944774 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-87e5f1a7-3143-44ab-8d26-addd66e6fa04 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 00:58:54.977627 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:54.977964 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:54.999644 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:55.073587 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:55.085823 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-19dee108-5c93-48a9-86a9-d770c299738d req-7c4be566-bc82-4e58-a42a-ee101caa23b0 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-deleted-232f9df8-2737-4ab4-9028-7ba9060284c4 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:55.085945 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-19dee108-5c93-48a9-86a9-d770c299738d req-7c4be566-bc82-4e58-a42a-ee101caa23b0 service nova] [instance: ebae9109-a600-4788-9008-74a8c320b803] Received event network-changed-d13e4109-188d-4b19-916a-486f62a27eea {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:55.086259 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-19dee108-5c93-48a9-86a9-d770c299738d req-7c4be566-bc82-4e58-a42a-ee101caa23b0 service nova] [instance: ebae9109-a600-4788-9008-74a8c320b803] Refreshing instance network info cache due to event network-changed-d13e4109-188d-4b19-916a-486f62a27eea. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:58:55.086642 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-19dee108-5c93-48a9-86a9-d770c299738d req-7c4be566-bc82-4e58-a42a-ee101caa23b0 service nova] Acquiring lock "refresh_cache-ebae9109-a600-4788-9008-74a8c320b803" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:58:55.087645 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:55.110449 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:55.145788 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:55.149789 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:55.176898 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a92f9a06-3427-4c8f-b937-b408b9d90966 req-a325eae5-b912-44a8-a797-58ab5a4f7aef service nova] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Received event network-vif-unplugged-16d9022a-b978-4e59-80a0-34d8d6da6b87 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:55.176959 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a92f9a06-3427-4c8f-b937-b408b9d90966 req-a325eae5-b912-44a8-a797-58ab5a4f7aef service nova] Acquiring lock "0928917f-0c8c-4019-aef4-083ba8224ce0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:55.177091 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a92f9a06-3427-4c8f-b937-b408b9d90966 req-a325eae5-b912-44a8-a797-58ab5a4f7aef service nova] Lock "0928917f-0c8c-4019-aef4-083ba8224ce0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:55.177195 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a92f9a06-3427-4c8f-b937-b408b9d90966 req-a325eae5-b912-44a8-a797-58ab5a4f7aef service nova] Lock "0928917f-0c8c-4019-aef4-083ba8224ce0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:55.177336 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a92f9a06-3427-4c8f-b937-b408b9d90966 req-a325eae5-b912-44a8-a797-58ab5a4f7aef service nova] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] No waiting events found dispatching network-vif-unplugged-16d9022a-b978-4e59-80a0-34d8d6da6b87 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:58:55.179701 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a92f9a06-3427-4c8f-b937-b408b9d90966 req-a325eae5-b912-44a8-a797-58ab5a4f7aef service nova] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Received event network-vif-unplugged-16d9022a-b978-4e59-80a0-34d8d6da6b87 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:58:55.288472 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 00:58:55.291270 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:55.320576 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999709278999944 future=<Future at 0x7c987030f800 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:58:55.328458 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Instance destroyed successfully.
May 28 00:58:55.329715 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-a9fcbfbb-d416-4df0-a115-9b0773260b26 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lazy-loading 'resources' on Instance uuid 0928917f-0c8c-4019-aef4-083ba8224ce0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:58:55.336745 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999721231999956 future=<Future at 0x7c984c7c0140 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:58:55.336745 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Instance destroyed successfully.
May 28 00:58:55.337696 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:55.342892 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-87e5f1a7-3143-44ab-8d26-addd66e6fa04 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lazy-loading 'resources' on Instance uuid 7fdf336e-65c1-4180-92eb-5f8ca0ebc526 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:58:55.359626 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Releasing lock "refresh_cache-ebae9109-a600-4788-9008-74a8c320b803" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:58:55.359950 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Instance network_info: |[{"id": "d13e4109-188d-4b19-916a-486f62a27eea", "address": "fa:16:3e:85:df:78", "network": {"id": "be63e483-23b8-4753-b2fa-d9fc516b53f9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-518223995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b80759164bf4465b0bd873db74c9c49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13e4109-18", "ovs_interfaceid": "d13e4109-188d-4b19-916a-486f62a27eea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 00:58:55.360822 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-19dee108-5c93-48a9-86a9-d770c299738d req-7c4be566-bc82-4e58-a42a-ee101caa23b0 service nova] Acquired lock "refresh_cache-ebae9109-a600-4788-9008-74a8c320b803" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:58:55.361659 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-19dee108-5c93-48a9-86a9-d770c299738d req-7c4be566-bc82-4e58-a42a-ee101caa23b0 service nova] [instance: ebae9109-a600-4788-9008-74a8c320b803] Refreshing network info cache for port d13e4109-188d-4b19-916a-486f62a27eea {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:58:55.366287 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Start _get_guest_xml network_info=[{"id": "d13e4109-188d-4b19-916a-486f62a27eea", "address": "fa:16:3e:85:df:78", "network": {"id": "be63e483-23b8-4753-b2fa-d9fc516b53f9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-518223995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b80759164bf4465b0bd873db74c9c49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13e4109-18", "ovs_interfaceid": "d13e4109-188d-4b19-916a-486f62a27eea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 00:58:55.367778 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:55.369625 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 00:58:55.370883 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-756428160', uuid='ebae9109-a600-4788-9008-74a8c320b803'), owner=OwnerMeta(userid='f43f6f5427ba4a5b896019555a2ef47a', username='tempest-VolumesBackupsTest-2139172395-project-member', projectid='6b80759164bf4465b0bd873db74c9c49', projectname='tempest-VolumesBackupsTest-2139172395'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d13e4109-188d-4b19-916a-486f62a27eea", "address": "fa:16:3e:85:df:78", "network": {"id": "be63e483-23b8-4753-b2fa-d9fc516b53f9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-518223995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b80759164bf4465b0bd873db74c9c49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13e4109-18", "ovs_interfaceid": "d13e4109-188d-4b19-916a-486f62a27eea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779929935.3704264) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 00:58:55.372882 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 00:58:55.373259 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 00:58:55.374260 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 00:58:55.374451 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 00:58:55.375503 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 00:58:55.375898 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 00:58:55.376668 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 00:58:55.376668 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 00:58:55.376668 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 00:58:55.376668 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 00:58:55.376866 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 00:58:55.377092 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 00:58:55.377284 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 00:58:55.377765 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 00:58:55.378346 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 00:58:55.378513 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 00:58:55.398390 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T00:58:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-756428160',display_name='tempest-VolumesBackupsTest-instance-756428160',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumesbackupstest-instance-756428160',id=11,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK97goX4/Mk9CRCWqwBu0BG5UIZZl/AJBLguOHFIko7C5AyGAHKiRCQDVTp751nZid77AB4v/HBNGzL7dQgWH1b1vtiA/9jSdmXvX78JdxK+9AAQJrADRyOHUlGmNrc3Zw==',key_name='tempest-keypair-933242402',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b80759164bf4465b0bd873db74c9c49',ramdisk_id='',reservation_id='r-0ile47bv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-2139172395',owner_user_name='tempest-VolumesBackupsTest-2139172395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:58:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f43f6f5427ba4a5b896019555a2ef47a',uuid=ebae9109-a600-4788-9008-74a8c320b803,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d13e4109-188d-4b19-916a-486f62a27eea", "address": "fa:16:3e:85:df:78", "network": {"id": "be63e483-23b8-4753-b2fa-d9fc516b53f9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-518223995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b80759164bf4465b0bd873db74c9c49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13e4109-18", "ovs_interfaceid": "d13e4109-188d-4b19-916a-486f62a27eea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 00:58:55.398656 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Converting VIF {"id": "d13e4109-188d-4b19-916a-486f62a27eea", "address": "fa:16:3e:85:df:78", "network": {"id": "be63e483-23b8-4753-b2fa-d9fc516b53f9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-518223995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b80759164bf4465b0bd873db74c9c49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13e4109-18", "ovs_interfaceid": "d13e4109-188d-4b19-916a-486f62a27eea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:58:55.399478 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:df:78,bridge_name='br-int',has_traffic_filtering=True,id=d13e4109-188d-4b19-916a-486f62a27eea,network=Network(be63e483-23b8-4753-b2fa-d9fc516b53f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd13e4109-18') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:58:55.400332 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lazy-loading 'pci_devices' on Instance uuid ebae9109-a600-4788-9008-74a8c320b803 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:58:55.437416 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-230e561b-3c07-45de-a784-e42441d786d1 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.668s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:55.514716 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-230e561b-3c07-45de-a784-e42441d786d1 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Deleted allocations for instance b1380963-8254-4ad0-95bb-91d24cea00f9
May 28 00:58:55.558937 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2856dd67-2490-4284-9d61-d5fd4dac5910 req-1e0de0f9-3aee-4172-93f3-247b5792a489 service nova] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Received event network-vif-deleted-ee97d14e-f88b-4516-a3a7-c7e4f7ae6483 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:55.559148 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2856dd67-2490-4284-9d61-d5fd4dac5910 req-1e0de0f9-3aee-4172-93f3-247b5792a489 service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Received event network-vif-unplugged-9f8ec3b0-780e-4a36-ad3f-4664a6829868 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:55.559383 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2856dd67-2490-4284-9d61-d5fd4dac5910 req-1e0de0f9-3aee-4172-93f3-247b5792a489 service nova] Acquiring lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:55.560209 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2856dd67-2490-4284-9d61-d5fd4dac5910 req-1e0de0f9-3aee-4172-93f3-247b5792a489 service nova] Lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:55.560415 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2856dd67-2490-4284-9d61-d5fd4dac5910 req-1e0de0f9-3aee-4172-93f3-247b5792a489 service nova] Lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:55.560606 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2856dd67-2490-4284-9d61-d5fd4dac5910 req-1e0de0f9-3aee-4172-93f3-247b5792a489 service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] No waiting events found dispatching network-vif-unplugged-9f8ec3b0-780e-4a36-ad3f-4664a6829868 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:58:55.560782 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2856dd67-2490-4284-9d61-d5fd4dac5910 req-1e0de0f9-3aee-4172-93f3-247b5792a489 service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Received event network-vif-unplugged-9f8ec3b0-780e-4a36-ad3f-4664a6829868 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:58:55.561296 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0005318190001162293 future=<Future at 0x7c988c1d4a70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:58:55.561674 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1779929920.5606604, 8783a79a-1374-43cf-8f20-81f1a156a315 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:58:55.561818 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:58:55.561954 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] VM Stopped (Lifecycle Event)
May 28 00:58:55.562766 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=3.500392882000142 future=<Future at 0x7c987058bad0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:58:55.562851 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=3.5002507180001885 future=<Future at 0x7c987058bad0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:58:55.696869 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:55.701897 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:55.732655 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:55.831181 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-a9fcbfbb-d416-4df0-a115-9b0773260b26 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1923104158-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testmultiattachvolumeswap-server-1923104158-1',id=3,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTrx4V3NNTvIO0v6e0UgrxyebG5bgkKISVc5kT+2xHSKFNJBCRuY+HWML8VJbZLvrlhGev6Ue1eO9Ec7vV8o3QKseEptwtOMBb5jUqsNTaO/QaEwQKXDgtt4TsHfOVLJQ==',key_name='tempest-keypair-1571596048',keypairs=<?>,launch_index=0,launched_at=2026-05-28T00:57:34Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df45e1c2b903482aa7e61c55b1f3f45b',ramdisk_id='',reservation_id='r-ka660b6i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-196235525',owner_user_name='tempest-TestMultiAttachVolumeSwap-196235525-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T00:57:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='027d659157ce49c7b674d0e5d41adf07',uuid=0928917f-0c8c-4019-aef4-083ba8224ce0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16d9022a-b978-4e59-80a0-34d8d6da6b87", "address": "fa:16:3e:89:ef:d4", "network": {"id": "e43128b4-a829-486a-a380-4b92728ed2c5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-655543488-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df45e1c2b903482aa7e61c55b1f3f45b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d9022a-b9", "ovs_interfaceid": "16d9022a-b978-4e59-80a0-34d8d6da6b87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 00:58:55.831686 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-a9fcbfbb-d416-4df0-a115-9b0773260b26 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Converting VIF {"id": "16d9022a-b978-4e59-80a0-34d8d6da6b87", "address": "fa:16:3e:89:ef:d4", "network": {"id": "e43128b4-a829-486a-a380-4b92728ed2c5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-655543488-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df45e1c2b903482aa7e61c55b1f3f45b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap16d9022a-b9", "ovs_interfaceid": "16d9022a-b978-4e59-80a0-34d8d6da6b87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:58:55.831964 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-a9fcbfbb-d416-4df0-a115-9b0773260b26 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:ef:d4,bridge_name='br-int',has_traffic_filtering=True,id=16d9022a-b978-4e59-80a0-34d8d6da6b87,network=Network(e43128b4-a829-486a-a380-4b92728ed2c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d9022a-b9') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:58:55.832129 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-a9fcbfbb-d416-4df0-a115-9b0773260b26 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:ef:d4,bridge_name='br-int',has_traffic_filtering=True,id=16d9022a-b978-4e59-80a0-34d8d6da6b87,network=Network(e43128b4-a829-486a-a380-4b92728ed2c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d9022a-b9') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 00:58:55.834624 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:55.834708 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:55.836980 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16d9022a-b9, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:55.839747 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:55.848272 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-87e5f1a7-3143-44ab-8d26-addd66e6fa04 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:57:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1923104158-2',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testmultiattachvolumeswap-server-1923104158-2',id=4,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTrx4V3NNTvIO0v6e0UgrxyebG5bgkKISVc5kT+2xHSKFNJBCRuY+HWML8VJbZLvrlhGev6Ue1eO9Ec7vV8o3QKseEptwtOMBb5jUqsNTaO/QaEwQKXDgtt4TsHfOVLJQ==',key_name='tempest-keypair-1571596048',keypairs=<?>,launch_index=1,launched_at=2026-05-28T00:57:44Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df45e1c2b903482aa7e61c55b1f3f45b',ramdisk_id='',reservation_id='r-ka660b6i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-196235525',owner_user_name='tempest-TestMultiAttachVolumeSwap-196235525-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T00:57:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='027d659157ce49c7b674d0e5d41adf07',uuid=7fdf336e-65c1-4180-92eb-5f8ca0ebc526,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f8ec3b0-780e-4a36-ad3f-4664a6829868", "address": "fa:16:3e:a7:28:21", "network": {"id": "e43128b4-a829-486a-a380-4b92728ed2c5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-655543488-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df45e1c2b903482aa7e61c55b1f3f45b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8ec3b0-78", "ovs_interfaceid": "9f8ec3b0-780e-4a36-ad3f-4664a6829868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 00:58:55.848522 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-87e5f1a7-3143-44ab-8d26-addd66e6fa04 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Converting VIF {"id": "9f8ec3b0-780e-4a36-ad3f-4664a6829868", "address": "fa:16:3e:a7:28:21", "network": {"id": "e43128b4-a829-486a-a380-4b92728ed2c5", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-655543488-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df45e1c2b903482aa7e61c55b1f3f45b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8ec3b0-78", "ovs_interfaceid": "9f8ec3b0-780e-4a36-ad3f-4664a6829868", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:58:55.848944 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-87e5f1a7-3143-44ab-8d26-addd66e6fa04 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:28:21,bridge_name='br-int',has_traffic_filtering=True,id=9f8ec3b0-780e-4a36-ad3f-4664a6829868,network=Network(e43128b4-a829-486a-a380-4b92728ed2c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f8ec3b0-78') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:58:55.849151 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-87e5f1a7-3143-44ab-8d26-addd66e6fa04 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:28:21,bridge_name='br-int',has_traffic_filtering=True,id=9f8ec3b0-780e-4a36-ad3f-4664a6829868,network=Network(e43128b4-a829-486a-a380-4b92728ed2c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f8ec3b0-78') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 00:58:55.864244 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-19dee108-5c93-48a9-86a9-d770c299738d req-7c4be566-bc82-4e58-a42a-ee101caa23b0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:55.869144 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:55.873407 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:55.873928 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:55.874404 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f8ec3b0-78, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:55.877640 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:55.877640 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:55.887513 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:55.888155 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:55.888297 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=086c0b16-9f12-4fa8-bffd-25ae32747895) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:55.889199 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:55.891237 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:55.892837 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:55.892837 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1cd0a9c3-c31c-4e6a-81f3-d2fa407580fe) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:55.893234 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:55.894762 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:55.894918 np0000001577 nova-compute[98319]: INFO os_vif [None req-a9fcbfbb-d416-4df0-a115-9b0773260b26 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:ef:d4,bridge_name='br-int',has_traffic_filtering=True,id=16d9022a-b978-4e59-80a0-34d8d6da6b87,network=Network(e43128b4-a829-486a-a380-4b92728ed2c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16d9022a-b9')
May 28 00:58:55.895281 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-a9fcbfbb-d416-4df0-a115-9b0773260b26 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Deleting instance files /opt/stack/data/nova/instances/0928917f-0c8c-4019-aef4-083ba8224ce0_del
May 28 00:58:55.896197 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-a9fcbfbb-d416-4df0-a115-9b0773260b26 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Deletion of /opt/stack/data/nova/instances/0928917f-0c8c-4019-aef4-083ba8224ce0_del complete
May 28 00:58:55.898471 np0000001577 nova-compute[98319]: INFO os_vif [None req-87e5f1a7-3143-44ab-8d26-addd66e6fa04 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:28:21,bridge_name='br-int',has_traffic_filtering=True,id=9f8ec3b0-780e-4a36-ad3f-4664a6829868,network=Network(e43128b4-a829-486a-a380-4b92728ed2c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f8ec3b0-78')
May 28 00:58:55.898908 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-87e5f1a7-3143-44ab-8d26-addd66e6fa04 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Deleting instance files /opt/stack/data/nova/instances/7fdf336e-65c1-4180-92eb-5f8ca0ebc526_del
May 28 00:58:55.899843 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-87e5f1a7-3143-44ab-8d26-addd66e6fa04 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Deletion of /opt/stack/data/nova/instances/7fdf336e-65c1-4180-92eb-5f8ca0ebc526_del complete
May 28 00:58:55.906274 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] End _get_guest_xml xml=<domain type="qemu">
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:   <uuid>ebae9109-a600-4788-9008-74a8c320b803</uuid>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:   <name>instance-0000000b</name>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:   <metadata>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       <nova:name>tempest-VolumesBackupsTest-instance-756428160</nova:name>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 00:58:55</nova:creationTime>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       </nova:image>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:         <nova:user uuid="f43f6f5427ba4a5b896019555a2ef47a">tempest-VolumesBackupsTest-2139172395-project-member</nova:user>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:         <nova:project uuid="6b80759164bf4465b0bd873db74c9c49">tempest-VolumesBackupsTest-2139172395</nova:project>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:         <nova:port uuid="d13e4109-188d-4b19-916a-486f62a27eea">
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:         </nova:port>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:   </metadata>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:     <system>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       <entry name="serial">ebae9109-a600-4788-9008-74a8c320b803</entry>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       <entry name="uuid">ebae9109-a600-4788-9008-74a8c320b803</entry>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:     </system>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:   <os>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:   </os>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:   <features>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:     <acpi/>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:     <tcg>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:     </tcg>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:   </features>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:   <devices>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/ebae9109-a600-4788-9008-74a8c320b803/disk"/>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:     </disk>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/ebae9109-a600-4788-9008-74a8c320b803/disk.config"/>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:     </disk>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:85:df:78"/>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       <target dev="tapd13e4109-18"/>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:     </interface>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/ebae9109-a600-4788-9008-74a8c320b803/console.log" append="off"/>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:     </serial>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:     <video>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:     </video>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:     </rng>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:     </memballoon>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:   </devices>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]: </domain>
May 28 00:58:55.906274 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 00:58:55.906274 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Preparing to wait for external event network-vif-plugged-d13e4109-188d-4b19-916a-486f62a27eea {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 00:58:55.906274 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "ebae9109-a600-4788-9008-74a8c320b803-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:55.906274 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "ebae9109-a600-4788-9008-74a8c320b803-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:55.906274 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "ebae9109-a600-4788-9008-74a8c320b803-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:55.906274 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T00:58:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-756428160',display_name='tempest-VolumesBackupsTest-instance-756428160',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumesbackupstest-instance-756428160',id=11,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK97goX4/Mk9CRCWqwBu0BG5UIZZl/AJBLguOHFIko7C5AyGAHKiRCQDVTp751nZid77AB4v/HBNGzL7dQgWH1b1vtiA/9jSdmXvX78JdxK+9AAQJrADRyOHUlGmNrc3Zw==',key_name='tempest-keypair-933242402',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b80759164bf4465b0bd873db74c9c49',ramdisk_id='',reservation_id='r-0ile47bv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-2139172395',owner_user_name='tempest-VolumesBackupsTest-2139172395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:58:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f43f6f5427ba4a5b896019555a2ef47a',uuid=ebae9109-a600-4788-9008-74a8c320b803,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d13e4109-188d-4b19-916a-486f62a27eea", "address": "fa:16:3e:85:df:78", "network": {"id": "be63e483-23b8-4753-b2fa-d9fc516b53f9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-518223995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b80759164bf4465b0bd873db74c9c49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13e4109-18", "ovs_interfaceid": "d13e4109-188d-4b19-916a-486f62a27eea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 00:58:55.910173 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Converting VIF {"id": "d13e4109-188d-4b19-916a-486f62a27eea", "address": "fa:16:3e:85:df:78", "network": {"id": "be63e483-23b8-4753-b2fa-d9fc516b53f9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-518223995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b80759164bf4465b0bd873db74c9c49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13e4109-18", "ovs_interfaceid": "d13e4109-188d-4b19-916a-486f62a27eea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:58:55.910173 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:df:78,bridge_name='br-int',has_traffic_filtering=True,id=d13e4109-188d-4b19-916a-486f62a27eea,network=Network(be63e483-23b8-4753-b2fa-d9fc516b53f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd13e4109-18') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:58:55.910385 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:df:78,bridge_name='br-int',has_traffic_filtering=True,id=d13e4109-188d-4b19-916a-486f62a27eea,network=Network(be63e483-23b8-4753-b2fa-d9fc516b53f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd13e4109-18') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 00:58:55.911333 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:55.911883 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:55.912090 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 00:58:55.913554 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:55.913554 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03f747e8-0140-5aa8-b137-9f70e60e030c', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:55.914992 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:55.915224 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:55.920976 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:55.921047 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd13e4109-18, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:55.921697 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd13e4109-18, col_values=(('qos', UUID('dc339cb5-2bbd-4de2-b451-a392feddf639')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:55.921697 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd13e4109-18, col_values=(('external_ids', {'iface-id': 'd13e4109-188d-4b19-916a-486f62a27eea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:df:78', 'vm-uuid': 'ebae9109-a600-4788-9008-74a8c320b803'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:55.922495 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:55.924464 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:55.930262 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:55.931578 np0000001577 nova-compute[98319]: INFO os_vif [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:df:78,bridge_name='br-int',has_traffic_filtering=True,id=d13e4109-188d-4b19-916a-486f62a27eea,network=Network(be63e483-23b8-4753-b2fa-d9fc516b53f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd13e4109-18')
May 28 00:58:55.963813 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:56.067240 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7ac4c9ec-36b8-4e41-b40d-0b3cfa61f4a1 None None] [instance: 8783a79a-1374-43cf-8f20-81f1a156a315] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:58:56.159093 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 00:58:56.211232 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Successfully updated port: 27b0856b-fab8-4285-8856-b3cabb6c5437 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 00:58:56.234277 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Took 1.72 seconds to detach 3 volumes for instance.
May 28 00:58:56.299699 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 00:58:56.300641 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 00:58:56.300905 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Creating image(s)
May 28 00:58:56.301292 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "/opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:56.301770 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "/opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:56.302256 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "/opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:56.302782 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:58:56.306576 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:58:56.308072 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:56.384701 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.076s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:58:56.385126 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:56.385587 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:56.385990 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:58:56.389523 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:58:56.392335 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-19dee108-5c93-48a9-86a9-d770c299738d req-7c4be566-bc82-4e58-a42a-ee101caa23b0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:56.394429 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:56.413977 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-a9fcbfbb-d416-4df0-a115-9b0773260b26 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Took 1.57 seconds to destroy the instance on the hypervisor.
May 28 00:58:56.417355 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-a9fcbfbb-d416-4df0-a115-9b0773260b26 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 00:58:56.418411 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 00:58:56.418606 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-87e5f1a7-3143-44ab-8d26-addd66e6fa04 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Took 1.47 seconds to destroy the instance on the hypervisor.
May 28 00:58:56.419156 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 00:58:56.420631 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-87e5f1a7-3143-44ab-8d26-addd66e6fa04 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 00:58:56.420754 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:56.424183 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 00:58:56.424410 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 00:58:56.424662 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:56.475520 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.083s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:58:56.475849 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:56.524836 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-230e561b-3c07-45de-a784-e42441d786d1 tempest-TaggedAttachmentsTest-585237783 tempest-TaggedAttachmentsTest-585237783-project-member] Lock "b1380963-8254-4ad0-95bb-91d24cea00f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.049s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:56.532605 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk 1073741824" returned: 0 in 0.057s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:58:56.535710 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.147s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:56.535710 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:56.610459 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.074s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:58:56.611642 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 00:58:56.611642 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:56.642935 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:56.651779 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:56.690348 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:58:56.690960 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Cannot resize image /opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 00:58:56.691331 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 00:58:56.691492 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Ensure instance console log exists: /opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 00:58:56.694860 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-19dee108-5c93-48a9-86a9-d770c299738d req-7c4be566-bc82-4e58-a42a-ee101caa23b0 service nova] [instance: ebae9109-a600-4788-9008-74a8c320b803] Updated VIF entry in instance network info cache for port d13e4109-188d-4b19-916a-486f62a27eea. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 00:58:56.695706 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:56.696095 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-19dee108-5c93-48a9-86a9-d770c299738d req-7c4be566-bc82-4e58-a42a-ee101caa23b0 service nova] [instance: ebae9109-a600-4788-9008-74a8c320b803] Updating instance_info_cache with network_info: [{"id": "d13e4109-188d-4b19-916a-486f62a27eea", "address": "fa:16:3e:85:df:78", "network": {"id": "be63e483-23b8-4753-b2fa-d9fc516b53f9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-518223995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b80759164bf4465b0bd873db74c9c49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13e4109-18", "ovs_interfaceid": "d13e4109-188d-4b19-916a-486f62a27eea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:58:56.697287 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:56.697511 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:56.715947 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "refresh_cache-d09e5674-c5ab-4ace-9952-554361002541" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:58:56.716149 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquired lock "refresh_cache-d09e5674-c5ab-4ace-9952-554361002541" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:58:56.716219 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 00:58:56.747159 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:56.748065 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:57.174900 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:58:57.175242 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:58:57.199088 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-19dee108-5c93-48a9-86a9-d770c299738d req-7c4be566-bc82-4e58-a42a-ee101caa23b0 service nova] Releasing lock "refresh_cache-ebae9109-a600-4788-9008-74a8c320b803" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:58:57.266791 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:57.268290 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2610dd12-a1f9-4b14-a68d-efa9204f5ab2 req-9e0ad02b-1406-4861-99d7-62fac918ed76 service nova] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Received event network-vif-unplugged-16d9022a-b978-4e59-80a0-34d8d6da6b87 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:57.269253 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2610dd12-a1f9-4b14-a68d-efa9204f5ab2 req-9e0ad02b-1406-4861-99d7-62fac918ed76 service nova] Acquiring lock "0928917f-0c8c-4019-aef4-083ba8224ce0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:57.270014 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2610dd12-a1f9-4b14-a68d-efa9204f5ab2 req-9e0ad02b-1406-4861-99d7-62fac918ed76 service nova] Lock "0928917f-0c8c-4019-aef4-083ba8224ce0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:57.270181 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2610dd12-a1f9-4b14-a68d-efa9204f5ab2 req-9e0ad02b-1406-4861-99d7-62fac918ed76 service nova] Lock "0928917f-0c8c-4019-aef4-083ba8224ce0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:57.270377 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2610dd12-a1f9-4b14-a68d-efa9204f5ab2 req-9e0ad02b-1406-4861-99d7-62fac918ed76 service nova] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] No waiting events found dispatching network-vif-unplugged-16d9022a-b978-4e59-80a0-34d8d6da6b87 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:58:57.270560 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2610dd12-a1f9-4b14-a68d-efa9204f5ab2 req-9e0ad02b-1406-4861-99d7-62fac918ed76 service nova] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Received event network-vif-unplugged-16d9022a-b978-4e59-80a0-34d8d6da6b87 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:58:57.300528 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-181ffc3b-9812-4840-a00b-1a657d0e9a7d req-54220483-9b0b-4de9-abc9-ddb4bdccb62e service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Received event network-vif-deleted-9f8ec3b0-780e-4a36-ad3f-4664a6829868 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:57.300664 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-181ffc3b-9812-4840-a00b-1a657d0e9a7d req-54220483-9b0b-4de9-abc9-ddb4bdccb62e service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Neutron deleted interface 9f8ec3b0-780e-4a36-ad3f-4664a6829868; detaching it from the instance and deleting it from the info cache
May 28 00:58:57.301480 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-181ffc3b-9812-4840-a00b-1a657d0e9a7d req-54220483-9b0b-4de9-abc9-ddb4bdccb62e service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Detach interface failed, port_id=9f8ec3b0-780e-4a36-ad3f-4664a6829868, reason: Instance 7fdf336e-65c1-4180-92eb-5f8ca0ebc526 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 00:58:57.357126 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:58:57.450831 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:58:57.451051 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:58:57.451202 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] No VIF found with MAC fa:16:3e:85:df:78, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 00:58:57.453688 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Using config drive
May 28 00:58:57.622670 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Received event network-vif-unplugged-9f8ec3b0-780e-4a36-ad3f-4664a6829868 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:57.622892 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] Acquiring lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:57.623107 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] Lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:57.623288 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] Lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:57.623509 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] No waiting events found dispatching network-vif-unplugged-9f8ec3b0-780e-4a36-ad3f-4664a6829868 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:58:57.623824 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Received event network-vif-unplugged-9f8ec3b0-780e-4a36-ad3f-4664a6829868 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:58:57.625359 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Received event network-vif-plugged-9f8ec3b0-780e-4a36-ad3f-4664a6829868 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:57.626318 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] Acquiring lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:57.626531 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] Lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:57.626729 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] Lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:57.626901 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] No waiting events found dispatching network-vif-plugged-9f8ec3b0-780e-4a36-ad3f-4664a6829868 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:58:57.627064 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Received unexpected event network-vif-plugged-9f8ec3b0-780e-4a36-ad3f-4664a6829868 for instance with vm_state active and task_state deleting.
May 28 00:58:57.627258 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] [instance: d09e5674-c5ab-4ace-9952-554361002541] Received event network-changed-27b0856b-fab8-4285-8856-b3cabb6c5437 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:57.627371 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] [instance: d09e5674-c5ab-4ace-9952-554361002541] Refreshing instance network info cache due to event network-changed-27b0856b-fab8-4285-8856-b3cabb6c5437. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:58:57.627540 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] Acquiring lock "refresh_cache-d09e5674-c5ab-4ace-9952-554361002541" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:58:57.678212 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:58:57.718866 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:57.756956 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:58:57.833663 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:58:57.869259 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Updating instance_info_cache with network_info: [{"id": "27b0856b-fab8-4285-8856-b3cabb6c5437", "address": "fa:16:3e:f0:24:6e", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b0856b-fa", "ovs_interfaceid": "27b0856b-fab8-4285-8856-b3cabb6c5437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:58:57.959427 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:58.093895 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Creating config drive at /opt/stack/data/nova/instances/ebae9109-a600-4788-9008-74a8c320b803/disk.config
May 28 00:58:58.100104 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ebae9109-a600-4788-9008-74a8c320b803/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6o531dw2 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:58:58.150620 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ebae9109-a600-4788-9008-74a8c320b803/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6o531dw2" returned: 0 in 0.050s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:58:58.185127 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.437s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:58.248384 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Deleted allocations for instance 9d7f874a-9bd5-4e26-abda-5978493313cf
May 28 00:58:58.259332 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Took 1.83 seconds to deallocate network for instance.
May 28 00:58:58.336127 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Took 1.92 seconds to deallocate network for instance.
May 28 00:58:58.373343 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Releasing lock "refresh_cache-d09e5674-c5ab-4ace-9952-554361002541" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:58:58.373343 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Instance network_info: |[{"id": "27b0856b-fab8-4285-8856-b3cabb6c5437", "address": "fa:16:3e:f0:24:6e", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b0856b-fa", "ovs_interfaceid": "27b0856b-fab8-4285-8856-b3cabb6c5437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 00:58:58.373793 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] Acquired lock "refresh_cache-d09e5674-c5ab-4ace-9952-554361002541" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:58:58.374008 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] [instance: d09e5674-c5ab-4ace-9952-554361002541] Refreshing network info cache for port 27b0856b-fab8-4285-8856-b3cabb6c5437 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:58:58.382706 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Start _get_guest_xml network_info=[{"id": "27b0856b-fab8-4285-8856-b3cabb6c5437", "address": "fa:16:3e:f0:24:6e", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b0856b-fa", "ovs_interfaceid": "27b0856b-fab8-4285-8856-b3cabb6c5437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 00:58:58.395949 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 00:58:58.395949 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='d09e5674-c5ab-4ace-9952-554361002541'), owner=OwnerMeta(userid='f8586a18edcf42cab0a60028135ae401', username='tempest-AttachVolumeMultiAttachTest-89204095-project-member', projectid='938c2829112843edb2054984e80ce7ad', projectname='tempest-AttachVolumeMultiAttachTest-89204095'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "27b0856b-fab8-4285-8856-b3cabb6c5437", "address": "fa:16:3e:f0:24:6e", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b0856b-fa", "ovs_interfaceid": "27b0856b-fab8-4285-8856-b3cabb6c5437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779929938.3946855) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 00:58:58.397355 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 00:58:58.397732 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 00:58:58.398781 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 00:58:58.400524 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 00:58:58.401773 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 00:58:58.402209 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 00:58:58.402438 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 00:58:58.402609 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 00:58:58.402795 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 00:58:58.402938 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 00:58:58.403092 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 00:58:58.403337 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 00:58:58.403493 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 00:58:58.403937 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 00:58:58.404126 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 00:58:58.404314 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 00:58:58.420123 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T00:58:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='multiattach-server-0',id=12,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7fHo3fyBWUybZxdNVpYEXXxMYY3ACB7D4odfvDXtuf5uMmk/o2XggiQakoJbwdRCXKjpHaMcmXgSyAS8x+3bDHMUWn1qlznnyXp/nDVRmoqTgLFpV2Do6YlUuA3zZ+mw==',key_name='tempest-keypair-627531643',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938c2829112843edb2054984e80ce7ad',ramdisk_id='',reservation_id='r-sx3wo073',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-89204095',owner_user_name='tempest-AttachVolumeMultiAttachTest-89204095-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:58:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8586a18edcf42cab0a60028135ae401',uuid=d09e5674-c5ab-4ace-9952-554361002541,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27b0856b-fab8-4285-8856-b3cabb6c5437", "address": "fa:16:3e:f0:24:6e", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b0856b-fa", "ovs_interfaceid": "27b0856b-fab8-4285-8856-b3cabb6c5437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 00:58:58.423574 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converting VIF {"id": "27b0856b-fab8-4285-8856-b3cabb6c5437", "address": "fa:16:3e:f0:24:6e", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b0856b-fa", "ovs_interfaceid": "27b0856b-fab8-4285-8856-b3cabb6c5437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:58:58.423574 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:24:6e,bridge_name='br-int',has_traffic_filtering=True,id=27b0856b-fab8-4285-8856-b3cabb6c5437,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b0856b-fa') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:58:58.423574 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lazy-loading 'pci_devices' on Instance uuid d09e5674-c5ab-4ace-9952-554361002541 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:58:58.632949 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:58.655058 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:58.657906 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:58.745240 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:58.767147 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-87e5f1a7-3143-44ab-8d26-addd66e6fa04 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:58.767391 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-87e5f1a7-3143-44ab-8d26-addd66e6fa04 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:58.852171 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a9fcbfbb-d416-4df0-a115-9b0773260b26 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:58.885325 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:58:58.925812 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] End _get_guest_xml xml=<domain type="qemu">
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:   <uuid>d09e5674-c5ab-4ace-9952-554361002541</uuid>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:   <name>instance-0000000c</name>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:   <metadata>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       <nova:name>multiattach-server-0</nova:name>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 00:58:58</nova:creationTime>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       </nova:image>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:         <nova:user uuid="f8586a18edcf42cab0a60028135ae401">tempest-AttachVolumeMultiAttachTest-89204095-project-member</nova:user>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:         <nova:project uuid="938c2829112843edb2054984e80ce7ad">tempest-AttachVolumeMultiAttachTest-89204095</nova:project>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:         <nova:port uuid="27b0856b-fab8-4285-8856-b3cabb6c5437">
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:         </nova:port>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:   </metadata>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:     <system>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       <entry name="serial">d09e5674-c5ab-4ace-9952-554361002541</entry>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       <entry name="uuid">d09e5674-c5ab-4ace-9952-554361002541</entry>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:     </system>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:   <os>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:   </os>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:   <features>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:     <acpi/>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:     <tcg>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:     </tcg>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:   </features>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:   <devices>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk"/>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:     </disk>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk.config"/>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:     </disk>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:f0:24:6e"/>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       <target dev="tap27b0856b-fa"/>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:     </interface>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/console.log" append="off"/>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:     </serial>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:     <video>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:     </video>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:     </rng>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:     </memballoon>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:   </devices>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]: </domain>
May 28 00:58:58.925812 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 00:58:58.927462 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Preparing to wait for external event network-vif-plugged-27b0856b-fab8-4285-8856-b3cabb6c5437 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 00:58:58.927462 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "d09e5674-c5ab-4ace-9952-554361002541-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:58.927462 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d09e5674-c5ab-4ace-9952-554361002541-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:58.927462 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d09e5674-c5ab-4ace-9952-554361002541-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:58.927462 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T00:58:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='multiattach-server-0',id=12,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7fHo3fyBWUybZxdNVpYEXXxMYY3ACB7D4odfvDXtuf5uMmk/o2XggiQakoJbwdRCXKjpHaMcmXgSyAS8x+3bDHMUWn1qlznnyXp/nDVRmoqTgLFpV2Do6YlUuA3zZ+mw==',key_name='tempest-keypair-627531643',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938c2829112843edb2054984e80ce7ad',ramdisk_id='',reservation_id='r-sx3wo073',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-89204095',owner_user_name='tempest-AttachVolumeMultiAttachTest-89204095-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:58:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8586a18edcf42cab0a60028135ae401',uuid=d09e5674-c5ab-4ace-9952-554361002541,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27b0856b-fab8-4285-8856-b3cabb6c5437", "address": "fa:16:3e:f0:24:6e", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b0856b-fa", "ovs_interfaceid": "27b0856b-fab8-4285-8856-b3cabb6c5437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 00:58:58.930783 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converting VIF {"id": "27b0856b-fab8-4285-8856-b3cabb6c5437", "address": "fa:16:3e:f0:24:6e", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b0856b-fa", "ovs_interfaceid": "27b0856b-fab8-4285-8856-b3cabb6c5437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:58:58.931521 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:24:6e,bridge_name='br-int',has_traffic_filtering=True,id=27b0856b-fab8-4285-8856-b3cabb6c5437,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b0856b-fa') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:58:58.931814 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:24:6e,bridge_name='br-int',has_traffic_filtering=True,id=27b0856b-fab8-4285-8856-b3cabb6c5437,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b0856b-fa') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 00:58:58.932268 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:58.932864 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:58.932864 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 00:58:58.933642 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:58.933797 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1d760dab-5c0a-5f69-b56f-779e4e2e3a9a', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:58.935007 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:58.935231 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:58.935934 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:58.938860 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:58.938931 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27b0856b-fa, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:58.940302 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap27b0856b-fa, col_values=(('qos', UUID('7ca0ef1d-754b-4563-9df3-084fb3dbb04a')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:58.940516 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap27b0856b-fa, col_values=(('external_ids', {'iface-id': '27b0856b-fab8-4285-8856-b3cabb6c5437', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:24:6e', 'vm-uuid': 'd09e5674-c5ab-4ace-9952-554361002541'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:58:58.946816 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:58.948744 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:58:58.948952 np0000001577 nova-compute[98319]: INFO os_vif [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:24:6e,bridge_name='br-int',has_traffic_filtering=True,id=27b0856b-fab8-4285-8856-b3cabb6c5437,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b0856b-fa')
May 28 00:58:58.975905 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:58.983649 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:58.987936 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:59.010590 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:59.020691 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:59.064293 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0009576079999078502 future=<Future at 0x7c987058bad0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:58:59.064293 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:58:59.064293 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=3.2806531869998707 future=<Future at 0x7c987042f320 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:58:59.064475 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=3.2805498649997844 future=<Future at 0x7c987042f320 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:58:59.065009 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-7ac4c9ec-36b8-4e41-b40d-0b3cfa61f4a1 None None] Emitting event <LifecycleEvent: 1779929924.0630214, a84e49f5-0bde-41ee-866e-6b434748077f => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:58:59.065139 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7ac4c9ec-36b8-4e41-b40d-0b3cfa61f4a1 None None] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] VM Stopped (Lifecycle Event)
May 28 00:58:59.162225 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-87e5f1a7-3143-44ab-8d26-addd66e6fa04 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:58:59.162458 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-87e5f1a7-3143-44ab-8d26-addd66e6fa04 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:58:59.259608 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-318b7f03-e56e-4110-9737-e180f459e6ed tempest-TaggedBootDevicesTest-1598854432 tempest-TaggedBootDevicesTest-1598854432-project-member] Lock "9d7f874a-9bd5-4e26-abda-5978493313cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.225s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:59.427132 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:58:59.524890 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929939.5216267, ebae9109-a600-4788-9008-74a8c320b803 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:58:59.524890 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: ebae9109-a600-4788-9008-74a8c320b803] VM Started (Lifecycle Event)
May 28 00:58:59.570809 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7ac4c9ec-36b8-4e41-b40d-0b3cfa61f4a1 None None] [instance: a84e49f5-0bde-41ee-866e-6b434748077f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:58:59.665101 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-87e5f1a7-3143-44ab-8d26-addd66e6fa04 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:58:59.677086 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-027e0a3b-1a41-4497-99be-cf3121fc53a2 req-e5615ceb-4c44-46d1-a14d-651e99453fb6 service nova] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Received event network-vif-deleted-16d9022a-b978-4e59-80a0-34d8d6da6b87 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:59.678007 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-027e0a3b-1a41-4497-99be-cf3121fc53a2 req-e5615ceb-4c44-46d1-a14d-651e99453fb6 service nova] [instance: ebae9109-a600-4788-9008-74a8c320b803] Received event network-vif-plugged-d13e4109-188d-4b19-916a-486f62a27eea {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:59.678175 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-027e0a3b-1a41-4497-99be-cf3121fc53a2 req-e5615ceb-4c44-46d1-a14d-651e99453fb6 service nova] Acquiring lock "ebae9109-a600-4788-9008-74a8c320b803-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:59.678325 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-027e0a3b-1a41-4497-99be-cf3121fc53a2 req-e5615ceb-4c44-46d1-a14d-651e99453fb6 service nova] Lock "ebae9109-a600-4788-9008-74a8c320b803-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:59.678432 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-027e0a3b-1a41-4497-99be-cf3121fc53a2 req-e5615ceb-4c44-46d1-a14d-651e99453fb6 service nova] Lock "ebae9109-a600-4788-9008-74a8c320b803-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:59.678565 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-027e0a3b-1a41-4497-99be-cf3121fc53a2 req-e5615ceb-4c44-46d1-a14d-651e99453fb6 service nova] [instance: ebae9109-a600-4788-9008-74a8c320b803] Processing event network-vif-plugged-d13e4109-188d-4b19-916a-486f62a27eea {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 00:58:59.678682 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-027e0a3b-1a41-4497-99be-cf3121fc53a2 req-e5615ceb-4c44-46d1-a14d-651e99453fb6 service nova] [instance: ebae9109-a600-4788-9008-74a8c320b803] Received event network-vif-plugged-d13e4109-188d-4b19-916a-486f62a27eea {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:58:59.678805 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-027e0a3b-1a41-4497-99be-cf3121fc53a2 req-e5615ceb-4c44-46d1-a14d-651e99453fb6 service nova] Acquiring lock "ebae9109-a600-4788-9008-74a8c320b803-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:58:59.678911 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-027e0a3b-1a41-4497-99be-cf3121fc53a2 req-e5615ceb-4c44-46d1-a14d-651e99453fb6 service nova] Lock "ebae9109-a600-4788-9008-74a8c320b803-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:58:59.679002 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-027e0a3b-1a41-4497-99be-cf3121fc53a2 req-e5615ceb-4c44-46d1-a14d-651e99453fb6 service nova] Lock "ebae9109-a600-4788-9008-74a8c320b803-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:58:59.679100 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-027e0a3b-1a41-4497-99be-cf3121fc53a2 req-e5615ceb-4c44-46d1-a14d-651e99453fb6 service nova] [instance: ebae9109-a600-4788-9008-74a8c320b803] No waiting events found dispatching network-vif-plugged-d13e4109-188d-4b19-916a-486f62a27eea {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:58:59.679283 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-027e0a3b-1a41-4497-99be-cf3121fc53a2 req-e5615ceb-4c44-46d1-a14d-651e99453fb6 service nova] [instance: ebae9109-a600-4788-9008-74a8c320b803] Received unexpected event network-vif-plugged-d13e4109-188d-4b19-916a-486f62a27eea for instance with vm_state building and task_state spawning.
May 28 00:58:59.680917 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 00:58:59.686226 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 00:58:59.692615 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: ebae9109-a600-4788-9008-74a8c320b803] Instance spawned successfully.
May 28 00:58:59.692615 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 00:59:00.028939 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: ebae9109-a600-4788-9008-74a8c320b803] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:00.030490 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: ebae9109-a600-4788-9008-74a8c320b803] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:59:00.083840 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:00.137026 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:00.176623 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-87e5f1a7-3143-44ab-8d26-addd66e6fa04 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.409s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:00.178252 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a9fcbfbb-d416-4df0-a115-9b0773260b26 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.325s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:00.197697 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:00.197917 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:00.198333 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:00.198712 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:00.199082 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:00.199448 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:00.237444 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-87e5f1a7-3143-44ab-8d26-addd66e6fa04 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Deleted allocations for instance 7fdf336e-65c1-4180-92eb-5f8ca0ebc526
May 28 00:59:00.466791 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:00.467237 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:00.467237 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No VIF found with MAC fa:16:3e:f0:24:6e, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 00:59:00.468409 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Using config drive
May 28 00:59:00.534859 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: ebae9109-a600-4788-9008-74a8c320b803] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 00:59:00.535137 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929940.5349622, ebae9109-a600-4788-9008-74a8c320b803 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:59:00.535259 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: ebae9109-a600-4788-9008-74a8c320b803] VM Paused (Lifecycle Event)
May 28 00:59:00.587936 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a9fcbfbb-d416-4df0-a115-9b0773260b26 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:59:00.588102 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a9fcbfbb-d416-4df0-a115-9b0773260b26 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:59:00.706864 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Took 6.93 seconds to spawn the instance on the hypervisor.
May 28 00:59:00.707112 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:00.965980 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:00.977205 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:01.041608 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: ebae9109-a600-4788-9008-74a8c320b803] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:01.044563 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929941.0443408, ebae9109-a600-4788-9008-74a8c320b803 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:59:01.044736 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: ebae9109-a600-4788-9008-74a8c320b803] VM Resumed (Lifecycle Event)
May 28 00:59:01.091330 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a9fcbfbb-d416-4df0-a115-9b0773260b26 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:59:01.213843 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] [instance: d09e5674-c5ab-4ace-9952-554361002541] Updated VIF entry in instance network info cache for port 27b0856b-fab8-4285-8856-b3cabb6c5437. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 00:59:01.214181 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] [instance: d09e5674-c5ab-4ace-9952-554361002541] Updating instance_info_cache with network_info: [{"id": "27b0856b-fab8-4285-8856-b3cabb6c5437", "address": "fa:16:3e:f0:24:6e", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b0856b-fa", "ovs_interfaceid": "27b0856b-fab8-4285-8856-b3cabb6c5437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:59:01.219970 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Took 14.03 seconds to build instance.
May 28 00:59:01.250478 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-87e5f1a7-3143-44ab-8d26-addd66e6fa04 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.816s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:01.269053 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:01.529931 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:01.547589 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: ebae9109-a600-4788-9008-74a8c320b803] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:01.550278 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: ebae9109-a600-4788-9008-74a8c320b803] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:59:01.608185 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a9fcbfbb-d416-4df0-a115-9b0773260b26 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.430s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:01.689311 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-a9fcbfbb-d416-4df0-a115-9b0773260b26 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Deleted allocations for instance 0928917f-0c8c-4019-aef4-083ba8224ce0
May 28 00:59:01.719559 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] Releasing lock "refresh_cache-d09e5674-c5ab-4ace-9952-554361002541" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:59:01.719559 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Received event network-vif-plugged-9f8ec3b0-780e-4a36-ad3f-4664a6829868 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:01.719559 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] Acquiring lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:01.719559 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] Lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:01.719559 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] Lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:01.719559 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] No waiting events found dispatching network-vif-plugged-9f8ec3b0-780e-4a36-ad3f-4664a6829868 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:59:01.719559 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Received unexpected event network-vif-plugged-9f8ec3b0-780e-4a36-ad3f-4664a6829868 for instance with vm_state active and task_state deleting.
May 28 00:59:01.719559 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Received event network-vif-unplugged-9f8ec3b0-780e-4a36-ad3f-4664a6829868 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:01.719559 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] Acquiring lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:01.719559 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] Lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:01.719559 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] Lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:01.719559 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] No waiting events found dispatching network-vif-unplugged-9f8ec3b0-780e-4a36-ad3f-4664a6829868 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:59:01.719559 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Received event network-vif-unplugged-9f8ec3b0-780e-4a36-ad3f-4664a6829868 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:59:01.719559 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Received event network-vif-unplugged-9f8ec3b0-780e-4a36-ad3f-4664a6829868 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:01.719559 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] Acquiring lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:01.719559 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] Lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:01.719559 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] Lock "7fdf336e-65c1-4180-92eb-5f8ca0ebc526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:01.719559 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] No waiting events found dispatching network-vif-unplugged-9f8ec3b0-780e-4a36-ad3f-4664a6829868 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:59:01.719559 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-43df6746-70a3-4f84-b273-5e57ddd77cf0 req-637b6f13-86e2-4968-adcf-562f61acf41f service nova] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Received event network-vif-unplugged-9f8ec3b0-780e-4a36-ad3f-4664a6829868 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:59:01.724819 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "ebae9109-a600-4788-9008-74a8c320b803" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.546s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:01.778927 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Creating config drive at /opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk.config
May 28 00:59:01.783495 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7jtxsooo {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:01.837760 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7jtxsooo" returned: 0 in 0.054s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:02.349840 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.004778541000177938 future=<Future at 0x7c987042f320 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:59:02.349840 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:59:02.349956 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=0.8653246460000901 future=<Future at 0x7c9870448560 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:59:02.350287 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=0.8652275950000785 future=<Future at 0x7c9870448560 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:59:02.351774 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Emitting event <LifecycleEvent: 1779929927.3448687, b1380963-8254-4ad0-95bb-91d24cea00f9 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:59:02.351774 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] VM Stopped (Lifecycle Event)
May 28 00:59:02.363090 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:02.395269 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:02.398337 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:02.484416 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:02.553222 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:02.557233 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:02.702236 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a9fcbfbb-d416-4df0-a115-9b0773260b26 tempest-TestMultiAttachVolumeSwap-196235525 tempest-TestMultiAttachVolumeSwap-196235525-project-member] Lock "0928917f-0c8c-4019-aef4-083ba8224ce0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.367s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:02.856605 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-715b84dd-a3fc-4ae7-ba55-d67491aa4f70 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: b1380963-8254-4ad0-95bb-91d24cea00f9] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:02.959203 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-35e443ec-905c-438b-b090-ba75a9cbb1a7 req-91bbc643-5295-4d9c-afc1-e29d6ffcdaef service nova] [instance: d09e5674-c5ab-4ace-9952-554361002541] Received event network-vif-plugged-27b0856b-fab8-4285-8856-b3cabb6c5437 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:02.960760 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-35e443ec-905c-438b-b090-ba75a9cbb1a7 req-91bbc643-5295-4d9c-afc1-e29d6ffcdaef service nova] Acquiring lock "d09e5674-c5ab-4ace-9952-554361002541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:02.960962 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-35e443ec-905c-438b-b090-ba75a9cbb1a7 req-91bbc643-5295-4d9c-afc1-e29d6ffcdaef service nova] Lock "d09e5674-c5ab-4ace-9952-554361002541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:02.961097 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-35e443ec-905c-438b-b090-ba75a9cbb1a7 req-91bbc643-5295-4d9c-afc1-e29d6ffcdaef service nova] Lock "d09e5674-c5ab-4ace-9952-554361002541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:02.961232 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-35e443ec-905c-438b-b090-ba75a9cbb1a7 req-91bbc643-5295-4d9c-afc1-e29d6ffcdaef service nova] [instance: d09e5674-c5ab-4ace-9952-554361002541] Processing event network-vif-plugged-27b0856b-fab8-4285-8856-b3cabb6c5437 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 00:59:03.108399 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2254098a-4483-4133-a4ab-5ebf932f7e19 req-26dbfe8b-9da5-4e0d-b793-d1173eb0573e service nova] [instance: ebae9109-a600-4788-9008-74a8c320b803] Received event network-changed-d13e4109-188d-4b19-916a-486f62a27eea {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:03.108785 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2254098a-4483-4133-a4ab-5ebf932f7e19 req-26dbfe8b-9da5-4e0d-b793-d1173eb0573e service nova] [instance: ebae9109-a600-4788-9008-74a8c320b803] Refreshing instance network info cache due to event network-changed-d13e4109-188d-4b19-916a-486f62a27eea. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:59:03.108988 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2254098a-4483-4133-a4ab-5ebf932f7e19 req-26dbfe8b-9da5-4e0d-b793-d1173eb0573e service nova] Acquiring lock "refresh_cache-ebae9109-a600-4788-9008-74a8c320b803" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:59:03.109113 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2254098a-4483-4133-a4ab-5ebf932f7e19 req-26dbfe8b-9da5-4e0d-b793-d1173eb0573e service nova] Acquired lock "refresh_cache-ebae9109-a600-4788-9008-74a8c320b803" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:59:03.109317 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-2254098a-4483-4133-a4ab-5ebf932f7e19 req-26dbfe8b-9da5-4e0d-b793-d1173eb0573e service nova] [instance: ebae9109-a600-4788-9008-74a8c320b803] Refreshing network info cache for port d13e4109-188d-4b19-916a-486f62a27eea {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:59:03.203564 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929943.203223, d09e5674-c5ab-4ace-9952-554361002541 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:59:03.203690 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d09e5674-c5ab-4ace-9952-554361002541] VM Started (Lifecycle Event)
May 28 00:59:03.206057 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 00:59:03.210067 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 00:59:03.213534 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: d09e5674-c5ab-4ace-9952-554361002541] Instance spawned successfully.
May 28 00:59:03.213534 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 00:59:03.215623 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00029533799988712417 future=<Future at 0x7c9870448560 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:59:03.215888 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:59:03.215996 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=7.104245221999918 future=<Future at 0x7c987030f800 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:59:03.216070 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=7.104150165999954 future=<Future at 0x7c987030f800 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:59:03.216715 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1779929928.2152178, 9d7f874a-9bd5-4e26-abda-5978493313cf => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:59:03.216820 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] VM Stopped (Lifecycle Event)
May 28 00:59:03.615030 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-2254098a-4483-4133-a4ab-5ebf932f7e19 req-26dbfe8b-9da5-4e0d-b793-d1173eb0573e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:03.710287 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d09e5674-c5ab-4ace-9952-554361002541] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:03.712911 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d09e5674-c5ab-4ace-9952-554361002541] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:59:03.719587 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-82da06d9-bd2a-4d78-a42c-78f22639f00f None None] [instance: 9d7f874a-9bd5-4e26-abda-5978493313cf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:03.727583 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:03.727583 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:03.728206 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:03.728462 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:03.728737 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:03.728975 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:03.943257 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:04.007188 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:04.221761 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d09e5674-c5ab-4ace-9952-554361002541] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 00:59:04.221761 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929944.2206695, d09e5674-c5ab-4ace-9952-554361002541 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:59:04.221982 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d09e5674-c5ab-4ace-9952-554361002541] VM Paused (Lifecycle Event)
May 28 00:59:04.235808 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Took 7.94 seconds to spawn the instance on the hypervisor.
May 28 00:59:04.236015 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:04.246416 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-2254098a-4483-4133-a4ab-5ebf932f7e19 req-26dbfe8b-9da5-4e0d-b793-d1173eb0573e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:04.425406 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-2254098a-4483-4133-a4ab-5ebf932f7e19 req-26dbfe8b-9da5-4e0d-b793-d1173eb0573e service nova] [instance: ebae9109-a600-4788-9008-74a8c320b803] Updated VIF entry in instance network info cache for port d13e4109-188d-4b19-916a-486f62a27eea. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 00:59:04.425706 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-2254098a-4483-4133-a4ab-5ebf932f7e19 req-26dbfe8b-9da5-4e0d-b793-d1173eb0573e service nova] [instance: ebae9109-a600-4788-9008-74a8c320b803] Updating instance_info_cache with network_info: [{"id": "d13e4109-188d-4b19-916a-486f62a27eea", "address": "fa:16:3e:85:df:78", "network": {"id": "be63e483-23b8-4753-b2fa-d9fc516b53f9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-518223995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b80759164bf4465b0bd873db74c9c49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13e4109-18", "ovs_interfaceid": "d13e4109-188d-4b19-916a-486f62a27eea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:59:04.724182 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d09e5674-c5ab-4ace-9952-554361002541] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:04.726872 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929944.7258937, d09e5674-c5ab-4ace-9952-554361002541 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:59:04.726872 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d09e5674-c5ab-4ace-9952-554361002541] VM Resumed (Lifecycle Event)
May 28 00:59:04.753679 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Took 13.87 seconds to build instance.
May 28 00:59:04.796014 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Acquiring lock "7d1add06-aef9-420b-b30e-8f881fcc968c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:04.796014 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lock "7d1add06-aef9-420b-b30e-8f881fcc968c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:04.932184 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2254098a-4483-4133-a4ab-5ebf932f7e19 req-26dbfe8b-9da5-4e0d-b793-d1173eb0573e service nova] Releasing lock "refresh_cache-ebae9109-a600-4788-9008-74a8c320b803" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:59:05.014204 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:05.045473 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-820a9c1e-42f9-4cac-af20-7a86b7645fa6 req-212a290e-827c-4a50-87b9-dfe6af5b97fa service nova] [instance: d09e5674-c5ab-4ace-9952-554361002541] Received event network-vif-plugged-27b0856b-fab8-4285-8856-b3cabb6c5437 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:05.046111 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-820a9c1e-42f9-4cac-af20-7a86b7645fa6 req-212a290e-827c-4a50-87b9-dfe6af5b97fa service nova] Acquiring lock "d09e5674-c5ab-4ace-9952-554361002541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:05.046230 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-820a9c1e-42f9-4cac-af20-7a86b7645fa6 req-212a290e-827c-4a50-87b9-dfe6af5b97fa service nova] Lock "d09e5674-c5ab-4ace-9952-554361002541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:05.046399 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-820a9c1e-42f9-4cac-af20-7a86b7645fa6 req-212a290e-827c-4a50-87b9-dfe6af5b97fa service nova] Lock "d09e5674-c5ab-4ace-9952-554361002541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:05.046578 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-820a9c1e-42f9-4cac-af20-7a86b7645fa6 req-212a290e-827c-4a50-87b9-dfe6af5b97fa service nova] [instance: d09e5674-c5ab-4ace-9952-554361002541] No waiting events found dispatching network-vif-plugged-27b0856b-fab8-4285-8856-b3cabb6c5437 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:59:05.046768 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-820a9c1e-42f9-4cac-af20-7a86b7645fa6 req-212a290e-827c-4a50-87b9-dfe6af5b97fa service nova] [instance: d09e5674-c5ab-4ace-9952-554361002541] Received unexpected event network-vif-plugged-27b0856b-fab8-4285-8856-b3cabb6c5437 for instance with vm_state active and task_state None.
May 28 00:59:05.228800 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d09e5674-c5ab-4ace-9952-554361002541] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:05.232211 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d09e5674-c5ab-4ace-9952-554361002541] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:59:05.258557 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d09e5674-c5ab-4ace-9952-554361002541" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.384s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:05.297338 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 00:59:05.702209 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9873f9e3-68b3-4b4b-ab89-0946b94cd240 req-2ea4c5d6-a481-4831-a7f7-286f20cf0246 service nova] [instance: d09e5674-c5ab-4ace-9952-554361002541] Received event network-changed-27b0856b-fab8-4285-8856-b3cabb6c5437 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:05.702363 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9873f9e3-68b3-4b4b-ab89-0946b94cd240 req-2ea4c5d6-a481-4831-a7f7-286f20cf0246 service nova] [instance: d09e5674-c5ab-4ace-9952-554361002541] Refreshing instance network info cache due to event network-changed-27b0856b-fab8-4285-8856-b3cabb6c5437. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:59:05.702471 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9873f9e3-68b3-4b4b-ab89-0946b94cd240 req-2ea4c5d6-a481-4831-a7f7-286f20cf0246 service nova] Acquiring lock "refresh_cache-d09e5674-c5ab-4ace-9952-554361002541" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:59:05.702580 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9873f9e3-68b3-4b4b-ab89-0946b94cd240 req-2ea4c5d6-a481-4831-a7f7-286f20cf0246 service nova] Acquired lock "refresh_cache-d09e5674-c5ab-4ace-9952-554361002541" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:59:05.702750 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-9873f9e3-68b3-4b4b-ab89-0946b94cd240 req-2ea4c5d6-a481-4831-a7f7-286f20cf0246 service nova] [instance: d09e5674-c5ab-4ace-9952-554361002541] Refreshing network info cache for port 27b0856b-fab8-4285-8856-b3cabb6c5437 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:59:05.896288 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:05.896902 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:05.900799 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 00:59:05.900917 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Claim successful on node np0000001577
May 28 00:59:05.967646 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:06.205964 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-9873f9e3-68b3-4b4b-ab89-0946b94cd240 req-2ea4c5d6-a481-4831-a7f7-286f20cf0246 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:07.302946 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:59:07.303482 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:59:07.362876 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:07.810396 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:59:08.284915 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-9873f9e3-68b3-4b4b-ab89-0946b94cd240 req-2ea4c5d6-a481-4831-a7f7-286f20cf0246 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:08.318645 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.422s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:08.319007 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 00:59:08.327637 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:08.828113 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 00:59:08.830732 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 00:59:08.831117 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:08.831425 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:08.945196 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:08.960918 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-9873f9e3-68b3-4b4b-ab89-0946b94cd240 req-2ea4c5d6-a481-4831-a7f7-286f20cf0246 service nova] [instance: d09e5674-c5ab-4ace-9952-554361002541] Updated VIF entry in instance network info cache for port 27b0856b-fab8-4285-8856-b3cabb6c5437. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 00:59:08.961786 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-9873f9e3-68b3-4b4b-ab89-0946b94cd240 req-2ea4c5d6-a481-4831-a7f7-286f20cf0246 service nova] [instance: d09e5674-c5ab-4ace-9952-554361002541] Updating instance_info_cache with network_info: [{"id": "27b0856b-fab8-4285-8856-b3cabb6c5437", "address": "fa:16:3e:f0:24:6e", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b0856b-fa", "ovs_interfaceid": "27b0856b-fab8-4285-8856-b3cabb6c5437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:59:09.005426 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3fef0b514622468f82d2b1f406d0d24d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8756cc804e134c1385157f89df922160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 00:59:09.047906 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "d988b526-836d-48b8-a381-1f7679caf41d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:09.048195 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d988b526-836d-48b8-a381-1f7679caf41d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:09.254658 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:09.334072 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 00:59:09.463291 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9873f9e3-68b3-4b4b-ab89-0946b94cd240 req-2ea4c5d6-a481-4831-a7f7-286f20cf0246 service nova] Releasing lock "refresh_cache-d09e5674-c5ab-4ace-9952-554361002541" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:59:09.550304 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 00:59:09.839141 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 00:59:09.846677 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Successfully created port: c8933b8a-f3aa-4393-9921-109f8e9fd5e9 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 00:59:10.129506 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:10.129884 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:10.133886 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 00:59:10.134045 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Claim successful on node np0000001577
May 28 00:59:10.321515 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.000812416000144367 future=<Future at 0x7c987030f800 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:59:10.321715 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Emitting event <LifecycleEvent: 1779929935.3201675, 0928917f-0c8c-4019-aef4-083ba8224ce0 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:59:10.321911 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:59:10.322279 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] VM Stopped (Lifecycle Event)
May 28 00:59:10.323698 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=0.010050424999917595 future=<Future at 0x7c984c7c0140 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:59:10.323901 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=0.009850002999883145 future=<Future at 0x7c984c7c0140 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:59:10.334879 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0011332320000292384 future=<Future at 0x7c984c7c0140 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:59:10.335359 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:59:10.335359 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-7ac4c9ec-36b8-4e41-b40d-0b3cfa61f4a1 None None] Emitting event <LifecycleEvent: 1779929935.3336558, 7fdf336e-65c1-4180-92eb-5f8ca0ebc526 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:59:10.335359 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7ac4c9ec-36b8-4e41-b40d-0b3cfa61f4a1 None None] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] VM Stopped (Lifecycle Event)
May 28 00:59:10.472025 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Successfully updated port: c8933b8a-f3aa-4393-9921-109f8e9fd5e9 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 00:59:10.825646 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-26451a28-175b-4479-b565-1385dcfe373c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 0928917f-0c8c-4019-aef4-083ba8224ce0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:10.837986 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7ac4c9ec-36b8-4e41-b40d-0b3cfa61f4a1 None None] [instance: 7fdf336e-65c1-4180-92eb-5f8ca0ebc526] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:10.849188 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 00:59:10.850447 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 00:59:10.850718 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Creating image(s)
May 28 00:59:10.851230 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d1add06-aef9-420b-b30e-8f881fcc968c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:10.851446 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lock "/opt/stack/data/nova/instances/7d1add06-aef9-420b-b30e-8f881fcc968c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:10.851993 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lock "/opt/stack/data/nova/instances/7d1add06-aef9-420b-b30e-8f881fcc968c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:10.852554 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:59:10.860900 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:59:10.864567 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:10.933355 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:10.945768 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8fb3c5d8-2dc1-4cff-bfaf-2319f921dbe8 req-6a19875b-6996-4f35-b318-91c45b820317 service nova] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Received event network-changed-c8933b8a-f3aa-4393-9921-109f8e9fd5e9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:10.945910 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8fb3c5d8-2dc1-4cff-bfaf-2319f921dbe8 req-6a19875b-6996-4f35-b318-91c45b820317 service nova] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Refreshing instance network info cache due to event network-changed-c8933b8a-f3aa-4393-9921-109f8e9fd5e9. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:59:10.946141 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8fb3c5d8-2dc1-4cff-bfaf-2319f921dbe8 req-6a19875b-6996-4f35-b318-91c45b820317 service nova] Acquiring lock "refresh_cache-7d1add06-aef9-420b-b30e-8f881fcc968c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:59:10.946232 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8fb3c5d8-2dc1-4cff-bfaf-2319f921dbe8 req-6a19875b-6996-4f35-b318-91c45b820317 service nova] Acquired lock "refresh_cache-7d1add06-aef9-420b-b30e-8f881fcc968c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:59:10.946359 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-8fb3c5d8-2dc1-4cff-bfaf-2319f921dbe8 req-6a19875b-6996-4f35-b318-91c45b820317 service nova] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Refreshing network info cache for port c8933b8a-f3aa-4393-9921-109f8e9fd5e9 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:59:10.965784 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.104s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:10.966980 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:10.968531 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:10.968531 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:59:10.969505 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:10.972518 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:59:10.973780 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:10.985292 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Acquiring lock "refresh_cache-7d1add06-aef9-420b-b30e-8f881fcc968c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:59:11.055784 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.082s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:11.056304 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/7d1add06-aef9-420b-b30e-8f881fcc968c/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:11.100973 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/7d1add06-aef9-420b-b30e-8f881fcc968c/disk 1073741824" returned: 0 in 0.044s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:11.101529 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.134s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:11.102010 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:11.200308 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.098s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:11.201300 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d1add06-aef9-420b-b30e-8f881fcc968c/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 00:59:11.201300 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d1add06-aef9-420b-b30e-8f881fcc968c/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:11.283708 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:11.286513 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d1add06-aef9-420b-b30e-8f881fcc968c/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:11.286671 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Cannot resize image /opt/stack/data/nova/instances/7d1add06-aef9-420b-b30e-8f881fcc968c/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 00:59:11.286887 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 00:59:11.287030 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Ensure instance console log exists: /opt/stack/data/nova/instances/7d1add06-aef9-420b-b30e-8f881fcc968c/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 00:59:11.287289 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:11.287481 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:11.287628 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:11.449607 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-8fb3c5d8-2dc1-4cff-bfaf-2319f921dbe8 req-6a19875b-6996-4f35-b318-91c45b820317 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:11.550925 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:11.563409 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:59:11.565758 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:59:11.632052 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-8fb3c5d8-2dc1-4cff-bfaf-2319f921dbe8 req-6a19875b-6996-4f35-b318-91c45b820317 service nova] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:59:11.780954 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:11.781472 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:11.847507 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-8fb3c5d8-2dc1-4cff-bfaf-2319f921dbe8 req-6a19875b-6996-4f35-b318-91c45b820317 service nova] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:59:12.067711 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:59:12.300473 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 00:59:12.349717 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8fb3c5d8-2dc1-4cff-bfaf-2319f921dbe8 req-6a19875b-6996-4f35-b318-91c45b820317 service nova] Releasing lock "refresh_cache-7d1add06-aef9-420b-b30e-8f881fcc968c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:59:12.350850 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Acquired lock "refresh_cache-7d1add06-aef9-420b-b30e-8f881fcc968c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:59:12.351025 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 00:59:12.579638 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.450s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:12.580658 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 00:59:12.742908 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "b73b73f0-79a5-448c-a374-bbb182da41a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:12.743103 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "b73b73f0-79a5-448c-a374-bbb182da41a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:12.864273 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:12.864540 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:12.867338 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 00:59:12.867461 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Claim successful on node np0000001577
May 28 00:59:13.089184 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 00:59:13.089184 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 00:59:13.089625 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:13.090131 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:13.247444 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 00:59:13.409104 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:59:13.482371 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8586a18edcf42cab0a60028135ae401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938c2829112843edb2054984e80ce7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 00:59:13.593333 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 00:59:13.688481 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:13.736082 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:13.802609 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:13.814373 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:13.946381 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:14.077659 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Successfully created port: d540d8c6-c40d-45db-a88e-e9b062d033fb {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 00:59:14.098269 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 00:59:14.404009 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Updating instance_info_cache with network_info: [{"id": "c8933b8a-f3aa-4393-9921-109f8e9fd5e9", "address": "fa:16:3e:92:da:8f", "network": {"id": "48717d5b-288f-4306-b7b5-70424d2d3284", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1352707990-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8756cc804e134c1385157f89df922160", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8933b8a-f3", "ovs_interfaceid": "c8933b8a-f3aa-4393-9921-109f8e9fd5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:59:14.408824 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:59:14.409056 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:59:14.907300 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Releasing lock "refresh_cache-7d1add06-aef9-420b-b30e-8f881fcc968c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:59:14.907300 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Instance network_info: |[{"id": "c8933b8a-f3aa-4393-9921-109f8e9fd5e9", "address": "fa:16:3e:92:da:8f", "network": {"id": "48717d5b-288f-4306-b7b5-70424d2d3284", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1352707990-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8756cc804e134c1385157f89df922160", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8933b8a-f3", "ovs_interfaceid": "c8933b8a-f3aa-4393-9921-109f8e9fd5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 00:59:14.911136 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Start _get_guest_xml network_info=[{"id": "c8933b8a-f3aa-4393-9921-109f8e9fd5e9", "address": "fa:16:3e:92:da:8f", "network": {"id": "48717d5b-288f-4306-b7b5-70424d2d3284", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1352707990-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8756cc804e134c1385157f89df922160", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8933b8a-f3", "ovs_interfaceid": "c8933b8a-f3aa-4393-9921-109f8e9fd5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 00:59:14.913070 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:59:14.924408 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 00:59:14.931936 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Successfully updated port: d540d8c6-c40d-45db-a88e-e9b062d033fb {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 00:59:14.933524 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-DeleteServersTestJSON-server-891324810', uuid='7d1add06-aef9-420b-b30e-8f881fcc968c'), owner=OwnerMeta(userid='3fef0b514622468f82d2b1f406d0d24d', username='tempest-DeleteServersTestJSON-1389929058-project-member', projectid='8756cc804e134c1385157f89df922160', projectname='tempest-DeleteServersTestJSON-1389929058'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c8933b8a-f3aa-4393-9921-109f8e9fd5e9", "address": "fa:16:3e:92:da:8f", "network": {"id": "48717d5b-288f-4306-b7b5-70424d2d3284", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1352707990-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8756cc804e134c1385157f89df922160", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8933b8a-f3", "ovs_interfaceid": "c8933b8a-f3aa-4393-9921-109f8e9fd5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779929954.9310305) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 00:59:14.937630 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 00:59:14.938019 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 00:59:14.940804 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 00:59:14.941178 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 00:59:14.942159 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 00:59:14.942474 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 00:59:14.942648 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 00:59:14.942740 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 00:59:14.942854 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 00:59:14.942959 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 00:59:14.943017 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 00:59:14.943177 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 00:59:14.943464 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 00:59:14.943464 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 00:59:14.943560 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 00:59:14.943680 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 00:59:14.965327 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T00:59:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-891324810',display_name='tempest-DeleteServersTestJSON-server-891324810',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-deleteserverstestjson-server-891324810',id=13,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8756cc804e134c1385157f89df922160',ramdisk_id='',reservation_id='r-5u2fa43v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1389929058',owner_user_name='tempest-DeleteServersTestJSON-1389929058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:59:10Z,user_data=None,user_id='3fef0b514622468f82d2b1f406d0d24d',uuid=7d1add06-aef9-420b-b30e-8f881fcc968c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8933b8a-f3aa-4393-9921-109f8e9fd5e9", "address": "fa:16:3e:92:da:8f", "network": {"id": "48717d5b-288f-4306-b7b5-70424d2d3284", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1352707990-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8756cc804e134c1385157f89df922160", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8933b8a-f3", "ovs_interfaceid": "c8933b8a-f3aa-4393-9921-109f8e9fd5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 00:59:14.965661 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Converting VIF {"id": "c8933b8a-f3aa-4393-9921-109f8e9fd5e9", "address": "fa:16:3e:92:da:8f", "network": {"id": "48717d5b-288f-4306-b7b5-70424d2d3284", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1352707990-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8756cc804e134c1385157f89df922160", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8933b8a-f3", "ovs_interfaceid": "c8933b8a-f3aa-4393-9921-109f8e9fd5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:59:14.966301 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:da:8f,bridge_name='br-int',has_traffic_filtering=True,id=c8933b8a-f3aa-4393-9921-109f8e9fd5e9,network=Network(48717d5b-288f-4306-b7b5-70424d2d3284),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8933b8a-f3') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:59:14.966924 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d1add06-aef9-420b-b30e-8f881fcc968c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:14.997032 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c9d38c68-936a-4b16-a9ec-4f96b1002b8b req-4c0bf90e-d9ee-41f6-aa51-60f9f3a564b7 service nova] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Received event network-changed-d540d8c6-c40d-45db-a88e-e9b062d033fb {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:14.997199 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c9d38c68-936a-4b16-a9ec-4f96b1002b8b req-4c0bf90e-d9ee-41f6-aa51-60f9f3a564b7 service nova] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Refreshing instance network info cache due to event network-changed-d540d8c6-c40d-45db-a88e-e9b062d033fb. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:59:14.997377 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c9d38c68-936a-4b16-a9ec-4f96b1002b8b req-4c0bf90e-d9ee-41f6-aa51-60f9f3a564b7 service nova] Acquiring lock "refresh_cache-d988b526-836d-48b8-a381-1f7679caf41d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:59:14.997465 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c9d38c68-936a-4b16-a9ec-4f96b1002b8b req-4c0bf90e-d9ee-41f6-aa51-60f9f3a564b7 service nova] Acquired lock "refresh_cache-d988b526-836d-48b8-a381-1f7679caf41d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:59:14.997585 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-c9d38c68-936a-4b16-a9ec-4f96b1002b8b req-4c0bf90e-d9ee-41f6-aa51-60f9f3a564b7 service nova] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Refreshing network info cache for port d540d8c6-c40d-45db-a88e-e9b062d033fb {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:59:15.108828 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 00:59:15.109936 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 00:59:15.110188 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Creating image(s)
May 28 00:59:15.110679 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "/opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:15.110891 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "/opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:15.111310 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "/opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:15.114280 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:59:15.118216 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:59:15.121254 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:15.210070 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:15.210973 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:15.211037 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:15.212266 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:59:15.215607 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:59:15.216033 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:15.309981 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.094s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:15.310863 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:15.336422 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:15.339409 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:15.362507 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk 1073741824" returned: 0 in 0.052s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:15.362900 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.152s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:15.363262 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:15.424974 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.560s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:15.425806 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 00:59:15.430087 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.616s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:15.434432 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 00:59:15.435813 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "refresh_cache-d988b526-836d-48b8-a381-1f7679caf41d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:59:15.436068 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Claim successful on node np0000001577
May 28 00:59:15.472061 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] End _get_guest_xml xml=<domain type="qemu">
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:   <uuid>7d1add06-aef9-420b-b30e-8f881fcc968c</uuid>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:   <name>instance-0000000d</name>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:   <metadata>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       <nova:name>tempest-DeleteServersTestJSON-server-891324810</nova:name>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 00:59:14</nova:creationTime>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       </nova:image>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:         <nova:user uuid="3fef0b514622468f82d2b1f406d0d24d">tempest-DeleteServersTestJSON-1389929058-project-member</nova:user>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:         <nova:project uuid="8756cc804e134c1385157f89df922160">tempest-DeleteServersTestJSON-1389929058</nova:project>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:         <nova:port uuid="c8933b8a-f3aa-4393-9921-109f8e9fd5e9">
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:         </nova:port>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:   </metadata>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:     <system>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       <entry name="serial">7d1add06-aef9-420b-b30e-8f881fcc968c</entry>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       <entry name="uuid">7d1add06-aef9-420b-b30e-8f881fcc968c</entry>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:     </system>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:   <os>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:   </os>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:   <features>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:     <acpi/>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:     <tcg>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:     </tcg>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:   </features>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:   <devices>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/7d1add06-aef9-420b-b30e-8f881fcc968c/disk"/>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:     </disk>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/7d1add06-aef9-420b-b30e-8f881fcc968c/disk.config"/>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:     </disk>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:92:da:8f"/>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       <target dev="tapc8933b8a-f3"/>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:     </interface>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/7d1add06-aef9-420b-b30e-8f881fcc968c/console.log" append="off"/>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:     </serial>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:     <video>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:     </video>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:     </rng>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:     </memballoon>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:   </devices>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]: </domain>
May 28 00:59:15.472061 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 00:59:15.475667 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Preparing to wait for external event network-vif-plugged-c8933b8a-f3aa-4393-9921-109f8e9fd5e9 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 00:59:15.475667 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Acquiring lock "7d1add06-aef9-420b-b30e-8f881fcc968c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:15.475667 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lock "7d1add06-aef9-420b-b30e-8f881fcc968c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:15.475667 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lock "7d1add06-aef9-420b-b30e-8f881fcc968c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:15.476123 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T00:59:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-891324810',display_name='tempest-DeleteServersTestJSON-server-891324810',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-deleteserverstestjson-server-891324810',id=13,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8756cc804e134c1385157f89df922160',ramdisk_id='',reservation_id='r-5u2fa43v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1389929058',owner_user_name='tempest-DeleteServersTestJSON-1389929058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:59:10Z,user_data=None,user_id='3fef0b514622468f82d2b1f406d0d24d',uuid=7d1add06-aef9-420b-b30e-8f881fcc968c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8933b8a-f3aa-4393-9921-109f8e9fd5e9", "address": "fa:16:3e:92:da:8f", "network": {"id": "48717d5b-288f-4306-b7b5-70424d2d3284", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1352707990-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8756cc804e134c1385157f89df922160", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8933b8a-f3", "ovs_interfaceid": "c8933b8a-f3aa-4393-9921-109f8e9fd5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 00:59:15.476320 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Converting VIF {"id": "c8933b8a-f3aa-4393-9921-109f8e9fd5e9", "address": "fa:16:3e:92:da:8f", "network": {"id": "48717d5b-288f-4306-b7b5-70424d2d3284", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1352707990-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8756cc804e134c1385157f89df922160", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8933b8a-f3", "ovs_interfaceid": "c8933b8a-f3aa-4393-9921-109f8e9fd5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:59:15.478787 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:da:8f,bridge_name='br-int',has_traffic_filtering=True,id=c8933b8a-f3aa-4393-9921-109f8e9fd5e9,network=Network(48717d5b-288f-4306-b7b5-70424d2d3284),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8933b8a-f3') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:59:15.479178 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:da:8f,bridge_name='br-int',has_traffic_filtering=True,id=c8933b8a-f3aa-4393-9921-109f8e9fd5e9,network=Network(48717d5b-288f-4306-b7b5-70424d2d3284),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8933b8a-f3') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 00:59:15.481672 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Acquiring lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:15.481805 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:15.484345 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:15.485909 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:15.486288 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 00:59:15.488734 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:15.489735 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '49d64ee6-7375-57bf-89ff-71d3d9ea17f6', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:15.490847 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.127s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:15.492404 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 00:59:15.493314 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:59:15.494013 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:15.508627 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-c9d38c68-936a-4b16-a9ec-4f96b1002b8b req-4c0bf90e-d9ee-41f6-aa51-60f9f3a564b7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:15.515502 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:15.516727 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8933b8a-f3, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:15.517435 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc8933b8a-f3, col_values=(('qos', UUID('001dc1f2-0e5c-4206-8b46-db84aa62f4cd')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:15.517717 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc8933b8a-f3, col_values=(('external_ids', {'iface-id': 'c8933b8a-f3aa-4393-9921-109f8e9fd5e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:da:8f', 'vm-uuid': '7d1add06-aef9-420b-b30e-8f881fcc968c'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:15.521635 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:59:15.526678 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:15.527579 np0000001577 nova-compute[98319]: INFO os_vif [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:da:8f,bridge_name='br-int',has_traffic_filtering=True,id=c8933b8a-f3aa-4393-9921-109f8e9fd5e9,network=Network(48717d5b-288f-4306-b7b5-70424d2d3284),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8933b8a-f3')
May 28 00:59:15.596122 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:15.596419 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Cannot resize image /opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 00:59:15.596587 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 00:59:15.596758 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Ensure instance console log exists: /opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 00:59:15.597113 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:15.597156 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:15.597283 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:15.624034 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-c9d38c68-936a-4b16-a9ec-4f96b1002b8b req-4c0bf90e-d9ee-41f6-aa51-60f9f3a564b7 service nova] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:59:15.842709 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-c9d38c68-936a-4b16-a9ec-4f96b1002b8b req-4c0bf90e-d9ee-41f6-aa51-60f9f3a564b7 service nova] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:59:15.846020 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 00:59:15.934799 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 00:59:15.935279 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 00:59:15.935821 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:15.936120 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:15.971204 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:15.990491 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lazy-loading 'flavor' on Instance uuid a8a28bb4-c3ea-4fb9-9130-1e8239191c5b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:16.044060 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e2684c1dc140407b91687ee5abadef9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5a1da6bb242e9a58cb82855897726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 00:59:16.348663 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c9d38c68-936a-4b16-a9ec-4f96b1002b8b req-4c0bf90e-d9ee-41f6-aa51-60f9f3a564b7 service nova] Releasing lock "refresh_cache-d988b526-836d-48b8-a381-1f7679caf41d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:59:16.349481 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquired lock "refresh_cache-d988b526-836d-48b8-a381-1f7679caf41d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:59:16.354175 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 00:59:16.404534 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:16.438857 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 00:59:16.567649 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Successfully created port: 3c4c4d7c-c6bd-4039-b75c-70bce7052b58 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 00:59:16.944244 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:59:16.955857 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 00:59:16.999282 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.517s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:17.024756 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:59:17.024945 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:59:17.061630 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:17.061630 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:17.061630 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] No VIF found with MAC fa:16:3e:92:da:8f, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 00:59:17.061630 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Using config drive
May 28 00:59:17.154219 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Successfully updated port: 3c4c4d7c-c6bd-4039-b75c-70bce7052b58 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 00:59:17.215469 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5ec8ce12-f52a-4001-b7df-d52bd1c85c68 req-2fe0a301-ba07-4b58-9493-0f8331e6dca0 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Received event network-changed-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:17.216358 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5ec8ce12-f52a-4001-b7df-d52bd1c85c68 req-2fe0a301-ba07-4b58-9493-0f8331e6dca0 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Refreshing instance network info cache due to event network-changed-3c4c4d7c-c6bd-4039-b75c-70bce7052b58. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:59:17.218135 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5ec8ce12-f52a-4001-b7df-d52bd1c85c68 req-2fe0a301-ba07-4b58-9493-0f8331e6dca0 service nova] Acquiring lock "refresh_cache-dccaa2b7-3c00-45f9-bf40-1a8a15030825" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:59:17.218135 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5ec8ce12-f52a-4001-b7df-d52bd1c85c68 req-2fe0a301-ba07-4b58-9493-0f8331e6dca0 service nova] Acquired lock "refresh_cache-dccaa2b7-3c00-45f9-bf40-1a8a15030825" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:59:17.218135 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-5ec8ce12-f52a-4001-b7df-d52bd1c85c68 req-2fe0a301-ba07-4b58-9493-0f8331e6dca0 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Refreshing network info cache for port 3c4c4d7c-c6bd-4039-b75c-70bce7052b58 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:59:17.292075 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:17.438726 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Updating instance_info_cache with network_info: [{"id": "d540d8c6-c40d-45db-a88e-e9b062d033fb", "address": "fa:16:3e:ca:a8:31", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd540d8c6-c4", "ovs_interfaceid": "d540d8c6-c40d-45db-a88e-e9b062d033fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:59:17.529672 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:59:17.576834 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:17.658115 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "refresh_cache-dccaa2b7-3c00-45f9-bf40-1a8a15030825" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:59:17.722936 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-5ec8ce12-f52a-4001-b7df-d52bd1c85c68 req-2fe0a301-ba07-4b58-9493-0f8331e6dca0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:17.728674 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Creating config drive at /opt/stack/data/nova/instances/7d1add06-aef9-420b-b30e-8f881fcc968c/disk.config
May 28 00:59:17.734120 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7d1add06-aef9-420b-b30e-8f881fcc968c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7vmrbbna {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:17.800429 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7d1add06-aef9-420b-b30e-8f881fcc968c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7vmrbbna" returned: 0 in 0.066s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:17.810655 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-5ec8ce12-f52a-4001-b7df-d52bd1c85c68 req-2fe0a301-ba07-4b58-9493-0f8331e6dca0 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:59:17.940963 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Releasing lock "refresh_cache-d988b526-836d-48b8-a381-1f7679caf41d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:59:17.942004 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Instance network_info: |[{"id": "d540d8c6-c40d-45db-a88e-e9b062d033fb", "address": "fa:16:3e:ca:a8:31", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd540d8c6-c4", "ovs_interfaceid": "d540d8c6-c40d-45db-a88e-e9b062d033fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 00:59:17.944583 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Start _get_guest_xml network_info=[{"id": "d540d8c6-c40d-45db-a88e-e9b062d033fb", "address": "fa:16:3e:ca:a8:31", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd540d8c6-c4", "ovs_interfaceid": "d540d8c6-c40d-45db-a88e-e9b062d033fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 00:59:17.948862 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 00:59:17.948862 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='d988b526-836d-48b8-a381-1f7679caf41d'), owner=OwnerMeta(userid='f8586a18edcf42cab0a60028135ae401', username='tempest-AttachVolumeMultiAttachTest-89204095-project-member', projectid='938c2829112843edb2054984e80ce7ad', projectname='tempest-AttachVolumeMultiAttachTest-89204095'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d540d8c6-c40d-45db-a88e-e9b062d033fb", "address": "fa:16:3e:ca:a8:31", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd540d8c6-c4", "ovs_interfaceid": "d540d8c6-c40d-45db-a88e-e9b062d033fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779929957.9482887) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 00:59:17.949809 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 00:59:17.950383 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 00:59:17.951382 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 00:59:17.951701 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 00:59:17.953127 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 00:59:17.953794 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 00:59:17.954125 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 00:59:17.954793 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 00:59:17.954793 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 00:59:17.954793 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 00:59:17.954943 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 00:59:17.955186 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 00:59:17.955374 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 00:59:17.955568 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 00:59:17.960573 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 00:59:17.960573 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 00:59:17.966411 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 00:59:17.970340 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 00:59:17.972086 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-5ec8ce12-f52a-4001-b7df-d52bd1c85c68 req-2fe0a301-ba07-4b58-9493-0f8331e6dca0 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:59:17.972960 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Creating image(s)
May 28 00:59:17.975565 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "/opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:17.976654 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "/opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:17.976654 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T00:59:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='multiattach-server-1',id=14,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7fHo3fyBWUybZxdNVpYEXXxMYY3ACB7D4odfvDXtuf5uMmk/o2XggiQakoJbwdRCXKjpHaMcmXgSyAS8x+3bDHMUWn1qlznnyXp/nDVRmoqTgLFpV2Do6YlUuA3zZ+mw==',key_name='tempest-keypair-627531643',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938c2829112843edb2054984e80ce7ad',ramdisk_id='',reservation_id='r-i9lqjheh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-89204095',owner_user_name='tempest-AttachVolumeMultiAttachTest-89204095-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:59:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8586a18edcf42cab0a60028135ae401',uuid=d988b526-836d-48b8-a381-1f7679caf41d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d540d8c6-c40d-45db-a88e-e9b062d033fb", "address": "fa:16:3e:ca:a8:31", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd540d8c6-c4", "ovs_interfaceid": "d540d8c6-c40d-45db-a88e-e9b062d033fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 00:59:17.977070 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converting VIF {"id": "d540d8c6-c40d-45db-a88e-e9b062d033fb", "address": "fa:16:3e:ca:a8:31", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd540d8c6-c4", "ovs_interfaceid": "d540d8c6-c40d-45db-a88e-e9b062d033fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:59:17.977976 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:a8:31,bridge_name='br-int',has_traffic_filtering=True,id=d540d8c6-c40d-45db-a88e-e9b062d033fb,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd540d8c6-c4') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:59:17.978593 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "/opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:17.978951 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lazy-loading 'pci_devices' on Instance uuid d988b526-836d-48b8-a381-1f7679caf41d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:17.980192 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:59:17.985080 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:59:17.986806 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:18.038797 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.609s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:18.039656 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 00:59:18.041963 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.638s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:18.046755 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 00:59:18.047098 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Claim successful on node np0000001577
May 28 00:59:18.063053 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.076s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:18.063629 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:18.064108 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:18.064594 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:59:18.072111 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:59:18.072111 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:18.087993 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Acquiring lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:18.088373 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:18.089128 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Attaching volume be1ff6db-176b-4318-a624-c60fbda323dc to /dev/vdb
May 28 00:59:18.158331 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:59:18.173772 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 00:59:18.185275 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.113s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:18.186292 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:18.204750 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:18.239813 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk 1073741824" returned: 0 in 0.054s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:18.240647 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.176s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:18.241090 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:18.257435 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 00:59:18.259689 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 00:59:18.264018 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:18.275209 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 00:59:18.278194 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe07:50fa', 'fe80::349a:eff:fe88:15e5', 'fe80::fc16:3eff:fe75:1c46', 'fe80::8c3:73ff:fe68:9ea1', 'fe80::fc16:3eff:fe85:df78', 'fe80::3834:39ff:fe20:36ec', 'fe80::fc16:3eff:fef0:246e', 'fe80::fc16:3eff:fe92:da8f'] 
May 28 00:59:18.278194 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 00:59:18.279597 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 00:59:18.279597 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:59:18.279597 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Updating existing volume attachment record: d7af18b8-0693-4177-acf2-f2512147c06a {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 00:59:18.289248 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:18.344721 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.104s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:18.345189 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 00:59:18.346083 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:18.401716 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:18.438090 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:18.439882 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Cannot resize image /opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 00:59:18.439882 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 00:59:18.439882 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Ensure instance console log exists: /opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 00:59:18.439882 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:18.439882 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:18.439882 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:18.477750 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5ec8ce12-f52a-4001-b7df-d52bd1c85c68 req-2fe0a301-ba07-4b58-9493-0f8331e6dca0 service nova] Releasing lock "refresh_cache-dccaa2b7-3c00-45f9-bf40-1a8a15030825" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:59:18.478360 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquired lock "refresh_cache-dccaa2b7-3c00-45f9-bf40-1a8a15030825" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:59:18.478574 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 00:59:18.487888 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] End _get_guest_xml xml=<domain type="qemu">
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:   <uuid>d988b526-836d-48b8-a381-1f7679caf41d</uuid>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:   <name>instance-0000000e</name>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:   <metadata>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       <nova:name>multiattach-server-1</nova:name>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 00:59:17</nova:creationTime>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       </nova:image>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:         <nova:user uuid="f8586a18edcf42cab0a60028135ae401">tempest-AttachVolumeMultiAttachTest-89204095-project-member</nova:user>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:         <nova:project uuid="938c2829112843edb2054984e80ce7ad">tempest-AttachVolumeMultiAttachTest-89204095</nova:project>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:         <nova:port uuid="d540d8c6-c40d-45db-a88e-e9b062d033fb">
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:         </nova:port>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:   </metadata>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:     <system>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       <entry name="serial">d988b526-836d-48b8-a381-1f7679caf41d</entry>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       <entry name="uuid">d988b526-836d-48b8-a381-1f7679caf41d</entry>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:     </system>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:   <os>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:   </os>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:   <features>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:     <acpi/>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:     <tcg>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:     </tcg>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:   </features>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:   <devices>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk"/>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:     </disk>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk.config"/>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:     </disk>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:ca:a8:31"/>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       <target dev="tapd540d8c6-c4"/>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:     </interface>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/console.log" append="off"/>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:     </serial>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:     <video>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:     </video>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:     </rng>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:     </memballoon>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:   </devices>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]: </domain>
May 28 00:59:18.487888 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 00:59:18.489664 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Preparing to wait for external event network-vif-plugged-d540d8c6-c40d-45db-a88e-e9b062d033fb {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 00:59:18.489664 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "d988b526-836d-48b8-a381-1f7679caf41d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:18.489664 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d988b526-836d-48b8-a381-1f7679caf41d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:18.489664 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d988b526-836d-48b8-a381-1f7679caf41d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:18.489664 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T00:59:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='multiattach-server-1',id=14,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7fHo3fyBWUybZxdNVpYEXXxMYY3ACB7D4odfvDXtuf5uMmk/o2XggiQakoJbwdRCXKjpHaMcmXgSyAS8x+3bDHMUWn1qlznnyXp/nDVRmoqTgLFpV2Do6YlUuA3zZ+mw==',key_name='tempest-keypair-627531643',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938c2829112843edb2054984e80ce7ad',ramdisk_id='',reservation_id='r-i9lqjheh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-89204095',owner_user_name='tempest-AttachVolumeMultiAttachTest-89204095-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:59:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8586a18edcf42cab0a60028135ae401',uuid=d988b526-836d-48b8-a381-1f7679caf41d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d540d8c6-c40d-45db-a88e-e9b062d033fb", "address": "fa:16:3e:ca:a8:31", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd540d8c6-c4", "ovs_interfaceid": "d540d8c6-c40d-45db-a88e-e9b062d033fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 00:59:18.489664 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converting VIF {"id": "d540d8c6-c40d-45db-a88e-e9b062d033fb", "address": "fa:16:3e:ca:a8:31", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd540d8c6-c4", "ovs_interfaceid": "d540d8c6-c40d-45db-a88e-e9b062d033fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:59:18.491117 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:a8:31,bridge_name='br-int',has_traffic_filtering=True,id=d540d8c6-c40d-45db-a88e-e9b062d033fb,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd540d8c6-c4') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:59:18.491117 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:a8:31,bridge_name='br-int',has_traffic_filtering=True,id=d540d8c6-c40d-45db-a88e-e9b062d033fb,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd540d8c6-c4') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 00:59:18.491348 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:18.491651 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:18.491934 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 00:59:18.492661 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:18.493289 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '24338afe-2dfd-5e18-9aec-a9b3e85baaf8', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:18.495824 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:18.495824 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:59:18.499964 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:18.499964 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd540d8c6-c4, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:18.499964 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd540d8c6-c4, col_values=(('qos', UUID('7ef08e59-1e12-416c-ade9-60cf8dce3763')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:18.500364 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd540d8c6-c4, col_values=(('external_ids', {'iface-id': 'd540d8c6-c40d-45db-a88e-e9b062d033fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:a8:31', 'vm-uuid': 'd988b526-836d-48b8-a381-1f7679caf41d'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:18.501319 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:18.503192 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:59:18.507554 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:18.510762 np0000001577 nova-compute[98319]: INFO os_vif [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:a8:31,bridge_name='br-int',has_traffic_filtering=True,id=d540d8c6-c40d-45db-a88e-e9b062d033fb,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd540d8c6-c4')
May 28 00:59:18.551529 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 00:59:18.551731 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 00:59:18.552157 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:18.552646 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:18.627509 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-343cae67-0679-456e-bf12-4855420b1154 req-ffc611a6-b9ab-4a8c-9d44-e32b86917510 service nova] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Received event network-vif-plugged-c8933b8a-f3aa-4393-9921-109f8e9fd5e9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:18.629285 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-343cae67-0679-456e-bf12-4855420b1154 req-ffc611a6-b9ab-4a8c-9d44-e32b86917510 service nova] Acquiring lock "7d1add06-aef9-420b-b30e-8f881fcc968c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:18.629285 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-343cae67-0679-456e-bf12-4855420b1154 req-ffc611a6-b9ab-4a8c-9d44-e32b86917510 service nova] Lock "7d1add06-aef9-420b-b30e-8f881fcc968c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:18.629285 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-343cae67-0679-456e-bf12-4855420b1154 req-ffc611a6-b9ab-4a8c-9d44-e32b86917510 service nova] Lock "7d1add06-aef9-420b-b30e-8f881fcc968c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:18.629285 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-343cae67-0679-456e-bf12-4855420b1154 req-ffc611a6-b9ab-4a8c-9d44-e32b86917510 service nova] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Processing event network-vif-plugged-c8933b8a-f3aa-4393-9921-109f8e9fd5e9 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 00:59:18.631783 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:18.639898 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:18.645735 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:18.648992 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e2684c1dc140407b91687ee5abadef9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5a1da6bb242e9a58cb82855897726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 00:59:18.671815 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:18.680101 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:18.851922 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 00:59:18.852292 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc', 'iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'be1ff6db-176b-4318-a624-c60fbda323dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:59:18.852454 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:59:18.852840 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:59:18.853006 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc', 'iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'be1ff6db-176b-4318-a624-c60fbda323dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 00:59:18.864812 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:59:18.865531 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:59:18.865897 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:59:18.866063 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 00:59:18.867769 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:59:18.867769 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 00:59:18.878439 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 00:59:18.878439 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:18.883932 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 00:59:18.883932 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:18.894526 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc] added
May 28 00:59:18.894526 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 00:59:18.894526 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:59:18.894526 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:59:18.894526 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:59:18.894526 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:59:18.894526 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:18.894526 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 00:59:18.894526 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0281(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 00:59:18.894526 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 00:59:18.896837 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc] added
May 28 00:59:18.896837 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 00:59:18.896837 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:59:18.896837 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:59:18.896837 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:59:18.896837 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:59:18.896837 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:18.897022 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 00:59:18.897213 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0306(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 00:59:18.897392 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 00:59:19.060989 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 00:59:19.074867 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Successfully created port: c023bfc4-a99c-4a75-81f2-981583584dcd {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 00:59:19.143385 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:59:19.152356 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929959.151948, 7d1add06-aef9-420b-b30e-8f881fcc968c => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:59:19.153076 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 00:59:19.155025 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] VM Started (Lifecycle Event)
May 28 00:59:19.156539 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 00:59:19.158141 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Instance spawned successfully.
May 28 00:59:19.158344 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 00:59:19.564914 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 00:59:19.573006 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:59:19.573006 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:59:19.656527 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:19.662101 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:59:19.666018 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:19.666180 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:19.666560 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:19.666822 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:19.667087 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:19.667349 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:19.704484 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:19.720434 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Successfully updated port: c023bfc4-a99c-4a75-81f2-981583584dcd {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 00:59:19.828982 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:19.895791 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 00:59:19.898928 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.startup = manual
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.port = 0
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 00:59:19.907092 np0000001577 nova-compute[98319]: # END RECORD
May 28 00:59:19.907092 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.startup = manual
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.port = 0
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 00:59:19.916630 np0000001577 nova-compute[98319]: # END RECORD
May 28 00:59:19.916630 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:19.921898 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-164d2c88-21c7-48a9-8f38-c0780678b94c req-ece41e8c-eb2c-49a5-b384-15862011228d service nova] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Received event network-changed-c023bfc4-a99c-4a75-81f2-981583584dcd {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:19.922233 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-164d2c88-21c7-48a9-8f38-c0780678b94c req-ece41e8c-eb2c-49a5-b384-15862011228d service nova] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Refreshing instance network info cache due to event network-changed-c023bfc4-a99c-4a75-81f2-981583584dcd. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:59:19.924103 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-164d2c88-21c7-48a9-8f38-c0780678b94c req-ece41e8c-eb2c-49a5-b384-15862011228d service nova] Acquiring lock "refresh_cache-b73b73f0-79a5-448c-a374-bbb182da41a9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:59:19.924103 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-164d2c88-21c7-48a9-8f38-c0780678b94c req-ece41e8c-eb2c-49a5-b384-15862011228d service nova] Acquired lock "refresh_cache-b73b73f0-79a5-448c-a374-bbb182da41a9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:59:19.924103 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-164d2c88-21c7-48a9-8f38-c0780678b94c req-ece41e8c-eb2c-49a5-b384-15862011228d service nova] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Refreshing network info cache for port c023bfc4-a99c-4a75-81f2-981583584dcd {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:59:19.925303 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:19.930194 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:19.938723 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:19.938723 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:19.938723 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:59:19.939211 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:19.939211 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:19.939211 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:59:19.950847 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:19.950847 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:19.950847 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:59:19.952086 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:19.952086 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:19.952086 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:59:19.973035 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc, portal: 192.168.40.100,3260]
May 28 00:59:19.973035 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc, portal: 192.168.40.100,3260] successful.
May 28 00:59:19.973035 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:19.989455 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc, portal: 192.168.50.100,3260]
May 28 00:59:19.989455 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc, portal: 192.168.50.100,3260] successful.
May 28 00:59:19.989455 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:19.990008 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:20.002053 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:20.007889 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:20.007889 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:20.007889 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:20.007889 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:20.007889 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:59:20.008071 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:20.008071 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:20.008071 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:20.008071 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:20.008071 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:59:20.008302 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:59:20.008445 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 00:59:20.009178 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] HCTL ('7', '-', '-', 0) found on session 21 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 00:59:20.009324 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 00:59:20.018329 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:20.018329 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:20.018329 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:20.018329 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:20.018329 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:59:20.018603 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:20.018603 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:20.018603 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:20.018603 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:20.018603 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:59:20.019053 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:59:20.019158 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 00:59:20.019707 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] HCTL ('8', '-', '-', 0) found on session 22 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 00:59:20.019864 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 00:59:20.030905 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Searching for a device in session 21 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 00:59:20.031080 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'be1ff6db-176b-4318-a624-c60fbda323dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 00:59:20.037974 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:20.040790 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Searching for a device in session 22 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 00:59:20.041457 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'be1ff6db-176b-4318-a624-c60fbda323dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 00:59:20.047777 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:20.047964 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:20.048135 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No VIF found with MAC fa:16:3e:ca:a8:31, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 00:59:20.049422 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Using config drive
May 28 00:59:20.075436 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:59:20.164841 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 00:59:20.165085 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929960.1649034, 7d1add06-aef9-420b-b30e-8f881fcc968c => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:59:20.165520 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] VM Paused (Lifecycle Event)
May 28 00:59:20.173620 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Took 9.32 seconds to spawn the instance on the hypervisor.
May 28 00:59:20.173801 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:20.223525 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "refresh_cache-b73b73f0-79a5-448c-a374-bbb182da41a9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:59:20.290324 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Updating instance_info_cache with network_info: [{"id": "3c4c4d7c-c6bd-4039-b75c-70bce7052b58", "address": "fa:16:3e:3e:23:29", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4c4d7c-c6", "ovs_interfaceid": "3c4c4d7c-c6bd-4039-b75c-70bce7052b58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:59:20.425892 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-164d2c88-21c7-48a9-8f38-c0780678b94c req-ece41e8c-eb2c-49a5-b384-15862011228d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:20.538817 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-164d2c88-21c7-48a9-8f38-c0780678b94c req-ece41e8c-eb2c-49a5-b384-15862011228d service nova] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:59:20.555238 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:20.576842 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 00:59:20.577640 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 00:59:20.577839 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Creating image(s)
May 28 00:59:20.578222 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "/opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:20.578367 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "/opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:20.578817 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "/opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:20.579243 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:59:20.584440 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:59:20.588872 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:20.612690 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.567s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:20.612771 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 00:59:20.668763 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:20.675643 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929960.6752377, 7d1add06-aef9-420b-b30e-8f881fcc968c => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:59:20.675854 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] VM Resumed (Lifecycle Event)
May 28 00:59:20.684842 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Took 14.88 seconds to build instance.
May 28 00:59:20.689256 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.100s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:20.690300 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:20.692862 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:20.693354 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:59:20.697530 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:59:20.697886 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:20.751292 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9dd5db5c-c580-460b-814a-f9c3ebf117ed req-35c81be9-9e21-4f24-9f07-3bf951d5f83b service nova] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Received event network-vif-plugged-c8933b8a-f3aa-4393-9921-109f8e9fd5e9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:20.754363 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9dd5db5c-c580-460b-814a-f9c3ebf117ed req-35c81be9-9e21-4f24-9f07-3bf951d5f83b service nova] Acquiring lock "7d1add06-aef9-420b-b30e-8f881fcc968c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:20.755824 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9dd5db5c-c580-460b-814a-f9c3ebf117ed req-35c81be9-9e21-4f24-9f07-3bf951d5f83b service nova] Lock "7d1add06-aef9-420b-b30e-8f881fcc968c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:20.755824 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9dd5db5c-c580-460b-814a-f9c3ebf117ed req-35c81be9-9e21-4f24-9f07-3bf951d5f83b service nova] Lock "7d1add06-aef9-420b-b30e-8f881fcc968c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:20.755824 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9dd5db5c-c580-460b-814a-f9c3ebf117ed req-35c81be9-9e21-4f24-9f07-3bf951d5f83b service nova] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] No waiting events found dispatching network-vif-plugged-c8933b8a-f3aa-4393-9921-109f8e9fd5e9 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:59:20.755824 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-9dd5db5c-c580-460b-814a-f9c3ebf117ed req-35c81be9-9e21-4f24-9f07-3bf951d5f83b service nova] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Received unexpected event network-vif-plugged-c8933b8a-f3aa-4393-9921-109f8e9fd5e9 for instance with vm_state active and task_state None.
May 28 00:59:20.783883 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:20.784483 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:20.810487 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Releasing lock "refresh_cache-dccaa2b7-3c00-45f9-bf40-1a8a15030825" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:59:20.811294 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Instance network_info: |[{"id": "3c4c4d7c-c6bd-4039-b75c-70bce7052b58", "address": "fa:16:3e:3e:23:29", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4c4d7c-c6", "ovs_interfaceid": "3c4c4d7c-c6bd-4039-b75c-70bce7052b58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 00:59:20.817440 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Start _get_guest_xml network_info=[{"id": "3c4c4d7c-c6bd-4039-b75c-70bce7052b58", "address": "fa:16:3e:3e:23:29", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4c4d7c-c6", "ovs_interfaceid": "3c4c4d7c-c6bd-4039-b75c-70bce7052b58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 00:59:20.827965 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 00:59:20.829569 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1356732443', uuid='dccaa2b7-3c00-45f9-bf40-1a8a15030825'), owner=OwnerMeta(userid='e2684c1dc140407b91687ee5abadef9d', username='tempest-ServerRescueNegativeTestJSON-509890320-project-member', projectid='a3c5a1da6bb242e9a58cb82855897726', projectname='tempest-ServerRescueNegativeTestJSON-509890320'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3c4c4d7c-c6bd-4039-b75c-70bce7052b58", "address": "fa:16:3e:3e:23:29", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4c4d7c-c6", "ovs_interfaceid": "3c4c4d7c-c6bd-4039-b75c-70bce7052b58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779929960.8291194) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 00:59:20.830626 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 00:59:20.831318 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 00:59:20.832989 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 00:59:20.833201 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 00:59:20.838455 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 00:59:20.839886 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 00:59:20.840094 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 00:59:20.840154 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 00:59:20.840291 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 00:59:20.840461 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 00:59:20.840732 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 00:59:20.840869 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 00:59:20.840869 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 00:59:20.841104 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 00:59:20.841981 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 00:59:20.841981 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 00:59:20.861999 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk 1073741824" returned: 0 in 0.077s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:20.862525 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.170s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:20.862829 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:20.886273 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 00:59:20.891823 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T00:59:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1356732443',display_name='tempest-ServerRescueNegativeTestJSON-server-1356732443',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serverrescuenegativetestjson-server-1356732443',id=15,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3c5a1da6bb242e9a58cb82855897726',ramdisk_id='',reservation_id='r-ptb9d526',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-509890320',owner_user_name='tempest-ServerRescueNegativeTestJSON-509890320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:59:17Z,user_data=None,user_id='e2684c1dc140407b91687ee5abadef9d',uuid=dccaa2b7-3c00-45f9-bf40-1a8a15030825,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c4c4d7c-c6bd-4039-b75c-70bce7052b58", "address": "fa:16:3e:3e:23:29", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4c4d7c-c6", "ovs_interfaceid": "3c4c4d7c-c6bd-4039-b75c-70bce7052b58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 00:59:20.891823 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Converting VIF {"id": "3c4c4d7c-c6bd-4039-b75c-70bce7052b58", "address": "fa:16:3e:3e:23:29", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4c4d7c-c6", "ovs_interfaceid": "3c4c4d7c-c6bd-4039-b75c-70bce7052b58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:59:20.892869 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:23:29,bridge_name='br-int',has_traffic_filtering=True,id=3c4c4d7c-c6bd-4039-b75c-70bce7052b58,network=Network(1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c4c4d7c-c6') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:59:20.894136 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'pci_devices' on Instance uuid dccaa2b7-3c00-45f9-bf40-1a8a15030825 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:20.902689 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-164d2c88-21c7-48a9-8f38-c0780678b94c req-ece41e8c-eb2c-49a5-b384-15862011228d service nova] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:59:20.953534 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.091s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:20.953864 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 00:59:20.954097 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:20.977456 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:21.015709 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Creating config drive at /opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk.config
May 28 00:59:21.020853 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwizicgw6 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:21.063872 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:21.064742 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Cannot resize image /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 00:59:21.065466 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 00:59:21.065946 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Ensure instance console log exists: /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 00:59:21.066636 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:21.066804 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:21.067256 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:21.071849 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwizicgw6" returned: 0 in 0.051s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:21.125098 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 00:59:21.125522 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 00:59:21.127889 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:21.127889 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:21.181620 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:21.188454 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6369204e-6868-4978-8ccc-ade6ad9462e5 tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lock "7d1add06-aef9-420b-b30e-8f881fcc968c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.392s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:21.188711 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:59:21.338163 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c45fdc9fb964707b5e02c1b5c0ff1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d410e4c6ea40ef87f92e84f362fa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 00:59:21.405828 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] End _get_guest_xml xml=<domain type="qemu">
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:   <uuid>dccaa2b7-3c00-45f9-bf40-1a8a15030825</uuid>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:   <name>instance-0000000f</name>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:   <metadata>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1356732443</nova:name>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 00:59:20</nova:creationTime>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       </nova:image>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:         <nova:user uuid="e2684c1dc140407b91687ee5abadef9d">tempest-ServerRescueNegativeTestJSON-509890320-project-member</nova:user>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:         <nova:project uuid="a3c5a1da6bb242e9a58cb82855897726">tempest-ServerRescueNegativeTestJSON-509890320</nova:project>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:         <nova:port uuid="3c4c4d7c-c6bd-4039-b75c-70bce7052b58">
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:         </nova:port>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:   </metadata>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:     <system>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       <entry name="serial">dccaa2b7-3c00-45f9-bf40-1a8a15030825</entry>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       <entry name="uuid">dccaa2b7-3c00-45f9-bf40-1a8a15030825</entry>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:     </system>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:   <os>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:   </os>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:   <features>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:     <acpi/>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:     <tcg>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:     </tcg>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:   </features>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:   <devices>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk"/>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:     </disk>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk.config"/>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:     </disk>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:3e:23:29"/>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       <target dev="tap3c4c4d7c-c6"/>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:     </interface>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/console.log" append="off"/>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:     </serial>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:     <video>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:     </video>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:     </rng>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:     </memballoon>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:   </devices>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]: </domain>
May 28 00:59:21.405828 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 00:59:21.408866 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-164d2c88-21c7-48a9-8f38-c0780678b94c req-ece41e8c-eb2c-49a5-b384-15862011228d service nova] Releasing lock "refresh_cache-b73b73f0-79a5-448c-a374-bbb182da41a9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:59:21.408866 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Preparing to wait for external event network-vif-plugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 00:59:21.408866 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:21.408866 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:21.408866 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:21.410382 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T00:59:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1356732443',display_name='tempest-ServerRescueNegativeTestJSON-server-1356732443',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serverrescuenegativetestjson-server-1356732443',id=15,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3c5a1da6bb242e9a58cb82855897726',ramdisk_id='',reservation_id='r-ptb9d526',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-509890320',owner_user_name='tempest-ServerRescueNegativeTestJSON-509890320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:59:17Z,user_data=None,user_id='e2684c1dc140407b91687ee5abadef9d',uuid=dccaa2b7-3c00-45f9-bf40-1a8a15030825,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c4c4d7c-c6bd-4039-b75c-70bce7052b58", "address": "fa:16:3e:3e:23:29", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4c4d7c-c6", "ovs_interfaceid": "3c4c4d7c-c6bd-4039-b75c-70bce7052b58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 00:59:21.410382 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Converting VIF {"id": "3c4c4d7c-c6bd-4039-b75c-70bce7052b58", "address": "fa:16:3e:3e:23:29", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4c4d7c-c6", "ovs_interfaceid": "3c4c4d7c-c6bd-4039-b75c-70bce7052b58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:59:21.410382 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:23:29,bridge_name='br-int',has_traffic_filtering=True,id=3c4c4d7c-c6bd-4039-b75c-70bce7052b58,network=Network(1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c4c4d7c-c6') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:59:21.410382 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:23:29,bridge_name='br-int',has_traffic_filtering=True,id=3c4c4d7c-c6bd-4039-b75c-70bce7052b58,network=Network(1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c4c4d7c-c6') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 00:59:21.410862 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:21.411880 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquired lock "refresh_cache-b73b73f0-79a5-448c-a374-bbb182da41a9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:59:21.412081 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 00:59:21.413720 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:21.414099 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 00:59:21.414955 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:21.415146 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2337ab5-efcf-56b3-8ca7-b6ded14d4446', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:21.416010 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:21.416856 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:59:21.422086 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:21.424942 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:21.425185 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c4c4d7c-c6, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:21.425642 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3c4c4d7c-c6, col_values=(('qos', UUID('8ac951e1-f35b-4163-9d07-59ba0c692caf')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:21.426057 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3c4c4d7c-c6, col_values=(('external_ids', {'iface-id': '3c4c4d7c-c6bd-4039-b75c-70bce7052b58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:23:29', 'vm-uuid': 'dccaa2b7-3c00-45f9-bf40-1a8a15030825'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:21.431826 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:21.434081 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:59:21.443251 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:21.444971 np0000001577 nova-compute[98319]: INFO os_vif [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:23:29,bridge_name='br-int',has_traffic_filtering=True,id=3c4c4d7c-c6bd-4039-b75c-70bce7052b58,network=Network(1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c4c4d7c-c6')
May 28 00:59:21.585725 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:21.618509 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:21.621050 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:21.626646 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 00:59:21.703684 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:21.757020 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:21.761932 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:21.902377 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Found WWN 3300000000f59c400 for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 00:59:21.903875 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.050s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:59:21.904097 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] <== connect_volume: return (3051ms) {'type': 'block', 'scsi_wwn': '3300000000f59c400', 'path': '/dev/dm-0', 'multipath_id': '3300000000f59c400'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:59:21.904216 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000f59c400', 'path': '/dev/dm-0', 'multipath_id': '3300000000f59c400'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 00:59:21.907885 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lazy-loading 'flavor' on Instance uuid a8a28bb4-c3ea-4fb9-9130-1e8239191c5b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:22.132595 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 00:59:22.274844 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:22.397654 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:59:22.414147 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Attempting to attach volume be1ff6db-176b-4318-a624-c60fbda323dc with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 00:59:22.417047 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] attach device xml: <disk type="block" device="disk">
May 28 00:59:22.417047 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 00:59:22.417047 np0000001577 nova-compute[98319]:   <alias name="ua-be1ff6db-176b-4318-a624-c60fbda323dc"/>
May 28 00:59:22.417047 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 28 00:59:22.417047 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 00:59:22.417047 np0000001577 nova-compute[98319]:   <serial>be1ff6db-176b-4318-a624-c60fbda323dc</serial>
May 28 00:59:22.417047 np0000001577 nova-compute[98319]: </disk>
May 28 00:59:22.417047 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 00:59:22.565584 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2e764f6f-6ac3-489f-b7f5-461bc0c402ae req-38688e17-4317-4133-821a-9c17f0f27759 service nova] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Received event network-vif-unplugged-d540d8c6-c40d-45db-a88e-e9b062d033fb {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:22.565725 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2e764f6f-6ac3-489f-b7f5-461bc0c402ae req-38688e17-4317-4133-821a-9c17f0f27759 service nova] Acquiring lock "d988b526-836d-48b8-a381-1f7679caf41d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:22.565988 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2e764f6f-6ac3-489f-b7f5-461bc0c402ae req-38688e17-4317-4133-821a-9c17f0f27759 service nova] Lock "d988b526-836d-48b8-a381-1f7679caf41d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:22.565988 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2e764f6f-6ac3-489f-b7f5-461bc0c402ae req-38688e17-4317-4133-821a-9c17f0f27759 service nova] Lock "d988b526-836d-48b8-a381-1f7679caf41d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:22.566054 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2e764f6f-6ac3-489f-b7f5-461bc0c402ae req-38688e17-4317-4133-821a-9c17f0f27759 service nova] [instance: d988b526-836d-48b8-a381-1f7679caf41d] No event matching network-vif-unplugged-d540d8c6-c40d-45db-a88e-e9b062d033fb in dict_keys([('network-vif-plugged', 'd540d8c6-c40d-45db-a88e-e9b062d033fb')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 00:59:22.566444 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-2e764f6f-6ac3-489f-b7f5-461bc0c402ae req-38688e17-4317-4133-821a-9c17f0f27759 service nova] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Received unexpected event network-vif-unplugged-d540d8c6-c40d-45db-a88e-e9b062d033fb for instance with vm_state building and task_state spawning.
May 28 00:59:22.583766 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929962.5833445, d988b526-836d-48b8-a381-1f7679caf41d => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:59:22.583952 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d988b526-836d-48b8-a381-1f7679caf41d] VM Started (Lifecycle Event)
May 28 00:59:22.679114 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:22.687775 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Acquiring lock "7d1add06-aef9-420b-b30e-8f881fcc968c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:22.687934 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lock "7d1add06-aef9-420b-b30e-8f881fcc968c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:22.866367 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Successfully created port: 0d344ede-14be-4d59-b796-097c682389f9 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 00:59:22.912442 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Updating instance_info_cache with network_info: [{"id": "c023bfc4-a99c-4a75-81f2-981583584dcd", "address": "fa:16:3e:72:df:47", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc023bfc4-a9", "ovs_interfaceid": "c023bfc4-a99c-4a75-81f2-981583584dcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:59:22.967695 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:22.968093 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:22.968093 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] No VIF found with MAC fa:16:3e:3e:23:29, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 00:59:22.968492 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Using config drive
May 28 00:59:23.086762 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:23.089682 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929963.0882778, d988b526-836d-48b8-a381-1f7679caf41d => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:59:23.089682 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d988b526-836d-48b8-a381-1f7679caf41d] VM Paused (Lifecycle Event)
May 28 00:59:23.143559 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 00:59:23.144756 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 00:59:23.145628 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Creating image(s)
May 28 00:59:23.145628 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:23.145628 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "/opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:23.146393 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "/opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:23.147031 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:59:23.150142 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:59:23.151349 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:23.193646 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lazy-loading 'flavor' on Instance uuid 7d1add06-aef9-420b-b30e-8f881fcc968c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:23.248660 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.097s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:23.249066 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:23.249540 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:23.249933 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:59:23.253499 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:59:23.254294 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:23.346503 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:23.346680 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:23.355793 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:23.398773 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk 1073741824" returned: 0 in 0.052s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:23.399378 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.150s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:23.400056 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:23.419756 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Releasing lock "refresh_cache-b73b73f0-79a5-448c-a374-bbb182da41a9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:59:23.420919 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Instance network_info: |[{"id": "c023bfc4-a99c-4a75-81f2-981583584dcd", "address": "fa:16:3e:72:df:47", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc023bfc4-a9", "ovs_interfaceid": "c023bfc4-a99c-4a75-81f2-981583584dcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 00:59:23.425770 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Start _get_guest_xml network_info=[{"id": "c023bfc4-a99c-4a75-81f2-981583584dcd", "address": "fa:16:3e:72:df:47", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc023bfc4-a9", "ovs_interfaceid": "c023bfc4-a99c-4a75-81f2-981583584dcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 00:59:23.428522 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 00:59:23.429935 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-717350635', uuid='b73b73f0-79a5-448c-a374-bbb182da41a9'), owner=OwnerMeta(userid='e2684c1dc140407b91687ee5abadef9d', username='tempest-ServerRescueNegativeTestJSON-509890320-project-member', projectid='a3c5a1da6bb242e9a58cb82855897726', projectname='tempest-ServerRescueNegativeTestJSON-509890320'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c023bfc4-a99c-4a75-81f2-981583584dcd", "address": "fa:16:3e:72:df:47", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc023bfc4-a9", "ovs_interfaceid": "c023bfc4-a99c-4a75-81f2-981583584dcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779929963.4295306) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 00:59:23.432451 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 00:59:23.432810 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 00:59:23.433538 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 00:59:23.433712 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 00:59:23.434591 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 00:59:23.434883 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 00:59:23.435334 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 00:59:23.435334 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 00:59:23.435334 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 00:59:23.435480 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 00:59:23.435518 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 00:59:23.435659 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 00:59:23.435757 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 00:59:23.435862 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 00:59:23.435958 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 00:59:23.436069 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 00:59:23.448450 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T00:59:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-717350635',display_name='tempest-ServerRescueNegativeTestJSON-server-717350635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serverrescuenegativetestjson-server-717350635',id=16,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3c5a1da6bb242e9a58cb82855897726',ramdisk_id='',reservation_id='r-f8vnn170',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-509890320',owner_user_name='tempest-ServerRescueNegativeTestJSON-509890320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:59:20Z,user_data=None,user_id='e2684c1dc140407b91687ee5abadef9d',uuid=b73b73f0-79a5-448c-a374-bbb182da41a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c023bfc4-a99c-4a75-81f2-981583584dcd", "address": "fa:16:3e:72:df:47", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc023bfc4-a9", "ovs_interfaceid": "c023bfc4-a99c-4a75-81f2-981583584dcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 00:59:23.448864 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Converting VIF {"id": "c023bfc4-a99c-4a75-81f2-981583584dcd", "address": "fa:16:3e:72:df:47", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc023bfc4-a9", "ovs_interfaceid": "c023bfc4-a99c-4a75-81f2-981583584dcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:59:23.449787 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:df:47,bridge_name='br-int',has_traffic_filtering=True,id=c023bfc4-a99c-4a75-81f2-981583584dcd,network=Network(1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc023bfc4-a9') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:59:23.450499 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'pci_devices' on Instance uuid b73b73f0-79a5-448c-a374-bbb182da41a9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:23.477726 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:23.481474 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.081s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:23.482047 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 00:59:23.482296 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:23.536959 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Successfully updated port: 0d344ede-14be-4d59-b796-097c682389f9 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 00:59:23.572287 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:23.572775 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Cannot resize image /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 00:59:23.573200 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 00:59:23.573619 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Ensure instance console log exists: /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 00:59:23.573894 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:23.574100 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:23.574245 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:23.591888 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:23.597840 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:59:23.696949 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Creating config drive at /opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk.config
May 28 00:59:23.705813 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpysnfkhnm {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:23.728263 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e2ceafe5-5ba0-4a4f-b70f-d5c101e62218 req-b02500e0-105b-474b-a216-433d54892c87 service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Received event network-changed-0d344ede-14be-4d59-b796-097c682389f9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:23.729108 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e2ceafe5-5ba0-4a4f-b70f-d5c101e62218 req-b02500e0-105b-474b-a216-433d54892c87 service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Refreshing instance network info cache due to event network-changed-0d344ede-14be-4d59-b796-097c682389f9. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:59:23.729604 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e2ceafe5-5ba0-4a4f-b70f-d5c101e62218 req-b02500e0-105b-474b-a216-433d54892c87 service nova] Acquiring lock "refresh_cache-2d2183ad-dbdb-4525-b678-39b72c7ab85d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:59:23.729759 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e2ceafe5-5ba0-4a4f-b70f-d5c101e62218 req-b02500e0-105b-474b-a216-433d54892c87 service nova] Acquired lock "refresh_cache-2d2183ad-dbdb-4525-b678-39b72c7ab85d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:59:23.730677 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-e2ceafe5-5ba0-4a4f-b70f-d5c101e62218 req-b02500e0-105b-474b-a216-433d54892c87 service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Refreshing network info cache for port 0d344ede-14be-4d59-b796-097c682389f9 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:59:23.757034 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpysnfkhnm" returned: 0 in 0.052s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:23.955208 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] End _get_guest_xml xml=<domain type="qemu">
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:   <uuid>b73b73f0-79a5-448c-a374-bbb182da41a9</uuid>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:   <name>instance-00000010</name>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:   <metadata>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-717350635</nova:name>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 00:59:23</nova:creationTime>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       </nova:image>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:         <nova:user uuid="e2684c1dc140407b91687ee5abadef9d">tempest-ServerRescueNegativeTestJSON-509890320-project-member</nova:user>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:         <nova:project uuid="a3c5a1da6bb242e9a58cb82855897726">tempest-ServerRescueNegativeTestJSON-509890320</nova:project>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:         <nova:port uuid="c023bfc4-a99c-4a75-81f2-981583584dcd">
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:         </nova:port>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:   </metadata>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:     <system>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       <entry name="serial">b73b73f0-79a5-448c-a374-bbb182da41a9</entry>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       <entry name="uuid">b73b73f0-79a5-448c-a374-bbb182da41a9</entry>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:     </system>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:   <os>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:   </os>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:   <features>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:     <acpi/>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:     <tcg>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:     </tcg>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:   </features>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:   <devices>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk"/>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:     </disk>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk.config"/>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:     </disk>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:72:df:47"/>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       <target dev="tapc023bfc4-a9"/>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:     </interface>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/console.log" append="off"/>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:     </serial>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:     <video>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:     </video>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:     </rng>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:     </memballoon>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:   </devices>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]: </domain>
May 28 00:59:23.955208 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 00:59:23.963255 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Preparing to wait for external event network-vif-plugged-c023bfc4-a99c-4a75-81f2-981583584dcd {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 00:59:23.963255 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "b73b73f0-79a5-448c-a374-bbb182da41a9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:23.963255 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "b73b73f0-79a5-448c-a374-bbb182da41a9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:23.963255 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "b73b73f0-79a5-448c-a374-bbb182da41a9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:23.963255 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T00:59:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-717350635',display_name='tempest-ServerRescueNegativeTestJSON-server-717350635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serverrescuenegativetestjson-server-717350635',id=16,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3c5a1da6bb242e9a58cb82855897726',ramdisk_id='',reservation_id='r-f8vnn170',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-509890320',owner_user_name='tempest-ServerRescueNegativeTestJSON-509890320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:59:20Z,user_data=None,user_id='e2684c1dc140407b91687ee5abadef9d',uuid=b73b73f0-79a5-448c-a374-bbb182da41a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c023bfc4-a99c-4a75-81f2-981583584dcd", "address": "fa:16:3e:72:df:47", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc023bfc4-a9", "ovs_interfaceid": "c023bfc4-a99c-4a75-81f2-981583584dcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 00:59:23.963255 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Converting VIF {"id": "c023bfc4-a99c-4a75-81f2-981583584dcd", "address": "fa:16:3e:72:df:47", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc023bfc4-a9", "ovs_interfaceid": "c023bfc4-a99c-4a75-81f2-981583584dcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:59:23.963255 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:df:47,bridge_name='br-int',has_traffic_filtering=True,id=c023bfc4-a99c-4a75-81f2-981583584dcd,network=Network(1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc023bfc4-a9') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:59:23.963255 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:df:47,bridge_name='br-int',has_traffic_filtering=True,id=c023bfc4-a99c-4a75-81f2-981583584dcd,network=Network(1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc023bfc4-a9') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 00:59:23.963255 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:23.963255 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:23.963255 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 00:59:23.963255 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:23.963255 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c787d68-ffb8-589e-8aed-414e6c43041a', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:23.963255 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:23.963255 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:59:23.968985 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:23.971526 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:23.971907 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc023bfc4-a9, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:23.972236 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc023bfc4-a9, col_values=(('qos', UUID('5331047f-6b95-480f-beae-f0e6d940e288')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:23.972444 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc023bfc4-a9, col_values=(('external_ids', {'iface-id': 'c023bfc4-a99c-4a75-81f2-981583584dcd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:df:47', 'vm-uuid': 'b73b73f0-79a5-448c-a374-bbb182da41a9'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:23.976259 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:23.976497 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:59:23.994645 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:23.997752 np0000001577 nova-compute[98319]: INFO os_vif [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:df:47,bridge_name='br-int',has_traffic_filtering=True,id=c023bfc4-a99c-4a75-81f2-981583584dcd,network=Network(1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc023bfc4-a9')
May 28 00:59:24.042470 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "refresh_cache-2d2183ad-dbdb-4525-b678-39b72c7ab85d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:59:24.100175 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d988b526-836d-48b8-a381-1f7679caf41d] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 00:59:24.127579 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:24.127722 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:24.127824 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:24.127969 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] No VIF found with MAC fa:16:3e:07:50:fa, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 00:59:24.203929 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lock "7d1add06-aef9-420b-b30e-8f881fcc968c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:24.234127 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-e2ceafe5-5ba0-4a4f-b70f-d5c101e62218 req-b02500e0-105b-474b-a216-433d54892c87 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:24.243748 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:24.286620 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:24.289789 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:24.383600 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-e2ceafe5-5ba0-4a4f-b70f-d5c101e62218 req-b02500e0-105b-474b-a216-433d54892c87 service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:59:24.385584 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:24.616120 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-e2ceafe5-5ba0-4a4f-b70f-d5c101e62218 req-b02500e0-105b-474b-a216-433d54892c87 service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:59:24.617942 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:24.625306 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:24.627380 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:24.658855 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:24.661680 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c7fc2cff-1f5e-4983-ae60-ae1bb582e608 req-d27a3074-abfe-412d-886d-020ad41baffb service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Received event network-vif-unplugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:24.661789 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c7fc2cff-1f5e-4983-ae60-ae1bb582e608 req-d27a3074-abfe-412d-886d-020ad41baffb service nova] Acquiring lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:24.662149 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c7fc2cff-1f5e-4983-ae60-ae1bb582e608 req-d27a3074-abfe-412d-886d-020ad41baffb service nova] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:24.662351 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c7fc2cff-1f5e-4983-ae60-ae1bb582e608 req-d27a3074-abfe-412d-886d-020ad41baffb service nova] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:24.662462 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c7fc2cff-1f5e-4983-ae60-ae1bb582e608 req-d27a3074-abfe-412d-886d-020ad41baffb service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] No event matching network-vif-unplugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 in dict_keys([('network-vif-plugged', '3c4c4d7c-c6bd-4039-b75c-70bce7052b58')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 00:59:24.662601 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-c7fc2cff-1f5e-4983-ae60-ae1bb582e608 req-d27a3074-abfe-412d-886d-020ad41baffb service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Received unexpected event network-vif-unplugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 for instance with vm_state building and task_state spawning.
May 28 00:59:24.662708 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c7fc2cff-1f5e-4983-ae60-ae1bb582e608 req-d27a3074-abfe-412d-886d-020ad41baffb service nova] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Received event network-vif-plugged-d540d8c6-c40d-45db-a88e-e9b062d033fb {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:24.662826 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c7fc2cff-1f5e-4983-ae60-ae1bb582e608 req-d27a3074-abfe-412d-886d-020ad41baffb service nova] Acquiring lock "d988b526-836d-48b8-a381-1f7679caf41d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:24.662937 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c7fc2cff-1f5e-4983-ae60-ae1bb582e608 req-d27a3074-abfe-412d-886d-020ad41baffb service nova] Lock "d988b526-836d-48b8-a381-1f7679caf41d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:24.663039 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c7fc2cff-1f5e-4983-ae60-ae1bb582e608 req-d27a3074-abfe-412d-886d-020ad41baffb service nova] Lock "d988b526-836d-48b8-a381-1f7679caf41d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:24.663171 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c7fc2cff-1f5e-4983-ae60-ae1bb582e608 req-d27a3074-abfe-412d-886d-020ad41baffb service nova] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Processing event network-vif-plugged-d540d8c6-c40d-45db-a88e-e9b062d033fb {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 00:59:24.663292 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c7fc2cff-1f5e-4983-ae60-ae1bb582e608 req-d27a3074-abfe-412d-886d-020ad41baffb service nova] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Received event network-vif-plugged-d540d8c6-c40d-45db-a88e-e9b062d033fb {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:24.663393 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c7fc2cff-1f5e-4983-ae60-ae1bb582e608 req-d27a3074-abfe-412d-886d-020ad41baffb service nova] Acquiring lock "d988b526-836d-48b8-a381-1f7679caf41d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:24.663504 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c7fc2cff-1f5e-4983-ae60-ae1bb582e608 req-d27a3074-abfe-412d-886d-020ad41baffb service nova] Lock "d988b526-836d-48b8-a381-1f7679caf41d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:24.663639 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c7fc2cff-1f5e-4983-ae60-ae1bb582e608 req-d27a3074-abfe-412d-886d-020ad41baffb service nova] Lock "d988b526-836d-48b8-a381-1f7679caf41d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:24.663739 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c7fc2cff-1f5e-4983-ae60-ae1bb582e608 req-d27a3074-abfe-412d-886d-020ad41baffb service nova] [instance: d988b526-836d-48b8-a381-1f7679caf41d] No waiting events found dispatching network-vif-plugged-d540d8c6-c40d-45db-a88e-e9b062d033fb {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:59:24.663836 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-c7fc2cff-1f5e-4983-ae60-ae1bb582e608 req-d27a3074-abfe-412d-886d-020ad41baffb service nova] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Received unexpected event network-vif-plugged-d540d8c6-c40d-45db-a88e-e9b062d033fb for instance with vm_state building and task_state spawning.
May 28 00:59:24.664786 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 00:59:24.668956 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929964.6685734, d988b526-836d-48b8-a381-1f7679caf41d => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:59:24.669134 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d988b526-836d-48b8-a381-1f7679caf41d] VM Resumed (Lifecycle Event)
May 28 00:59:24.670542 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 00:59:24.676061 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Instance spawned successfully.
May 28 00:59:24.677248 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 00:59:25.117966 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e2ceafe5-5ba0-4a4f-b70f-d5c101e62218 req-b02500e0-105b-474b-a216-433d54892c87 service nova] Releasing lock "refresh_cache-2d2183ad-dbdb-4525-b678-39b72c7ab85d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:59:25.118419 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquired lock "refresh_cache-2d2183ad-dbdb-4525-b678-39b72c7ab85d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:59:25.118638 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 00:59:25.175757 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:25.178248 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:59:25.186272 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:25.186272 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:25.189310 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:25.190116 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:25.190116 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:25.190347 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:25.319056 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Acquiring lock "7d1add06-aef9-420b-b30e-8f881fcc968c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:25.319630 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lock "7d1add06-aef9-420b-b30e-8f881fcc968c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:25.319630 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Attaching volume af0408f8-b906-446a-bec3-429706d03033 to /dev/vdb
May 28 00:59:25.360293 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:59:25.369811 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 00:59:25.391337 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:25.434042 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 00:59:25.435060 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 00:59:25.447315 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 00:59:25.453188 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe07:50fa', 'fe80::349a:eff:fe88:15e5', 'fe80::fc16:3eff:fe75:1c46', 'fe80::8c3:73ff:fe68:9ea1', 'fe80::fc16:3eff:fe85:df78', 'fe80::3834:39ff:fe20:36ec', 'fe80::fc16:3eff:fef0:246e', 'fe80::fc16:3eff:fe92:da8f', 'fe80::348c:26ff:feba:4aeb', 'fe80::fc16:3eff:feca:a831', 'fe80::fc16:3eff:fe3e:2329', 'fe80::e8d7:d3ff:fe11:4890'] 
May 28 00:59:25.455043 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 00:59:25.455043 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 00:59:25.455043 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] <== get_connector_properties: return (93ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:59:25.455043 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Updating existing volume attachment record: 9f98436e-e32d-454a-b25e-5f0acf171207 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 00:59:25.519111 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:25.519316 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:25.519469 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] No VIF found with MAC fa:16:3e:72:df:47, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 00:59:25.520202 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Using config drive
May 28 00:59:25.686795 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d988b526-836d-48b8-a381-1f7679caf41d] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 00:59:25.686795 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929965.6860301, dccaa2b7-3c00-45f9-bf40-1a8a15030825 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:59:25.686795 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] VM Started (Lifecycle Event)
May 28 00:59:25.699513 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Took 10.59 seconds to spawn the instance on the hypervisor.
May 28 00:59:25.700560 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:25.712467 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ce4a3522-c247-4adb-bdac-aab61ba08dd5 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.624s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:25.739575 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:59:25.751171 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:25.944874 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:25.979887 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:26.019263 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 00:59:26.019703 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033', 'iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'af0408f8-b906-446a-bec3-429706d03033', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:59:26.019931 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:59:26.020426 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:59:26.020693 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033', 'iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'af0408f8-b906-446a-bec3-429706d03033', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 00:59:26.028231 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:26.036477 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:59:26.038017 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:59:26.038606 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:59:26.038800 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 00:59:26.039156 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:59:26.039339 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 00:59:26.052955 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 00:59:26.052955 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:26.059797 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 00:59:26.059797 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:26.072055 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033] added
May 28 00:59:26.072055 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 00:59:26.072055 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:59:26.072055 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:59:26.072055 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:59:26.072055 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:59:26.072055 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:26.072530 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 00:59:26.072530 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0335(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 00:59:26.072530 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 00:59:26.075251 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033] added
May 28 00:59:26.075251 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 00:59:26.075251 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:59:26.075251 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:59:26.075251 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:59:26.075251 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:59:26.075251 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:26.075251 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 00:59:26.075522 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.036(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 00:59:26.075522 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 00:59:26.140978 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Updating instance_info_cache with network_info: [{"id": "0d344ede-14be-4d59-b796-097c682389f9", "address": "fa:16:3e:bd:1f:a1", "network": {"id": "8dc9ea08-c48e-4321-b325-d1191e9557b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1143389599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78d410e4c6ea40ef87f92e84f362fa43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d344ede-14", "ovs_interfaceid": "0d344ede-14be-4d59-b796-097c682389f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:59:26.188679 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:26.196186 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929966.1958804, dccaa2b7-3c00-45f9-bf40-1a8a15030825 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:59:26.196460 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] VM Paused (Lifecycle Event)
May 28 00:59:26.214314 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Took 16.16 seconds to build instance.
May 28 00:59:26.273112 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Creating config drive at /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk.config
May 28 00:59:26.276689 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphfu9g_r0 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:26.320888 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphfu9g_r0" returned: 0 in 0.044s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:26.643473 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Releasing lock "refresh_cache-2d2183ad-dbdb-4525-b678-39b72c7ab85d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:59:26.643961 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Instance network_info: |[{"id": "0d344ede-14be-4d59-b796-097c682389f9", "address": "fa:16:3e:bd:1f:a1", "network": {"id": "8dc9ea08-c48e-4321-b325-d1191e9557b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1143389599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78d410e4c6ea40ef87f92e84f362fa43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d344ede-14", "ovs_interfaceid": "0d344ede-14be-4d59-b796-097c682389f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 00:59:26.647752 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Start _get_guest_xml network_info=[{"id": "0d344ede-14be-4d59-b796-097c682389f9", "address": "fa:16:3e:bd:1f:a1", "network": {"id": "8dc9ea08-c48e-4321-b325-d1191e9557b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1143389599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78d410e4c6ea40ef87f92e84f362fa43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d344ede-14", "ovs_interfaceid": "0d344ede-14be-4d59-b796-097c682389f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 00:59:26.650495 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 00:59:26.652292 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-126815204', uuid='2d2183ad-dbdb-4525-b678-39b72c7ab85d'), owner=OwnerMeta(userid='2c45fdc9fb964707b5e02c1b5c0ff1d8', username='tempest-ServerActionsTestOtherB-243435399-project-member', projectid='78d410e4c6ea40ef87f92e84f362fa43', projectname='tempest-ServerActionsTestOtherB-243435399'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0d344ede-14be-4d59-b796-097c682389f9", "address": "fa:16:3e:bd:1f:a1", "network": {"id": "8dc9ea08-c48e-4321-b325-d1191e9557b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1143389599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78d410e4c6ea40ef87f92e84f362fa43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d344ede-14", "ovs_interfaceid": "0d344ede-14be-4d59-b796-097c682389f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779929966.6518426) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 00:59:26.653804 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 00:59:26.653954 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 00:59:26.656223 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 00:59:26.657318 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 00:59:26.658217 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 00:59:26.658664 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 00:59:26.658910 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 00:59:26.659048 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 00:59:26.659256 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 00:59:26.659393 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 00:59:26.659563 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 00:59:26.660072 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 00:59:26.660234 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 00:59:26.660407 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 00:59:26.660585 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 00:59:26.660762 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 00:59:26.681395 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T00:59:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-126815204',display_name='tempest-ServerActionsTestOtherB-server-126815204',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serveractionstestotherb-server-126815204',id=17,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHowHxSKo/GbZ3/T/DuqsFzaBQyor5k7f+0IXzkeGeXUAEkx6L+ijA0U/nuHnUHla5vZzHw/uAJ60OyJL0qlD41uqiYRDGnW+sKtXyVuDHBRaZp3vxryet5baLwLYdDdtg==',key_name='tempest-keypair-1717835047',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78d410e4c6ea40ef87f92e84f362fa43',ramdisk_id='',reservation_id='r-6x23ytl1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-243435399',owner_user_name='tempest-ServerActionsTestOtherB-243435399-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:59:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c45fdc9fb964707b5e02c1b5c0ff1d8',uuid=2d2183ad-dbdb-4525-b678-39b72c7ab85d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d344ede-14be-4d59-b796-097c682389f9", "address": "fa:16:3e:bd:1f:a1", "network": {"id": "8dc9ea08-c48e-4321-b325-d1191e9557b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1143389599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78d410e4c6ea40ef87f92e84f362fa43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d344ede-14", "ovs_interfaceid": "0d344ede-14be-4d59-b796-097c682389f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 00:59:26.681591 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Converting VIF {"id": "0d344ede-14be-4d59-b796-097c682389f9", "address": "fa:16:3e:bd:1f:a1", "network": {"id": "8dc9ea08-c48e-4321-b325-d1191e9557b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1143389599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78d410e4c6ea40ef87f92e84f362fa43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d344ede-14", "ovs_interfaceid": "0d344ede-14be-4d59-b796-097c682389f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:59:26.682327 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:1f:a1,bridge_name='br-int',has_traffic_filtering=True,id=0d344ede-14be-4d59-b796-097c682389f9,network=Network(8dc9ea08-c48e-4321-b325-d1191e9557b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d344ede-14') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:59:26.683053 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d2183ad-dbdb-4525-b678-39b72c7ab85d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:26.699894 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:26.703538 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:59:26.716114 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2827d777-bf08-462d-9e41-0ee019e54eb9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d988b526-836d-48b8-a381-1f7679caf41d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.668s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:26.756904 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f9b7e6d4-bb49-428f-be3e-cf3f474b5292 req-5e4697bb-9fea-4abb-a53e-444d2e818274 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Received event network-vif-plugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:26.757181 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f9b7e6d4-bb49-428f-be3e-cf3f474b5292 req-5e4697bb-9fea-4abb-a53e-444d2e818274 service nova] Acquiring lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:26.757426 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f9b7e6d4-bb49-428f-be3e-cf3f474b5292 req-5e4697bb-9fea-4abb-a53e-444d2e818274 service nova] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:26.757624 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f9b7e6d4-bb49-428f-be3e-cf3f474b5292 req-5e4697bb-9fea-4abb-a53e-444d2e818274 service nova] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:26.757784 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f9b7e6d4-bb49-428f-be3e-cf3f474b5292 req-5e4697bb-9fea-4abb-a53e-444d2e818274 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Processing event network-vif-plugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 00:59:26.757980 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f9b7e6d4-bb49-428f-be3e-cf3f474b5292 req-5e4697bb-9fea-4abb-a53e-444d2e818274 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Received event network-vif-plugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:26.760114 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 00:59:26.760271 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f9b7e6d4-bb49-428f-be3e-cf3f474b5292 req-5e4697bb-9fea-4abb-a53e-444d2e818274 service nova] Acquiring lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:26.760580 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f9b7e6d4-bb49-428f-be3e-cf3f474b5292 req-5e4697bb-9fea-4abb-a53e-444d2e818274 service nova] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:26.760892 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f9b7e6d4-bb49-428f-be3e-cf3f474b5292 req-5e4697bb-9fea-4abb-a53e-444d2e818274 service nova] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:26.761063 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f9b7e6d4-bb49-428f-be3e-cf3f474b5292 req-5e4697bb-9fea-4abb-a53e-444d2e818274 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] No waiting events found dispatching network-vif-plugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:59:26.761265 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-f9b7e6d4-bb49-428f-be3e-cf3f474b5292 req-5e4697bb-9fea-4abb-a53e-444d2e818274 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Received unexpected event network-vif-plugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 for instance with vm_state building and task_state spawning.
May 28 00:59:26.765164 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 00:59:26.770621 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Instance spawned successfully.
May 28 00:59:26.772127 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 00:59:26.868717 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:26.905093 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:26.914125 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:26.991923 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:27.073370 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 00:59:27.075936 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.startup = manual
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.port = 0
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 00:59:27.092032 np0000001577 nova-compute[98319]: # END RECORD
May 28 00:59:27.092032 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.startup = manual
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.port = 0
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 00:59:27.104190 np0000001577 nova-compute[98319]: # END RECORD
May 28 00:59:27.104190 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:27.118669 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:27.125173 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:27.127372 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:27.131345 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:27.140434 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:27.140434 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:27.140434 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:27.140434 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:27.140434 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:59:27.140836 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:27.140836 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:27.140836 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:27.140836 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:27.140836 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:59:27.146771 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "f2b64af8-9a7b-4726-b298-cf9d2cb24498" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:27.146955 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "f2b64af8-9a7b-4726-b298-cf9d2cb24498" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:27.154518 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:27.154518 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:27.154518 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:27.154518 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:27.154518 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:59:27.154683 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:27.154683 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:27.154683 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:27.154683 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:27.154683 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:59:27.187343 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] End _get_guest_xml xml=<domain type="qemu">
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:   <uuid>2d2183ad-dbdb-4525-b678-39b72c7ab85d</uuid>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:   <name>instance-00000011</name>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:   <metadata>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       <nova:name>tempest-ServerActionsTestOtherB-server-126815204</nova:name>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 00:59:26</nova:creationTime>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       </nova:image>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:         <nova:user uuid="2c45fdc9fb964707b5e02c1b5c0ff1d8">tempest-ServerActionsTestOtherB-243435399-project-member</nova:user>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:         <nova:project uuid="78d410e4c6ea40ef87f92e84f362fa43">tempest-ServerActionsTestOtherB-243435399</nova:project>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:         <nova:port uuid="0d344ede-14be-4d59-b796-097c682389f9">
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:         </nova:port>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:   </metadata>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:     <system>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       <entry name="serial">2d2183ad-dbdb-4525-b678-39b72c7ab85d</entry>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       <entry name="uuid">2d2183ad-dbdb-4525-b678-39b72c7ab85d</entry>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:     </system>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:   <os>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:   </os>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:   <features>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:     <acpi/>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:     <tcg>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:     </tcg>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:   </features>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:   <devices>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk"/>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:     </disk>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk.config"/>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:     </disk>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:bd:1f:a1"/>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       <target dev="tap0d344ede-14"/>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:     </interface>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/console.log" append="off"/>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:     </serial>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:     <video>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:     </video>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:     </rng>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:     </memballoon>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:   </devices>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]: </domain>
May 28 00:59:27.187343 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 00:59:27.187343 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Preparing to wait for external event network-vif-plugged-0d344ede-14be-4d59-b796-097c682389f9 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 00:59:27.187343 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:27.189154 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:27.192016 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:27.193981 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T00:59:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-126815204',display_name='tempest-ServerActionsTestOtherB-server-126815204',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serveractionstestotherb-server-126815204',id=17,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHowHxSKo/GbZ3/T/DuqsFzaBQyor5k7f+0IXzkeGeXUAEkx6L+ijA0U/nuHnUHla5vZzHw/uAJ60OyJL0qlD41uqiYRDGnW+sKtXyVuDHBRaZp3vxryet5baLwLYdDdtg==',key_name='tempest-keypair-1717835047',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78d410e4c6ea40ef87f92e84f362fa43',ramdisk_id='',reservation_id='r-6x23ytl1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-243435399',owner_user_name='tempest-ServerActionsTestOtherB-243435399-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:59:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c45fdc9fb964707b5e02c1b5c0ff1d8',uuid=2d2183ad-dbdb-4525-b678-39b72c7ab85d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d344ede-14be-4d59-b796-097c682389f9", "address": "fa:16:3e:bd:1f:a1", "network": {"id": "8dc9ea08-c48e-4321-b325-d1191e9557b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1143389599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78d410e4c6ea40ef87f92e84f362fa43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d344ede-14", "ovs_interfaceid": "0d344ede-14be-4d59-b796-097c682389f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 00:59:27.194189 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Converting VIF {"id": "0d344ede-14be-4d59-b796-097c682389f9", "address": "fa:16:3e:bd:1f:a1", "network": {"id": "8dc9ea08-c48e-4321-b325-d1191e9557b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1143389599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78d410e4c6ea40ef87f92e84f362fa43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d344ede-14", "ovs_interfaceid": "0d344ede-14be-4d59-b796-097c682389f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:59:27.195790 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:1f:a1,bridge_name='br-int',has_traffic_filtering=True,id=0d344ede-14be-4d59-b796-097c682389f9,network=Network(8dc9ea08-c48e-4321-b325-d1191e9557b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d344ede-14') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:59:27.195911 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:1f:a1,bridge_name='br-int',has_traffic_filtering=True,id=0d344ede-14be-4d59-b796-097c682389f9,network=Network(8dc9ea08-c48e-4321-b325-d1191e9557b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d344ede-14') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 00:59:27.196275 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:27.196524 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:27.196797 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 00:59:27.197446 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033, portal: 192.168.50.100,3260]
May 28 00:59:27.197446 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033, portal: 192.168.50.100,3260] successful.
May 28 00:59:27.197446 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:27.198999 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:27.199183 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ace69347-2c6a-537b-ace2-983b15e1e242', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:27.203260 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:59:27.205081 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:27.209145 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 00:59:27.209739 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929967.2095242, dccaa2b7-3c00-45f9-bf40-1a8a15030825 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:59:27.209894 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] VM Resumed (Lifecycle Event)
May 28 00:59:27.211376 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:27.211779 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033, portal: 192.168.40.100,3260]
May 28 00:59:27.211779 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033, portal: 192.168.40.100,3260] successful.
May 28 00:59:27.211779 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:27.212296 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d344ede-14, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:27.212745 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0d344ede-14, col_values=(('qos', UUID('74623575-0dd2-44e3-8e57-ac0a41681fc6')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:27.212966 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0d344ede-14, col_values=(('external_ids', {'iface-id': '0d344ede-14be-4d59-b796-097c682389f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:1f:a1', 'vm-uuid': '2d2183ad-dbdb-4525-b678-39b72c7ab85d'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:27.216640 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:27.218081 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:27.219562 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:59:27.226190 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:27.228224 np0000001577 nova-compute[98319]: INFO os_vif [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:1f:a1,bridge_name='br-int',has_traffic_filtering=True,id=0d344ede-14be-4d59-b796-097c682389f9,network=Network(8dc9ea08-c48e-4321-b325-d1191e9557b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d344ede-14')
May 28 00:59:27.240591 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:27.242434 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:27.242434 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:27.242434 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:27.242434 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:27.242434 np0000001577 nova-compute[98319]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:27.242434 np0000001577 nova-compute[98319]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:27.242434 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:59:27.243588 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:27.243588 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:27.243588 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:27.243588 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:27.243588 np0000001577 nova-compute[98319]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:27.243588 np0000001577 nova-compute[98319]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:27.243588 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:59:27.244011 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.205s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:59:27.244210 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 00:59:27.246336 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] HCTL ('9', '-', '-', 0) found on session 23 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 00:59:27.246569 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 00:59:27.262199 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:27.262199 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:27.262199 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:27.262199 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:27.262199 np0000001577 nova-compute[98319]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:27.262199 np0000001577 nova-compute[98319]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:27.262199 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:59:27.262509 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:27.262509 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:27.262509 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:27.262509 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:27.262509 np0000001577 nova-compute[98319]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:27.262509 np0000001577 nova-compute[98319]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:27.262509 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:59:27.265628 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.224s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:59:27.265628 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 00:59:27.265628 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] HCTL ('10', '-', '-', 0) found on session 24 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 00:59:27.265628 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 00:59:27.271401 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Searching for a device in session 23 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 00:59:27.271401 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'af0408f8-b906-446a-bec3-429706d03033', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 00:59:27.291282 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:27.291282 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:27.291282 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:27.291282 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:27.291282 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:27.291282 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:27.307473 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Searching for a device in session 24 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 00:59:27.308157 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'af0408f8-b906-446a-bec3-429706d03033', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 00:59:27.651260 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 00:59:27.720856 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:27.723873 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:59:27.780700 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Acquiring lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:27.780963 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:27.811130 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Took 9.84 seconds to spawn the instance on the hypervisor.
May 28 00:59:27.811258 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:27.852116 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:27.979653 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a5fdc242-dee8-489b-bc03-dee1dfc4b20e req-edf53a91-0c13-49a6-9637-2829706140b7 service nova] [instance: d09e5674-c5ab-4ace-9952-554361002541] Received event network-changed-27b0856b-fab8-4285-8856-b3cabb6c5437 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:27.979737 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a5fdc242-dee8-489b-bc03-dee1dfc4b20e req-edf53a91-0c13-49a6-9637-2829706140b7 service nova] [instance: d09e5674-c5ab-4ace-9952-554361002541] Refreshing instance network info cache due to event network-changed-27b0856b-fab8-4285-8856-b3cabb6c5437. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:59:27.980805 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5fdc242-dee8-489b-bc03-dee1dfc4b20e req-edf53a91-0c13-49a6-9637-2829706140b7 service nova] Acquiring lock "refresh_cache-d09e5674-c5ab-4ace-9952-554361002541" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:59:27.980921 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5fdc242-dee8-489b-bc03-dee1dfc4b20e req-edf53a91-0c13-49a6-9637-2829706140b7 service nova] Acquired lock "refresh_cache-d09e5674-c5ab-4ace-9952-554361002541" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:59:27.981076 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-a5fdc242-dee8-489b-bc03-dee1dfc4b20e req-edf53a91-0c13-49a6-9637-2829706140b7 service nova] [instance: d09e5674-c5ab-4ace-9952-554361002541] Refreshing network info cache for port 27b0856b-fab8-4285-8856-b3cabb6c5437 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:59:28.038260 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 00:59:28.212679 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:28.212831 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:28.215703 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 00:59:28.215826 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Claim successful on node np0000001577
May 28 00:59:28.226962 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 00:59:28.227451 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929968.2270465, b73b73f0-79a5-448c-a374-bbb182da41a9 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:59:28.227451 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] VM Started (Lifecycle Event)
May 28 00:59:28.285237 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lazy-loading 'flavor' on Instance uuid a8a28bb4-c3ea-4fb9-9130-1e8239191c5b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:28.328135 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Took 15.52 seconds to build instance.
May 28 00:59:28.485378 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-a5fdc242-dee8-489b-bc03-dee1dfc4b20e req-edf53a91-0c13-49a6-9637-2829706140b7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:28.730917 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:28.733184 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929968.7329211, b73b73f0-79a5-448c-a374-bbb182da41a9 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:59:28.733438 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] VM Paused (Lifecycle Event)
May 28 00:59:28.759382 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:28.759568 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:28.759720 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] No VIF found with MAC fa:16:3e:bd:1f:a1, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 00:59:28.760230 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Using config drive
May 28 00:59:28.822536 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-a5fdc242-dee8-489b-bc03-dee1dfc4b20e req-edf53a91-0c13-49a6-9637-2829706140b7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:28.829485 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eefa2ab2-2eab-4c43-88b1-d5c5dd29e361 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.048s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:28.962498 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-a5fdc242-dee8-489b-bc03-dee1dfc4b20e req-edf53a91-0c13-49a6-9637-2829706140b7 service nova] [instance: d09e5674-c5ab-4ace-9952-554361002541] Updated VIF entry in instance network info cache for port 27b0856b-fab8-4285-8856-b3cabb6c5437. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 00:59:28.962737 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-a5fdc242-dee8-489b-bc03-dee1dfc4b20e req-edf53a91-0c13-49a6-9637-2829706140b7 service nova] [instance: d09e5674-c5ab-4ace-9952-554361002541] Updating instance_info_cache with network_info: [{"id": "27b0856b-fab8-4285-8856-b3cabb6c5437", "address": "fa:16:3e:f0:24:6e", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b0856b-fa", "ovs_interfaceid": "27b0856b-fab8-4285-8856-b3cabb6c5437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:59:29.057499 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Found WWN 3300000005ccc64c1 for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 00:59:29.057847 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:59:29.058067 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '3300000005ccc64c1', 'path': '/dev/dm-1', 'multipath_id': '3300000005ccc64c1'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:59:29.058172 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005ccc64c1', 'path': '/dev/dm-1', 'multipath_id': '3300000005ccc64c1'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 00:59:29.061061 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lazy-loading 'flavor' on Instance uuid 7d1add06-aef9-420b-b30e-8f881fcc968c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:29.236086 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:29.238850 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:59:29.265796 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:29.289276 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:29.441505 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Creating config drive at /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk.config
May 28 00:59:29.451569 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1khrdhfo {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:29.470156 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5fdc242-dee8-489b-bc03-dee1dfc4b20e req-edf53a91-0c13-49a6-9637-2829706140b7 service nova] Releasing lock "refresh_cache-d09e5674-c5ab-4ace-9952-554361002541" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:59:29.506944 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1khrdhfo" returned: 0 in 0.055s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:29.564068 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Attempting to attach volume af0408f8-b906-446a-bec3-429706d03033 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 00:59:29.567329 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] attach device xml: <disk type="block" device="disk">
May 28 00:59:29.567329 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 00:59:29.567329 np0000001577 nova-compute[98319]:   <alias name="ua-af0408f8-b906-446a-bec3-429706d03033"/>
May 28 00:59:29.567329 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 28 00:59:29.567329 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 00:59:29.567329 np0000001577 nova-compute[98319]:   <serial>af0408f8-b906-446a-bec3-429706d03033</serial>
May 28 00:59:29.567329 np0000001577 nova-compute[98319]: </disk>
May 28 00:59:29.567329 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 00:59:29.740493 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 00:59:29.772471 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "d09e5674-c5ab-4ace-9952-554361002541" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:29.772711 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d09e5674-c5ab-4ace-9952-554361002541" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:29.835290 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:59:29.835290 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:59:29.978341 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:59:29.978714 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Cleaning up deleted instances {{(pid=98319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 28 00:59:30.131830 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:30.159423 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:30.162894 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:30.260026 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:30.278746 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lazy-loading 'flavor' on Instance uuid d09e5674-c5ab-4ace-9952-554361002541 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:30.338289 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:59:30.399136 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-fe242eb0-bda9-49b5-bae6-e2940e844537 req-6754bdda-2fc8-4e7a-b1bf-78700080f6ba service nova] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Received event network-changed-d540d8c6-c40d-45db-a88e-e9b062d033fb {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:30.399136 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-fe242eb0-bda9-49b5-bae6-e2940e844537 req-6754bdda-2fc8-4e7a-b1bf-78700080f6ba service nova] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Refreshing instance network info cache due to event network-changed-d540d8c6-c40d-45db-a88e-e9b062d033fb. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:59:30.399136 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fe242eb0-bda9-49b5-bae6-e2940e844537 req-6754bdda-2fc8-4e7a-b1bf-78700080f6ba service nova] Acquiring lock "refresh_cache-d988b526-836d-48b8-a381-1f7679caf41d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:59:30.399136 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fe242eb0-bda9-49b5-bae6-e2940e844537 req-6754bdda-2fc8-4e7a-b1bf-78700080f6ba service nova] Acquired lock "refresh_cache-d988b526-836d-48b8-a381-1f7679caf41d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:59:30.399136 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-fe242eb0-bda9-49b5-bae6-e2940e844537 req-6754bdda-2fc8-4e7a-b1bf-78700080f6ba service nova] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Refreshing network info cache for port d540d8c6-c40d-45db-a88e-e9b062d033fb {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:59:30.403537 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Acquiring lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:30.403760 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:30.404039 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Attaching volume ba3ca79b-44f2-41fe-9399-fac706396546 to /dev/vdc
May 28 00:59:30.454164 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:59:30.467733 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 00:59:30.483927 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] There are 0 instances to clean {{(pid=98319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 28 00:59:30.485429 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:59:30.485574 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98319) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 28 00:59:30.495571 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:30.537157 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:30.539810 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 00:59:30.539810 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:30.542252 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 00:59:30.543751 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:30.551226 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 00:59:30.552466 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe07:50fa', 'fe80::349a:eff:fe88:15e5', 'fe80::fc16:3eff:fe75:1c46', 'fe80::8c3:73ff:fe68:9ea1', 'fe80::fc16:3eff:fe85:df78', 'fe80::3834:39ff:fe20:36ec', 'fe80::fc16:3eff:fef0:246e', 'fe80::fc16:3eff:fe92:da8f', 'fe80::348c:26ff:feba:4aeb', 'fe80::fc16:3eff:feca:a831', 'fe80::fc16:3eff:fe3e:2329', 'fe80::e8d7:d3ff:fe11:4890', 'fe80::fc16:3eff:fe72:df47', 'fe80::fc16:3eff:febd:1fa1', 'fe80::743e:7eff:fe2c:709c'] 
May 28 00:59:30.552664 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 00:59:30.554112 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 00:59:30.554332 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] <== get_connector_properties: return (99ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:59:30.554976 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Updating existing volume attachment record: 5639fabb-28c3-4e25-9d55-730a409d097a {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 00:59:30.563445 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:30.567135 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:30.844754 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.632s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:30.845134 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 00:59:30.908062 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-fe242eb0-bda9-49b5-bae6-e2940e844537 req-6754bdda-2fc8-4e7a-b1bf-78700080f6ba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:30.930980 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929970.930631, 2d2183ad-dbdb-4525-b678-39b72c7ab85d => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:59:30.931142 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] VM Started (Lifecycle Event)
May 28 00:59:30.993056 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:59:31.000668 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:31.118864 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 00:59:31.118864 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546', 'iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba3ca79b-44f2-41fe-9399-fac706396546', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:59:31.118864 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:59:31.118864 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:59:31.118864 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546', 'iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba3ca79b-44f2-41fe-9399-fac706396546', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 00:59:31.130972 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:59:31.132269 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:59:31.133272 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:59:31.133582 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 00:59:31.134099 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:59:31.134353 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 00:59:31.144369 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 00:59:31.144369 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:31.154884 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 00:59:31.154884 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:31.159285 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546] added
May 28 00:59:31.159285 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 00:59:31.159285 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:59:31.159285 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:59:31.159285 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:59:31.159285 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:59:31.159285 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:31.159493 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 00:59:31.159692 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0261(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 00:59:31.159798 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 00:59:31.169181 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546] added
May 28 00:59:31.169181 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 00:59:31.169181 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:59:31.169181 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:59:31.169181 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:59:31.169181 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:59:31.169181 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:31.169957 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 00:59:31.169957 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0355(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 00:59:31.169957 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 00:59:31.274416 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-fe242eb0-bda9-49b5-bae6-e2940e844537 req-6754bdda-2fc8-4e7a-b1bf-78700080f6ba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:31.293452 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d09e5674-c5ab-4ace-9952-554361002541" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.521s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:31.350799 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 00:59:31.351082 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 00:59:31.351335 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:31.351515 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:31.432574 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:31.432574 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:31.432574 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:31.432574 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] No VIF found with MAC fa:16:3e:92:da:8f, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 00:59:31.435597 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:31.440515 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929971.4400947, 2d2183ad-dbdb-4525-b678-39b72c7ab85d => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:59:31.440677 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] VM Paused (Lifecycle Event)
May 28 00:59:31.446407 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-fe242eb0-bda9-49b5-bae6-e2940e844537 req-6754bdda-2fc8-4e7a-b1bf-78700080f6ba service nova] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Updated VIF entry in instance network info cache for port d540d8c6-c40d-45db-a88e-e9b062d033fb. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 00:59:31.446686 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-fe242eb0-bda9-49b5-bae6-e2940e844537 req-6754bdda-2fc8-4e7a-b1bf-78700080f6ba service nova] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Updating instance_info_cache with network_info: [{"id": "d540d8c6-c40d-45db-a88e-e9b062d033fb", "address": "fa:16:3e:ca:a8:31", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd540d8c6-c4", "ovs_interfaceid": "d540d8c6-c40d-45db-a88e-e9b062d033fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:59:31.477240 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '84e218b589ef4968828db0c740eaa72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ee6b376bb14dffb5664085cca58288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 00:59:31.495347 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 00:59:31.858615 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 00:59:31.940755 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Successfully created port: 4bd7989d-5591-41bb-a6e4-29c3a6aa27de {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 00:59:31.947651 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:31.949116 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:59:31.950796 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fe242eb0-bda9-49b5-bae6-e2940e844537 req-6754bdda-2fc8-4e7a-b1bf-78700080f6ba service nova] Releasing lock "refresh_cache-d988b526-836d-48b8-a381-1f7679caf41d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:59:32.160314 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 00:59:32.170409 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.startup = manual
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.port = 0
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 00:59:32.175866 np0000001577 nova-compute[98319]: # END RECORD
May 28 00:59:32.175866 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.startup = manual
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.port = 0
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 00:59:32.183502 np0000001577 nova-compute[98319]: # END RECORD
May 28 00:59:32.183502 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:32.191904 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:32.197394 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:32.207724 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:32.207724 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:32.207724 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:32.207724 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:32.207724 np0000001577 nova-compute[98319]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:32.207724 np0000001577 nova-compute[98319]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:32.207724 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:59:32.207997 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:32.207997 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:32.207997 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:32.207997 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:32.207997 np0000001577 nova-compute[98319]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:32.207997 np0000001577 nova-compute[98319]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:32.207997 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:59:32.213117 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:32.213117 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:32.213117 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:32.213117 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:32.213117 np0000001577 nova-compute[98319]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:32.213117 np0000001577 nova-compute[98319]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:32.213117 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:59:32.213117 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:32.213117 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:32.213117 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:32.213117 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:32.213117 np0000001577 nova-compute[98319]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:32.213117 np0000001577 nova-compute[98319]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:32.213117 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:59:32.221602 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:32.251743 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546, portal: 192.168.50.100,3260]
May 28 00:59:32.251743 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546, portal: 192.168.50.100,3260] successful.
May 28 00:59:32.251743 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:32.262690 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:32.270503 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546, portal: 192.168.40.100,3260]
May 28 00:59:32.270503 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546, portal: 192.168.40.100,3260] successful.
May 28 00:59:32.270503 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:32.283374 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:32.283374 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:32.283374 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:32.283374 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:32.283374 np0000001577 nova-compute[98319]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:32.283374 np0000001577 nova-compute[98319]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:32.283374 np0000001577 nova-compute[98319]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546 (non-flash)
May 28 00:59:32.283374 np0000001577 nova-compute[98319]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546 (non-flash)
May 28 00:59:32.283374 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:59:32.283374 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:32.283374 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:32.283374 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:32.283374 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:32.283374 np0000001577 nova-compute[98319]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:32.283374 np0000001577 nova-compute[98319]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:32.283374 np0000001577 nova-compute[98319]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546 (non-flash)
May 28 00:59:32.283374 np0000001577 nova-compute[98319]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546 (non-flash)
May 28 00:59:32.283374 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:59:32.283798 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:59:32.283873 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 00:59:32.284918 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:32.285502 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] HCTL ('11', '-', '-', 0) found on session 25 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 00:59:32.285715 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 00:59:32.308091 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Searching for a device in session 25 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 00:59:32.308091 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ba3ca79b-44f2-41fe-9399-fac706396546', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 00:59:32.311945 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:32.311945 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:32.311945 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:32.311945 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:32.311945 np0000001577 nova-compute[98319]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:32.311945 np0000001577 nova-compute[98319]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:32.311945 np0000001577 nova-compute[98319]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546 (non-flash)
May 28 00:59:32.311945 np0000001577 nova-compute[98319]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546 (non-flash)
May 28 00:59:32.311945 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:59:32.312242 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:32.312242 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:32.312242 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:32.312242 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:32.312242 np0000001577 nova-compute[98319]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:32.312242 np0000001577 nova-compute[98319]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:32.312242 np0000001577 nova-compute[98319]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546 (non-flash)
May 28 00:59:32.312242 np0000001577 nova-compute[98319]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546 (non-flash)
May 28 00:59:32.312242 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:59:32.312598 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.178s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:59:32.312598 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 00:59:32.313412 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] HCTL ('12', '-', '-', 0) found on session 26 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 00:59:32.313511 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 00:59:32.331412 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Searching for a device in session 26 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 00:59:32.331412 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba3ca79b-44f2-41fe-9399-fac706396546', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 00:59:32.342525 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "d09e5674-c5ab-4ace-9952-554361002541" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:32.342748 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d09e5674-c5ab-4ace-9952-554361002541" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:32.343002 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Attaching volume 7734b529-89b2-424a-b025-86b7042d9da8 to /dev/vdb
May 28 00:59:32.364088 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 00:59:32.415960 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:59:32.447105 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 00:59:32.452937 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 00:59:32.476815 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:32.497280 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:59:32.497280 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:59:32.497372 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:59:32.497744 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 00:59:32.499939 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:59:32.510307 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c523959f-d194-4ed1-b312-aa03f25aaf87 req-38939ca9-52a7-411a-8c96-39f25df4c11f service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Received event network-vif-plugged-0d344ede-14be-4d59-b796-097c682389f9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:32.513251 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c523959f-d194-4ed1-b312-aa03f25aaf87 req-38939ca9-52a7-411a-8c96-39f25df4c11f service nova] Acquiring lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:32.518251 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c523959f-d194-4ed1-b312-aa03f25aaf87 req-38939ca9-52a7-411a-8c96-39f25df4c11f service nova] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:32.518481 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c523959f-d194-4ed1-b312-aa03f25aaf87 req-38939ca9-52a7-411a-8c96-39f25df4c11f service nova] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:32.518702 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c523959f-d194-4ed1-b312-aa03f25aaf87 req-38939ca9-52a7-411a-8c96-39f25df4c11f service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Processing event network-vif-plugged-0d344ede-14be-4d59-b796-097c682389f9 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 00:59:32.520177 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c523959f-d194-4ed1-b312-aa03f25aaf87 req-38939ca9-52a7-411a-8c96-39f25df4c11f service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Received event network-vif-plugged-0d344ede-14be-4d59-b796-097c682389f9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:32.520177 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c523959f-d194-4ed1-b312-aa03f25aaf87 req-38939ca9-52a7-411a-8c96-39f25df4c11f service nova] Acquiring lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:32.520508 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 00:59:32.521243 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c523959f-d194-4ed1-b312-aa03f25aaf87 req-38939ca9-52a7-411a-8c96-39f25df4c11f service nova] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:32.521403 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c523959f-d194-4ed1-b312-aa03f25aaf87 req-38939ca9-52a7-411a-8c96-39f25df4c11f service nova] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:32.521782 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c523959f-d194-4ed1-b312-aa03f25aaf87 req-38939ca9-52a7-411a-8c96-39f25df4c11f service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] No waiting events found dispatching network-vif-plugged-0d344ede-14be-4d59-b796-097c682389f9 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:59:32.522011 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-c523959f-d194-4ed1-b312-aa03f25aaf87 req-38939ca9-52a7-411a-8c96-39f25df4c11f service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Received unexpected event network-vif-plugged-0d344ede-14be-4d59-b796-097c682389f9 for instance with vm_state building and task_state spawning.
May 28 00:59:32.532594 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929972.5320742, 2d2183ad-dbdb-4525-b678-39b72c7ab85d => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:59:32.533489 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] VM Resumed (Lifecycle Event)
May 28 00:59:32.533489 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 00:59:32.538182 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 00:59:32.539169 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 00:59:32.540502 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Instance spawned successfully.
May 28 00:59:32.541141 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 00:59:32.550331 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 00:59:32.552008 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe07:50fa', 'fe80::349a:eff:fe88:15e5', 'fe80::fc16:3eff:fe75:1c46', 'fe80::8c3:73ff:fe68:9ea1', 'fe80::fc16:3eff:fe85:df78', 'fe80::3834:39ff:fe20:36ec', 'fe80::fc16:3eff:fef0:246e', 'fe80::fc16:3eff:fe92:da8f', 'fe80::348c:26ff:feba:4aeb', 'fe80::fc16:3eff:feca:a831', 'fe80::fc16:3eff:fe3e:2329', 'fe80::e8d7:d3ff:fe11:4890', 'fe80::fc16:3eff:fe72:df47', 'fe80::fc16:3eff:febd:1fa1', 'fe80::743e:7eff:fe2c:709c'] 
May 28 00:59:32.552138 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 00:59:32.555288 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 00:59:32.555288 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:59:32.555288 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Updating existing volume attachment record: a958f061-9fa3-429a-b96c-4c7b0401649f {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 00:59:32.686063 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Successfully updated port: 4bd7989d-5591-41bb-a6e4-29c3a6aa27de {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 00:59:32.760875 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e0784754-7881-40ea-a5c8-002c47b01927 req-3f45b690-f952-4eb3-b7f6-454586e8becf service nova] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Received event network-changed-4bd7989d-5591-41bb-a6e4-29c3a6aa27de {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:32.762533 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e0784754-7881-40ea-a5c8-002c47b01927 req-3f45b690-f952-4eb3-b7f6-454586e8becf service nova] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Refreshing instance network info cache due to event network-changed-4bd7989d-5591-41bb-a6e4-29c3a6aa27de. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:59:32.762533 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e0784754-7881-40ea-a5c8-002c47b01927 req-3f45b690-f952-4eb3-b7f6-454586e8becf service nova] Acquiring lock "refresh_cache-f2b64af8-9a7b-4726-b298-cf9d2cb24498" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:59:32.762756 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e0784754-7881-40ea-a5c8-002c47b01927 req-3f45b690-f952-4eb3-b7f6-454586e8becf service nova] Acquired lock "refresh_cache-f2b64af8-9a7b-4726-b298-cf9d2cb24498" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:59:32.762756 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-e0784754-7881-40ea-a5c8-002c47b01927 req-3f45b690-f952-4eb3-b7f6-454586e8becf service nova] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Refreshing network info cache for port 4bd7989d-5591-41bb-a6e4-29c3a6aa27de {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:59:33.023238 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:33.023782 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:33.023782 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:33.023782 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Auditing locally available compute resources for np0000001577 (node: np0000001577) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 00:59:33.039408 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:33.046680 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:59:33.048278 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-44d69cff-f516-4dc5-9393-f1f69fab35fc tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lock "7d1add06-aef9-420b-b30e-8f881fcc968c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.729s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:33.050349 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:33.050472 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:33.050761 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:33.050963 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:33.051209 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:33.051432 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:33.134231 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 00:59:33.134231 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8', 'iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7734b529-89b2-424a-b025-86b7042d9da8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:59:33.134231 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:59:33.137313 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 00:59:33.193106 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "refresh_cache-f2b64af8-9a7b-4726-b298-cf9d2cb24498" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:59:33.265370 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-e0784754-7881-40ea-a5c8-002c47b01927 req-3f45b690-f952-4eb3-b7f6-454586e8becf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:33.351804 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-e0784754-7881-40ea-a5c8-002c47b01927 req-3f45b690-f952-4eb3-b7f6-454586e8becf service nova] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:59:33.383433 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 00:59:33.384810 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 00:59:33.385102 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Creating image(s)
May 28 00:59:33.385705 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:33.385882 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "/opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:33.386759 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "/opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:33.387394 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:59:33.391449 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:59:33.392828 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:33.430095 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Acquiring lock "7d1add06-aef9-420b-b30e-8f881fcc968c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:33.432066 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lock "7d1add06-aef9-420b-b30e-8f881fcc968c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:33.432511 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Acquiring lock "7d1add06-aef9-420b-b30e-8f881fcc968c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:33.432754 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lock "7d1add06-aef9-420b-b30e-8f881fcc968c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:33.432907 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lock "7d1add06-aef9-420b-b30e-8f881fcc968c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:33.438216 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Terminating instance
May 28 00:59:33.504290 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-e0784754-7881-40ea-a5c8-002c47b01927 req-3f45b690-f952-4eb3-b7f6-454586e8becf service nova] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:59:33.505403 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.113s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:33.506339 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:33.506710 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:33.508143 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:59:33.509930 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:59:33.510266 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:33.553214 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 00:59:33.557138 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Took 10.41 seconds to spawn the instance on the hypervisor.
May 28 00:59:33.557389 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:33.598337 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.088s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:33.601093 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:33.645831 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498/disk 1073741824" returned: 0 in 0.047s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:33.647148 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.140s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:33.647148 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:33.733788 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:33.734245 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 00:59:33.734535 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:33.820448 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:33.821303 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Cannot resize image /opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 00:59:33.821865 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 00:59:33.822137 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Ensure instance console log exists: /opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 00:59:33.822532 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:33.822824 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:33.823000 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:33.945566 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 00:59:33.986992 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:33.994474 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:34.007163 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e0784754-7881-40ea-a5c8-002c47b01927 req-3f45b690-f952-4eb3-b7f6-454586e8becf service nova] Releasing lock "refresh_cache-f2b64af8-9a7b-4726-b298-cf9d2cb24498" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:59:34.008985 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquired lock "refresh_cache-f2b64af8-9a7b-4726-b298-cf9d2cb24498" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:59:34.009070 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 00:59:34.011534 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:34.014028 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:34.041574 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:34.041574 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:34.077038 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Took 17.73 seconds to build instance.
May 28 00:59:34.162214 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Found WWN 3300000007204ce2b for multipath device dm-2 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 00:59:34.162564 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:59:34.162795 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] <== connect_volume: return (3044ms) {'type': 'block', 'scsi_wwn': '3300000007204ce2b', 'path': '/dev/dm-2', 'multipath_id': '3300000007204ce2b'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:59:34.162882 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007204ce2b', 'path': '/dev/dm-2', 'multipath_id': '3300000007204ce2b'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 00:59:34.163929 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.029s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:59:34.163929 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8', 'iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7734b529-89b2-424a-b025-86b7042d9da8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 00:59:34.171617 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lazy-loading 'flavor' on Instance uuid a8a28bb4-c3ea-4fb9-9130-1e8239191c5b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:34.180310 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:59:34.180879 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:59:34.181239 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:59:34.182890 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 00:59:34.182998 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:59:34.183222 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 00:59:34.195499 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 00:59:34.195499 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:34.201120 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 00:59:34.201120 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:34.212572 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8] added
May 28 00:59:34.212572 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 00:59:34.212572 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:59:34.212572 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:59:34.212572 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:59:34.212572 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:59:34.212572 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:34.212835 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 00:59:34.213077 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0316(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 00:59:34.213493 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 00:59:34.215266 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8] added
May 28 00:59:34.215266 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 00:59:34.215266 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:59:34.215266 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:59:34.215266 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:59:34.215266 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:59:34.215266 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:34.215451 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 00:59:34.215611 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0324(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 00:59:34.216159 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 00:59:34.268953 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:34.278723 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:34.313616 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999577916000135 future=<Future at 0x7c984c69dc10 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:59:34.318618 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.993781728000158 future=<Future at 0x7c984c69dc10 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:59:34.318618 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d1add06-aef9-420b-b30e-8f881fcc968c/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:34.318843 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.993021446000057 future=<Future at 0x7c984c69dc10 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:59:34.334209 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Instance destroyed successfully.
May 28 00:59:34.336632 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lazy-loading 'resources' on Instance uuid 7d1add06-aef9-420b-b30e-8f881fcc968c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:34.422996 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d1add06-aef9-420b-b30e-8f881fcc968c/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:34.424390 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d1add06-aef9-420b-b30e-8f881fcc968c/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:34.535587 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d1add06-aef9-420b-b30e-8f881fcc968c/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:34.536837 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 00:59:34.539896 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:34.581431 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0552aa71-4e1d-4ac2-8d54-c7993ff2f550 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.243s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:34.593455 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-44ce661a-7b6d-448c-9ffb-290e5d9cf41d req-463cdb91-152b-42d1-a138-335f6995e0c8 service nova] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Received event network-vif-unplugged-c8933b8a-f3aa-4393-9921-109f8e9fd5e9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:34.595392 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-44ce661a-7b6d-448c-9ffb-290e5d9cf41d req-463cdb91-152b-42d1-a138-335f6995e0c8 service nova] Acquiring lock "7d1add06-aef9-420b-b30e-8f881fcc968c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:34.595654 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-44ce661a-7b6d-448c-9ffb-290e5d9cf41d req-463cdb91-152b-42d1-a138-335f6995e0c8 service nova] Lock "7d1add06-aef9-420b-b30e-8f881fcc968c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:34.596942 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-44ce661a-7b6d-448c-9ffb-290e5d9cf41d req-463cdb91-152b-42d1-a138-335f6995e0c8 service nova] Lock "7d1add06-aef9-420b-b30e-8f881fcc968c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:34.598415 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-44ce661a-7b6d-448c-9ffb-290e5d9cf41d req-463cdb91-152b-42d1-a138-335f6995e0c8 service nova] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] No waiting events found dispatching network-vif-unplugged-c8933b8a-f3aa-4393-9921-109f8e9fd5e9 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:59:34.598641 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-44ce661a-7b6d-448c-9ffb-290e5d9cf41d req-463cdb91-152b-42d1-a138-335f6995e0c8 service nova] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Received event network-vif-unplugged-c8933b8a-f3aa-4393-9921-109f8e9fd5e9 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:59:34.598799 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-44ce661a-7b6d-448c-9ffb-290e5d9cf41d req-463cdb91-152b-42d1-a138-335f6995e0c8 service nova] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Received event network-vif-unplugged-c8933b8a-f3aa-4393-9921-109f8e9fd5e9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:34.598997 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-44ce661a-7b6d-448c-9ffb-290e5d9cf41d req-463cdb91-152b-42d1-a138-335f6995e0c8 service nova] Acquiring lock "7d1add06-aef9-420b-b30e-8f881fcc968c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:34.599202 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-44ce661a-7b6d-448c-9ffb-290e5d9cf41d req-463cdb91-152b-42d1-a138-335f6995e0c8 service nova] Lock "7d1add06-aef9-420b-b30e-8f881fcc968c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:34.599395 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-44ce661a-7b6d-448c-9ffb-290e5d9cf41d req-463cdb91-152b-42d1-a138-335f6995e0c8 service nova] Lock "7d1add06-aef9-420b-b30e-8f881fcc968c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:34.599576 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-44ce661a-7b6d-448c-9ffb-290e5d9cf41d req-463cdb91-152b-42d1-a138-335f6995e0c8 service nova] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] No waiting events found dispatching network-vif-unplugged-c8933b8a-f3aa-4393-9921-109f8e9fd5e9 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:59:34.599732 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-44ce661a-7b6d-448c-9ffb-290e5d9cf41d req-463cdb91-152b-42d1-a138-335f6995e0c8 service nova] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Received event network-vif-unplugged-c8933b8a-f3aa-4393-9921-109f8e9fd5e9 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:59:34.606493 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:59:34.631357 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:34.632041 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:34.675270 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Attempting to attach volume ba3ca79b-44f2-41fe-9399-fac706396546 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 00:59:34.685631 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] attach device xml: <disk type="block" device="disk">
May 28 00:59:34.685631 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 00:59:34.685631 np0000001577 nova-compute[98319]:   <alias name="ua-ba3ca79b-44f2-41fe-9399-fac706396546"/>
May 28 00:59:34.685631 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-2"/>
May 28 00:59:34.685631 np0000001577 nova-compute[98319]:   <target dev="vdc" bus="virtio"/>
May 28 00:59:34.685631 np0000001577 nova-compute[98319]:   <serial>ba3ca79b-44f2-41fe-9399-fac706396546</serial>
May 28 00:59:34.685631 np0000001577 nova-compute[98319]: </disk>
May 28 00:59:34.685631 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 00:59:34.688359 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7e211901-f2ab-4d87-b3e7-c3ce1a9f3cc6 req-60ca1a9c-6cda-48d2-9696-0be3ed0457c1 service nova] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Received event network-vif-plugged-c023bfc4-a99c-4a75-81f2-981583584dcd {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:34.690627 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7e211901-f2ab-4d87-b3e7-c3ce1a9f3cc6 req-60ca1a9c-6cda-48d2-9696-0be3ed0457c1 service nova] Acquiring lock "b73b73f0-79a5-448c-a374-bbb182da41a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:34.691057 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7e211901-f2ab-4d87-b3e7-c3ce1a9f3cc6 req-60ca1a9c-6cda-48d2-9696-0be3ed0457c1 service nova] Lock "b73b73f0-79a5-448c-a374-bbb182da41a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:34.691326 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7e211901-f2ab-4d87-b3e7-c3ce1a9f3cc6 req-60ca1a9c-6cda-48d2-9696-0be3ed0457c1 service nova] Lock "b73b73f0-79a5-448c-a374-bbb182da41a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:34.693152 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7e211901-f2ab-4d87-b3e7-c3ce1a9f3cc6 req-60ca1a9c-6cda-48d2-9696-0be3ed0457c1 service nova] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Processing event network-vif-plugged-c023bfc4-a99c-4a75-81f2-981583584dcd {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 00:59:34.693923 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Instance event wait completed in 6 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 00:59:34.704983 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929974.7045262, b73b73f0-79a5-448c-a374-bbb182da41a9 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:59:34.707864 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 00:59:34.710646 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] VM Resumed (Lifecycle Event)
May 28 00:59:34.713967 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Instance spawned successfully.
May 28 00:59:34.714239 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 00:59:34.736700 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:34.739604 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:34.841875 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-891324810',display_name='tempest-DeleteServersTestJSON-server-891324810',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-deleteserverstestjson-server-891324810',id=13,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T00:59:20Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8756cc804e134c1385157f89df922160',ramdisk_id='',reservation_id='r-5u2fa43v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1389929058',owner_user_name='tempest-DeleteServersTestJSON-1389929058-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T00:59:20Z,user_data=None,user_id='3fef0b514622468f82d2b1f406d0d24d',uuid=7d1add06-aef9-420b-b30e-8f881fcc968c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8933b8a-f3aa-4393-9921-109f8e9fd5e9", "address": "fa:16:3e:92:da:8f", "network": {"id": "48717d5b-288f-4306-b7b5-70424d2d3284", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1352707990-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8756cc804e134c1385157f89df922160", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8933b8a-f3", "ovs_interfaceid": "c8933b8a-f3aa-4393-9921-109f8e9fd5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 00:59:34.842659 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Converting VIF {"id": "c8933b8a-f3aa-4393-9921-109f8e9fd5e9", "address": "fa:16:3e:92:da:8f", "network": {"id": "48717d5b-288f-4306-b7b5-70424d2d3284", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1352707990-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8756cc804e134c1385157f89df922160", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8933b8a-f3", "ovs_interfaceid": "c8933b8a-f3aa-4393-9921-109f8e9fd5e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:59:34.844559 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:da:8f,bridge_name='br-int',has_traffic_filtering=True,id=c8933b8a-f3aa-4393-9921-109f8e9fd5e9,network=Network(48717d5b-288f-4306-b7b5-70424d2d3284),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8933b8a-f3') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:59:34.844559 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:da:8f,bridge_name='br-int',has_traffic_filtering=True,id=c8933b8a-f3aa-4393-9921-109f8e9fd5e9,network=Network(48717d5b-288f-4306-b7b5-70424d2d3284),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8933b8a-f3') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 00:59:34.845984 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:34.850808 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:34.853004 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:34.867160 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:34.868892 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8933b8a-f3, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:34.874635 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:34.874635 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:59:34.883752 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:34.887267 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:34.887747 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=001dc1f2-0e5c-4206-8b46-db84aa62f4cd) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:34.890505 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:34.891902 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:59:34.898425 np0000001577 nova-compute[98319]: INFO os_vif [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:da:8f,bridge_name='br-int',has_traffic_filtering=True,id=c8933b8a-f3aa-4393-9921-109f8e9fd5e9,network=Network(48717d5b-288f-4306-b7b5-70424d2d3284),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8933b8a-f3')
May 28 00:59:34.899293 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 00:59:34.899824 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033', 'iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'af0408f8-b906-446a-bec3-429706d03033', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:59:34.900018 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:59:34.967157 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:34.970396 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:35.076271 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-878d5423-6827-4b48-959c-7d39c4164b3c req-2ad0a323-0117-4d83-b53a-e04fde954e82 service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Received event network-changed-0d344ede-14be-4d59-b796-097c682389f9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:35.077237 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-878d5423-6827-4b48-959c-7d39c4164b3c req-2ad0a323-0117-4d83-b53a-e04fde954e82 service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Refreshing instance network info cache due to event network-changed-0d344ede-14be-4d59-b796-097c682389f9. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:59:35.077237 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-878d5423-6827-4b48-959c-7d39c4164b3c req-2ad0a323-0117-4d83-b53a-e04fde954e82 service nova] Acquiring lock "refresh_cache-2d2183ad-dbdb-4525-b678-39b72c7ab85d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:59:35.077237 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-878d5423-6827-4b48-959c-7d39c4164b3c req-2ad0a323-0117-4d83-b53a-e04fde954e82 service nova] Acquired lock "refresh_cache-2d2183ad-dbdb-4525-b678-39b72c7ab85d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:59:35.077237 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-878d5423-6827-4b48-959c-7d39c4164b3c req-2ad0a323-0117-4d83-b53a-e04fde954e82 service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Refreshing network info cache for port 0d344ede-14be-4d59-b796-097c682389f9 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:59:35.085254 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:35.086137 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:35.149166 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Updating instance_info_cache with network_info: [{"id": "4bd7989d-5591-41bb-a6e4-29c3a6aa27de", "address": "fa:16:3e:12:3f:51", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bd7989d-55", "ovs_interfaceid": "4bd7989d-5591-41bb-a6e4-29c3a6aa27de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:59:35.169434 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:35.174132 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:35.214664 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:35.215052 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 00:59:35.216737 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 00:59:35.218598 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.startup = manual
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.port = 0
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 00:59:35.229434 np0000001577 nova-compute[98319]: # END RECORD
May 28 00:59:35.229434 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:35.231305 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:35.231305 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:35.231305 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:35.231305 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:35.231305 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:35.231305 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.startup = manual
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.port = 0
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 00:59:35.239862 np0000001577 nova-compute[98319]: # END RECORD
May 28 00:59:35.239862 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:35.250168 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:35.258417 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:35.275044 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:35.278975 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:35.292995 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:35.292995 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:35.292995 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:35.292995 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:35.292995 np0000001577 nova-compute[98319]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:35.292995 np0000001577 nova-compute[98319]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:35.292995 np0000001577 nova-compute[98319]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546 (non-flash)
May 28 00:59:35.292995 np0000001577 nova-compute[98319]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546 (non-flash)
May 28 00:59:35.292995 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:59:35.293264 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:35.293264 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:35.293264 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:35.293264 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:35.293264 np0000001577 nova-compute[98319]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:35.293264 np0000001577 nova-compute[98319]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:35.293264 np0000001577 nova-compute[98319]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546 (non-flash)
May 28 00:59:35.293264 np0000001577 nova-compute[98319]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546 (non-flash)
May 28 00:59:35.293264 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:59:35.294085 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:35.294085 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:35.294085 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:35.294085 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:35.294085 np0000001577 nova-compute[98319]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:35.294085 np0000001577 nova-compute[98319]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:35.294085 np0000001577 nova-compute[98319]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546 (non-flash)
May 28 00:59:35.294085 np0000001577 nova-compute[98319]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546 (non-flash)
May 28 00:59:35.294085 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:59:35.294085 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:35.294085 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:35.294085 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:35.294085 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:35.294085 np0000001577 nova-compute[98319]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:35.294085 np0000001577 nova-compute[98319]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:35.294085 np0000001577 nova-compute[98319]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546 (non-flash)
May 28 00:59:35.294085 np0000001577 nova-compute[98319]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546 (non-flash)
May 28 00:59:35.294085 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:59:35.339740 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8, portal: 192.168.50.100,3260]
May 28 00:59:35.339740 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8, portal: 192.168.50.100,3260] successful.
May 28 00:59:35.339740 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:35.354370 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:35.364064 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8, portal: 192.168.40.100,3260]
May 28 00:59:35.364064 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8, portal: 192.168.40.100,3260] successful.
May 28 00:59:35.364064 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:35.376332 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:35.376857 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:35.376857 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:35.376857 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:35.376857 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:35.376857 np0000001577 nova-compute[98319]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:35.376857 np0000001577 nova-compute[98319]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:35.376857 np0000001577 nova-compute[98319]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546 (non-flash)
May 28 00:59:35.376857 np0000001577 nova-compute[98319]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546 (non-flash)
May 28 00:59:35.376857 np0000001577 nova-compute[98319]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:35.376857 np0000001577 nova-compute[98319]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:35.376857 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:59:35.377238 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:35.377238 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:35.377238 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:35.377238 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:35.377238 np0000001577 nova-compute[98319]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:35.377238 np0000001577 nova-compute[98319]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:35.377238 np0000001577 nova-compute[98319]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546 (non-flash)
May 28 00:59:35.377238 np0000001577 nova-compute[98319]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546 (non-flash)
May 28 00:59:35.377238 np0000001577 nova-compute[98319]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:35.377238 np0000001577 nova-compute[98319]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:35.377238 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:59:35.379575 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.197s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:59:35.379575 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 00:59:35.380003 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] HCTL ('13', '-', '-', 0) found on session 27 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 00:59:35.380840 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 00:59:35.405335 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:35.405335 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:35.405335 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:35.405335 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:35.405335 np0000001577 nova-compute[98319]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:35.405335 np0000001577 nova-compute[98319]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:35.405335 np0000001577 nova-compute[98319]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546 (non-flash)
May 28 00:59:35.405335 np0000001577 nova-compute[98319]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546 (non-flash)
May 28 00:59:35.405335 np0000001577 nova-compute[98319]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:35.405335 np0000001577 nova-compute[98319]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:35.405335 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:59:35.408343 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:35.408343 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:35.408343 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:35.408343 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:35.408343 np0000001577 nova-compute[98319]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:35.408343 np0000001577 nova-compute[98319]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:35.408343 np0000001577 nova-compute[98319]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546 (non-flash)
May 28 00:59:35.408343 np0000001577 nova-compute[98319]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546 (non-flash)
May 28 00:59:35.408343 np0000001577 nova-compute[98319]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:35.408343 np0000001577 nova-compute[98319]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:35.408343 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:59:35.408343 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.223s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:59:35.408343 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 00:59:35.418087 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:35.419377 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Searching for a device in session 27 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 00:59:35.420211 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7734b529-89b2-424a-b025-86b7042d9da8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 00:59:35.422515 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] HCTL ('14', '-', '-', 0) found on session 28 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 00:59:35.422515 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 00:59:35.427676 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-9 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 00:59:35.434578 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a28bb4-c3ea-4fb9-9130-1e8239191c5b/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:35.459149 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Searching for a device in session 28 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 00:59:35.459508 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7734b529-89b2-424a-b025-86b7042d9da8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 00:59:35.559383 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a28bb4-c3ea-4fb9-9130-1e8239191c5b/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:35.559890 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a28bb4-c3ea-4fb9-9130-1e8239191c5b/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:35.591247 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-878d5423-6827-4b48-959c-7d39c4164b3c req-2ad0a323-0117-4d83-b53a-e04fde954e82 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:35.653010 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Releasing lock "refresh_cache-f2b64af8-9a7b-4726-b298-cf9d2cb24498" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:59:35.653602 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Instance network_info: |[{"id": "4bd7989d-5591-41bb-a6e4-29c3a6aa27de", "address": "fa:16:3e:12:3f:51", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bd7989d-55", "ovs_interfaceid": "4bd7989d-5591-41bb-a6e4-29c3a6aa27de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 00:59:35.655652 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Start _get_guest_xml network_info=[{"id": "4bd7989d-5591-41bb-a6e4-29c3a6aa27de", "address": "fa:16:3e:12:3f:51", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bd7989d-55", "ovs_interfaceid": "4bd7989d-5591-41bb-a6e4-29c3a6aa27de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 00:59:35.656256 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a28bb4-c3ea-4fb9-9130-1e8239191c5b/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:35.656614 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 00:59:35.656785 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-2 (vdc) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 00:59:35.661575 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:35.661575 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 00:59:35.661575 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-2083714749', uuid='f2b64af8-9a7b-4726-b298-cf9d2cb24498'), owner=OwnerMeta(userid='84e218b589ef4968828db0c740eaa72b', username='tempest-ServerActionsTestOtherA-1279266727-project-member', projectid='73ee6b376bb14dffb5664085cca58288', projectname='tempest-ServerActionsTestOtherA-1279266727'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4bd7989d-5591-41bb-a6e4-29c3a6aa27de", "address": "fa:16:3e:12:3f:51", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bd7989d-55", "ovs_interfaceid": "4bd7989d-5591-41bb-a6e4-29c3a6aa27de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779929975.6601207) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 00:59:35.679961 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 00:59:35.681953 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 00:59:35.684159 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 00:59:35.685243 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 00:59:35.686261 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 00:59:35.687018 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 00:59:35.687226 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 00:59:35.687316 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 00:59:35.687436 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 00:59:35.687536 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 00:59:35.687681 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 00:59:35.687887 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 00:59:35.688028 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 00:59:35.688160 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 00:59:35.688354 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 00:59:35.688615 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 00:59:35.700307 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T00:59:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2083714749',display_name='tempest-ServerActionsTestOtherA-server-2083714749',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serveractionstestothera-server-2083714749',id=18,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOEhInnYH8OIPIS+AoDN91vRrTIl7emQTWVv1MQvwyvOos+qsDslhGKWhjOWQnKEu789RlRl8BiqEdHw4m/ZZapwhCdnQdK7FOovVNbbHnETkK3QhUrm9lcqluHt42QLQ==',key_name='tempest-keypair-1959255291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73ee6b376bb14dffb5664085cca58288',ramdisk_id='',reservation_id='r-y1a0eolr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1279266727',owner_user_name='tempest-ServerActionsTestOtherA-1279266727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:59:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84e218b589ef4968828db0c740eaa72b',uuid=f2b64af8-9a7b-4726-b298-cf9d2cb24498,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bd7989d-5591-41bb-a6e4-29c3a6aa27de", "address": "fa:16:3e:12:3f:51", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bd7989d-55", "ovs_interfaceid": "4bd7989d-5591-41bb-a6e4-29c3a6aa27de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 00:59:35.700615 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Converting VIF {"id": "4bd7989d-5591-41bb-a6e4-29c3a6aa27de", "address": "fa:16:3e:12:3f:51", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bd7989d-55", "ovs_interfaceid": "4bd7989d-5591-41bb-a6e4-29c3a6aa27de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:59:35.701348 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:3f:51,bridge_name='br-int',has_traffic_filtering=True,id=4bd7989d-5591-41bb-a6e4-29c3a6aa27de,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bd7989d-55') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:59:35.701899 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lazy-loading 'pci_devices' on Instance uuid f2b64af8-9a7b-4726-b298-cf9d2cb24498 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:35.726627 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 00:59:35.745689 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Took 15.17 seconds to spawn the instance on the hypervisor.
May 28 00:59:35.745840 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:35.759687 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:35.760573 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:35.858127 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:35.862516 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebae9109-a600-4788-9008-74a8c320b803/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:35.946061 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebae9109-a600-4788-9008-74a8c320b803/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:35.946427 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebae9109-a600-4788-9008-74a8c320b803/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:35.997530 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:36.007029 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-878d5423-6827-4b48-959c-7d39c4164b3c req-2ad0a323-0117-4d83-b53a-e04fde954e82 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:36.035644 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebae9109-a600-4788-9008-74a8c320b803/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:36.037947 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 00:59:36.039316 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:36.083572 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "env LANG=C uptime" returned: 0 in 0.044s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:36.084004 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Hypervisor/Node resource view: name=np0000001577 free_ram=12160MB free_disk=74.5182113647461GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 00:59:36.084164 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:36.084685 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:36.188870 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 00:59:36.197977 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-878d5423-6827-4b48-959c-7d39c4164b3c req-2ad0a323-0117-4d83-b53a-e04fde954e82 service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Updated VIF entry in instance network info cache for port 0d344ede-14be-4d59-b796-097c682389f9. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 00:59:36.198688 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-878d5423-6827-4b48-959c-7d39c4164b3c req-2ad0a323-0117-4d83-b53a-e04fde954e82 service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Updating instance_info_cache with network_info: [{"id": "0d344ede-14be-4d59-b796-097c682389f9", "address": "fa:16:3e:bd:1f:a1", "network": {"id": "8dc9ea08-c48e-4321-b325-d1191e9557b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1143389599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78d410e4c6ea40ef87f92e84f362fa43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d344ede-14", "ovs_interfaceid": "0d344ede-14be-4d59-b796-097c682389f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:59:36.213948 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] End _get_guest_xml xml=<domain type="qemu">
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:   <uuid>f2b64af8-9a7b-4726-b298-cf9d2cb24498</uuid>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:   <name>instance-00000012</name>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:   <metadata>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       <nova:name>tempest-ServerActionsTestOtherA-server-2083714749</nova:name>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 00:59:35</nova:creationTime>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       </nova:image>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:         <nova:user uuid="84e218b589ef4968828db0c740eaa72b">tempest-ServerActionsTestOtherA-1279266727-project-member</nova:user>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:         <nova:project uuid="73ee6b376bb14dffb5664085cca58288">tempest-ServerActionsTestOtherA-1279266727</nova:project>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:         <nova:port uuid="4bd7989d-5591-41bb-a6e4-29c3a6aa27de">
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:         </nova:port>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:   </metadata>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:     <system>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       <entry name="serial">f2b64af8-9a7b-4726-b298-cf9d2cb24498</entry>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       <entry name="uuid">f2b64af8-9a7b-4726-b298-cf9d2cb24498</entry>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:     </system>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:   <os>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:   </os>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:   <features>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:     <acpi/>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:     <tcg>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:     </tcg>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:   </features>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:   <devices>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498/disk"/>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:     </disk>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498/disk.config"/>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:     </disk>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:12:3f:51"/>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       <target dev="tap4bd7989d-55"/>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:     </interface>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498/console.log" append="off"/>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:     </serial>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:     <video>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:     </video>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:     </rng>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:     </memballoon>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:   </devices>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]: </domain>
May 28 00:59:36.213948 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 00:59:36.215641 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Preparing to wait for external event network-vif-plugged-4bd7989d-5591-41bb-a6e4-29c3a6aa27de {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 00:59:36.215641 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "f2b64af8-9a7b-4726-b298-cf9d2cb24498-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:36.215641 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "f2b64af8-9a7b-4726-b298-cf9d2cb24498-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:36.215641 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "f2b64af8-9a7b-4726-b298-cf9d2cb24498-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:36.215641 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T00:59:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2083714749',display_name='tempest-ServerActionsTestOtherA-server-2083714749',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serveractionstestothera-server-2083714749',id=18,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOEhInnYH8OIPIS+AoDN91vRrTIl7emQTWVv1MQvwyvOos+qsDslhGKWhjOWQnKEu789RlRl8BiqEdHw4m/ZZapwhCdnQdK7FOovVNbbHnETkK3QhUrm9lcqluHt42QLQ==',key_name='tempest-keypair-1959255291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73ee6b376bb14dffb5664085cca58288',ramdisk_id='',reservation_id='r-y1a0eolr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1279266727',owner_user_name='tempest-ServerActionsTestOtherA-1279266727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:59:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84e218b589ef4968828db0c740eaa72b',uuid=f2b64af8-9a7b-4726-b298-cf9d2cb24498,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bd7989d-5591-41bb-a6e4-29c3a6aa27de", "address": "fa:16:3e:12:3f:51", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bd7989d-55", "ovs_interfaceid": "4bd7989d-5591-41bb-a6e4-29c3a6aa27de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 00:59:36.215641 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Converting VIF {"id": "4bd7989d-5591-41bb-a6e4-29c3a6aa27de", "address": "fa:16:3e:12:3f:51", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bd7989d-55", "ovs_interfaceid": "4bd7989d-5591-41bb-a6e4-29c3a6aa27de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:59:36.216479 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:3f:51,bridge_name='br-int',has_traffic_filtering=True,id=4bd7989d-5591-41bb-a6e4-29c3a6aa27de,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bd7989d-55') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:59:36.216821 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:3f:51,bridge_name='br-int',has_traffic_filtering=True,id=4bd7989d-5591-41bb-a6e4-29c3a6aa27de,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bd7989d-55') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 00:59:36.218359 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:36.218671 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:36.218925 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 00:59:36.220035 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:36.220191 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3cb375e9-df6f-5457-86a5-5eb69bea86e4', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:36.221156 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:36.221632 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:59:36.222754 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:36.224888 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:36.225297 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4bd7989d-55, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:36.225347 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4bd7989d-55, col_values=(('qos', UUID('34320d3e-590d-440b-be54-4ad2e460d443')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:36.225489 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4bd7989d-55, col_values=(('external_ids', {'iface-id': '4bd7989d-5591-41bb-a6e4-29c3a6aa27de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:3f:51', 'vm-uuid': 'f2b64af8-9a7b-4726-b298-cf9d2cb24498'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:36.226353 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:36.228115 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:59:36.236669 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:36.237983 np0000001577 nova-compute[98319]: INFO os_vif [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:3f:51,bridge_name='br-int',has_traffic_filtering=True,id=4bd7989d-5591-41bb-a6e4-29c3a6aa27de,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bd7989d-55')
May 28 00:59:36.257852 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Took 22.51 seconds to build instance.
May 28 00:59:36.403521 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:36.403648 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:36.403775 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:36.403837 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:36.403970 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] No VIF found with MAC fa:16:3e:07:50:fa, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 00:59:36.701005 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-878d5423-6827-4b48-959c-7d39c4164b3c req-2ad0a323-0117-4d83-b53a-e04fde954e82 service nova] Releasing lock "refresh_cache-2d2183ad-dbdb-4525-b678-39b72c7ab85d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:59:36.762494 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1b04431b-bfdf-436b-9ee9-bb6a8616f6ea req-cf2949fd-ec11-4a14-a7a8-181c96ac2173 service nova] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Received event network-vif-plugged-c023bfc4-a99c-4a75-81f2-981583584dcd {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:36.765003 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8edd1ba4-3247-4ec2-ace8-145c2135175e tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "b73b73f0-79a5-448c-a374-bbb182da41a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.020s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:36.765667 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1b04431b-bfdf-436b-9ee9-bb6a8616f6ea req-cf2949fd-ec11-4a14-a7a8-181c96ac2173 service nova] Acquiring lock "b73b73f0-79a5-448c-a374-bbb182da41a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:36.765667 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1b04431b-bfdf-436b-9ee9-bb6a8616f6ea req-cf2949fd-ec11-4a14-a7a8-181c96ac2173 service nova] Lock "b73b73f0-79a5-448c-a374-bbb182da41a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:36.765763 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1b04431b-bfdf-436b-9ee9-bb6a8616f6ea req-cf2949fd-ec11-4a14-a7a8-181c96ac2173 service nova] Lock "b73b73f0-79a5-448c-a374-bbb182da41a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:36.765815 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1b04431b-bfdf-436b-9ee9-bb6a8616f6ea req-cf2949fd-ec11-4a14-a7a8-181c96ac2173 service nova] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] No waiting events found dispatching network-vif-plugged-c023bfc4-a99c-4a75-81f2-981583584dcd {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:59:36.765959 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-1b04431b-bfdf-436b-9ee9-bb6a8616f6ea req-cf2949fd-ec11-4a14-a7a8-181c96ac2173 service nova] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Received unexpected event network-vif-plugged-c023bfc4-a99c-4a75-81f2-981583584dcd for instance with vm_state active and task_state rescuing.
May 28 00:59:36.950965 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Rescuing
May 28 00:59:36.952561 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "refresh_cache-b73b73f0-79a5-448c-a374-bbb182da41a9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:59:36.952561 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquired lock "refresh_cache-b73b73f0-79a5-448c-a374-bbb182da41a9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:59:36.952561 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 00:59:37.144703 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 8bca25d8-071e-4b2d-960c-50582381cc75 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 00:59:37.144703 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance a8a28bb4-c3ea-4fb9-9130-1e8239191c5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 00:59:37.145156 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance ebae9109-a600-4788-9008-74a8c320b803 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 00:59:37.145156 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance d09e5674-c5ab-4ace-9952-554361002541 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 00:59:37.145156 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 7d1add06-aef9-420b-b30e-8f881fcc968c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 00:59:37.145156 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance d988b526-836d-48b8-a381-1f7679caf41d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 00:59:37.145156 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance dccaa2b7-3c00-45f9-bf40-1a8a15030825 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 00:59:37.145368 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance b73b73f0-79a5-448c-a374-bbb182da41a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 00:59:37.145368 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 2d2183ad-dbdb-4525-b678-39b72c7ab85d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 00:59:37.145457 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance f2b64af8-9a7b-4726-b298-cf9d2cb24498 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 00:59:37.145617 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 00:59:37.145734 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Final resource view: name=np0000001577 phys_ram=24030MB used_ram=2432MB phys_disk=95GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 00:59:36 up 31 min,  2 users,  load average: 9.57, 5.04, 2.32\n', 'num_instances': '10', 'num_vm_active': '9', 'num_task_None': '8', 'num_os_type_None': '10', 'num_proj_938c2829112843edb2054984e80ce7ad': '3', 'io_workload': '1', 'num_proj_07e72ea70b9147f68a0d66cd524ae614': '1', 'num_proj_6b80759164bf4465b0bd873db74c9c49': '1', 'num_task_deleting': '1', 'num_proj_8756cc804e134c1385157f89df922160': '1', 'num_proj_a3c5a1da6bb242e9a58cb82855897726': '2', 'num_proj_78d410e4c6ea40ef87f92e84f362fa43': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_73ee6b376bb14dffb5664085cca58288': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 00:59:37.208131 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Found WWN 3300000009522a530 for multipath device dm-3 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 00:59:37.208642 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:59:37.208884 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] <== connect_volume: return (4075ms) {'type': 'block', 'scsi_wwn': '3300000009522a530', 'path': '/dev/dm-3', 'multipath_id': '3300000009522a530'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:59:37.209059 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009522a530', 'path': '/dev/dm-3', 'multipath_id': '3300000009522a530'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 00:59:37.209518 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.309s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:59:37.209976 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033', 'iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'af0408f8-b906-446a-bec3-429706d03033', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 00:59:37.210156 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 00:59:37.211529 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lazy-loading 'flavor' on Instance uuid d09e5674-c5ab-4ace-9952-554361002541 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:37.241392 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:37.241392 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:37.241392 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:37.241392 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:37.241392 np0000001577 nova-compute[98319]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:37.241392 np0000001577 nova-compute[98319]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:37.241392 np0000001577 nova-compute[98319]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546 (non-flash)
May 28 00:59:37.241392 np0000001577 nova-compute[98319]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546 (non-flash)
May 28 00:59:37.241392 np0000001577 nova-compute[98319]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:37.241392 np0000001577 nova-compute[98319]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:37.241392 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:59:37.241787 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:37.241787 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:37.241787 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:37.241787 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:37.241787 np0000001577 nova-compute[98319]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:37.241787 np0000001577 nova-compute[98319]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033 (non-flash)
May 28 00:59:37.241787 np0000001577 nova-compute[98319]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546 (non-flash)
May 28 00:59:37.241787 np0000001577 nova-compute[98319]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546 (non-flash)
May 28 00:59:37.241787 np0000001577 nova-compute[98319]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:37.241787 np0000001577 nova-compute[98319]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:37.241787 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:59:37.241787 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546', '25'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546', '26'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8', '27'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8', '28')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 00:59:37.241787 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033', '24')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 00:59:37.243562 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033', '23')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 00:59:37.243673 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c98704b4180>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033'): ({'sdd'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 00:59:37.243836 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Removing multipathed devices sde, sdd {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 00:59:37.244069 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Flush multipath device 3300000005ccc64c1 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 00:59:37.273195 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 00:59:37.325828 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 00:59:37.370735 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 00:59:37.370912 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 00:59:37.372541 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 00:59:37.388572 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 00:59:37.388572 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 00:59:37.397341 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:37.439268 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033, portal: 192.168.40.100,3260]
May 28 00:59:37.439268 np0000001577 nova-compute[98319]: Logout of [sid: 24, target: iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033, portal: 192.168.40.100,3260] successful.
May 28 00:59:37.439268 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:37.460473 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:37.461669 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:37.476574 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:37.525048 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033, portal: 192.168.50.100,3260]
May 28 00:59:37.525048 np0000001577 nova-compute[98319]: Logout of [sid: 23, target: iqn.2023-03.storpool.com:os--volume-af0408f8-b906-446a-bec3-429706d03033, portal: 192.168.50.100,3260] successful.
May 28 00:59:37.525048 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:37.547310 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:37.547729 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:59:37.547924 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] <== disconnect_volume: return (2648ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:59:37.548094 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 00:59:37.549711 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Deleting instance files /opt/stack/data/nova/instances/7d1add06-aef9-420b-b30e-8f881fcc968c_del
May 28 00:59:37.550672 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Deletion of /opt/stack/data/nova/instances/7d1add06-aef9-420b-b30e-8f881fcc968c_del complete
May 28 00:59:37.716475 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Attempting to attach volume 7734b529-89b2-424a-b025-86b7042d9da8 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 00:59:37.722148 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] attach device xml: <disk type="block" device="disk">
May 28 00:59:37.722148 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 00:59:37.722148 np0000001577 nova-compute[98319]:   <alias name="ua-7734b529-89b2-424a-b025-86b7042d9da8"/>
May 28 00:59:37.722148 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-3"/>
May 28 00:59:37.722148 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 00:59:37.722148 np0000001577 nova-compute[98319]:   <serial>7734b529-89b2-424a-b025-86b7042d9da8</serial>
May 28 00:59:37.722148 np0000001577 nova-compute[98319]:   <shareable/>
May 28 00:59:37.722148 np0000001577 nova-compute[98319]: </disk>
May 28 00:59:37.722148 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 00:59:37.762672 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:37.762879 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:37.763046 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] No VIF found with MAC fa:16:3e:12:3f:51, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 00:59:37.765929 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Using config drive
May 28 00:59:37.768241 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:59:37.770594 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:59:37.929711 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:37.998041 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a83eba39-e228-488a-9517-bed5abb3df74 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.594s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:38.068334 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Took 4.12 seconds to destroy the instance on the hypervisor.
May 28 00:59:38.068875 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 00:59:38.069275 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 00:59:38.069275 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 00:59:38.069405 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:38.091695 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Updating instance_info_cache with network_info: [{"id": "c023bfc4-a99c-4a75-81f2-981583584dcd", "address": "fa:16:3e:72:df:47", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc023bfc4-a9", "ovs_interfaceid": "c023bfc4-a99c-4a75-81f2-981583584dcd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:59:38.191483 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:38.281632 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:59:38.288514 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:38.443726 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Creating config drive at /opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498/disk.config
May 28 00:59:38.450664 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpru9tifw5 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:38.476794 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8455a798-8414-4314-9466-7f7e7fd09119 req-3a4f676e-b031-430f-8781-07c9ee7626ef service nova] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Received event network-vif-deleted-c8933b8a-f3aa-4393-9921-109f8e9fd5e9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:38.477338 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-8455a798-8414-4314-9466-7f7e7fd09119 req-3a4f676e-b031-430f-8781-07c9ee7626ef service nova] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Neutron deleted interface c8933b8a-f3aa-4393-9921-109f8e9fd5e9; detaching it from the instance and deleting it from the info cache
May 28 00:59:38.480377 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8455a798-8414-4314-9466-7f7e7fd09119 req-3a4f676e-b031-430f-8781-07c9ee7626ef service nova] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Detach interface failed, port_id=c8933b8a-f3aa-4393-9921-109f8e9fd5e9, reason: Instance 7d1add06-aef9-420b-b30e-8f881fcc968c could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 00:59:38.497421 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpru9tifw5" returned: 0 in 0.047s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:38.584617 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Acquiring lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:38.584880 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:38.596655 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Releasing lock "refresh_cache-b73b73f0-79a5-448c-a374-bbb182da41a9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:59:38.790124 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Compute_service record updated for np0000001577:np0000001577 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 00:59:38.790318 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.706s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:38.792165 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.48 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 00:59:38.920061 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:59:38.996985 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:39.019901 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:39.023258 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:39.096043 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Detaching volume ba3ca79b-44f2-41fe-9399-fac706396546
May 28 00:59:39.170232 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:39.201728 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Attempting to driver detach volume ba3ca79b-44f2-41fe-9399-fac706396546 from mountpoint /dev/vdc
May 28 00:59:39.216570 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Found disk vdc by alias ua-ba3ca79b-44f2-41fe-9399-fac706396546 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 00:59:39.217440 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Found disk vdc by alias ua-ba3ca79b-44f2-41fe-9399-fac706396546 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 00:59:39.217440 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Attempting to detach device vdc from instance a8a28bb4-c3ea-4fb9-9130-1e8239191c5b from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 00:59:39.217995 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] detach device xml: <disk type="block" device="disk">
May 28 00:59:39.217995 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 00:59:39.217995 np0000001577 nova-compute[98319]:   <alias name="ua-ba3ca79b-44f2-41fe-9399-fac706396546"/>
May 28 00:59:39.217995 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-2"/>
May 28 00:59:39.217995 np0000001577 nova-compute[98319]:   <target dev="vdc" bus="virtio"/>
May 28 00:59:39.217995 np0000001577 nova-compute[98319]:   <serial>ba3ca79b-44f2-41fe-9399-fac706396546</serial>
May 28 00:59:39.217995 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 00:59:39.217995 np0000001577 nova-compute[98319]: </disk>
May 28 00:59:39.217995 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 00:59:39.245134 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Successfully detached device vdc from instance a8a28bb4-c3ea-4fb9-9130-1e8239191c5b from the persistent domain config.
May 28 00:59:39.246353 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] (1/8): Attempting to detach device vdc with device alias ua-ba3ca79b-44f2-41fe-9399-fac706396546 from instance a8a28bb4-c3ea-4fb9-9130-1e8239191c5b from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 00:59:39.246353 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] detach device xml: <disk type="block" device="disk">
May 28 00:59:39.246353 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 00:59:39.246353 np0000001577 nova-compute[98319]:   <alias name="ua-ba3ca79b-44f2-41fe-9399-fac706396546"/>
May 28 00:59:39.246353 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-2"/>
May 28 00:59:39.246353 np0000001577 nova-compute[98319]:   <target dev="vdc" bus="virtio"/>
May 28 00:59:39.246353 np0000001577 nova-compute[98319]:   <serial>ba3ca79b-44f2-41fe-9399-fac706396546</serial>
May 28 00:59:39.246353 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 00:59:39.246353 np0000001577 nova-compute[98319]: </disk>
May 28 00:59:39.246353 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 00:59:39.271126 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:59:39.272609 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:59:39.273052 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:59:39.273993 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 00:59:39.274318 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.70 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 00:59:39.349830 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-13324a6e-427f-404e-bb4c-bae52271de95 req-be2a08ce-4d55-4739-9cf0-3a9538573469 service nova] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Received event network-vif-plugged-4bd7989d-5591-41bb-a6e4-29c3a6aa27de {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:39.349830 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-13324a6e-427f-404e-bb4c-bae52271de95 req-be2a08ce-4d55-4739-9cf0-3a9538573469 service nova] Acquiring lock "f2b64af8-9a7b-4726-b298-cf9d2cb24498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:39.349830 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-13324a6e-427f-404e-bb4c-bae52271de95 req-be2a08ce-4d55-4739-9cf0-3a9538573469 service nova] Lock "f2b64af8-9a7b-4726-b298-cf9d2cb24498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:39.349830 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-13324a6e-427f-404e-bb4c-bae52271de95 req-be2a08ce-4d55-4739-9cf0-3a9538573469 service nova] Lock "f2b64af8-9a7b-4726-b298-cf9d2cb24498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:39.349830 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-13324a6e-427f-404e-bb4c-bae52271de95 req-be2a08ce-4d55-4739-9cf0-3a9538573469 service nova] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Processing event network-vif-plugged-4bd7989d-5591-41bb-a6e4-29c3a6aa27de {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 00:59:39.409525 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:39.409665 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:39.409755 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:39.409816 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No VIF found with MAC fa:16:3e:f0:24:6e, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 00:59:39.424671 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Took 1.36 seconds to deallocate network for instance.
May 28 00:59:39.495431 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "ebae9109-a600-4788-9008-74a8c320b803" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:39.495599 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "ebae9109-a600-4788-9008-74a8c320b803" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:39.511349 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:39.519339 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:39.540347 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:39.542211 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:39.828974 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779929979.8286145, a8a28bb4-c3ea-4fb9-9130-1e8239191c5b => ua-ba3ca79b-44f2-41fe-9399-fac706396546> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 00:59:39.830984 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-ba3ca79b-44f2-41fe-9399-fac706396546 for instance a8a28bb4-c3ea-4fb9-9130-1e8239191c5b {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 00:59:39.833260 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Successfully detached device vdc from instance a8a28bb4-c3ea-4fb9-9130-1e8239191c5b from the live domain config.
May 28 00:59:39.834320 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 00:59:39.834662 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546', 'iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba3ca79b-44f2-41fe-9399-fac706396546', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:59:39.834842 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:59:39.835212 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:59:39.835507 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546', 'iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba3ca79b-44f2-41fe-9399-fac706396546', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 00:59:39.835746 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 00:59:39.861958 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:39.861958 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:39.861958 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:39.861958 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:39.861958 np0000001577 nova-compute[98319]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546 (non-flash)
May 28 00:59:39.861958 np0000001577 nova-compute[98319]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546 (non-flash)
May 28 00:59:39.861958 np0000001577 nova-compute[98319]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:39.861958 np0000001577 nova-compute[98319]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:39.861958 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:59:39.862242 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:39.862242 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:39.862242 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:39.862242 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:39.862242 np0000001577 nova-compute[98319]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546 (non-flash)
May 28 00:59:39.862242 np0000001577 nova-compute[98319]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546 (non-flash)
May 28 00:59:39.862242 np0000001577 nova-compute[98319]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:39.862242 np0000001577 nova-compute[98319]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:39.862242 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:59:39.862242 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546', '25'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546', '26'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8', '27'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8', '28')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 00:59:39.862594 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546', '26')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 00:59:39.863303 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546', '25')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 00:59:39.864319 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c9870529300>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546'): ({'sdf'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 00:59:39.864640 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Removing multipathed devices sdf, sdg {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 00:59:39.864783 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Flush multipath device 3300000007204ce2b {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 00:59:39.892189 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 00:59:39.929589 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 00:59:39.985092 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 00:59:39.985269 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 00:59:39.986321 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 00:59:39.999142 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lazy-loading 'flavor' on Instance uuid ebae9109-a600-4788-9008-74a8c320b803 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:40.002476 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 00:59:40.002476 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 00:59:40.020454 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:40.021097 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Took 0.60 seconds to detach 1 volumes for instance.
May 28 00:59:40.038045 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 00:59:40.038333 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929980.0381114, f2b64af8-9a7b-4726-b298-cf9d2cb24498 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:59:40.038590 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] VM Started (Lifecycle Event)
May 28 00:59:40.040717 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 00:59:40.047848 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Instance spawned successfully.
May 28 00:59:40.049660 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 00:59:40.070260 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546, portal: 192.168.40.100,3260]
May 28 00:59:40.070260 np0000001577 nova-compute[98319]: Logout of [sid: 26, target: iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546, portal: 192.168.40.100,3260] successful.
May 28 00:59:40.070260 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:40.091592 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:40.107438 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:40.149052 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546, portal: 192.168.50.100,3260]
May 28 00:59:40.149052 np0000001577 nova-compute[98319]: Logout of [sid: 25, target: iqn.2023-03.storpool.com:os--volume-ba3ca79b-44f2-41fe-9399-fac706396546, portal: 192.168.50.100,3260] successful.
May 28 00:59:40.149052 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:40.173883 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:40.174094 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:59:40.174228 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] <== disconnect_volume: return (339ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:59:40.174337 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 00:59:40.234118 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:40.237064 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:40.255443 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:40.427929 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:40.433999 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:40.505286 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Ignoring supplied device name: /dev/vdb
May 28 00:59:40.517483 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:40.528292 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:40.532648 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:40.532648 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:40.542339 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:40.547887 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:59:40.553205 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Instance destroyed successfully.
May 28 00:59:40.553808 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'numa_topology' on Instance uuid b73b73f0-79a5-448c-a374-bbb182da41a9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:40.563604 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:40.563604 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:40.563604 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:40.563604 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:40.563604 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:40.563897 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 00:59:40.725226 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lazy-loading 'flavor' on Instance uuid a8a28bb4-c3ea-4fb9-9130-1e8239191c5b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:40.793559 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "d988b526-836d-48b8-a381-1f7679caf41d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:40.793875 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d988b526-836d-48b8-a381-1f7679caf41d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:40.999526 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:41.002290 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2487ce9-8ff1-49d4-9ec1-c3ad2b6823d5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d09e5674-c5ab-4ace-9952-554361002541" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.659s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:41.010622 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "ebae9109-a600-4788-9008-74a8c320b803" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:41.052005 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 00:59:41.052218 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929981.052066, f2b64af8-9a7b-4726-b298-cf9d2cb24498 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:59:41.052324 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] VM Paused (Lifecycle Event)
May 28 00:59:41.063654 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Attempting rescue
May 28 00:59:41.065825 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98319) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 28 00:59:41.070724 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Took 7.69 seconds to spawn the instance on the hypervisor.
May 28 00:59:41.070724 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:41.071940 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Instance directory exists: not creating {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 00:59:41.072271 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Creating image(s)
May 28 00:59:41.076375 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "/opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:41.076375 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "/opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:41.076375 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "/opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:41.076375 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'trusted_certs' on Instance uuid b73b73f0-79a5-448c-a374-bbb182da41a9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:41.217117 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:59:41.217344 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:59:41.228751 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:41.299492 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lazy-loading 'flavor' on Instance uuid d988b526-836d-48b8-a381-1f7679caf41d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:41.387785 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:41.388015 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "2dbd7449-2081-4377-a31d-e4d202679da1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:41.520085 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-16eea57c-7f53-484a-9143-e29cb03a3409 req-dad147a8-5f8c-41bc-a506-86680bf20114 service nova] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Received event network-vif-plugged-4bd7989d-5591-41bb-a6e4-29c3a6aa27de {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:41.520085 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-16eea57c-7f53-484a-9143-e29cb03a3409 req-dad147a8-5f8c-41bc-a506-86680bf20114 service nova] Acquiring lock "f2b64af8-9a7b-4726-b298-cf9d2cb24498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:41.520085 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-16eea57c-7f53-484a-9143-e29cb03a3409 req-dad147a8-5f8c-41bc-a506-86680bf20114 service nova] Lock "f2b64af8-9a7b-4726-b298-cf9d2cb24498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:41.520085 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-16eea57c-7f53-484a-9143-e29cb03a3409 req-dad147a8-5f8c-41bc-a506-86680bf20114 service nova] Lock "f2b64af8-9a7b-4726-b298-cf9d2cb24498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:41.520791 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-16eea57c-7f53-484a-9143-e29cb03a3409 req-dad147a8-5f8c-41bc-a506-86680bf20114 service nova] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] No waiting events found dispatching network-vif-plugged-4bd7989d-5591-41bb-a6e4-29c3a6aa27de {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:59:41.521566 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-16eea57c-7f53-484a-9143-e29cb03a3409 req-dad147a8-5f8c-41bc-a506-86680bf20114 service nova] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Received unexpected event network-vif-plugged-4bd7989d-5591-41bb-a6e4-29c3a6aa27de for instance with vm_state active and task_state None.
May 28 00:59:41.552981 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8530c609-6c61-426d-8706-d3f1522d5421 req-5e8da54f-134c-4e24-a136-08c5b9c1b2bb service nova] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Received event network-vif-unplugged-c023bfc4-a99c-4a75-81f2-981583584dcd {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:41.553351 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8530c609-6c61-426d-8706-d3f1522d5421 req-5e8da54f-134c-4e24-a136-08c5b9c1b2bb service nova] Acquiring lock "b73b73f0-79a5-448c-a374-bbb182da41a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:41.553493 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8530c609-6c61-426d-8706-d3f1522d5421 req-5e8da54f-134c-4e24-a136-08c5b9c1b2bb service nova] Lock "b73b73f0-79a5-448c-a374-bbb182da41a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:41.553609 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8530c609-6c61-426d-8706-d3f1522d5421 req-5e8da54f-134c-4e24-a136-08c5b9c1b2bb service nova] Lock "b73b73f0-79a5-448c-a374-bbb182da41a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:41.553730 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8530c609-6c61-426d-8706-d3f1522d5421 req-5e8da54f-134c-4e24-a136-08c5b9c1b2bb service nova] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] No waiting events found dispatching network-vif-unplugged-c023bfc4-a99c-4a75-81f2-981583584dcd {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:59:41.553833 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-8530c609-6c61-426d-8706-d3f1522d5421 req-5e8da54f-134c-4e24-a136-08c5b9c1b2bb service nova] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Received unexpected event network-vif-unplugged-c023bfc4-a99c-4a75-81f2-981583584dcd for instance with vm_state active and task_state rescuing.
May 28 00:59:41.554575 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:41.560713 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929981.560357, f2b64af8-9a7b-4726-b298-cf9d2cb24498 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:59:41.560829 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] VM Resumed (Lifecycle Event)
May 28 00:59:41.577950 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Object Instance<b73b73f0-79a5-448c-a374-bbb182da41a9> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 00:59:41.581048 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:59:41.583116 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Took 13.43 seconds to build instance.
May 28 00:59:41.590700 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:59:41.592388 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:41.595567 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:41.595567 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:59:41.595567 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:59:41.596033 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:41.670269 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.074s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:41.671228 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk.rescue {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:41.721685 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:59:41.730432 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk.rescue" returned: 0 in 0.059s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:41.732093 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.138s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:41.732093 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'migration_context' on Instance uuid b73b73f0-79a5-448c-a374-bbb182da41a9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:41.732532 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-99d3c268-79be-4bab-9bc7-e9fab1b34778 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.148s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:41.892695 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 00:59:42.071706 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:42.075294 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:59:42.091682 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "f2b64af8-9a7b-4726-b298-cf9d2cb24498" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.944s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:42.127753 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "ebae9109-a600-4788-9008-74a8c320b803" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:42.128604 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "ebae9109-a600-4788-9008-74a8c320b803" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:42.132381 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Attaching volume e6d37c59-727a-44bb-992c-7034d5fc6131 to /dev/vdb
May 28 00:59:42.189798 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:59:42.201910 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 00:59:42.223487 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:42.247618 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.710s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:42.254216 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Object Instance<b73b73f0-79a5-448c-a374-bbb182da41a9> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 00:59:42.254709 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 00:59:42.255417 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Start _get_guest_xml network_info=[{"id": "c023bfc4-a99c-4a75-81f2-981583584dcd", "address": "fa:16:3e:72:df:47", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "vif_mac": "fa:16:3e:72:df:47"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc023bfc4-a9", "ovs_interfaceid": "c023bfc4-a99c-4a75-81f2-981583584dcd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 00:59:42.255693 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'resources' on Instance uuid b73b73f0-79a5-448c-a374-bbb182da41a9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:42.264688 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 00:59:42.265068 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 00:59:42.276749 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 00:59:42.278481 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe07:50fa', 'fe80::349a:eff:fe88:15e5', 'fe80::fc16:3eff:fe75:1c46', 'fe80::8c3:73ff:fe68:9ea1', 'fe80::fc16:3eff:fe85:df78', 'fe80::3834:39ff:fe20:36ec', 'fe80::fc16:3eff:fef0:246e', 'fe80::fc16:3eff:feca:a831', 'fe80::fc16:3eff:fe3e:2329', 'fe80::e8d7:d3ff:fe11:4890', 'fe80::fc16:3eff:febd:1fa1', 'fe80::743e:7eff:fe2c:709c', 'fe80::fc16:3eff:fe12:3f51', 'fe80::64e0:a4ff:fe34:ffd6'] 
May 28 00:59:42.278667 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 00:59:42.278747 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 00:59:42.279028 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:59:42.279284 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Updating existing volume attachment record: cb16028b-596f-40ae-a6e4-16648b0b6db5 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 00:59:42.305424 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d988b526-836d-48b8-a381-1f7679caf41d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:42.323081 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Deleted allocations for instance 7d1add06-aef9-420b-b30e-8f881fcc968c
May 28 00:59:42.442298 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:42.442470 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:42.446847 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 00:59:42.447043 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Claim successful on node np0000001577
May 28 00:59:42.573020 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Acquiring lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:42.573283 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:42.578624 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999632388000009 future=<Future at 0x7c984c4fe870 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:59:42.762353 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Object Instance<b73b73f0-79a5-448c-a374-bbb182da41a9> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 00:59:42.764126 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 00:59:42.765372 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-717350635', uuid='b73b73f0-79a5-448c-a374-bbb182da41a9'), owner=OwnerMeta(userid='e2684c1dc140407b91687ee5abadef9d', username='tempest-ServerRescueNegativeTestJSON-509890320-project-member', projectid='a3c5a1da6bb242e9a58cb82855897726', projectname='tempest-ServerRescueNegativeTestJSON-509890320'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c023bfc4-a99c-4a75-81f2-981583584dcd", "address": "fa:16:3e:72:df:47", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "vif_mac": "fa:16:3e:72:df:47"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc023bfc4-a9", "ovs_interfaceid": "c023bfc4-a99c-4a75-81f2-981583584dcd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779929982.7649698) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 00:59:42.766141 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 00:59:42.766499 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 00:59:42.767843 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 00:59:42.768048 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 00:59:42.770621 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 00:59:42.770980 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 00:59:42.771185 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 00:59:42.771326 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 00:59:42.771489 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 00:59:42.771632 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 00:59:42.771774 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 00:59:42.771962 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 00:59:42.772123 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 00:59:42.772325 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 00:59:42.772472 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 00:59:42.772644 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 00:59:42.772792 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'vcpu_model' on Instance uuid b73b73f0-79a5-448c-a374-bbb182da41a9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:42.848032 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 00:59:42.848487 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131', 'iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6d37c59-727a-44bb-992c-7034d5fc6131', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:59:42.848700 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:59:42.849109 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:59:42.849371 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131', 'iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6d37c59-727a-44bb-992c-7034d5fc6131', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 00:59:42.866584 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:59:42.869362 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:59:42.869893 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:59:42.870154 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 00:59:42.872501 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:59:42.872501 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 00:59:42.886708 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 00:59:42.886708 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:42.890291 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 00:59:42.890291 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:42.903142 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131] added
May 28 00:59:42.903142 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 00:59:42.903142 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:59:42.903142 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:59:42.903142 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:59:42.903142 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:59:42.903142 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:42.903375 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 00:59:42.903491 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0333(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 00:59:42.905352 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 00:59:42.906459 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131] added
May 28 00:59:42.906459 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 00:59:42.906459 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:59:42.906459 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:59:42.906459 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 00:59:42.906459 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 00:59:42.906459 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:42.906765 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 00:59:42.906765 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0358(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 00:59:42.906888 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 00:59:43.029213 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ab1015de-33fb-4f81-9822-7fe9409d1d75 req-bf35a785-974b-4808-8341-2a1149201502 service nova] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Received event network-changed-4bd7989d-5591-41bb-a6e4-29c3a6aa27de {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:43.029367 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ab1015de-33fb-4f81-9822-7fe9409d1d75 req-bf35a785-974b-4808-8341-2a1149201502 service nova] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Refreshing instance network info cache due to event network-changed-4bd7989d-5591-41bb-a6e4-29c3a6aa27de. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:59:43.029742 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ab1015de-33fb-4f81-9822-7fe9409d1d75 req-bf35a785-974b-4808-8341-2a1149201502 service nova] Acquiring lock "refresh_cache-f2b64af8-9a7b-4726-b298-cf9d2cb24498" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:59:43.029895 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ab1015de-33fb-4f81-9822-7fe9409d1d75 req-bf35a785-974b-4808-8341-2a1149201502 service nova] Acquired lock "refresh_cache-f2b64af8-9a7b-4726-b298-cf9d2cb24498" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:59:43.030039 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-ab1015de-33fb-4f81-9822-7fe9409d1d75 req-bf35a785-974b-4808-8341-2a1149201502 service nova] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Refreshing network info cache for port 4bd7989d-5591-41bb-a6e4-29c3a6aa27de {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:59:43.076647 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Detaching volume be1ff6db-176b-4318-a624-c60fbda323dc
May 28 00:59:43.113826 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Attempting to driver detach volume be1ff6db-176b-4318-a624-c60fbda323dc from mountpoint /dev/vdb
May 28 00:59:43.117023 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Found disk vdb by alias ua-be1ff6db-176b-4318-a624-c60fbda323dc {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 00:59:43.118134 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Found disk vdb by alias ua-be1ff6db-176b-4318-a624-c60fbda323dc {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 00:59:43.118249 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Attempting to detach device vdb from instance a8a28bb4-c3ea-4fb9-9130-1e8239191c5b from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 00:59:43.118517 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] detach device xml: <disk type="block" device="disk">
May 28 00:59:43.118517 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 00:59:43.118517 np0000001577 nova-compute[98319]:   <alias name="ua-be1ff6db-176b-4318-a624-c60fbda323dc"/>
May 28 00:59:43.118517 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 28 00:59:43.118517 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 00:59:43.118517 np0000001577 nova-compute[98319]:   <serial>be1ff6db-176b-4318-a624-c60fbda323dc</serial>
May 28 00:59:43.118517 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 00:59:43.118517 np0000001577 nova-compute[98319]: </disk>
May 28 00:59:43.118517 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 00:59:43.122642 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Successfully detached device vdb from instance a8a28bb4-c3ea-4fb9-9130-1e8239191c5b from the persistent domain config.
May 28 00:59:43.122789 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] (1/8): Attempting to detach device vdb with device alias ua-be1ff6db-176b-4318-a624-c60fbda323dc from instance a8a28bb4-c3ea-4fb9-9130-1e8239191c5b from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 00:59:43.123025 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] detach device xml: <disk type="block" device="disk">
May 28 00:59:43.123025 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 00:59:43.123025 np0000001577 nova-compute[98319]:   <alias name="ua-be1ff6db-176b-4318-a624-c60fbda323dc"/>
May 28 00:59:43.123025 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 28 00:59:43.123025 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 00:59:43.123025 np0000001577 nova-compute[98319]:   <serial>be1ff6db-176b-4318-a624-c60fbda323dc</serial>
May 28 00:59:43.123025 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 00:59:43.123025 np0000001577 nova-compute[98319]: </disk>
May 28 00:59:43.123025 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 00:59:43.274852 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Object Instance<b73b73f0-79a5-448c-a374-bbb182da41a9> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 00:59:43.284509 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-717350635',display_name='tempest-ServerRescueNegativeTestJSON-server-717350635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serverrescuenegativetestjson-server-717350635',id=16,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T00:59:35Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3c5a1da6bb242e9a58cb82855897726',ramdisk_id='',reservation_id='r-f8vnn170',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-509890320',owner_user_name='tempest-ServerRescueNegativeTestJSON-509890320-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:59:36Z,user_data=None,user_id='e2684c1dc140407b91687ee5abadef9d',uuid=b73b73f0-79a5-448c-a374-bbb182da41a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c023bfc4-a99c-4a75-81f2-981583584dcd", "address": "fa:16:3e:72:df:47", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "vif_mac": "fa:16:3e:72:df:47"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc023bfc4-a9", "ovs_interfaceid": "c023bfc4-a99c-4a75-81f2-981583584dcd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 00:59:43.285587 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Converting VIF {"id": "c023bfc4-a99c-4a75-81f2-981583584dcd", "address": "fa:16:3e:72:df:47", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "vif_mac": "fa:16:3e:72:df:47"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc023bfc4-a9", "ovs_interfaceid": "c023bfc4-a99c-4a75-81f2-981583584dcd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:59:43.285587 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:df:47,bridge_name='br-int',has_traffic_filtering=True,id=c023bfc4-a99c-4a75-81f2-981583584dcd,network=Network(1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc023bfc4-a9') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:59:43.285880 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'pci_devices' on Instance uuid b73b73f0-79a5-448c-a374-bbb182da41a9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:43.332334 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-99ec5926-b283-4d80-8d6f-b4a4bafdebff tempest-DeleteServersTestJSON-1389929058 tempest-DeleteServersTestJSON-1389929058-project-member] Lock "7d1add06-aef9-420b-b30e-8f881fcc968c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.900s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:43.393711 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "d988b526-836d-48b8-a381-1f7679caf41d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:43.395749 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d988b526-836d-48b8-a381-1f7679caf41d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:43.395749 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Attaching volume 7734b529-89b2-424a-b025-86b7042d9da8 to /dev/vdb
May 28 00:59:43.446714 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:59:43.458645 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 00:59:43.480011 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:43.521173 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 00:59:43.521467 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 00:59:43.532226 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 00:59:43.534668 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe07:50fa', 'fe80::349a:eff:fe88:15e5', 'fe80::fc16:3eff:fe75:1c46', 'fe80::8c3:73ff:fe68:9ea1', 'fe80::fc16:3eff:fe85:df78', 'fe80::3834:39ff:fe20:36ec', 'fe80::fc16:3eff:fef0:246e', 'fe80::fc16:3eff:feca:a831', 'fe80::fc16:3eff:fe3e:2329', 'fe80::e8d7:d3ff:fe11:4890', 'fe80::fc16:3eff:febd:1fa1', 'fe80::743e:7eff:fe2c:709c', 'fe80::fc16:3eff:fe12:3f51', 'fe80::64e0:a4ff:fe34:ffd6'] 
May 28 00:59:43.534668 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 00:59:43.534668 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 00:59:43.534668 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:59:43.534668 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Updating existing volume attachment record: 7a13c683-d47d-4447-8b41-fe6b1da79fab {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 00:59:43.536176 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-ab1015de-33fb-4f81-9822-7fe9409d1d75 req-bf35a785-974b-4808-8341-2a1149201502 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:43.629227 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-be1ff6db-176b-4318-a624-c60fbda323dc for instance a8a28bb4-c3ea-4fb9-9130-1e8239191c5b {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 00:59:43.630508 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779929983.6301212, a8a28bb4-c3ea-4fb9-9130-1e8239191c5b => ua-be1ff6db-176b-4318-a624-c60fbda323dc> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 00:59:43.640859 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Successfully detached device vdb from instance a8a28bb4-c3ea-4fb9-9130-1e8239191c5b from the live domain config.
May 28 00:59:43.642101 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b38c24e8-1e6b-4229-b8fb-84002eed6e11 req-db5a72f5-ce48-4dde-aa9f-760739907341 service nova] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Received event network-vif-unplugged-c023bfc4-a99c-4a75-81f2-981583584dcd {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:43.642342 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b38c24e8-1e6b-4229-b8fb-84002eed6e11 req-db5a72f5-ce48-4dde-aa9f-760739907341 service nova] Acquiring lock "b73b73f0-79a5-448c-a374-bbb182da41a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:43.643320 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b38c24e8-1e6b-4229-b8fb-84002eed6e11 req-db5a72f5-ce48-4dde-aa9f-760739907341 service nova] Lock "b73b73f0-79a5-448c-a374-bbb182da41a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:43.643409 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b38c24e8-1e6b-4229-b8fb-84002eed6e11 req-db5a72f5-ce48-4dde-aa9f-760739907341 service nova] Lock "b73b73f0-79a5-448c-a374-bbb182da41a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:43.643534 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b38c24e8-1e6b-4229-b8fb-84002eed6e11 req-db5a72f5-ce48-4dde-aa9f-760739907341 service nova] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] No waiting events found dispatching network-vif-unplugged-c023bfc4-a99c-4a75-81f2-981583584dcd {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:59:43.643904 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-b38c24e8-1e6b-4229-b8fb-84002eed6e11 req-db5a72f5-ce48-4dde-aa9f-760739907341 service nova] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Received unexpected event network-vif-unplugged-c023bfc4-a99c-4a75-81f2-981583584dcd for instance with vm_state active and task_state rescuing.
May 28 00:59:43.647885 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 00:59:43.648258 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc', 'iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'be1ff6db-176b-4318-a624-c60fbda323dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:59:43.648427 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:59:43.787586 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Object Instance<b73b73f0-79a5-448c-a374-bbb182da41a9> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 00:59:43.789646 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] End _get_guest_xml xml=<domain type="qemu">
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:   <uuid>b73b73f0-79a5-448c-a374-bbb182da41a9</uuid>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:   <name>instance-00000010</name>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:   <metadata>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-717350635</nova:name>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 00:59:42</nova:creationTime>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       </nova:image>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:         <nova:user uuid="e2684c1dc140407b91687ee5abadef9d">tempest-ServerRescueNegativeTestJSON-509890320-project-member</nova:user>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:         <nova:project uuid="a3c5a1da6bb242e9a58cb82855897726">tempest-ServerRescueNegativeTestJSON-509890320</nova:project>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:         <nova:port uuid="c023bfc4-a99c-4a75-81f2-981583584dcd">
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:         </nova:port>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:   </metadata>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:     <system>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       <entry name="serial">b73b73f0-79a5-448c-a374-bbb182da41a9</entry>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       <entry name="uuid">b73b73f0-79a5-448c-a374-bbb182da41a9</entry>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:     </system>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:   <os>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:   </os>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:   <features>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:     <acpi/>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:     <tcg>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:     </tcg>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:   </features>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:   <devices>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk.rescue"/>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:     </disk>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk"/>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:     </disk>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk.config.rescue"/>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:     </disk>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:72:df:47"/>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       <target dev="tapc023bfc4-a9"/>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:     </interface>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/console.log" append="off"/>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:     </serial>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:     <video>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:     </video>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:     </rng>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:     </memballoon>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:   </devices>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]: </domain>
May 28 00:59:43.789646 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 00:59:43.796117 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Instance destroyed successfully.
May 28 00:59:43.906288 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 00:59:43.907369 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 00:59:43.917638 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-ab1015de-33fb-4f81-9822-7fe9409d1d75 req-bf35a785-974b-4808-8341-2a1149201502 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.startup = manual
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.port = 0
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 00:59:43.923782 np0000001577 nova-compute[98319]: # END RECORD
May 28 00:59:43.923782 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.startup = manual
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.port = 0
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 00:59:43.929747 np0000001577 nova-compute[98319]: # END RECORD
May 28 00:59:43.929747 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:43.937023 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:43.942541 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:43.953637 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:43.953637 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:43.953637 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:43.953637 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:43.953637 np0000001577 nova-compute[98319]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:43.953637 np0000001577 nova-compute[98319]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:43.953637 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:59:43.953637 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:43.953637 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:43.953637 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:43.953637 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:43.953637 np0000001577 nova-compute[98319]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:43.953637 np0000001577 nova-compute[98319]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:43.953637 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:59:43.958385 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:43.958385 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:43.958385 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:43.958385 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:43.958385 np0000001577 nova-compute[98319]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:43.958385 np0000001577 nova-compute[98319]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:43.958385 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:59:43.958720 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:43.958720 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:43.958720 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:43.958720 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:43.958720 np0000001577 nova-compute[98319]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:43.958720 np0000001577 nova-compute[98319]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:43.958720 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:59:43.991588 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131, portal: 192.168.40.100,3260]
May 28 00:59:43.991588 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131, portal: 192.168.40.100,3260] successful.
May 28 00:59:43.991588 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:43.998982 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131, portal: 192.168.50.100,3260]
May 28 00:59:43.998982 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131, portal: 192.168.50.100,3260] successful.
May 28 00:59:43.998982 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:44.009624 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:44.010639 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:44.026935 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:44.026935 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:44.026935 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:44.026935 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:44.026935 np0000001577 nova-compute[98319]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:44.026935 np0000001577 nova-compute[98319]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:44.026935 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 00:59:44.026935 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 00:59:44.026935 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:59:44.027490 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:44.027490 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:44.027490 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:44.027490 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:44.027490 np0000001577 nova-compute[98319]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:44.027490 np0000001577 nova-compute[98319]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:44.027490 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 00:59:44.027490 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 00:59:44.027490 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:59:44.028503 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.158s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:59:44.028503 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 00:59:44.028760 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:44.028760 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:44.028760 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:44.028760 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:44.028760 np0000001577 nova-compute[98319]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:44.028760 np0000001577 nova-compute[98319]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:44.028760 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 00:59:44.028760 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 00:59:44.028760 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:59:44.030108 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] HCTL ('9', '-', '-', 0) found on session 29 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 00:59:44.030810 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:44.030810 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:44.030810 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:44.030810 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:44.030810 np0000001577 nova-compute[98319]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:44.030810 np0000001577 nova-compute[98319]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:44.030810 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 00:59:44.030810 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 00:59:44.030810 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:59:44.032243 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 00:59:44.034775 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:59:44.034935 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 00:59:44.035743 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] HCTL ('10', '-', '-', 0) found on session 30 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 00:59:44.035848 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 00:59:44.055394 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Searching for a device in session 29 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 00:59:44.055394 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6d37c59-727a-44bb-992c-7034d5fc6131', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 00:59:44.065959 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Searching for a device in session 30 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 00:59:44.066264 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e6d37c59-727a-44bb-992c-7034d5fc6131', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 00:59:44.073981 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:59:44.074145 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:59:44.093726 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-ab1015de-33fb-4f81-9822-7fe9409d1d75 req-bf35a785-974b-4808-8341-2a1149201502 service nova] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Updated VIF entry in instance network info cache for port 4bd7989d-5591-41bb-a6e4-29c3a6aa27de. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 00:59:44.094268 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-ab1015de-33fb-4f81-9822-7fe9409d1d75 req-bf35a785-974b-4808-8341-2a1149201502 service nova] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Updating instance_info_cache with network_info: [{"id": "4bd7989d-5591-41bb-a6e4-29c3a6aa27de", "address": "fa:16:3e:12:3f:51", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bd7989d-55", "ovs_interfaceid": "4bd7989d-5591-41bb-a6e4-29c3a6aa27de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:59:44.107503 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 00:59:44.107923 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8', 'iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7734b529-89b2-424a-b025-86b7042d9da8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:59:44.108075 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:59:44.577204 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:59:44.596537 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ab1015de-33fb-4f81-9822-7fe9409d1d75 req-bf35a785-974b-4808-8341-2a1149201502 service nova] Releasing lock "refresh_cache-f2b64af8-9a7b-4726-b298-cf9d2cb24498" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:59:44.870358 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 00:59:45.084127 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.641s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:45.084326 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 00:59:45.310620 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:45.310761 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:45.310869 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:45.310968 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] No VIF found with MAC fa:16:3e:72:df:47, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 00:59:45.311641 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Using config drive
May 28 00:59:45.589461 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 00:59:45.589990 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 00:59:45.590176 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:45.590394 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:45.776964 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0b66af1e9e094d3fa78454b91757d6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54eb635d961644dc9c1845baf24fc6db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 00:59:45.814345 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'ec2_ids' on Instance uuid b73b73f0-79a5-448c-a374-bbb182da41a9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:45.889958 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Found WWN 330000000b4ee91f3 for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 00:59:45.890255 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:59:45.890423 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '330000000b4ee91f3', 'path': '/dev/dm-1', 'multipath_id': '330000000b4ee91f3'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:59:45.890560 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b4ee91f3', 'path': '/dev/dm-1', 'multipath_id': '330000000b4ee91f3'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 00:59:45.891320 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.243s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:59:45.891821 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc', 'iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'be1ff6db-176b-4318-a624-c60fbda323dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 00:59:45.892032 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 00:59:45.899915 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lazy-loading 'flavor' on Instance uuid ebae9109-a600-4788-9008-74a8c320b803 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:45.921269 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:45.921269 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:45.921269 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:45.921269 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:45.921269 np0000001577 nova-compute[98319]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:45.921269 np0000001577 nova-compute[98319]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:45.921269 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 00:59:45.921269 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 00:59:45.921269 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:59:45.921714 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:45.921714 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:45.921714 np0000001577 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:45.921714 np0000001577 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc (non-flash)
May 28 00:59:45.921714 np0000001577 nova-compute[98319]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:45.921714 np0000001577 nova-compute[98319]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:45.921714 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 00:59:45.921714 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 00:59:45.921714 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:59:45.921714 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8', '27'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131', '30')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 00:59:45.922184 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc', '21')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 00:59:45.923292 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc', '22')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 00:59:45.924263 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c984c6a39c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc'): ({'sdc'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 00:59:45.924477 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 00:59:45.924774 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Flush multipath device 3300000000f59c400 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 00:59:45.954975 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:45.958428 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 00:59:46.003406 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:46.006079 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 00:59:46.054184 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 00:59:46.054341 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 00:59:46.055266 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 00:59:46.065136 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 00:59:46.065340 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 00:59:46.075489 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:46.091294 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 00:59:46.110108 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc, portal: 192.168.40.100,3260]
May 28 00:59:46.110108 np0000001577 nova-compute[98319]: Logout of [sid: 21, target: iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc, portal: 192.168.40.100,3260] successful.
May 28 00:59:46.110108 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:46.130335 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:46.143097 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:46.187423 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc, portal: 192.168.50.100,3260]
May 28 00:59:46.187423 np0000001577 nova-compute[98319]: Logout of [sid: 22, target: iqn.2023-03.storpool.com:os--volume-be1ff6db-176b-4318-a624-c60fbda323dc, portal: 192.168.50.100,3260] successful.
May 28 00:59:46.187423 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:46.212073 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:46.212337 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:59:46.212469 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] <== disconnect_volume: return (2563ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:59:46.212614 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 00:59:46.214805 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.107s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:59:46.215230 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8', 'iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7734b529-89b2-424a-b025-86b7042d9da8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 00:59:46.227366 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:59:46.228591 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 00:59:46.229420 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:59:46.229642 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 00:59:46.230021 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 00:59:46.230419 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 00:59:46.230745 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.startup = automatic
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.port = 0
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.session.scan = manual
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 00:59:46.247865 np0000001577 nova-compute[98319]: # END RECORD
May 28 00:59:46.247865 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.startup = automatic
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.port = 0
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.session.scan = manual
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 00:59:46.256670 np0000001577 nova-compute[98319]: # END RECORD
May 28 00:59:46.256670 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:46.266610 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:46.278885 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 00:59:46.285559 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:46.285559 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:46.285559 np0000001577 nova-compute[98319]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:46.285559 np0000001577 nova-compute[98319]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:46.285559 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 00:59:46.285559 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 00:59:46.285559 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:59:46.285773 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:46.285773 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:46.285773 np0000001577 nova-compute[98319]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:46.285773 np0000001577 nova-compute[98319]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:46.285773 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 00:59:46.285773 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 00:59:46.285773 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:59:46.286050 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.057s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:59:46.286135 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 00:59:46.286771 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] HCTL ('14', '0', '0', 0) found on session 28 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 00:59:46.286927 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 00:59:46.295194 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:46.295194 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:46.295194 np0000001577 nova-compute[98319]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:46.295194 np0000001577 nova-compute[98319]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:46.295194 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 00:59:46.295194 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 00:59:46.295194 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 00:59:46.295360 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:46.295360 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 00:59:46.295360 np0000001577 nova-compute[98319]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:46.295360 np0000001577 nova-compute[98319]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 00:59:46.295360 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 00:59:46.295360 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 00:59:46.295360 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 00:59:46.295756 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.066s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:59:46.295878 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 00:59:46.296421 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] HCTL ('13', '0', '0', 0) found on session 27 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 00:59:46.296522 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Scanning host 13 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 00:59:46.297927 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Searching for a device in session 28 and hctl ('14', '0', '0', 0) yield: sdi {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 00:59:46.298058 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7734b529-89b2-424a-b025-86b7042d9da8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 00:59:46.306619 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Searching for a device in session 27 and hctl ('13', '0', '0', 0) yield: sdh {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 00:59:46.306776 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7734b529-89b2-424a-b025-86b7042d9da8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 00:59:46.321816 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Object Instance<b73b73f0-79a5-448c-a374-bbb182da41a9> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 00:59:46.322021 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'keypairs' on Instance uuid b73b73f0-79a5-448c-a374-bbb182da41a9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:46.342932 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Successfully created port: 8a85618a-56c3-4690-af32-885b836a2c19 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 00:59:46.404479 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Attempting to attach volume e6d37c59-727a-44bb-992c-7034d5fc6131 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 00:59:46.405939 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] attach device xml: <disk type="block" device="disk">
May 28 00:59:46.405939 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 00:59:46.405939 np0000001577 nova-compute[98319]:   <alias name="ua-e6d37c59-727a-44bb-992c-7034d5fc6131"/>
May 28 00:59:46.405939 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 28 00:59:46.405939 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 00:59:46.405939 np0000001577 nova-compute[98319]:   <serial>e6d37c59-727a-44bb-992c-7034d5fc6131</serial>
May 28 00:59:46.405939 np0000001577 nova-compute[98319]: </disk>
May 28 00:59:46.405939 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 00:59:46.779058 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lazy-loading 'flavor' on Instance uuid a8a28bb4-c3ea-4fb9-9130-1e8239191c5b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:46.787794 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Successfully created port: 3de085f7-074a-44c7-99ab-7093e0ddc084 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 00:59:46.827301 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Object Instance<b73b73f0-79a5-448c-a374-bbb182da41a9> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 00:59:46.827301 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:46.942307 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Creating config drive at /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk.config.rescue
May 28 00:59:46.945360 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpk7kbfzhf {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:47.004199 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpk7kbfzhf" returned: 0 in 0.058s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:47.210352 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Successfully created port: 02325a90-5e85-4e9f-a65e-c1bd91c39e80 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 00:59:47.230926 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 00:59:47.509699 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:47.535795 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:47.606979 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 00:59:47.637569 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:47.685769 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:47.688144 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:47.740456 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Successfully created port: 59a7e22c-8c09-4a33-9b95-58ee955f6895 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 00:59:47.785242 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1f2f27a9-0715-4062-9a87-927bdb412a09 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.212s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:47.819116 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-138e79d3-bbc6-4437-93be-4bac88c83eac req-d70a8501-061b-42ce-8ea6-0d391429fcb0 service nova] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Received event network-vif-plugged-c023bfc4-a99c-4a75-81f2-981583584dcd {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:47.819244 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-138e79d3-bbc6-4437-93be-4bac88c83eac req-d70a8501-061b-42ce-8ea6-0d391429fcb0 service nova] Acquiring lock "b73b73f0-79a5-448c-a374-bbb182da41a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:47.819397 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-138e79d3-bbc6-4437-93be-4bac88c83eac req-d70a8501-061b-42ce-8ea6-0d391429fcb0 service nova] Lock "b73b73f0-79a5-448c-a374-bbb182da41a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:47.820399 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-138e79d3-bbc6-4437-93be-4bac88c83eac req-d70a8501-061b-42ce-8ea6-0d391429fcb0 service nova] Lock "b73b73f0-79a5-448c-a374-bbb182da41a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:47.820399 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-138e79d3-bbc6-4437-93be-4bac88c83eac req-d70a8501-061b-42ce-8ea6-0d391429fcb0 service nova] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] No waiting events found dispatching network-vif-plugged-c023bfc4-a99c-4a75-81f2-981583584dcd {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:59:47.820399 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-138e79d3-bbc6-4437-93be-4bac88c83eac req-d70a8501-061b-42ce-8ea6-0d391429fcb0 service nova] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Received unexpected event network-vif-plugged-c023bfc4-a99c-4a75-81f2-981583584dcd for instance with vm_state active and task_state rescuing.
May 28 00:59:48.093942 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:48.094108 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:48.094108 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:48.094222 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] No VIF found with MAC fa:16:3e:85:df:78, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 00:59:48.112104 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Booting with volume 39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea at /dev/vda
May 28 00:59:48.131122 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9ea24d40-db51-4930-adfc-e3552782c315 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Acquiring lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:48.131284 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9ea24d40-db51-4930-adfc-e3552782c315 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:48.131450 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9ea24d40-db51-4930-adfc-e3552782c315 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Acquiring lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:48.131585 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9ea24d40-db51-4930-adfc-e3552782c315 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:48.131693 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9ea24d40-db51-4930-adfc-e3552782c315 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:48.134657 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-9ea24d40-db51-4930-adfc-e3552782c315 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Terminating instance
May 28 00:59:48.162734 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:59:48.175274 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 00:59:48.197349 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:48.230650 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 00:59:48.230650 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 00:59:48.241840 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 00:59:48.243799 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe07:50fa', 'fe80::349a:eff:fe88:15e5', 'fe80::fc16:3eff:fe75:1c46', 'fe80::8c3:73ff:fe68:9ea1', 'fe80::fc16:3eff:fe85:df78', 'fe80::3834:39ff:fe20:36ec', 'fe80::fc16:3eff:fef0:246e', 'fe80::fc16:3eff:feca:a831', 'fe80::fc16:3eff:fe3e:2329', 'fe80::e8d7:d3ff:fe11:4890', 'fe80::fc16:3eff:febd:1fa1', 'fe80::743e:7eff:fe2c:709c', 'fe80::fc16:3eff:fe12:3f51', 'fe80::64e0:a4ff:fe34:ffd6', 'fe80::fc16:3eff:fe72:df47'] 
May 28 00:59:48.244129 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 00:59:48.244354 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 00:59:48.244765 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] <== get_connector_properties: return (81ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:59:48.245105 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Updating existing volume attachment record: 386dbd42-0912-4c17-b166-0577211ee1a5 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 00:59:48.253593 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Found WWN 3300000009522a530 for multipath device dm-3 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 00:59:48.254106 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.040s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 00:59:48.254302 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] <== connect_volume: return (4146ms) {'type': 'block', 'scsi_wwn': '3300000009522a530', 'path': '/dev/dm-3', 'multipath_id': '3300000009522a530'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:59:48.254431 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009522a530', 'path': '/dev/dm-3', 'multipath_id': '3300000009522a530'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 00:59:48.257918 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lazy-loading 'flavor' on Instance uuid d988b526-836d-48b8-a381-1f7679caf41d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:48.379692 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Successfully created port: d1b61752-f189-4f02-b9eb-92326fb29830 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 00:59:48.411342 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0118afb2-b666-4f63-ac0b-49b9262de5fc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:48.413250 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Removed pending STOPPED event for b73b73f0-79a5-448c-a374-bbb182da41a9 due to new event <LifecycleEvent: 1779929988.4113922, b73b73f0-79a5-448c-a374-bbb182da41a9 => Resumed> {{(pid=98319) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 00:59:48.413250 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929988.4113922, b73b73f0-79a5-448c-a374-bbb182da41a9 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:59:48.413250 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] VM Resumed (Lifecycle Event)
May 28 00:59:48.642081 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-9ea24d40-db51-4930-adfc-e3552782c315 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 00:59:48.666347 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:48.672876 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:48.693912 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:48.696182 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:48.726472 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:48.763237 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Attempting to attach volume 7734b529-89b2-424a-b025-86b7042d9da8 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 00:59:48.764433 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] attach device xml: <disk type="block" device="disk">
May 28 00:59:48.764433 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 00:59:48.764433 np0000001577 nova-compute[98319]:   <alias name="ua-7734b529-89b2-424a-b025-86b7042d9da8"/>
May 28 00:59:48.764433 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-3"/>
May 28 00:59:48.764433 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 00:59:48.764433 np0000001577 nova-compute[98319]:   <serial>7734b529-89b2-424a-b025-86b7042d9da8</serial>
May 28 00:59:48.764433 np0000001577 nova-compute[98319]:   <shareable/>
May 28 00:59:48.764433 np0000001577 nova-compute[98319]: </disk>
May 28 00:59:48.764433 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 00:59:48.915048 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:48.926228 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:59:48.985286 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1bab999b-4db4-4b7d-b76b-6240f3523d9c req-476a7665-4453-4062-8783-6159f81e11dc service nova] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Received event network-vif-unplugged-73b37d7b-3ec2-45cc-8a9c-22ee6556af87 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:48.985906 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1bab999b-4db4-4b7d-b76b-6240f3523d9c req-476a7665-4453-4062-8783-6159f81e11dc service nova] Acquiring lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:48.986288 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1bab999b-4db4-4b7d-b76b-6240f3523d9c req-476a7665-4453-4062-8783-6159f81e11dc service nova] Lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:48.986521 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1bab999b-4db4-4b7d-b76b-6240f3523d9c req-476a7665-4453-4062-8783-6159f81e11dc service nova] Lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:48.986758 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1bab999b-4db4-4b7d-b76b-6240f3523d9c req-476a7665-4453-4062-8783-6159f81e11dc service nova] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] No waiting events found dispatching network-vif-unplugged-73b37d7b-3ec2-45cc-8a9c-22ee6556af87 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:59:48.986965 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1bab999b-4db4-4b7d-b76b-6240f3523d9c req-476a7665-4453-4062-8783-6159f81e11dc service nova] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Received event network-vif-unplugged-73b37d7b-3ec2-45cc-8a9c-22ee6556af87 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:59:49.005809 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Successfully updated port: 8a85618a-56c3-4690-af32-885b836a2c19 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 00:59:49.035350 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:49.044038 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:49.065432 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Instance destroyed successfully.
May 28 00:59:49.066403 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-9ea24d40-db51-4930-adfc-e3552782c315 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lazy-loading 'resources' on Instance uuid a8a28bb4-c3ea-4fb9-9130-1e8239191c5b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:49.312783 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0011750449998544354 future=<Future at 0x7c984c69dc10 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:59:49.314034 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Emitting event <LifecycleEvent: 1779929974.311414, 7d1add06-aef9-420b-b30e-8f881fcc968c => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:59:49.314248 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] VM Stopped (Lifecycle Event)
May 28 00:59:49.315776 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:59:49.315776 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=8.262506333000147 future=<Future at 0x7c984c4fe870 state=cancelled>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:59:49.315776 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=8.262343351000027 future=<Future at 0x7c984c4fe870 state=cancelled>) was cancelled while queued, skipping {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:59:49.316105 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:59:49.429481 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779929989.4291723, b73b73f0-79a5-448c-a374-bbb182da41a9 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 00:59:49.429718 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] VM Started (Lifecycle Event)
May 28 00:59:49.570208 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-9ea24d40-db51-4930-adfc-e3552782c315 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:58:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1019416892',display_name='tempest-TestServerVolumeAttachmentScenario-server-1019416892',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testservervolumeattachmentscenario-server-1019416892',id=10,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhE3klP3t3yPdT8s2nQVboZn/3UjT+0OWw3+eokvovJgBH9qjUTjY0178ZpP0ENO8gC7LTRwNHllNITeG6iz6rto97Lsxn2pzptoki+tWe8lfn7v90PbUlnupavcTmNHQ==',key_name='tempest-keypair-2110859788',keypairs=<?>,launch_index=0,launched_at=2026-05-28T00:58:36Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07e72ea70b9147f68a0d66cd524ae614',ramdisk_id='',reservation_id='r-0ffxn1x8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1047363655',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1047363655-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T00:58:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fe24b43fd0b4818a4fd4bbced85a6e3',uuid=a8a28bb4-c3ea-4fb9-9130-1e8239191c5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73b37d7b-3ec2-45cc-8a9c-22ee6556af87", "address": "fa:16:3e:07:50:fa", "network": {"id": "0dbd83f8-e813-4259-a5a9-71f615374a48", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1523117392-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07e72ea70b9147f68a0d66cd524ae614", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b37d7b-3e", "ovs_interfaceid": "73b37d7b-3ec2-45cc-8a9c-22ee6556af87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 00:59:49.570208 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9ea24d40-db51-4930-adfc-e3552782c315 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Converting VIF {"id": "73b37d7b-3ec2-45cc-8a9c-22ee6556af87", "address": "fa:16:3e:07:50:fa", "network": {"id": "0dbd83f8-e813-4259-a5a9-71f615374a48", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1523117392-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07e72ea70b9147f68a0d66cd524ae614", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b37d7b-3e", "ovs_interfaceid": "73b37d7b-3ec2-45cc-8a9c-22ee6556af87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:59:49.571084 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9ea24d40-db51-4930-adfc-e3552782c315 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:50:fa,bridge_name='br-int',has_traffic_filtering=True,id=73b37d7b-3ec2-45cc-8a9c-22ee6556af87,network=Network(0dbd83f8-e813-4259-a5a9-71f615374a48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73b37d7b-3e') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:59:49.574838 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-9ea24d40-db51-4930-adfc-e3552782c315 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:50:fa,bridge_name='br-int',has_traffic_filtering=True,id=73b37d7b-3ec2-45cc-8a9c-22ee6556af87,network=Network(0dbd83f8-e813-4259-a5a9-71f615374a48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73b37d7b-3e') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 00:59:49.575177 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:49.577069 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73b37d7b-3e, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:49.580245 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:49.584515 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:59:49.586098 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:49.586098 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ec71f41-562e-46d6-9ed8-568356ea23c7) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 00:59:49.587068 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:49.587683 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 00:59:49.590434 np0000001577 nova-compute[98319]: INFO os_vif [None req-9ea24d40-db51-4930-adfc-e3552782c315 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:50:fa,bridge_name='br-int',has_traffic_filtering=True,id=73b37d7b-3ec2-45cc-8a9c-22ee6556af87,network=Network(0dbd83f8-e813-4259-a5a9-71f615374a48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73b37d7b-3e')
May 28 00:59:49.590901 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9ea24d40-db51-4930-adfc-e3552782c315 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Deleting instance files /opt/stack/data/nova/instances/a8a28bb4-c3ea-4fb9-9130-1e8239191c5b_del
May 28 00:59:49.592036 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9ea24d40-db51-4930-adfc-e3552782c315 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Deletion of /opt/stack/data/nova/instances/a8a28bb4-c3ea-4fb9-9130-1e8239191c5b_del complete
May 28 00:59:49.680273 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-02f25ff7-f81e-41e1-aa86-dd852886c1c1 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "ebae9109-a600-4788-9008-74a8c320b803" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.552s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:49.818423 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-cd66556f-49b5-4824-95d5-404a217dac5d tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 7d1add06-aef9-420b-b30e-8f881fcc968c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:49.887842 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Booting with volume d22fca90-ede2-4d3c-a61b-f5cffaf76d2f at /dev/vdb
May 28 00:59:49.908753 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-79bb54ab-a183-4700-a476-ad5f38fac6c1 req-be824626-ac11-4518-92f1-27511d406cc8 service nova] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Received event network-vif-plugged-c023bfc4-a99c-4a75-81f2-981583584dcd {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:49.908753 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-79bb54ab-a183-4700-a476-ad5f38fac6c1 req-be824626-ac11-4518-92f1-27511d406cc8 service nova] Acquiring lock "b73b73f0-79a5-448c-a374-bbb182da41a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:49.908753 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-79bb54ab-a183-4700-a476-ad5f38fac6c1 req-be824626-ac11-4518-92f1-27511d406cc8 service nova] Lock "b73b73f0-79a5-448c-a374-bbb182da41a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:49.908753 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-79bb54ab-a183-4700-a476-ad5f38fac6c1 req-be824626-ac11-4518-92f1-27511d406cc8 service nova] Lock "b73b73f0-79a5-448c-a374-bbb182da41a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:49.908753 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-79bb54ab-a183-4700-a476-ad5f38fac6c1 req-be824626-ac11-4518-92f1-27511d406cc8 service nova] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] No waiting events found dispatching network-vif-plugged-c023bfc4-a99c-4a75-81f2-981583584dcd {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:59:49.908753 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-79bb54ab-a183-4700-a476-ad5f38fac6c1 req-be824626-ac11-4518-92f1-27511d406cc8 service nova] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Received unexpected event network-vif-plugged-c023bfc4-a99c-4a75-81f2-981583584dcd for instance with vm_state rescued and task_state None.
May 28 00:59:49.908753 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-79bb54ab-a183-4700-a476-ad5f38fac6c1 req-be824626-ac11-4518-92f1-27511d406cc8 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-changed-8a85618a-56c3-4690-af32-885b836a2c19 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:49.908753 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-79bb54ab-a183-4700-a476-ad5f38fac6c1 req-be824626-ac11-4518-92f1-27511d406cc8 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Refreshing instance network info cache due to event network-changed-8a85618a-56c3-4690-af32-885b836a2c19. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:59:49.908753 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-79bb54ab-a183-4700-a476-ad5f38fac6c1 req-be824626-ac11-4518-92f1-27511d406cc8 service nova] Acquiring lock "refresh_cache-2dbd7449-2081-4377-a31d-e4d202679da1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:59:49.908753 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-79bb54ab-a183-4700-a476-ad5f38fac6c1 req-be824626-ac11-4518-92f1-27511d406cc8 service nova] Acquired lock "refresh_cache-2dbd7449-2081-4377-a31d-e4d202679da1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:59:49.909198 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-79bb54ab-a183-4700-a476-ad5f38fac6c1 req-be824626-ac11-4518-92f1-27511d406cc8 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Refreshing network info cache for port 8a85618a-56c3-4690-af32-885b836a2c19 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:59:49.932197 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 00:59:49.934600 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 00:59:49.949200 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:59:49.962027 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 00:59:49.982828 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:50.016620 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 00:59:50.017089 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 00:59:50.025280 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 00:59:50.026783 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe75:1c46', 'fe80::8c3:73ff:fe68:9ea1', 'fe80::fc16:3eff:fe85:df78', 'fe80::3834:39ff:fe20:36ec', 'fe80::fc16:3eff:fef0:246e', 'fe80::fc16:3eff:feca:a831', 'fe80::fc16:3eff:fe3e:2329', 'fe80::e8d7:d3ff:fe11:4890', 'fe80::fc16:3eff:febd:1fa1', 'fe80::743e:7eff:fe2c:709c', 'fe80::fc16:3eff:fe12:3f51', 'fe80::64e0:a4ff:fe34:ffd6', 'fe80::fc16:3eff:fe72:df47'] 
May 28 00:59:50.026906 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 00:59:50.027010 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 00:59:50.027243 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] <== get_connector_properties: return (77ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:59:50.027430 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Updating existing volume attachment record: f2688d72-a5e3-4094-bc50-423e20f6db80 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 00:59:50.103858 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-9ea24d40-db51-4930-adfc-e3552782c315 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Took 1.46 seconds to destroy the instance on the hypervisor.
May 28 00:59:50.104851 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-9ea24d40-db51-4930-adfc-e3552782c315 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 00:59:50.105087 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 00:59:50.105279 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 00:59:50.105521 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:50.188487 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:50.203381 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Successfully updated port: 7de931f4-ea15-4c26-9bd7-00b40cd57781 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 00:59:50.389016 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:50.411904 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-79bb54ab-a183-4700-a476-ad5f38fac6c1 req-be824626-ac11-4518-92f1-27511d406cc8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:50.438828 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999528013999907 future=<Future at 0x7c988c1b7c20 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:59:50.439720 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.998643651000066 future=<Future at 0x7c988c1b7c20 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:59:50.440470 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.998257332999856 future=<Future at 0x7c988c1b7c20 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:59:50.465927 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:50.466132 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:50.466220 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 00:59:50.466343 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No VIF found with MAC fa:16:3e:ca:a8:31, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 00:59:50.555097 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-79bb54ab-a183-4700-a476-ad5f38fac6c1 req-be824626-ac11-4518-92f1-27511d406cc8 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:59:50.783623 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-79bb54ab-a183-4700-a476-ad5f38fac6c1 req-be824626-ac11-4518-92f1-27511d406cc8 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:59:51.008281 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:51.109240 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-63b7a5c0-9b33-4ff4-b34a-1ec6215d789f req-bdfabd29-4dec-4369-abbd-c83342c3c4ee service nova] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Received event network-vif-unplugged-73b37d7b-3ec2-45cc-8a9c-22ee6556af87 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:51.110300 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-63b7a5c0-9b33-4ff4-b34a-1ec6215d789f req-bdfabd29-4dec-4369-abbd-c83342c3c4ee service nova] Acquiring lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:51.110641 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-63b7a5c0-9b33-4ff4-b34a-1ec6215d789f req-bdfabd29-4dec-4369-abbd-c83342c3c4ee service nova] Lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:51.111869 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-63b7a5c0-9b33-4ff4-b34a-1ec6215d789f req-bdfabd29-4dec-4369-abbd-c83342c3c4ee service nova] Lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:51.112025 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-63b7a5c0-9b33-4ff4-b34a-1ec6215d789f req-bdfabd29-4dec-4369-abbd-c83342c3c4ee service nova] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] No waiting events found dispatching network-vif-unplugged-73b37d7b-3ec2-45cc-8a9c-22ee6556af87 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:59:51.115214 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-63b7a5c0-9b33-4ff4-b34a-1ec6215d789f req-bdfabd29-4dec-4369-abbd-c83342c3c4ee service nova] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Received event network-vif-unplugged-73b37d7b-3ec2-45cc-8a9c-22ee6556af87 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 00:59:51.116127 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-63b7a5c0-9b33-4ff4-b34a-1ec6215d789f req-bdfabd29-4dec-4369-abbd-c83342c3c4ee service nova] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Received event network-vif-deleted-73b37d7b-3ec2-45cc-8a9c-22ee6556af87 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:51.116381 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-63b7a5c0-9b33-4ff4-b34a-1ec6215d789f req-bdfabd29-4dec-4369-abbd-c83342c3c4ee service nova] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Neutron deleted interface 73b37d7b-3ec2-45cc-8a9c-22ee6556af87; detaching it from the instance and deleting it from the info cache
May 28 00:59:51.117739 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-63b7a5c0-9b33-4ff4-b34a-1ec6215d789f req-bdfabd29-4dec-4369-abbd-c83342c3c4ee service nova] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Detach interface failed, port_id=73b37d7b-3ec2-45cc-8a9c-22ee6556af87, reason: Instance a8a28bb4-c3ea-4fb9-9130-1e8239191c5b could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 00:59:51.257225 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:59:51.288510 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-79bb54ab-a183-4700-a476-ad5f38fac6c1 req-be824626-ac11-4518-92f1-27511d406cc8 service nova] Releasing lock "refresh_cache-2dbd7449-2081-4377-a31d-e4d202679da1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:59:51.316236 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Successfully updated port: 5624a417-cdef-4be1-8586-16ca7bfdc8b9 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 00:59:51.485939 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Rescuing
May 28 00:59:51.486131 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "refresh_cache-dccaa2b7-3c00-45f9-bf40-1a8a15030825" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:59:51.486262 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquired lock "refresh_cache-dccaa2b7-3c00-45f9-bf40-1a8a15030825" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:59:51.486403 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 00:59:51.674414 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Booting with volume edef1fd4-4646-4d7f-aad4-df2fc2a4dcca at /dev/vdc
May 28 00:59:51.740599 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 00:59:51.759160 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 00:59:51.763126 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Took 1.66 seconds to deallocate network for instance.
May 28 00:59:51.784344 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:51.843464 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 00:59:51.843821 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 00:59:51.855528 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 00:59:51.857484 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe75:1c46', 'fe80::8c3:73ff:fe68:9ea1', 'fe80::fc16:3eff:fe85:df78', 'fe80::3834:39ff:fe20:36ec', 'fe80::fc16:3eff:fef0:246e', 'fe80::fc16:3eff:feca:a831', 'fe80::fc16:3eff:fe3e:2329', 'fe80::e8d7:d3ff:fe11:4890', 'fe80::fc16:3eff:febd:1fa1', 'fe80::743e:7eff:fe2c:709c', 'fe80::fc16:3eff:fe12:3f51', 'fe80::64e0:a4ff:fe34:ffd6', 'fe80::fc16:3eff:fe72:df47'] 
May 28 00:59:51.857638 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 00:59:51.857774 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 00:59:51.858237 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 00:59:51.858486 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Updating existing volume attachment record: 2cf3ac73-aece-464d-a747-e65f4af77a32 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 00:59:51.990966 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:52.008649 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f1d4e1b0-e0b0-4c0f-b79b-97ed3a770f16 req-1d6a5af7-c50b-4641-a822-c8401d076458 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-changed-7de931f4-ea15-4c26-9bd7-00b40cd57781 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:52.008649 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f1d4e1b0-e0b0-4c0f-b79b-97ed3a770f16 req-1d6a5af7-c50b-4641-a822-c8401d076458 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Refreshing instance network info cache due to event network-changed-7de931f4-ea15-4c26-9bd7-00b40cd57781. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:59:52.008649 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f1d4e1b0-e0b0-4c0f-b79b-97ed3a770f16 req-1d6a5af7-c50b-4641-a822-c8401d076458 service nova] Acquiring lock "refresh_cache-2dbd7449-2081-4377-a31d-e4d202679da1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:59:52.008649 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f1d4e1b0-e0b0-4c0f-b79b-97ed3a770f16 req-1d6a5af7-c50b-4641-a822-c8401d076458 service nova] Acquired lock "refresh_cache-2dbd7449-2081-4377-a31d-e4d202679da1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:59:52.009369 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-f1d4e1b0-e0b0-4c0f-b79b-97ed3a770f16 req-1d6a5af7-c50b-4641-a822-c8401d076458 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Refreshing network info cache for port 7de931f4-ea15-4c26-9bd7-00b40cd57781 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:59:52.044533 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee2403bb-2ffa-4eba-885c-b1af5ac106ea tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d988b526-836d-48b8-a381-1f7679caf41d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.651s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:52.273721 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9ea24d40-db51-4930-adfc-e3552782c315 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:52.273909 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9ea24d40-db51-4930-adfc-e3552782c315 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:52.421504 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:52.425833 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:52.512868 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-f1d4e1b0-e0b0-4c0f-b79b-97ed3a770f16 req-1d6a5af7-c50b-4641-a822-c8401d076458 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:52.552150 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-9ea24d40-db51-4930-adfc-e3552782c315 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Refreshing inventories for resource provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 28 00:59:52.654583 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-9ea24d40-db51-4930-adfc-e3552782c315 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Updating ProviderTree inventory for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 28 00:59:52.656593 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-9ea24d40-db51-4930-adfc-e3552782c315 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Updating inventory in ProviderTree for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 00:59:52.666446 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-f1d4e1b0-e0b0-4c0f-b79b-97ed3a770f16 req-1d6a5af7-c50b-4641-a822-c8401d076458 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:59:52.706504 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fc6b4dad-b493-4307-b239-c2671d817321 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "d09e5674-c5ab-4ace-9952-554361002541" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:52.706741 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fc6b4dad-b493-4307-b239-c2671d817321 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d09e5674-c5ab-4ace-9952-554361002541" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:52.742839 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-9ea24d40-db51-4930-adfc-e3552782c315 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Refreshing aggregate associations for resource provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2, aggregates: None {{(pid=98319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 28 00:59:52.756213 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Updating instance_info_cache with network_info: [{"id": "3c4c4d7c-c6bd-4039-b75c-70bce7052b58", "address": "fa:16:3e:3e:23:29", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4c4d7c-c6", "ovs_interfaceid": "3c4c4d7c-c6bd-4039-b75c-70bce7052b58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:59:52.805951 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-9ea24d40-db51-4930-adfc-e3552782c315 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Refreshing trait associations for resource provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ARCH_PPC64LE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,HW_ARCH_X86_64,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOUND_MODEL_AC97,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ARCH_X86_64,COMPUTE_ARCH_S390X,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_SOUND_MODEL_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ARCH_MIPSEL,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOUND_MODEL_SB16,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ARCH_RISCV64,HW_CPU_X86_SSE2,COMPUTE_ARCH_AARCH64,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_IGB {{(pid=98319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 28 00:59:52.963640 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-f1d4e1b0-e0b0-4c0f-b79b-97ed3a770f16 req-1d6a5af7-c50b-4641-a822-c8401d076458 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:59:53.184051 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-733757a3-db86-4077-a5c9-cb8d4e54bfc0 req-affafad3-b670-4f54-a031-67c3aae4191f service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-changed-5624a417-cdef-4be1-8586-16ca7bfdc8b9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:53.184051 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-733757a3-db86-4077-a5c9-cb8d4e54bfc0 req-affafad3-b670-4f54-a031-67c3aae4191f service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Refreshing instance network info cache due to event network-changed-5624a417-cdef-4be1-8586-16ca7bfdc8b9. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:59:53.184051 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-733757a3-db86-4077-a5c9-cb8d4e54bfc0 req-affafad3-b670-4f54-a031-67c3aae4191f service nova] Acquiring lock "refresh_cache-2dbd7449-2081-4377-a31d-e4d202679da1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:59:53.213059 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-fc6b4dad-b493-4307-b239-c2671d817321 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Detaching volume 7734b529-89b2-424a-b025-86b7042d9da8
May 28 00:59:53.260067 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Releasing lock "refresh_cache-dccaa2b7-3c00-45f9-bf40-1a8a15030825" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:59:53.285727 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-fc6b4dad-b493-4307-b239-c2671d817321 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Attempting to driver detach volume 7734b529-89b2-424a-b025-86b7042d9da8 from mountpoint /dev/vdb
May 28 00:59:53.293628 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fc6b4dad-b493-4307-b239-c2671d817321 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Found disk vdb by alias ua-7734b529-89b2-424a-b025-86b7042d9da8 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 00:59:53.297804 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fc6b4dad-b493-4307-b239-c2671d817321 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Found disk vdb by alias ua-7734b529-89b2-424a-b025-86b7042d9da8 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 00:59:53.297804 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fc6b4dad-b493-4307-b239-c2671d817321 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Attempting to detach device vdb from instance d09e5674-c5ab-4ace-9952-554361002541 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 00:59:53.297804 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-fc6b4dad-b493-4307-b239-c2671d817321 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] detach device xml: <disk type="block" device="disk">
May 28 00:59:53.297804 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 00:59:53.297804 np0000001577 nova-compute[98319]:   <alias name="ua-7734b529-89b2-424a-b025-86b7042d9da8"/>
May 28 00:59:53.297804 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-3"/>
May 28 00:59:53.297804 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 00:59:53.297804 np0000001577 nova-compute[98319]:   <serial>7734b529-89b2-424a-b025-86b7042d9da8</serial>
May 28 00:59:53.297804 np0000001577 nova-compute[98319]:   <shareable/>
May 28 00:59:53.297804 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 00:59:53.297804 np0000001577 nova-compute[98319]: </disk>
May 28 00:59:53.297804 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 00:59:53.307586 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-fc6b4dad-b493-4307-b239-c2671d817321 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Successfully detached device vdb from instance d09e5674-c5ab-4ace-9952-554361002541 from the persistent domain config.
May 28 00:59:53.310505 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fc6b4dad-b493-4307-b239-c2671d817321 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] (1/8): Attempting to detach device vdb with device alias ua-7734b529-89b2-424a-b025-86b7042d9da8 from instance d09e5674-c5ab-4ace-9952-554361002541 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 00:59:53.310865 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-fc6b4dad-b493-4307-b239-c2671d817321 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] detach device xml: <disk type="block" device="disk">
May 28 00:59:53.310865 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 00:59:53.310865 np0000001577 nova-compute[98319]:   <alias name="ua-7734b529-89b2-424a-b025-86b7042d9da8"/>
May 28 00:59:53.310865 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-3"/>
May 28 00:59:53.310865 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 00:59:53.310865 np0000001577 nova-compute[98319]:   <serial>7734b529-89b2-424a-b025-86b7042d9da8</serial>
May 28 00:59:53.310865 np0000001577 nova-compute[98319]:   <shareable/>
May 28 00:59:53.310865 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 00:59:53.310865 np0000001577 nova-compute[98319]: </disk>
May 28 00:59:53.310865 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 00:59:53.431576 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Successfully updated port: 3de085f7-074a-44c7-99ab-7093e0ddc084 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 00:59:53.466769 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f1d4e1b0-e0b0-4c0f-b79b-97ed3a770f16 req-1d6a5af7-c50b-4641-a822-c8401d076458 service nova] Releasing lock "refresh_cache-2dbd7449-2081-4377-a31d-e4d202679da1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:59:53.468072 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-733757a3-db86-4077-a5c9-cb8d4e54bfc0 req-affafad3-b670-4f54-a031-67c3aae4191f service nova] Acquired lock "refresh_cache-2dbd7449-2081-4377-a31d-e4d202679da1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:59:53.468072 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-733757a3-db86-4077-a5c9-cb8d4e54bfc0 req-affafad3-b670-4f54-a031-67c3aae4191f service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Refreshing network info cache for port 5624a417-cdef-4be1-8586-16ca7bfdc8b9 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:59:53.490686 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-507bafbe-fe03-4bd4-8a06-fdb11cfa887f req-8e98cdce-c1f8-4fea-be56-3519de487caf service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-changed-3de085f7-074a-44c7-99ab-7093e0ddc084 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:53.491178 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-507bafbe-fe03-4bd4-8a06-fdb11cfa887f req-8e98cdce-c1f8-4fea-be56-3519de487caf service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Refreshing instance network info cache due to event network-changed-3de085f7-074a-44c7-99ab-7093e0ddc084. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:59:53.491310 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-507bafbe-fe03-4bd4-8a06-fdb11cfa887f req-8e98cdce-c1f8-4fea-be56-3519de487caf service nova] Acquiring lock "refresh_cache-2dbd7449-2081-4377-a31d-e4d202679da1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:59:53.493843 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9ea24d40-db51-4930-adfc-e3552782c315 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:59:53.494032 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-9ea24d40-db51-4930-adfc-e3552782c315 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:59:53.943262 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779929993.9428444, d09e5674-c5ab-4ace-9952-554361002541 => ua-7734b529-89b2-424a-b025-86b7042d9da8> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 00:59:53.948602 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fc6b4dad-b493-4307-b239-c2671d817321 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-7734b529-89b2-424a-b025-86b7042d9da8 for instance d09e5674-c5ab-4ace-9952-554361002541 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 00:59:53.951237 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-fc6b4dad-b493-4307-b239-c2671d817321 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Successfully detached device vdb from instance d09e5674-c5ab-4ace-9952-554361002541 from the live domain config.
May 28 00:59:53.970037 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-733757a3-db86-4077-a5c9-cb8d4e54bfc0 req-affafad3-b670-4f54-a031-67c3aae4191f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:54.001117 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-9ea24d40-db51-4930-adfc-e3552782c315 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:59:54.022318 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 00:59:54.023347 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 00:59:54.023582 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Creating image(s)
May 28 00:59:54.025716 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 00:59:54.025716 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Ensure instance console log exists: /opt/stack/data/nova/instances/2dbd7449-2081-4377-a31d-e4d202679da1/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 00:59:54.025923 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:54.026063 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:54.026195 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:54.081056 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-733757a3-db86-4077-a5c9-cb8d4e54bfc0 req-affafad3-b670-4f54-a031-67c3aae4191f service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:59:54.258756 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-733757a3-db86-4077-a5c9-cb8d4e54bfc0 req-affafad3-b670-4f54-a031-67c3aae4191f service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:59:54.509365 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Acquiring lock "6cb44d19-8ed5-4c83-aedd-5fa187c05b00" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:54.509660 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "6cb44d19-8ed5-4c83-aedd-5fa187c05b00" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:54.519568 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9ea24d40-db51-4930-adfc-e3552782c315 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.244s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:54.531526 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-fc6b4dad-b493-4307-b239-c2671d817321 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Detected multiple connections on this host for volume: 7734b529-89b2-424a-b025-86b7042d9da8, skipping target disconnect.
May 28 00:59:54.562379 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Successfully updated port: 02325a90-5e85-4e9f-a65e-c1bd91c39e80 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 00:59:54.588425 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:54.608741 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-9ea24d40-db51-4930-adfc-e3552782c315 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Deleted allocations for instance a8a28bb4-c3ea-4fb9-9130-1e8239191c5b
May 28 00:59:54.761034 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-733757a3-db86-4077-a5c9-cb8d4e54bfc0 req-affafad3-b670-4f54-a031-67c3aae4191f service nova] Releasing lock "refresh_cache-2dbd7449-2081-4377-a31d-e4d202679da1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:59:54.762312 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-507bafbe-fe03-4bd4-8a06-fdb11cfa887f req-8e98cdce-c1f8-4fea-be56-3519de487caf service nova] Acquired lock "refresh_cache-2dbd7449-2081-4377-a31d-e4d202679da1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:59:54.762312 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-507bafbe-fe03-4bd4-8a06-fdb11cfa887f req-8e98cdce-c1f8-4fea-be56-3519de487caf service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Refreshing network info cache for port 3de085f7-074a-44c7-99ab-7093e0ddc084 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:59:54.956881 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:54.981994 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:55.012026 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 00:59:55.105447 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-fc6b4dad-b493-4307-b239-c2671d817321 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lazy-loading 'flavor' on Instance uuid d09e5674-c5ab-4ace-9952-554361002541 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:55.133383 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:55.143639 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:55.264480 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-507bafbe-fe03-4bd4-8a06-fdb11cfa887f req-8e98cdce-c1f8-4fea-be56-3519de487caf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:55.275031 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999693471 future=<Future at 0x7c98705a8950 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 00:59:55.275202 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Instance destroyed successfully.
May 28 00:59:55.276169 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'numa_topology' on Instance uuid dccaa2b7-3c00-45f9-bf40-1a8a15030825 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:55.362971 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-507bafbe-fe03-4bd4-8a06-fdb11cfa887f req-8e98cdce-c1f8-4fea-be56-3519de487caf service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:59:55.558574 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e72bd90c-7d3f-424d-ba7b-1ee25a0f9f6b req-dd907e2f-4290-4b39-9e3d-c58d13a07e62 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-changed-02325a90-5e85-4e9f-a65e-c1bd91c39e80 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:55.558763 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e72bd90c-7d3f-424d-ba7b-1ee25a0f9f6b req-dd907e2f-4290-4b39-9e3d-c58d13a07e62 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Refreshing instance network info cache due to event network-changed-02325a90-5e85-4e9f-a65e-c1bd91c39e80. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:59:55.559899 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e72bd90c-7d3f-424d-ba7b-1ee25a0f9f6b req-dd907e2f-4290-4b39-9e3d-c58d13a07e62 service nova] Acquiring lock "refresh_cache-2dbd7449-2081-4377-a31d-e4d202679da1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:59:55.577443 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-507bafbe-fe03-4bd4-8a06-fdb11cfa887f req-8e98cdce-c1f8-4fea-be56-3519de487caf service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:59:55.588610 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:55.588759 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:55.591855 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 00:59:55.592024 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Claim successful on node np0000001577
May 28 00:59:55.636505 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9ea24d40-db51-4930-adfc-e3552782c315 tempest-TestServerVolumeAttachmentScenario-1047363655 tempest-TestServerVolumeAttachmentScenario-1047363655-project-member] Lock "a8a28bb4-c3ea-4fb9-9130-1e8239191c5b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.504s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:55.683038 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Successfully updated port: 59a7e22c-8c09-4a33-9b95-58ee955f6895 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 00:59:55.774816 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-620ffb86-840c-48b0-9916-b376898a7426 req-829edbca-629a-4188-a592-b1708297851f service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-changed-59a7e22c-8c09-4a33-9b95-58ee955f6895 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:55.775474 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-620ffb86-840c-48b0-9916-b376898a7426 req-829edbca-629a-4188-a592-b1708297851f service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Refreshing instance network info cache due to event network-changed-59a7e22c-8c09-4a33-9b95-58ee955f6895. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:59:55.775474 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-620ffb86-840c-48b0-9916-b376898a7426 req-829edbca-629a-4188-a592-b1708297851f service nova] Acquiring lock "refresh_cache-2dbd7449-2081-4377-a31d-e4d202679da1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:59:55.780158 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Attempting rescue
May 28 00:59:55.780994 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98319) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 28 00:59:55.784142 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Instance directory exists: not creating {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 00:59:55.784142 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Creating image(s)
May 28 00:59:55.784826 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "/opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:55.785646 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "/opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:55.785646 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "/opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:55.789517 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'trusted_certs' on Instance uuid dccaa2b7-3c00-45f9-bf40-1a8a15030825 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:56.009905 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:56.079815 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-507bafbe-fe03-4bd4-8a06-fdb11cfa887f req-8e98cdce-c1f8-4fea-be56-3519de487caf service nova] Releasing lock "refresh_cache-2dbd7449-2081-4377-a31d-e4d202679da1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:59:56.080008 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e72bd90c-7d3f-424d-ba7b-1ee25a0f9f6b req-dd907e2f-4290-4b39-9e3d-c58d13a07e62 service nova] Acquired lock "refresh_cache-2dbd7449-2081-4377-a31d-e4d202679da1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:59:56.080178 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-e72bd90c-7d3f-424d-ba7b-1ee25a0f9f6b req-dd907e2f-4290-4b39-9e3d-c58d13a07e62 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Refreshing network info cache for port 02325a90-5e85-4e9f-a65e-c1bd91c39e80 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:59:56.126851 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fc6b4dad-b493-4307-b239-c2671d817321 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d09e5674-c5ab-4ace-9952-554361002541" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.420s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:56.168568 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "d988b526-836d-48b8-a381-1f7679caf41d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:56.168797 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d988b526-836d-48b8-a381-1f7679caf41d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:56.290053 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Object Instance<dccaa2b7-3c00-45f9-bf40-1a8a15030825> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 00:59:56.290053 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:59:56.299977 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:59:56.301047 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:56.301380 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:56.301832 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:59:56.305006 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 00:59:56.305136 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:56.418567 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.113s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:56.419011 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk.rescue {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 00:59:56.466971 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk.rescue" returned: 0 in 0.046s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 00:59:56.466971 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.165s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:56.466971 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'migration_context' on Instance uuid dccaa2b7-3c00-45f9-bf40-1a8a15030825 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:56.582427 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-e72bd90c-7d3f-424d-ba7b-1ee25a0f9f6b req-dd907e2f-4290-4b39-9e3d-c58d13a07e62 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:56.672311 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Detaching volume 7734b529-89b2-424a-b025-86b7042d9da8
May 28 00:59:56.700984 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-e72bd90c-7d3f-424d-ba7b-1ee25a0f9f6b req-dd907e2f-4290-4b39-9e3d-c58d13a07e62 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:59:56.730350 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Attempting to driver detach volume 7734b529-89b2-424a-b025-86b7042d9da8 from mountpoint /dev/vdb
May 28 00:59:56.739693 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Found disk vdb by alias ua-7734b529-89b2-424a-b025-86b7042d9da8 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 00:59:56.746851 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Found disk vdb by alias ua-7734b529-89b2-424a-b025-86b7042d9da8 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 00:59:56.747479 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Attempting to detach device vdb from instance d988b526-836d-48b8-a381-1f7679caf41d from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 00:59:56.747479 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] detach device xml: <disk type="block" device="disk">
May 28 00:59:56.747479 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 00:59:56.747479 np0000001577 nova-compute[98319]:   <alias name="ua-7734b529-89b2-424a-b025-86b7042d9da8"/>
May 28 00:59:56.747479 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-3"/>
May 28 00:59:56.747479 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 00:59:56.747479 np0000001577 nova-compute[98319]:   <serial>7734b529-89b2-424a-b025-86b7042d9da8</serial>
May 28 00:59:56.747479 np0000001577 nova-compute[98319]:   <shareable/>
May 28 00:59:56.747479 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 00:59:56.747479 np0000001577 nova-compute[98319]: </disk>
May 28 00:59:56.747479 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 00:59:56.757648 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Successfully detached device vdb from instance d988b526-836d-48b8-a381-1f7679caf41d from the persistent domain config.
May 28 00:59:56.757648 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] (1/8): Attempting to detach device vdb with device alias ua-7734b529-89b2-424a-b025-86b7042d9da8 from instance d988b526-836d-48b8-a381-1f7679caf41d from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 00:59:56.757648 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] detach device xml: <disk type="block" device="disk">
May 28 00:59:56.757648 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 00:59:56.757648 np0000001577 nova-compute[98319]:   <alias name="ua-7734b529-89b2-424a-b025-86b7042d9da8"/>
May 28 00:59:56.757648 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-3"/>
May 28 00:59:56.757648 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 00:59:56.757648 np0000001577 nova-compute[98319]:   <serial>7734b529-89b2-424a-b025-86b7042d9da8</serial>
May 28 00:59:56.757648 np0000001577 nova-compute[98319]:   <shareable/>
May 28 00:59:56.757648 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 00:59:56.757648 np0000001577 nova-compute[98319]: </disk>
May 28 00:59:56.757648 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 00:59:56.827266 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Successfully updated port: d1b61752-f189-4f02-b9eb-92326fb29830 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 00:59:56.906561 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-e72bd90c-7d3f-424d-ba7b-1ee25a0f9f6b req-dd907e2f-4290-4b39-9e3d-c58d13a07e62 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:59:56.972597 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Object Instance<dccaa2b7-3c00-45f9-bf40-1a8a15030825> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 00:59:56.972820 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 00:59:56.973441 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Start _get_guest_xml network_info=[{"id": "3c4c4d7c-c6bd-4039-b75c-70bce7052b58", "address": "fa:16:3e:3e:23:29", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "vif_mac": "fa:16:3e:3e:23:29"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4c4d7c-c6", "ovs_interfaceid": "3c4c4d7c-c6bd-4039-b75c-70bce7052b58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 00:59:56.973441 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'resources' on Instance uuid dccaa2b7-3c00-45f9-bf40-1a8a15030825 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:57.140409 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 00:59:57.140618 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 00:59:57.330109 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Acquiring lock "refresh_cache-2dbd7449-2081-4377-a31d-e4d202679da1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:59:57.411209 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e72bd90c-7d3f-424d-ba7b-1ee25a0f9f6b req-dd907e2f-4290-4b39-9e3d-c58d13a07e62 service nova] Releasing lock "refresh_cache-2dbd7449-2081-4377-a31d-e4d202679da1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:59:57.411559 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-620ffb86-840c-48b0-9916-b376898a7426 req-829edbca-629a-4188-a592-b1708297851f service nova] Acquired lock "refresh_cache-2dbd7449-2081-4377-a31d-e4d202679da1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:59:57.411710 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-620ffb86-840c-48b0-9916-b376898a7426 req-829edbca-629a-4188-a592-b1708297851f service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Refreshing network info cache for port 59a7e22c-8c09-4a33-9b95-58ee955f6895 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 00:59:57.475814 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Object Instance<dccaa2b7-3c00-45f9-bf40-1a8a15030825> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 00:59:57.478682 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 00:59:57.480085 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1356732443', uuid='dccaa2b7-3c00-45f9-bf40-1a8a15030825'), owner=OwnerMeta(userid='e2684c1dc140407b91687ee5abadef9d', username='tempest-ServerRescueNegativeTestJSON-509890320-project-member', projectid='a3c5a1da6bb242e9a58cb82855897726', projectname='tempest-ServerRescueNegativeTestJSON-509890320'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3c4c4d7c-c6bd-4039-b75c-70bce7052b58", "address": "fa:16:3e:3e:23:29", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "vif_mac": "fa:16:3e:3e:23:29"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4c4d7c-c6", "ovs_interfaceid": "3c4c4d7c-c6bd-4039-b75c-70bce7052b58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779929997.4797087) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 00:59:57.483318 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 00:59:57.483787 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 00:59:57.485836 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 00:59:57.486075 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 00:59:57.487171 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 00:59:57.487465 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 00:59:57.487621 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 00:59:57.487720 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 00:59:57.487862 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 00:59:57.487955 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 00:59:57.488052 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 00:59:57.488208 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 00:59:57.488365 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 00:59:57.489250 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 00:59:57.489404 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 00:59:57.489688 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 00:59:57.490389 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'vcpu_model' on Instance uuid dccaa2b7-3c00-45f9-bf40-1a8a15030825 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:57.645747 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4c55f372-6bbb-4dc9-b38a-987cddfec6e8 req-9c11e593-882c-47b7-8d5d-0d4f26b42ee2 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-changed-d1b61752-f189-4f02-b9eb-92326fb29830 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:57.647095 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 00:59:57.652198 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4c55f372-6bbb-4dc9-b38a-987cddfec6e8 req-9c11e593-882c-47b7-8d5d-0d4f26b42ee2 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Refreshing instance network info cache due to event network-changed-d1b61752-f189-4f02-b9eb-92326fb29830. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 00:59:57.652605 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4c55f372-6bbb-4dc9-b38a-987cddfec6e8 req-9c11e593-882c-47b7-8d5d-0d4f26b42ee2 service nova] Acquiring lock "refresh_cache-2dbd7449-2081-4377-a31d-e4d202679da1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 00:59:57.913524 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-620ffb86-840c-48b0-9916-b376898a7426 req-829edbca-629a-4188-a592-b1708297851f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:57.994469 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Object Instance<dccaa2b7-3c00-45f9-bf40-1a8a15030825> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 00:59:58.013235 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-620ffb86-840c-48b0-9916-b376898a7426 req-829edbca-629a-4188-a592-b1708297851f service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:59:58.022583 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1356732443',display_name='tempest-ServerRescueNegativeTestJSON-server-1356732443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serverrescuenegativetestjson-server-1356732443',id=15,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T00:59:27Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3c5a1da6bb242e9a58cb82855897726',ramdisk_id='',reservation_id='r-ptb9d526',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-509890320',owner_user_name='tempest-ServerRescueNegativeTestJSON-509890320-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:59:28Z,user_data=None,user_id='e2684c1dc140407b91687ee5abadef9d',uuid=dccaa2b7-3c00-45f9-bf40-1a8a15030825,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c4c4d7c-c6bd-4039-b75c-70bce7052b58", "address": "fa:16:3e:3e:23:29", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "vif_mac": "fa:16:3e:3e:23:29"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4c4d7c-c6", "ovs_interfaceid": "3c4c4d7c-c6bd-4039-b75c-70bce7052b58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 00:59:58.022825 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Converting VIF {"id": "3c4c4d7c-c6bd-4039-b75c-70bce7052b58", "address": "fa:16:3e:3e:23:29", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "vif_mac": "fa:16:3e:3e:23:29"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4c4d7c-c6", "ovs_interfaceid": "3c4c4d7c-c6bd-4039-b75c-70bce7052b58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 00:59:58.023531 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:23:29,bridge_name='br-int',has_traffic_filtering=True,id=3c4c4d7c-c6bd-4039-b75c-70bce7052b58,network=Network(1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c4c4d7c-c6') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 00:59:58.024133 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'pci_devices' on Instance uuid dccaa2b7-3c00-45f9-bf40-1a8a15030825 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 00:59:58.157206 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.566s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:58.157206 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 00:59:58.246611 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-620ffb86-840c-48b0-9916-b376898a7426 req-829edbca-629a-4188-a592-b1708297851f service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 00:59:58.526036 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Object Instance<dccaa2b7-3c00-45f9-bf40-1a8a15030825> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 00:59:58.527023 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] End _get_guest_xml xml=<domain type="qemu">
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:   <uuid>dccaa2b7-3c00-45f9-bf40-1a8a15030825</uuid>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:   <name>instance-0000000f</name>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:   <metadata>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1356732443</nova:name>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 00:59:57</nova:creationTime>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       </nova:image>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:         <nova:user uuid="e2684c1dc140407b91687ee5abadef9d">tempest-ServerRescueNegativeTestJSON-509890320-project-member</nova:user>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:         <nova:project uuid="a3c5a1da6bb242e9a58cb82855897726">tempest-ServerRescueNegativeTestJSON-509890320</nova:project>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:         <nova:port uuid="3c4c4d7c-c6bd-4039-b75c-70bce7052b58">
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:         </nova:port>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:   </metadata>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:     <system>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       <entry name="serial">dccaa2b7-3c00-45f9-bf40-1a8a15030825</entry>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       <entry name="uuid">dccaa2b7-3c00-45f9-bf40-1a8a15030825</entry>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:     </system>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:   <os>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:   </os>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:   <features>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:     <acpi/>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:     <tcg>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:     </tcg>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:   </features>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:   </cpu>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:   <devices>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk.rescue"/>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:     </disk>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk"/>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:     </disk>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk.config.rescue"/>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:     </disk>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:3e:23:29"/>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       <target dev="tap3c4c4d7c-c6"/>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:     </interface>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/console.log" append="off"/>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:     </serial>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:     <video>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:     </video>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:     </rng>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:     </memballoon>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:   </devices>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]: </domain>
May 28 00:59:58.527023 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 00:59:58.533330 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Instance destroyed successfully.
May 28 00:59:58.673374 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 00:59:58.673520 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 00:59:58.673699 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:58.673897 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:58.751684 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-620ffb86-840c-48b0-9916-b376898a7426 req-829edbca-629a-4188-a592-b1708297851f service nova] Releasing lock "refresh_cache-2dbd7449-2081-4377-a31d-e4d202679da1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 00:59:58.752728 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Acquired lock "refresh_cache-2dbd7449-2081-4377-a31d-e4d202679da1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 00:59:58.752886 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 00:59:58.764193 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb8bed94f4864e6696094a671fc6ef4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caedf1b88e96476bacbd226b0510ed55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 00:59:59.178349 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Successfully created port: 789466ca-15ad-48a2-a426-0af41bc52b1b {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 00:59:59.182405 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 00:59:59.376449 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 00:59:59.591740 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 00:59:59.687140 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 00:59:59.707504 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Successfully updated port: 789466ca-15ad-48a2-a426-0af41bc52b1b {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 00:59:59.727970 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 00:59:59.730290 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8c5065d7-9eeb-487e-9a49-0ab1410c29c2 req-86ad2ace-433a-4d72-8d08-788a6059202c service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Received event network-vif-unplugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:59.730460 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8c5065d7-9eeb-487e-9a49-0ab1410c29c2 req-86ad2ace-433a-4d72-8d08-788a6059202c service nova] Acquiring lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:59.730646 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8c5065d7-9eeb-487e-9a49-0ab1410c29c2 req-86ad2ace-433a-4d72-8d08-788a6059202c service nova] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:59.731822 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8c5065d7-9eeb-487e-9a49-0ab1410c29c2 req-86ad2ace-433a-4d72-8d08-788a6059202c service nova] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:59.732002 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8c5065d7-9eeb-487e-9a49-0ab1410c29c2 req-86ad2ace-433a-4d72-8d08-788a6059202c service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] No waiting events found dispatching network-vif-unplugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:59:59.732085 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-8c5065d7-9eeb-487e-9a49-0ab1410c29c2 req-86ad2ace-433a-4d72-8d08-788a6059202c service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Received unexpected event network-vif-unplugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 for instance with vm_state active and task_state rescuing.
May 28 00:59:59.732184 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8c5065d7-9eeb-487e-9a49-0ab1410c29c2 req-86ad2ace-433a-4d72-8d08-788a6059202c service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Received event network-vif-unplugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 00:59:59.732310 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8c5065d7-9eeb-487e-9a49-0ab1410c29c2 req-86ad2ace-433a-4d72-8d08-788a6059202c service nova] Acquiring lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 00:59:59.732877 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8c5065d7-9eeb-487e-9a49-0ab1410c29c2 req-86ad2ace-433a-4d72-8d08-788a6059202c service nova] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 00:59:59.732877 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8c5065d7-9eeb-487e-9a49-0ab1410c29c2 req-86ad2ace-433a-4d72-8d08-788a6059202c service nova] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 00:59:59.733079 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8c5065d7-9eeb-487e-9a49-0ab1410c29c2 req-86ad2ace-433a-4d72-8d08-788a6059202c service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] No waiting events found dispatching network-vif-unplugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 00:59:59.733079 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-8c5065d7-9eeb-487e-9a49-0ab1410c29c2 req-86ad2ace-433a-4d72-8d08-788a6059202c service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Received unexpected event network-vif-unplugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 for instance with vm_state active and task_state rescuing.
May 28 01:00:00.033799 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:00.054656 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:00:00.054656 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:00:00.054656 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:00:00.054656 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] No VIF found with MAC fa:16:3e:3e:23:29, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:00:00.054656 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Using config drive
May 28 01:00:00.210082 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Acquiring lock "refresh_cache-6cb44d19-8ed5-4c83-aedd-5fa187c05b00" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:00:00.213535 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Acquired lock "refresh_cache-6cb44d19-8ed5-4c83-aedd-5fa187c05b00" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:00:00.213535 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:00:00.408186 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:00.557284 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'ec2_ids' on Instance uuid dccaa2b7-3c00-45f9-bf40-1a8a15030825 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:00:00.701080 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:00:00.702255 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:00:00.702526 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Creating image(s)
May 28 01:00:00.703145 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Acquiring lock "/opt/stack/data/nova/instances/6cb44d19-8ed5-4c83-aedd-5fa187c05b00/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:00.703314 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "/opt/stack/data/nova/instances/6cb44d19-8ed5-4c83-aedd-5fa187c05b00/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:00.704212 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "/opt/stack/data/nova/instances/6cb44d19-8ed5-4c83-aedd-5fa187c05b00/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:00.705569 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:00:00.709212 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:00:00.711367 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:00.763790 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:00.817813 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.106s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:00.822637 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:00.822637 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:00.822637 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:00:00.823668 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:00:00.825749 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:00.856104 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:00:00.922640 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.097s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:00.923092 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/6cb44d19-8ed5-4c83-aedd-5fa187c05b00/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:00.966879 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:00.981604 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/6cb44d19-8ed5-4c83-aedd-5fa187c05b00/disk 1073741824" returned: 0 in 0.058s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:00.982076 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.163s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:00.982243 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:01.018737 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:01.068228 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Object Instance<dccaa2b7-3c00-45f9-bf40-1a8a15030825> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:00:01.068228 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'keypairs' on Instance uuid dccaa2b7-3c00-45f9-bf40-1a8a15030825 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:00:01.098818 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.116s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:01.099325 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6cb44d19-8ed5-4c83-aedd-5fa187c05b00/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:00:01.099725 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cb44d19-8ed5-4c83-aedd-5fa187c05b00/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:01.202560 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:01.207208 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cb44d19-8ed5-4c83-aedd-5fa187c05b00/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:01.208602 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Cannot resize image /opt/stack/data/nova/instances/6cb44d19-8ed5-4c83-aedd-5fa187c05b00/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:00:01.208602 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:00:01.208602 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Ensure instance console log exists: /opt/stack/data/nova/instances/6cb44d19-8ed5-4c83-aedd-5fa187c05b00/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:00:01.208602 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:01.208602 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:01.208831 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:01.214680 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-7734b529-89b2-424a-b025-86b7042d9da8 for instance d988b526-836d-48b8-a381-1f7679caf41d {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:00:01.215345 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930001.214671, d988b526-836d-48b8-a381-1f7679caf41d => ua-7734b529-89b2-424a-b025-86b7042d9da8> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:00:01.219206 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Successfully detached device vdb from instance d988b526-836d-48b8-a381-1f7679caf41d from the live domain config.
May 28 01:00:01.221286 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:01.259334 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:00:01.260075 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8', 'iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7734b529-89b2-424a-b025-86b7042d9da8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:00:01.260075 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:00:01.260477 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:00:01.261125 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8', 'iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7734b529-89b2-424a-b025-86b7042d9da8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:00:01.261125 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:00:01.289690 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:01.289690 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:01.289690 np0000001577 nova-compute[98319]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 01:00:01.289690 np0000001577 nova-compute[98319]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 01:00:01.289690 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:01.289690 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:01.289690 np0000001577 nova-compute[98319]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ea028c7-3b28-468a-884e-ae85b2bc6f55 (non-flash)
May 28 01:00:01.289690 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:00:01.289690 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:01.289690 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:01.289690 np0000001577 nova-compute[98319]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 01:00:01.289690 np0000001577 nova-compute[98319]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8 (non-flash)
May 28 01:00:01.289690 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:01.289690 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:01.289690 np0000001577 nova-compute[98319]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ea028c7-3b28-468a-884e-ae85b2bc6f55 (non-flash)
May 28 01:00:01.289690 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:00:01.289690 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8', '27'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ea028c7-3b28-468a-884e-ae85b2bc6f55', '31')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:00:01.289690 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8', '28')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:00:01.289690 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8', '27')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:00:01.289690 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c984c50be20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8'): ({'sdh'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:00:01.289690 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Removing multipathed devices sdh, sdi {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:00:01.296466 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Flush multipath device 3300000009522a530 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:00:01.332331 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:00:01.387040 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:00:01.434235 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:00:01.435206 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:00:01.437281 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:00:01.439824 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Updating instance_info_cache with network_info: [{"id": "789466ca-15ad-48a2-a426-0af41bc52b1b", "address": "fa:16:3e:d9:e2:18", "network": {"id": "92076d1f-65e0-44ef-afce-207d3e18dc80", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906118401-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "caedf1b88e96476bacbd226b0510ed55", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap789466ca-15", "ovs_interfaceid": "789466ca-15ad-48a2-a426-0af41bc52b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:00:01.451453 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:01.453300 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:00:01.453582 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:00:01.465142 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:01.495808 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8, portal: 192.168.40.100,3260]
May 28 01:00:01.495808 np0000001577 nova-compute[98319]: Logout of [sid: 28, target: iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8, portal: 192.168.40.100,3260] successful.
May 28 01:00:01.495808 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:01.517693 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:01.533135 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:01.572623 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8, portal: 192.168.50.100,3260]
May 28 01:00:01.572623 np0000001577 nova-compute[98319]: Logout of [sid: 27, target: iqn.2023-03.storpool.com:os--volume-7734b529-89b2-424a-b025-86b7042d9da8, portal: 192.168.50.100,3260] successful.
May 28 01:00:01.572623 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:01.575826 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Object Instance<dccaa2b7-3c00-45f9-bf40-1a8a15030825> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:00:01.581876 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:01.593135 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:01.593380 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:00:01.593529 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] <== disconnect_volume: return (333ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:00:01.593834 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:00:01.694415 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:01.806835 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Creating config drive at /opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk.config.rescue
May 28 01:00:01.813351 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsdk450ds {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:01.846657 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b3979dd0-9a23-40c1-8876-c8c7ff52b46d req-c4001cc2-bf7b-45cd-9d59-d70fdc8665f1 service nova] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Received event network-changed-789466ca-15ad-48a2-a426-0af41bc52b1b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:01.849384 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b3979dd0-9a23-40c1-8876-c8c7ff52b46d req-c4001cc2-bf7b-45cd-9d59-d70fdc8665f1 service nova] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Refreshing instance network info cache due to event network-changed-789466ca-15ad-48a2-a426-0af41bc52b1b. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:00:01.849692 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b3979dd0-9a23-40c1-8876-c8c7ff52b46d req-c4001cc2-bf7b-45cd-9d59-d70fdc8665f1 service nova] Acquiring lock "refresh_cache-6cb44d19-8ed5-4c83-aedd-5fa187c05b00" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:00:01.908680 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsdk450ds" returned: 0 in 0.095s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:01.943857 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Releasing lock "refresh_cache-6cb44d19-8ed5-4c83-aedd-5fa187c05b00" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:00:01.944306 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Instance network_info: |[{"id": "789466ca-15ad-48a2-a426-0af41bc52b1b", "address": "fa:16:3e:d9:e2:18", "network": {"id": "92076d1f-65e0-44ef-afce-207d3e18dc80", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906118401-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "caedf1b88e96476bacbd226b0510ed55", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap789466ca-15", "ovs_interfaceid": "789466ca-15ad-48a2-a426-0af41bc52b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:00:01.945424 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b3979dd0-9a23-40c1-8876-c8c7ff52b46d req-c4001cc2-bf7b-45cd-9d59-d70fdc8665f1 service nova] Acquired lock "refresh_cache-6cb44d19-8ed5-4c83-aedd-5fa187c05b00" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:00:01.945718 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b3979dd0-9a23-40c1-8876-c8c7ff52b46d req-c4001cc2-bf7b-45cd-9d59-d70fdc8665f1 service nova] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Refreshing network info cache for port 789466ca-15ad-48a2-a426-0af41bc52b1b {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:00:01.951438 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Start _get_guest_xml network_info=[{"id": "789466ca-15ad-48a2-a426-0af41bc52b1b", "address": "fa:16:3e:d9:e2:18", "network": {"id": "92076d1f-65e0-44ef-afce-207d3e18dc80", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906118401-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "caedf1b88e96476bacbd226b0510ed55", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap789466ca-15", "ovs_interfaceid": "789466ca-15ad-48a2-a426-0af41bc52b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:00:01.958577 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:00:01.962006 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-1031123220', uuid='6cb44d19-8ed5-4c83-aedd-5fa187c05b00'), owner=OwnerMeta(userid='bb8bed94f4864e6696094a671fc6ef4f', username='tempest-ServersNegativeTestJSON-811169851-project-member', projectid='caedf1b88e96476bacbd226b0510ed55', projectname='tempest-ServersNegativeTestJSON-811169851'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "789466ca-15ad-48a2-a426-0af41bc52b1b", "address": "fa:16:3e:d9:e2:18", "network": {"id": "92076d1f-65e0-44ef-afce-207d3e18dc80", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906118401-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "caedf1b88e96476bacbd226b0510ed55", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap789466ca-15", "ovs_interfaceid": "789466ca-15ad-48a2-a426-0af41bc52b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930001.961293) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:00:01.963998 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:00:01.964562 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:00:01.968856 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:00:01.969234 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:00:01.971783 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:00:01.972673 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:00:01.972673 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:00:01.972848 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:00:01.973026 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:00:01.973811 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:00:01.973811 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:00:01.974723 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:00:01.974981 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:00:01.975439 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:00:01.975924 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:00:01.977608 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:00:01.999913 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T00:59:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1031123220',display_name='tempest-ServersNegativeTestJSON-server-1031123220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serversnegativetestjson-server-1031123220',id=20,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='caedf1b88e96476bacbd226b0510ed55',ramdisk_id='',reservation_id='r-f62mlp01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-811169851',owner_user_name='tempest-ServersNegativeTestJSON-811169851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:00:00Z,user_data=None,user_id='bb8bed94f4864e6696094a671fc6ef4f',uuid=6cb44d19-8ed5-4c83-aedd-5fa187c05b00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "789466ca-15ad-48a2-a426-0af41bc52b1b", "address": "fa:16:3e:d9:e2:18", "network": {"id": "92076d1f-65e0-44ef-afce-207d3e18dc80", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906118401-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "caedf1b88e96476bacbd226b0510ed55", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap789466ca-15", "ovs_interfaceid": "789466ca-15ad-48a2-a426-0af41bc52b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:00:02.000413 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Converting VIF {"id": "789466ca-15ad-48a2-a426-0af41bc52b1b", "address": "fa:16:3e:d9:e2:18", "network": {"id": "92076d1f-65e0-44ef-afce-207d3e18dc80", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906118401-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "caedf1b88e96476bacbd226b0510ed55", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap789466ca-15", "ovs_interfaceid": "789466ca-15ad-48a2-a426-0af41bc52b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:02.001476 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e2:18,bridge_name='br-int',has_traffic_filtering=True,id=789466ca-15ad-48a2-a426-0af41bc52b1b,network=Network(92076d1f-65e0-44ef-afce-207d3e18dc80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap789466ca-15') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:02.003183 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lazy-loading 'pci_devices' on Instance uuid 6cb44d19-8ed5-4c83-aedd-5fa187c05b00 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:00:02.148075 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:02.189568 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lazy-loading 'flavor' on Instance uuid d988b526-836d-48b8-a381-1f7679caf41d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:00:02.319985 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Updating instance_info_cache with network_info: [{"id": "8a85618a-56c3-4690-af32-885b836a2c19", "address": "fa:16:3e:8f:58:e7", "network": {"id": "4fae2e1c-05e1-4891-8645-b0200336c3ab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1018677949-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a85618a-56", "ovs_interfaceid": "8a85618a-56c3-4690-af32-885b836a2c19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7de931f4-ea15-4c26-9bd7-00b40cd57781", "address": "fa:16:3e:d8:03:80", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de931f4-ea", "ovs_interfaceid": "7de931f4-ea15-4c26-9bd7-00b40cd57781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5624a417-cdef-4be1-8586-16ca7bfdc8b9", "address": "fa:16:3e:3a:9b:65", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5624a417-cd", "ovs_interfaceid": "5624a417-cdef-4be1-8586-16ca7bfdc8b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3de085f7-074a-44c7-99ab-7093e0ddc084", "address": "fa:16:3e:ab:a0:32", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de085f7-07", "ovs_interfaceid": "3de085f7-074a-44c7-99ab-7093e0ddc084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02325a90-5e85-4e9f-a65e-c1bd91c39e80", "address": "fa:16:3e:e0:c1:49", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02325a90-5e", "ovs_interfaceid": "02325a90-5e85-4e9f-a65e-c1bd91c39e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "59a7e22c-8c09-4a33-9b95-58ee955f6895", "address": "fa:16:3e:1b:8b:e7", "network": {"id": "0a64f131-06a0-4c34-a1d8-06f8419256bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-288972260", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59a7e22c-8c", "ovs_interfaceid": "59a7e22c-8c09-4a33-9b95-58ee955f6895", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d1b61752-f189-4f02-b9eb-92326fb29830", "address": "fa:16:3e:40:00:63", "network": {"id": "0a64f131-06a0-4c34-a1d8-06f8419256bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-288972260", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b61752-f1", "ovs_interfaceid": "d1b61752-f189-4f02-b9eb-92326fb29830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:00:02.447042 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:02.452703 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:02.462230 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-b3979dd0-9a23-40c1-8876-c8c7ff52b46d req-c4001cc2-bf7b-45cd-9d59-d70fdc8665f1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:02.474706 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:02.475524 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:02.507893 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] End _get_guest_xml xml=<domain type="qemu">
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:   <uuid>6cb44d19-8ed5-4c83-aedd-5fa187c05b00</uuid>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:   <name>instance-00000014</name>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       <nova:name>tempest-ServersNegativeTestJSON-server-1031123220</nova:name>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:00:01</nova:creationTime>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:         <nova:user uuid="bb8bed94f4864e6696094a671fc6ef4f">tempest-ServersNegativeTestJSON-811169851-project-member</nova:user>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:         <nova:project uuid="caedf1b88e96476bacbd226b0510ed55">tempest-ServersNegativeTestJSON-811169851</nova:project>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:         <nova:port uuid="789466ca-15ad-48a2-a426-0af41bc52b1b">
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:     <system>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       <entry name="serial">6cb44d19-8ed5-4c83-aedd-5fa187c05b00</entry>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       <entry name="uuid">6cb44d19-8ed5-4c83-aedd-5fa187c05b00</entry>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:     </system>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:   <os>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:   </os>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:   <features>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:   </features>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:   <devices>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/6cb44d19-8ed5-4c83-aedd-5fa187c05b00/disk"/>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:     </disk>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/6cb44d19-8ed5-4c83-aedd-5fa187c05b00/disk.config"/>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:     </disk>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:d9:e2:18"/>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       <target dev="tap789466ca-15"/>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:     </interface>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/6cb44d19-8ed5-4c83-aedd-5fa187c05b00/console.log" append="off"/>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:     </serial>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:     <video>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:     </video>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:     </rng>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:   </devices>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]: </domain>
May 28 01:00:02.507893 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:00:02.507893 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Preparing to wait for external event network-vif-plugged-789466ca-15ad-48a2-a426-0af41bc52b1b {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:00:02.507893 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Acquiring lock "6cb44d19-8ed5-4c83-aedd-5fa187c05b00-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:02.507893 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "6cb44d19-8ed5-4c83-aedd-5fa187c05b00-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:02.507893 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "6cb44d19-8ed5-4c83-aedd-5fa187c05b00-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:02.507893 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T00:59:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1031123220',display_name='tempest-ServersNegativeTestJSON-server-1031123220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serversnegativetestjson-server-1031123220',id=20,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='caedf1b88e96476bacbd226b0510ed55',ramdisk_id='',reservation_id='r-f62mlp01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-811169851',owner_user_name='tempest-ServersNegativeTestJSON-811169851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:00:00Z,user_data=None,user_id='bb8bed94f4864e6696094a671fc6ef4f',uuid=6cb44d19-8ed5-4c83-aedd-5fa187c05b00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "789466ca-15ad-48a2-a426-0af41bc52b1b", "address": "fa:16:3e:d9:e2:18", "network": {"id": "92076d1f-65e0-44ef-afce-207d3e18dc80", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906118401-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "caedf1b88e96476bacbd226b0510ed55", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap789466ca-15", "ovs_interfaceid": "789466ca-15ad-48a2-a426-0af41bc52b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:00:02.507893 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Converting VIF {"id": "789466ca-15ad-48a2-a426-0af41bc52b1b", "address": "fa:16:3e:d9:e2:18", "network": {"id": "92076d1f-65e0-44ef-afce-207d3e18dc80", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906118401-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "caedf1b88e96476bacbd226b0510ed55", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap789466ca-15", "ovs_interfaceid": "789466ca-15ad-48a2-a426-0af41bc52b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:02.507893 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e2:18,bridge_name='br-int',has_traffic_filtering=True,id=789466ca-15ad-48a2-a426-0af41bc52b1b,network=Network(92076d1f-65e0-44ef-afce-207d3e18dc80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap789466ca-15') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:02.507893 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e2:18,bridge_name='br-int',has_traffic_filtering=True,id=789466ca-15ad-48a2-a426-0af41bc52b1b,network=Network(92076d1f-65e0-44ef-afce-207d3e18dc80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap789466ca-15') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:00:02.510175 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:02.510175 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:02.510175 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:00:02.510985 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:02.511199 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4fd0a500-0f04-5c42-be75-f0a078e83282', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:02.513504 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:02.515435 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:02.515499 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap789466ca-15, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:02.515897 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap789466ca-15, col_values=(('qos', UUID('64cd9e31-9fae-492d-a42a-02da21489744')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:02.517212 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap789466ca-15, col_values=(('external_ids', {'iface-id': '789466ca-15ad-48a2-a426-0af41bc52b1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:e2:18', 'vm-uuid': '6cb44d19-8ed5-4c83-aedd-5fa187c05b00'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:02.519921 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:02.523728 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:02.526666 np0000001577 nova-compute[98319]: INFO os_vif [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e2:18,bridge_name='br-int',has_traffic_filtering=True,id=789466ca-15ad-48a2-a426-0af41bc52b1b,network=Network(92076d1f-65e0-44ef-afce-207d3e18dc80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap789466ca-15')
May 28 01:00:02.569018 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:02.643486 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:02.649247 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:02.811345 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-b3979dd0-9a23-40c1-8876-c8c7ff52b46d req-c4001cc2-bf7b-45cd-9d59-d70fdc8665f1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:02.825570 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Releasing lock "refresh_cache-2dbd7449-2081-4377-a31d-e4d202679da1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:00:02.825570 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Instance network_info: |[{"id": "8a85618a-56c3-4690-af32-885b836a2c19", "address": "fa:16:3e:8f:58:e7", "network": {"id": "4fae2e1c-05e1-4891-8645-b0200336c3ab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1018677949-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a85618a-56", "ovs_interfaceid": "8a85618a-56c3-4690-af32-885b836a2c19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7de931f4-ea15-4c26-9bd7-00b40cd57781", "address": "fa:16:3e:d8:03:80", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de931f4-ea", "ovs_interfaceid": "7de931f4-ea15-4c26-9bd7-00b40cd57781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5624a417-cdef-4be1-8586-16ca7bfdc8b9", "address": "fa:16:3e:3a:9b:65", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5624a417-cd", "ovs_interfaceid": "5624a417-cdef-4be1-8586-16ca7bfdc8b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3de085f7-074a-44c7-99ab-7093e0ddc084", "address": "fa:16:3e:ab:a0:32", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de085f7-07", "ovs_interfaceid": "3de085f7-074a-44c7-99ab-7093e0ddc084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02325a90-5e85-4e9f-a65e-c1bd91c39e80", "address": "fa:16:3e:e0:c1:49", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02325a90-5e", "ovs_interfaceid": "02325a90-5e85-4e9f-a65e-c1bd91c39e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "59a7e22c-8c09-4a33-9b95-58ee955f6895", "address": "fa:16:3e:1b:8b:e7", "network": {"id": "0a64f131-06a0-4c34-a1d8-06f8419256bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-288972260", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59a7e22c-8c", "ovs_interfaceid": "59a7e22c-8c09-4a33-9b95-58ee955f6895", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d1b61752-f189-4f02-b9eb-92326fb29830", "address": "fa:16:3e:40:00:63", "network": {"id": "0a64f131-06a0-4c34-a1d8-06f8419256bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-288972260", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b61752-f1", "ovs_interfaceid": "d1b61752-f189-4f02-b9eb-92326fb29830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:00:02.825823 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Start _get_guest_xml network_info=[{"id": "8a85618a-56c3-4690-af32-885b836a2c19", "address": "fa:16:3e:8f:58:e7", "network": {"id": "4fae2e1c-05e1-4891-8645-b0200336c3ab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1018677949-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a85618a-56", "ovs_interfaceid": "8a85618a-56c3-4690-af32-885b836a2c19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7de931f4-ea15-4c26-9bd7-00b40cd57781", "address": "fa:16:3e:d8:03:80", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de931f4-ea", "ovs_interfaceid": "7de931f4-ea15-4c26-9bd7-00b40cd57781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5624a417-cdef-4be1-8586-16ca7bfdc8b9", "address": "fa:16:3e:3a:9b:65", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5624a417-cd", "ovs_interfaceid": "5624a417-cdef-4be1-8586-16ca7bfdc8b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3de085f7-074a-44c7-99ab-7093e0ddc084", "address": "fa:16:3e:ab:a0:32", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de085f7-07", "ovs_interfaceid": "3de085f7-074a-44c7-99ab-7093e0ddc084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02325a90-5e85-4e9f-a65e-c1bd91c39e80", "address": "fa:16:3e:e0:c1:49", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02325a90-5e", "ovs_interfaceid": "02325a90-5e85-4e9f-a65e-c1bd91c39e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "59a7e22c-8c09-4a33-9b95-58ee955f6895", "address": "fa:16:3e:1b:8b:e7", "network": {"id": "0a64f131-06a0-4c34-a1d8-06f8419256bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-288972260", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59a7e22c-8c", "ovs_interfaceid": "59a7e22c-8c09-4a33-9b95-58ee955f6895", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d1b61752-f189-4f02-b9eb-92326fb29830", "address": "fa:16:3e:40:00:63", "network": {"id": "0a64f131-06a0-4c34-a1d8-06f8419256bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-288972260", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b61752-f1", "ovs_interfaceid": "d1b61752-f189-4f02-b9eb-92326fb29830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', 'iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '2dbd7449-2081-4377-a31d-e4d202679da1', 'attached_at': '', 'detached_at': '', 'volume_id': '39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', 'serial': '39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '386dbd42-0912-4c17-b166-0577211ee1a5', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f', 'iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd22fca90-ede2-4d3c-a61b-f5cffaf76d2f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '2dbd7449-2081-4377-a31d-e4d202679da1', 'attached_at': '', 'detached_at': '', 'volume_id': 'd22fca90-ede2-4d3c-a61b-f5cffaf76d2f', 'serial': 'd22fca90-ede2-4d3c-a61b-f5cffaf76d2f'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'f2688d72-a5e3-4094-bc50-423e20f6db80', 'boot_index': 1, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '2dbd7449-2081-4377-a31d-e4d202679da1', 'attached_at': '', 'detached_at': '', 'volume_id': 'edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', 'serial': 'edef1fd4-4646-4d7f-aad4-df2fc2a4dcca'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '2cf3ac73-aece-464d-a747-e65f4af77a32', 'boot_index': 2, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:00:02.825823 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4c55f372-6bbb-4dc9-b38a-987cddfec6e8 req-9c11e593-882c-47b7-8d5d-0d4f26b42ee2 service nova] Acquired lock "refresh_cache-2dbd7449-2081-4377-a31d-e4d202679da1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:00:02.825823 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-4c55f372-6bbb-4dc9-b38a-987cddfec6e8 req-9c11e593-882c-47b7-8d5d-0d4f26b42ee2 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Refreshing network info cache for port d1b61752-f189-4f02-b9eb-92326fb29830 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:00:02.829929 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:00:02.831322 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1792575949', uuid='2dbd7449-2081-4377-a31d-e4d202679da1'), owner=OwnerMeta(userid='0b66af1e9e094d3fa78454b91757d6cf', username='tempest-TaggedBootDevicesTest_v242-1752653874-project-member', projectid='54eb635d961644dc9c1845baf24fc6db', projectname='tempest-TaggedBootDevicesTest_v242-1752653874'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8a85618a-56c3-4690-af32-885b836a2c19", "address": "fa:16:3e:8f:58:e7", "network": {"id": "4fae2e1c-05e1-4891-8645-b0200336c3ab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1018677949-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a85618a-56", "ovs_interfaceid": "8a85618a-56c3-4690-af32-885b836a2c19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7de931f4-ea15-4c26-9bd7-00b40cd57781", "address": "fa:16:3e:d8:03:80", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de931f4-ea", "ovs_interfaceid": "7de931f4-ea15-4c26-9bd7-00b40cd57781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5624a417-cdef-4be1-8586-16ca7bfdc8b9", "address": "fa:16:3e:3a:9b:65", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5624a417-cd", "ovs_interfaceid": "5624a417-cdef-4be1-8586-16ca7bfdc8b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3de085f7-074a-44c7-99ab-7093e0ddc084", "address": "fa:16:3e:ab:a0:32", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de085f7-07", "ovs_interfaceid": "3de085f7-074a-44c7-99ab-7093e0ddc084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02325a90-5e85-4e9f-a65e-c1bd91c39e80", "address": "fa:16:3e:e0:c1:49", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02325a90-5e", "ovs_interfaceid": "02325a90-5e85-4e9f-a65e-c1bd91c39e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "59a7e22c-8c09-4a33-9b95-58ee955f6895", "address": "fa:16:3e:1b:8b:e7", "network": {"id": "0a64f131-06a0-4c34-a1d8-06f8419256bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-288972260", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59a7e22c-8c", "ovs_interfaceid": "59a7e22c-8c09-4a33-9b95-58ee955f6895", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d1b61752-f189-4f02-b9eb-92326fb29830", "address": "fa:16:3e:40:00:63", "network": {"id": "0a64f131-06a0-4c34-a1d8-06f8419256bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-288972260", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b61752-f1", "ovs_interfaceid": "d1b61752-f189-4f02-b9eb-92326fb29830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930002.83081) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:00:02.832241 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:00:02.832666 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:00:02.833491 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:00:02.833719 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:00:02.834533 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:00:02.835337 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:00:02.835337 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:00:02.835337 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:00:02.835543 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:00:02.835543 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:00:02.835647 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:00:02.835817 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:00:02.835942 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:00:02.836083 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:00:02.836224 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:00:02.836673 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:00:02.853110 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:00:02.853779 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', 'iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:00:02.853924 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:00:02.854647 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:00:02.854825 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', 'iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:00:02.865880 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:00:02.866647 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:00:02.866933 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:00:02.867277 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:00:02.868020 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:00:02.868250 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:00:02.883703 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:00:02.883703 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:02.893237 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:00:02.893237 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:02.900990 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea] added
May 28 01:00:02.900990 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:00:02.900990 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:00:02.900990 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:00:02.900990 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:00:02.900990 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:00:02.900990 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:02.902825 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:00:02.903116 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0356(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:00:02.903497 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:00:02.903785 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea] added
May 28 01:00:02.903785 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:00:02.903785 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:00:02.903785 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:00:02.903785 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:00:02.903785 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:00:02.903785 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:02.903997 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:00:02.904117 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0372(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:00:02.904286 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:00:02.975711 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b3979dd0-9a23-40c1-8876-c8c7ff52b46d req-c4001cc2-bf7b-45cd-9d59-d70fdc8665f1 service nova] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Updated VIF entry in instance network info cache for port 789466ca-15ad-48a2-a426-0af41bc52b1b. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:00:02.978471 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b3979dd0-9a23-40c1-8876-c8c7ff52b46d req-c4001cc2-bf7b-45cd-9d59-d70fdc8665f1 service nova] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Updating instance_info_cache with network_info: [{"id": "789466ca-15ad-48a2-a426-0af41bc52b1b", "address": "fa:16:3e:d9:e2:18", "network": {"id": "92076d1f-65e0-44ef-afce-207d3e18dc80", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906118401-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "caedf1b88e96476bacbd226b0510ed55", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap789466ca-15", "ovs_interfaceid": "789466ca-15ad-48a2-a426-0af41bc52b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:00:03.195470 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-340694d3-98e7-46b0-a27b-f5817a62b2b5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d988b526-836d-48b8-a381-1f7679caf41d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.027s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:03.310579 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Removed pending STOPPED event for dccaa2b7-3c00-45f9-bf40-1a8a15030825 due to new event <LifecycleEvent: 1779930003.3102221, dccaa2b7-3c00-45f9-bf40-1a8a15030825 => Resumed> {{(pid=98319) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 01:00:03.310901 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930003.3102221, dccaa2b7-3c00-45f9-bf40-1a8a15030825 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:00:03.310901 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] VM Resumed (Lifecycle Event)
May 28 01:00:03.314929 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-2b2892c1-939a-40db-b8e4-88fb3a77e2d8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:03.329925 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-4c55f372-6bbb-4dc9-b38a-987cddfec6e8 req-9c11e593-882c-47b7-8d5d-0d4f26b42ee2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:03.480729 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b3979dd0-9a23-40c1-8876-c8c7ff52b46d req-c4001cc2-bf7b-45cd-9d59-d70fdc8665f1 service nova] Releasing lock "refresh_cache-6cb44d19-8ed5-4c83-aedd-5fa187c05b00" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:00:03.738113 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:03.799140 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-4c55f372-6bbb-4dc9-b38a-987cddfec6e8 req-9c11e593-882c-47b7-8d5d-0d4f26b42ee2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:03.816047 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:03.819203 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:00:03.903887 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:00:03.904514 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:00:03.920064 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:00:03.920064 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:00:03.933578 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:00:03.933578 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:03.939579 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:03.944724 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a405c29f-033e-4d91-850f-8b4a404031b6 req-93c24b87-198e-4937-9983-5c293f80fce4 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Received event network-vif-plugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:03.944724 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a405c29f-033e-4d91-850f-8b4a404031b6 req-93c24b87-198e-4937-9983-5c293f80fce4 service nova] Acquiring lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:03.944724 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a405c29f-033e-4d91-850f-8b4a404031b6 req-93c24b87-198e-4937-9983-5c293f80fce4 service nova] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:03.944724 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a405c29f-033e-4d91-850f-8b4a404031b6 req-93c24b87-198e-4937-9983-5c293f80fce4 service nova] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:03.944724 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a405c29f-033e-4d91-850f-8b4a404031b6 req-93c24b87-198e-4937-9983-5c293f80fce4 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] No waiting events found dispatching network-vif-plugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:00:03.946837 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-a405c29f-033e-4d91-850f-8b4a404031b6 req-93c24b87-198e-4937-9983-5c293f80fce4 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Received unexpected event network-vif-plugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 for instance with vm_state rescued and task_state None.
May 28 01:00:03.946837 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a405c29f-033e-4d91-850f-8b4a404031b6 req-93c24b87-198e-4937-9983-5c293f80fce4 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Received event network-vif-plugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:03.946837 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a405c29f-033e-4d91-850f-8b4a404031b6 req-93c24b87-198e-4937-9983-5c293f80fce4 service nova] Acquiring lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:03.946837 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a405c29f-033e-4d91-850f-8b4a404031b6 req-93c24b87-198e-4937-9983-5c293f80fce4 service nova] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:03.946837 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a405c29f-033e-4d91-850f-8b4a404031b6 req-93c24b87-198e-4937-9983-5c293f80fce4 service nova] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:03.946837 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a405c29f-033e-4d91-850f-8b4a404031b6 req-93c24b87-198e-4937-9983-5c293f80fce4 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] No waiting events found dispatching network-vif-plugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:00:03.946837 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-a405c29f-033e-4d91-850f-8b4a404031b6 req-93c24b87-198e-4937-9983-5c293f80fce4 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Received unexpected event network-vif-plugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 for instance with vm_state rescued and task_state None.
May 28 01:00:03.952198 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:03.959512 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:03.959512 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:03.959512 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:03.959512 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:03.959512 np0000001577 nova-compute[98319]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ea028c7-3b28-468a-884e-ae85b2bc6f55 (non-flash)
May 28 01:00:03.959512 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:00:03.959754 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:03.959754 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:03.959754 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:03.959754 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:03.959754 np0000001577 nova-compute[98319]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ea028c7-3b28-468a-884e-ae85b2bc6f55 (non-flash)
May 28 01:00:03.959754 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:00:03.970756 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:03.970756 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:03.970756 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:03.970756 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:03.970756 np0000001577 nova-compute[98319]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ea028c7-3b28-468a-884e-ae85b2bc6f55 (non-flash)
May 28 01:00:03.970756 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:00:03.971002 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:03.971002 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:03.971002 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:03.971002 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:03.971002 np0000001577 nova-compute[98319]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ea028c7-3b28-468a-884e-ae85b2bc6f55 (non-flash)
May 28 01:00:03.971002 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:00:04.005938 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-4c55f372-6bbb-4dc9-b38a-987cddfec6e8 req-9c11e593-882c-47b7-8d5d-0d4f26b42ee2 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Updated VIF entry in instance network info cache for port d1b61752-f189-4f02-b9eb-92326fb29830. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:00:04.005938 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-4c55f372-6bbb-4dc9-b38a-987cddfec6e8 req-9c11e593-882c-47b7-8d5d-0d4f26b42ee2 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Updating instance_info_cache with network_info: [{"id": "8a85618a-56c3-4690-af32-885b836a2c19", "address": "fa:16:3e:8f:58:e7", "network": {"id": "4fae2e1c-05e1-4891-8645-b0200336c3ab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1018677949-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a85618a-56", "ovs_interfaceid": "8a85618a-56c3-4690-af32-885b836a2c19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7de931f4-ea15-4c26-9bd7-00b40cd57781", "address": "fa:16:3e:d8:03:80", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de931f4-ea", "ovs_interfaceid": "7de931f4-ea15-4c26-9bd7-00b40cd57781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5624a417-cdef-4be1-8586-16ca7bfdc8b9", "address": "fa:16:3e:3a:9b:65", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5624a417-cd", "ovs_interfaceid": "5624a417-cdef-4be1-8586-16ca7bfdc8b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3de085f7-074a-44c7-99ab-7093e0ddc084", "address": "fa:16:3e:ab:a0:32", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de085f7-07", "ovs_interfaceid": "3de085f7-074a-44c7-99ab-7093e0ddc084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02325a90-5e85-4e9f-a65e-c1bd91c39e80", "address": "fa:16:3e:e0:c1:49", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02325a90-5e", "ovs_interfaceid": "02325a90-5e85-4e9f-a65e-c1bd91c39e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "59a7e22c-8c09-4a33-9b95-58ee955f6895", "address": "fa:16:3e:1b:8b:e7", "network": {"id": "0a64f131-06a0-4c34-a1d8-06f8419256bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-288972260", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59a7e22c-8c", "ovs_interfaceid": "59a7e22c-8c09-4a33-9b95-58ee955f6895", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d1b61752-f189-4f02-b9eb-92326fb29830", "address": "fa:16:3e:40:00:63", "network": {"id": "0a64f131-06a0-4c34-a1d8-06f8419256bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-288972260", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b61752-f1", "ovs_interfaceid": "d1b61752-f189-4f02-b9eb-92326fb29830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:00:04.008997 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea, portal: 192.168.40.100,3260]
May 28 01:00:04.008997 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea, portal: 192.168.40.100,3260] successful.
May 28 01:00:04.008997 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:04.009428 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea, portal: 192.168.50.100,3260]
May 28 01:00:04.009428 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea, portal: 192.168.50.100,3260] successful.
May 28 01:00:04.009428 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:04.024857 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:04.027384 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:04.044668 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:04.044668 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:04.044668 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:04.044668 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:04.044668 np0000001577 nova-compute[98319]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ea028c7-3b28-468a-884e-ae85b2bc6f55 (non-flash)
May 28 01:00:04.044668 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:04.044668 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:04.044668 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:00:04.045236 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:04.045236 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:04.045236 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:04.045236 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:04.045236 np0000001577 nova-compute[98319]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ea028c7-3b28-468a-884e-ae85b2bc6f55 (non-flash)
May 28 01:00:04.045236 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:04.045236 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:04.045236 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:00:04.046448 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.179s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:00:04.046695 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:00:04.047804 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:04.047804 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:04.047804 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:04.047804 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:04.047804 np0000001577 nova-compute[98319]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ea028c7-3b28-468a-884e-ae85b2bc6f55 (non-flash)
May 28 01:00:04.047804 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:04.047804 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:04.047804 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:00:04.048084 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:04.048084 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:04.048084 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:04.048084 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:04.048084 np0000001577 nova-compute[98319]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ea028c7-3b28-468a-884e-ae85b2bc6f55 (non-flash)
May 28 01:00:04.048084 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:04.048084 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:04.048084 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:00:04.049613 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:00:04.049613 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:00:04.049847 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] HCTL ('11', '-', '-', 0) found on session 33 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:00:04.050500 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:00:04.051005 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] HCTL ('8', '-', '-', 0) found on session 32 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:00:04.051146 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:00:04.054132 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:00:04.057661 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:00:04.057661 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] No VIF found with MAC fa:16:3e:d9:e2:18, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:00:04.057661 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Using config drive
May 28 01:00:04.097779 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Searching for a device in session 33 and hctl ['11', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:00:04.097779 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:00:04.097779 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Searching for a device in session 32 and hctl ['8', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:00:04.097779 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:00:04.327494 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930004.3255882, dccaa2b7-3c00-45f9-bf40-1a8a15030825 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:00:04.327494 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] VM Started (Lifecycle Event)
May 28 01:00:04.509812 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4c55f372-6bbb-4dc9-b38a-987cddfec6e8 req-9c11e593-882c-47b7-8d5d-0d4f26b42ee2 service nova] Releasing lock "refresh_cache-2dbd7449-2081-4377-a31d-e4d202679da1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:00:04.568374 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:04.704725 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Creating config drive at /opt/stack/data/nova/instances/6cb44d19-8ed5-4c83-aedd-5fa187c05b00/disk.config
May 28 01:00:04.708732 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6cb44d19-8ed5-4c83-aedd-5fa187c05b00/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5z6d2fpw {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:04.774859 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-29742f7e-accd-495d-b7d9-83093f6bf20c tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Unrescuing
May 28 01:00:04.776767 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-29742f7e-accd-495d-b7d9-83093f6bf20c tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "refresh_cache-dccaa2b7-3c00-45f9-bf40-1a8a15030825" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:00:04.776767 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-29742f7e-accd-495d-b7d9-83093f6bf20c tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquired lock "refresh_cache-dccaa2b7-3c00-45f9-bf40-1a8a15030825" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:00:04.776767 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-29742f7e-accd-495d-b7d9-83093f6bf20c tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:00:04.778939 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6cb44d19-8ed5-4c83-aedd-5fa187c05b00/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5z6d2fpw" returned: 0 in 0.070s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:04.833531 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:04.839597 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:00:04.869863 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:00:05.030571 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:05.031021 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:05.266713 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:05.282658 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-29742f7e-accd-495d-b7d9-83093f6bf20c tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:05.298278 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:05.306334 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:05.341063 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 28 01:00:05.416074 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:05.438747 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00037675800012948457 future=<Future at 0x7c988c1b7c20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:00:05.438814 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:00:05.438873 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=4.835813073000054 future=<Future at 0x7c98705a8950 state=cancelled>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:00:05.438912 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=4.835750166000025 future=<Future at 0x7c98705a8950 state=cancelled>) was cancelled while queued, skipping {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:00:05.439032 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:00:05.439448 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Emitting event <LifecycleEvent: 1779929990.4382114, a8a28bb4-c3ea-4fb9-9130-1e8239191c5b => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:00:05.439587 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] VM Stopped (Lifecycle Event)
May 28 01:00:05.531047 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-03821e44-af3c-4b5f-86d9-52a7c07fb350 req-6606a62e-0e39-4624-98b2-f4c28e9012dc service nova] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Received event network-vif-plugged-789466ca-15ad-48a2-a426-0af41bc52b1b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:05.531290 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-03821e44-af3c-4b5f-86d9-52a7c07fb350 req-6606a62e-0e39-4624-98b2-f4c28e9012dc service nova] Acquiring lock "6cb44d19-8ed5-4c83-aedd-5fa187c05b00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:05.531447 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-03821e44-af3c-4b5f-86d9-52a7c07fb350 req-6606a62e-0e39-4624-98b2-f4c28e9012dc service nova] Lock "6cb44d19-8ed5-4c83-aedd-5fa187c05b00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:05.531671 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-03821e44-af3c-4b5f-86d9-52a7c07fb350 req-6606a62e-0e39-4624-98b2-f4c28e9012dc service nova] Lock "6cb44d19-8ed5-4c83-aedd-5fa187c05b00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:05.531800 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-03821e44-af3c-4b5f-86d9-52a7c07fb350 req-6606a62e-0e39-4624-98b2-f4c28e9012dc service nova] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Processing event network-vif-plugged-789466ca-15ad-48a2-a426-0af41bc52b1b {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:00:05.534738 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:00:05.757807 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:05.799748 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:05.838666 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-29742f7e-accd-495d-b7d9-83093f6bf20c tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:05.885955 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Found WWN 33000000090c17179 for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:00:05.886350 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:00:05.886574 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '33000000090c17179', 'path': '/dev/dm-0', 'multipath_id': '33000000090c17179'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:00:05.886737 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000090c17179', 'path': '/dev/dm-0', 'multipath_id': '33000000090c17179'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:00:05.946749 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: a8a28bb4-c3ea-4fb9-9130-1e8239191c5b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:05.997965 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-29742f7e-accd-495d-b7d9-83093f6bf20c tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Updating instance_info_cache with network_info: [{"id": "3c4c4d7c-c6bd-4039-b75c-70bce7052b58", "address": "fa:16:3e:3e:23:29", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4c4d7c-c6", "ovs_interfaceid": "3c4c4d7c-c6bd-4039-b75c-70bce7052b58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:00:06.014102 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:06.087414 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:06.087804 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:06.091005 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:00:06.091243 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Claim successful on node np0000001577
May 28 01:00:06.395032 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:00:06.395367 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f', 'iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd22fca90-ede2-4d3c-a61b-f5cffaf76d2f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:00:06.395487 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:00:06.397139 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:00:06.397557 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:00:06.398430 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f', 'iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd22fca90-ede2-4d3c-a61b-f5cffaf76d2f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:00:06.398804 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930006.3981712, 6cb44d19-8ed5-4c83-aedd-5fa187c05b00 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:00:06.398955 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] VM Started (Lifecycle Event)
May 28 01:00:06.404765 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:00:06.409162 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Instance spawned successfully.
May 28 01:00:06.411103 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:00:06.414475 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:00:06.414888 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:00:06.415082 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:00:06.415856 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:00:06.416688 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:00:06.416688 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:00:06.430119 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:00:06.430119 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:06.438048 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:00:06.438048 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:06.443852 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f] added
May 28 01:00:06.443852 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:00:06.443852 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:00:06.443852 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:00:06.443852 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:00:06.443852 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:00:06.443852 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:06.443852 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:00:06.444180 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0289(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:00:06.444180 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:00:06.448601 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f] added
May 28 01:00:06.448601 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:00:06.448601 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:00:06.448601 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:00:06.448601 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:00:06.448601 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:00:06.448601 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:06.448881 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:00:06.448925 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0324(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:00:06.449077 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:00:06.501658 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-29742f7e-accd-495d-b7d9-83093f6bf20c tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Releasing lock "refresh_cache-dccaa2b7-3c00-45f9-bf40-1a8a15030825" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:00:06.501658 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-29742f7e-accd-495d-b7d9-83093f6bf20c tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'flavor' on Instance uuid dccaa2b7-3c00-45f9-bf40-1a8a15030825 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:00:06.903348 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:06.908228 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:00:06.920410 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:06.923608 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:06.923608 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:06.923608 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:06.923608 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:06.923608 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:07.034622 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:07.037471 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:07.062622 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:07.210682 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:07.218619 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:07.374456 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Instance destroyed successfully.
May 28 01:00:07.374862 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-29742f7e-accd-495d-b7d9-83093f6bf20c tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'numa_topology' on Instance uuid dccaa2b7-3c00-45f9-bf40-1a8a15030825 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:00:07.413988 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:00:07.414237 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930007.4139614, 6cb44d19-8ed5-4c83-aedd-5fa187c05b00 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:00:07.414237 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] VM Paused (Lifecycle Event)
May 28 01:00:07.428421 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Took 6.73 seconds to spawn the instance on the hypervisor.
May 28 01:00:07.428612 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:07.446722 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:00:07.450451 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:00:07.459388 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:00:07.459388 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:00:07.467416 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:00:07.467416 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:07.476171 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:07.482680 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:07.492343 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:07.492343 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:07.492343 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:07.492343 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:07.492343 np0000001577 nova-compute[98319]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ea028c7-3b28-468a-884e-ae85b2bc6f55 (non-flash)
May 28 01:00:07.492343 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:07.492343 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:07.492343 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:00:07.492343 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:07.492343 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:07.492343 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:07.492343 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:07.492343 np0000001577 nova-compute[98319]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ea028c7-3b28-468a-884e-ae85b2bc6f55 (non-flash)
May 28 01:00:07.492343 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:07.492343 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:07.492343 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:00:07.499306 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:07.499306 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:07.499306 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:07.499306 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:07.499306 np0000001577 nova-compute[98319]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ea028c7-3b28-468a-884e-ae85b2bc6f55 (non-flash)
May 28 01:00:07.499306 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:07.499306 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:07.499306 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:00:07.499306 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:07.499306 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:07.499306 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:07.499306 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:07.499306 np0000001577 nova-compute[98319]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ea028c7-3b28-468a-884e-ae85b2bc6f55 (non-flash)
May 28 01:00:07.499306 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:07.499306 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:07.499306 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:00:07.518583 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:07.536450 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f, portal: 192.168.40.100,3260]
May 28 01:00:07.536450 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f, portal: 192.168.40.100,3260] successful.
May 28 01:00:07.536450 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:07.544996 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f, portal: 192.168.50.100,3260]
May 28 01:00:07.544996 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f, portal: 192.168.50.100,3260] successful.
May 28 01:00:07.544996 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:07.552006 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:07.559072 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:07.574475 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:07.574475 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:07.574475 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:07.574475 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:07.574475 np0000001577 nova-compute[98319]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ea028c7-3b28-468a-884e-ae85b2bc6f55 (non-flash)
May 28 01:00:07.574475 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:07.574475 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:07.574475 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:07.574475 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:07.574475 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:00:07.574475 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:07.574475 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:07.574475 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:07.574475 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:07.574475 np0000001577 nova-compute[98319]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ea028c7-3b28-468a-884e-ae85b2bc6f55 (non-flash)
May 28 01:00:07.574475 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:07.574475 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:07.574475 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:07.574475 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:07.574475 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:00:07.575126 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.160s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:00:07.575204 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:00:07.576709 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] HCTL ('12', '-', '-', 0) found on session 34 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:00:07.576709 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:00:07.584479 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:07.584479 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:07.584479 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:07.584479 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:07.584479 np0000001577 nova-compute[98319]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ea028c7-3b28-468a-884e-ae85b2bc6f55 (non-flash)
May 28 01:00:07.584479 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:07.584479 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:07.584479 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:07.584479 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:07.584479 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:00:07.585680 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:07.585680 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:07.585680 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:07.585680 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:07.585680 np0000001577 nova-compute[98319]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ea028c7-3b28-468a-884e-ae85b2bc6f55 (non-flash)
May 28 01:00:07.585680 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:07.585680 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:07.585680 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:07.585680 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:07.585680 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:00:07.585680 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.169s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:00:07.585680 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:00:07.587601 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] HCTL ('13', '-', '-', 0) found on session 35 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:00:07.587601 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:00:07.596440 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Searching for a device in session 34 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:00:07.597287 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd22fca90-ede2-4d3c-a61b-f5cffaf76d2f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:00:07.603454 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Searching for a device in session 35 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:00:07.603454 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd22fca90-ede2-4d3c-a61b-f5cffaf76d2f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:00:07.637932 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a11faa2f-a8e1-403c-9b1c-075ac8575cba req-b5407063-1e6a-4c01-89c6-69c30b9ddff1 service nova] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Received event network-vif-plugged-789466ca-15ad-48a2-a426-0af41bc52b1b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:07.639034 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a11faa2f-a8e1-403c-9b1c-075ac8575cba req-b5407063-1e6a-4c01-89c6-69c30b9ddff1 service nova] Acquiring lock "6cb44d19-8ed5-4c83-aedd-5fa187c05b00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:07.639354 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a11faa2f-a8e1-403c-9b1c-075ac8575cba req-b5407063-1e6a-4c01-89c6-69c30b9ddff1 service nova] Lock "6cb44d19-8ed5-4c83-aedd-5fa187c05b00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:07.640301 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a11faa2f-a8e1-403c-9b1c-075ac8575cba req-b5407063-1e6a-4c01-89c6-69c30b9ddff1 service nova] Lock "6cb44d19-8ed5-4c83-aedd-5fa187c05b00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:07.640494 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a11faa2f-a8e1-403c-9b1c-075ac8575cba req-b5407063-1e6a-4c01-89c6-69c30b9ddff1 service nova] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] No waiting events found dispatching network-vif-plugged-789466ca-15ad-48a2-a426-0af41bc52b1b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:00:07.640695 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-a11faa2f-a8e1-403c-9b1c-075ac8575cba req-b5407063-1e6a-4c01-89c6-69c30b9ddff1 service nova] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Received unexpected event network-vif-plugged-789466ca-15ad-48a2-a426-0af41bc52b1b for instance with vm_state active and task_state None.
May 28 01:00:07.784925 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:00:07.784925 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:00:07.865533 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c2fb2445-2e61-404c-a3fb-0d7c1f0d5d65 req-565a2ca2-24ef-46e0-9ce0-447914cdc5e3 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Received event network-vif-unplugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:07.866235 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c2fb2445-2e61-404c-a3fb-0d7c1f0d5d65 req-565a2ca2-24ef-46e0-9ce0-447914cdc5e3 service nova] Acquiring lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:07.866629 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c2fb2445-2e61-404c-a3fb-0d7c1f0d5d65 req-565a2ca2-24ef-46e0-9ce0-447914cdc5e3 service nova] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:07.867968 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c2fb2445-2e61-404c-a3fb-0d7c1f0d5d65 req-565a2ca2-24ef-46e0-9ce0-447914cdc5e3 service nova] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:07.868159 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c2fb2445-2e61-404c-a3fb-0d7c1f0d5d65 req-565a2ca2-24ef-46e0-9ce0-447914cdc5e3 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] No waiting events found dispatching network-vif-unplugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:00:07.868316 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-c2fb2445-2e61-404c-a3fb-0d7c1f0d5d65 req-565a2ca2-24ef-46e0-9ce0-447914cdc5e3 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Received unexpected event network-vif-unplugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 for instance with vm_state rescued and task_state unrescuing.
May 28 01:00:07.877270 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-29742f7e-accd-495d-b7d9-83093f6bf20c tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Object Instance<dccaa2b7-3c00-45f9-bf40-1a8a15030825> lazy-loaded attributes: flavor,numa_topology {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:00:07.918217 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:07.921310 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930007.920966, 6cb44d19-8ed5-4c83-aedd-5fa187c05b00 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:00:07.921489 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] VM Resumed (Lifecycle Event)
May 28 01:00:07.942620 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Took 12.43 seconds to build instance.
May 28 01:00:08.285120 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:00:08.361119 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:08.397948 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:08.397948 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:08.418306 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:00:08.425517 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:08.428523 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:00:08.444861 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "6cb44d19-8ed5-4c83-aedd-5fa187c05b00" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.935s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:08.472015 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:08.540300 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:08.793229 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.705s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:08.793651 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:00:08.931916 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999777406000021 future=<Future at 0x7c984c57b6e0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:00:08.932312 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999479142999917 future=<Future at 0x7c984c57b6e0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:00:08.932312 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999391950000017 future=<Future at 0x7c984c57b6e0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:00:09.194874 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Removed pending STOPPED event for dccaa2b7-3c00-45f9-bf40-1a8a15030825 due to new event <LifecycleEvent: 1779930009.194523, dccaa2b7-3c00-45f9-bf40-1a8a15030825 => Resumed> {{(pid=98319) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 01:00:09.195026 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930009.194523, dccaa2b7-3c00-45f9-bf40-1a8a15030825 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:00:09.195074 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] VM Resumed (Lifecycle Event)
May 28 01:00:09.198556 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-29742f7e-accd-495d-b7d9-83093f6bf20c tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:09.303291 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:00:09.304230 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:00:09.307793 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:09.308015 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:09.388159 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8586a18edcf42cab0a60028135ae401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938c2829112843edb2054984e80ce7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:00:09.434583 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Found WWN 3300000005f9f3a53 for multipath device dm-4 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:00:09.434583 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:00:09.434583 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '3300000005f9f3a53', 'path': '/dev/dm-4', 'multipath_id': '3300000005f9f3a53'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:00:09.434583 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005f9f3a53', 'path': '/dev/dm-4', 'multipath_id': '3300000005f9f3a53'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:00:09.699236 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:09.703802 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:09.705773 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:00:09.809164 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:00:09.944065 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:00:09.944065 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:00:09.944065 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:00:09.944649 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:00:09.944649 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:00:09.956422 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5ded5f23-c167-4d09-a17d-5d083681ac28 req-a24d41f4-ef0b-4c78-a067-92127c086489 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Received event network-vif-unplugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:09.956422 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5ded5f23-c167-4d09-a17d-5d083681ac28 req-a24d41f4-ef0b-4c78-a067-92127c086489 service nova] Acquiring lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:09.956422 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5ded5f23-c167-4d09-a17d-5d083681ac28 req-a24d41f4-ef0b-4c78-a067-92127c086489 service nova] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:09.956422 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5ded5f23-c167-4d09-a17d-5d083681ac28 req-a24d41f4-ef0b-4c78-a067-92127c086489 service nova] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:09.956422 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5ded5f23-c167-4d09-a17d-5d083681ac28 req-a24d41f4-ef0b-4c78-a067-92127c086489 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] No waiting events found dispatching network-vif-unplugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:00:09.956422 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-5ded5f23-c167-4d09-a17d-5d083681ac28 req-a24d41f4-ef0b-4c78-a067-92127c086489 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Received unexpected event network-vif-unplugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 for instance with vm_state active and task_state None.
May 28 01:00:09.956422 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5ded5f23-c167-4d09-a17d-5d083681ac28 req-a24d41f4-ef0b-4c78-a067-92127c086489 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Received event network-vif-plugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:09.956422 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5ded5f23-c167-4d09-a17d-5d083681ac28 req-a24d41f4-ef0b-4c78-a067-92127c086489 service nova] Acquiring lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:09.956422 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5ded5f23-c167-4d09-a17d-5d083681ac28 req-a24d41f4-ef0b-4c78-a067-92127c086489 service nova] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:09.956422 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5ded5f23-c167-4d09-a17d-5d083681ac28 req-a24d41f4-ef0b-4c78-a067-92127c086489 service nova] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:09.956422 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5ded5f23-c167-4d09-a17d-5d083681ac28 req-a24d41f4-ef0b-4c78-a067-92127c086489 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] No waiting events found dispatching network-vif-plugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:00:09.956766 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-5ded5f23-c167-4d09-a17d-5d083681ac28 req-a24d41f4-ef0b-4c78-a067-92127c086489 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Received unexpected event network-vif-plugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 for instance with vm_state active and task_state None.
May 28 01:00:09.956766 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5ded5f23-c167-4d09-a17d-5d083681ac28 req-a24d41f4-ef0b-4c78-a067-92127c086489 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Received event network-vif-plugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:09.956766 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5ded5f23-c167-4d09-a17d-5d083681ac28 req-a24d41f4-ef0b-4c78-a067-92127c086489 service nova] Acquiring lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:09.956907 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5ded5f23-c167-4d09-a17d-5d083681ac28 req-a24d41f4-ef0b-4c78-a067-92127c086489 service nova] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:09.957222 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5ded5f23-c167-4d09-a17d-5d083681ac28 req-a24d41f4-ef0b-4c78-a067-92127c086489 service nova] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:09.957321 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5ded5f23-c167-4d09-a17d-5d083681ac28 req-a24d41f4-ef0b-4c78-a067-92127c086489 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] No waiting events found dispatching network-vif-plugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:00:09.957411 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-5ded5f23-c167-4d09-a17d-5d083681ac28 req-a24d41f4-ef0b-4c78-a067-92127c086489 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Received unexpected event network-vif-plugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 for instance with vm_state active and task_state None.
May 28 01:00:09.959266 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:00:09.959911 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:00:09.960247 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:00:09.960432 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:00:09.961315 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:00:09.961315 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:00:09.974699 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:00:09.974699 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:09.980339 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:00:09.980339 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:09.987619 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca] added
May 28 01:00:09.987619 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:00:09.987619 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:00:09.987619 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:00:09.987619 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:00:09.987619 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:00:09.987619 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:09.987899 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:00:09.990719 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0275(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:00:09.990719 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:00:09.995617 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca] added
May 28 01:00:09.995617 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:00:09.995617 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:00:09.995617 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:00:09.995617 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:00:09.995617 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:00:09.995617 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:09.995817 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:00:09.995881 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0349(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:00:09.995997 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:00:10.091775 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Acquiring lock "11d1c78c-76d0-4b3a-8a7d-9de7e37148d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:10.092017 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "11d1c78c-76d0-4b3a-8a7d-9de7e37148d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:10.207976 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930010.207651, dccaa2b7-3c00-45f9-bf40-1a8a15030825 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:00:10.208134 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] VM Started (Lifecycle Event)
May 28 01:00:10.288237 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Successfully created port: 3ed3d348-6b93-4492-9c18-7b0eecc6454a {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:00:10.313851 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:00:10.596988 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:00:10.711276 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:10.712855 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:00:10.990420 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:00:10.996886 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:00:11.007315 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:00:11.007315 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:11.014777 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:00:11.017149 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:00:11.017149 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:11.026569 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:11.031628 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:11.041330 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:11.041330 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:11.041330 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:11.041330 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:11.041330 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:11.041330 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:11.041330 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:11.041330 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:11.041330 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:00:11.041683 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:11.041683 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:11.041683 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:11.041683 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:11.041683 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:11.041683 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:11.041683 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:11.041683 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:11.041683 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:00:11.050709 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:11.050709 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:11.050709 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:11.050709 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:11.050709 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:11.050709 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:11.050709 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:11.050709 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:11.050709 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:00:11.050943 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:11.050943 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:11.050943 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:11.050943 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:11.050943 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:11.050943 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:11.050943 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:11.050943 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:11.050943 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:00:11.086239 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca, portal: 192.168.50.100,3260]
May 28 01:00:11.086239 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca, portal: 192.168.50.100,3260] successful.
May 28 01:00:11.086239 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:11.090586 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca, portal: 192.168.40.100,3260]
May 28 01:00:11.090586 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca, portal: 192.168.40.100,3260] successful.
May 28 01:00:11.090586 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:11.102236 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:11.113383 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:11.124497 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:11.124497 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:11.124497 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:11.124497 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:11.124497 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:11.124497 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:11.124497 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:11.124497 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:11.124497 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:11.124497 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:11.124497 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:00:11.124935 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:11.124935 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:11.124935 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:11.124935 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:11.124935 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:11.124935 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:11.124935 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:11.124935 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:11.124935 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:11.124935 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:11.124935 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:00:11.125292 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:00:11.125292 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:00:11.126732 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] HCTL ('7', '-', '-', 0) found on session 36 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:00:11.126732 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:00:11.141729 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:11.141729 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:11.141729 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:11.141729 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:11.141729 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:11.141729 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:11.141729 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:11.141729 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:11.141729 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:11.141729 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:11.141729 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:00:11.141729 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:11.141729 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:11.141729 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:11.141729 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:11.141729 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:11.141729 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:11.141729 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:11.141729 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:11.141729 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:11.141729 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:11.141729 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:00:11.141729 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:00:11.141729 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:00:11.141729 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Searching for a device in session 36 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:00:11.141729 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:00:11.142568 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] HCTL ('14', '-', '-', 0) found on session 37 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:00:11.142568 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:00:11.165905 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Searching for a device in session 37 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:00:11.166119 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:00:11.178861 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:11.178861 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:11.182287 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:00:11.182453 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Claim successful on node np0000001577
May 28 01:00:11.322956 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:00:11.323876 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:00:11.324271 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Creating image(s)
May 28 01:00:11.324926 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "/opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:11.325011 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "/opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:11.325731 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "/opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:11.327253 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:00:11.333449 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:00:11.334722 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:11.380192 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Successfully updated port: 3ed3d348-6b93-4492-9c18-7b0eecc6454a {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:00:11.423837 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:11.426410 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:11.426410 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:11.426410 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:00:11.428857 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:00:11.429216 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:11.510947 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.081s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:11.511520 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:11.583418 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk 1073741824" returned: 0 in 0.071s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:11.583418 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.159s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:11.583739 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:11.691221 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.107s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:11.691843 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:00:11.693376 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:11.796951 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:11.798817 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Cannot resize image /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:00:11.798817 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:00:11.798817 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Ensure instance console log exists: /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:00:11.798817 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:11.798950 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:11.799007 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:11.884644 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "refresh_cache-d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:00:11.885390 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquired lock "refresh_cache-d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:00:11.885390 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:00:11.962796 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:00:12.039781 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-494627b8-aeaf-498b-95a2-c35b27c20254 req-075c8fa9-0046-46ee-8688-641beac03a70 service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Received event network-changed-3ed3d348-6b93-4492-9c18-7b0eecc6454a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:12.040657 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-494627b8-aeaf-498b-95a2-c35b27c20254 req-075c8fa9-0046-46ee-8688-641beac03a70 service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Refreshing instance network info cache due to event network-changed-3ed3d348-6b93-4492-9c18-7b0eecc6454a. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:00:12.040802 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-494627b8-aeaf-498b-95a2-c35b27c20254 req-075c8fa9-0046-46ee-8688-641beac03a70 service nova] Acquiring lock "refresh_cache-d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:00:12.463575 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:00:12.513920 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:12.520154 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:12.698584 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:12.875878 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:00:12.876096 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:00:12.881968 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Updating instance_info_cache with network_info: [{"id": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "address": "fa:16:3e:28:56:65", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3d348-6b", "ovs_interfaceid": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:00:12.981478 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Found WWN 330000000ead4ec9b for multipath device dm-5 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:00:12.981818 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:00:12.981974 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '330000000ead4ec9b', 'path': '/dev/dm-5', 'multipath_id': '330000000ead4ec9b'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:00:12.982103 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ead4ec9b', 'path': '/dev/dm-5', 'multipath_id': '330000000ead4ec9b'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:00:13.031153 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "ebae9109-a600-4788-9008-74a8c320b803" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:13.031153 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "ebae9109-a600-4788-9008-74a8c320b803" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:13.256759 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:13.257245 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:13.378466 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:00:13.385961 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Releasing lock "refresh_cache-d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:00:13.389880 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Instance network_info: |[{"id": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "address": "fa:16:3e:28:56:65", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3d348-6b", "ovs_interfaceid": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:00:13.395954 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-494627b8-aeaf-498b-95a2-c35b27c20254 req-075c8fa9-0046-46ee-8688-641beac03a70 service nova] Acquired lock "refresh_cache-d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:00:13.396202 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-494627b8-aeaf-498b-95a2-c35b27c20254 req-075c8fa9-0046-46ee-8688-641beac03a70 service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Refreshing network info cache for port 3ed3d348-6b93-4492-9c18-7b0eecc6454a {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:00:13.397349 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Start _get_guest_xml network_info=[{"id": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "address": "fa:16:3e:28:56:65", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3d348-6b", "ovs_interfaceid": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:00:13.403317 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:00:13.404751 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='d87bb95b-a1e9-4786-8bee-16f2cfaabf2d'), owner=OwnerMeta(userid='f8586a18edcf42cab0a60028135ae401', username='tempest-AttachVolumeMultiAttachTest-89204095-project-member', projectid='938c2829112843edb2054984e80ce7ad', projectname='tempest-AttachVolumeMultiAttachTest-89204095'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "address": "fa:16:3e:28:56:65", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3d348-6b", "ovs_interfaceid": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930013.4043136) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:00:13.406389 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:00:13.407418 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:00:13.408513 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:00:13.408728 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:00:13.409794 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:00:13.410621 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:00:13.410621 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:00:13.410621 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:00:13.410900 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:00:13.410900 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:00:13.410998 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:00:13.411142 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:00:13.411265 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:00:13.411385 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:00:13.411504 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:00:13.411658 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:00:13.426510 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='multiattach-server-0',id=21,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7fHo3fyBWUybZxdNVpYEXXxMYY3ACB7D4odfvDXtuf5uMmk/o2XggiQakoJbwdRCXKjpHaMcmXgSyAS8x+3bDHMUWn1qlznnyXp/nDVRmoqTgLFpV2Do6YlUuA3zZ+mw==',key_name='tempest-keypair-627531643',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938c2829112843edb2054984e80ce7ad',ramdisk_id='',reservation_id='r-vg7s0e6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-89204095',owner_user_name='tempest-AttachVolumeMultiAttachTest-89204095-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:00:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8586a18edcf42cab0a60028135ae401',uuid=d87bb95b-a1e9-4786-8bee-16f2cfaabf2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "address": "fa:16:3e:28:56:65", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3d348-6b", "ovs_interfaceid": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:00:13.426784 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converting VIF {"id": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "address": "fa:16:3e:28:56:65", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3d348-6b", "ovs_interfaceid": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:13.427614 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:56:65,bridge_name='br-int',has_traffic_filtering=True,id=3ed3d348-6b93-4492-9c18-7b0eecc6454a,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed3d348-6b') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:13.428215 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lazy-loading 'pci_devices' on Instance uuid d87bb95b-a1e9-4786-8bee-16f2cfaabf2d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:00:13.488094 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1792575949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1792575949',id=19,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1P9ZawshZj4d2nh1lOk0Fv8roeGP0Y7qMP0EmUJ750BqsN/Fcq/c3OR67lR1+FLd77FwgEUGC4BrSbDELBraS3IiHPO2T5AnpM+EnT2CfWDwC/fytu8FA54TM0d8j/A==',key_name='tempest-keypair-2104888731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54eb635d961644dc9c1845baf24fc6db',ramdisk_id='',reservation_id='r-5gdx0woc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1752653874',owner_user_name='tempest-TaggedBootDevicesTest_v242-1752653874-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:59:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b66af1e9e094d3fa78454b91757d6cf',uuid=2dbd7449-2081-4377-a31d-e4d202679da1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a85618a-56c3-4690-af32-885b836a2c19", "address": "fa:16:3e:8f:58:e7", "network": {"id": "4fae2e1c-05e1-4891-8645-b0200336c3ab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1018677949-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a85618a-56", "ovs_interfaceid": "8a85618a-56c3-4690-af32-885b836a2c19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:00:13.488282 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converting VIF {"id": "8a85618a-56c3-4690-af32-885b836a2c19", "address": "fa:16:3e:8f:58:e7", "network": {"id": "4fae2e1c-05e1-4891-8645-b0200336c3ab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1018677949-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a85618a-56", "ovs_interfaceid": "8a85618a-56c3-4690-af32-885b836a2c19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:13.488747 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:58:e7,bridge_name='br-int',has_traffic_filtering=True,id=8a85618a-56c3-4690-af32-885b836a2c19,network=Network(4fae2e1c-05e1-4891-8645-b0200336c3ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a85618a-56') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:13.489379 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1792575949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1792575949',id=19,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1P9ZawshZj4d2nh1lOk0Fv8roeGP0Y7qMP0EmUJ750BqsN/Fcq/c3OR67lR1+FLd77FwgEUGC4BrSbDELBraS3IiHPO2T5AnpM+EnT2CfWDwC/fytu8FA54TM0d8j/A==',key_name='tempest-keypair-2104888731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54eb635d961644dc9c1845baf24fc6db',ramdisk_id='',reservation_id='r-5gdx0woc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1752653874',owner_user_name='tempest-TaggedBootDevicesTest_v242-1752653874-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:59:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b66af1e9e094d3fa78454b91757d6cf',uuid=2dbd7449-2081-4377-a31d-e4d202679da1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7de931f4-ea15-4c26-9bd7-00b40cd57781", "address": "fa:16:3e:d8:03:80", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de931f4-ea", "ovs_interfaceid": "7de931f4-ea15-4c26-9bd7-00b40cd57781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:00:13.489537 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converting VIF {"id": "7de931f4-ea15-4c26-9bd7-00b40cd57781", "address": "fa:16:3e:d8:03:80", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de931f4-ea", "ovs_interfaceid": "7de931f4-ea15-4c26-9bd7-00b40cd57781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:13.489898 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:03:80,bridge_name='br-int',has_traffic_filtering=True,id=7de931f4-ea15-4c26-9bd7-00b40cd57781,network=Network(6280a6b4-4539-4dd4-8845-12626e668c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7de931f4-ea') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:13.490443 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1792575949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1792575949',id=19,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1P9ZawshZj4d2nh1lOk0Fv8roeGP0Y7qMP0EmUJ750BqsN/Fcq/c3OR67lR1+FLd77FwgEUGC4BrSbDELBraS3IiHPO2T5AnpM+EnT2CfWDwC/fytu8FA54TM0d8j/A==',key_name='tempest-keypair-2104888731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54eb635d961644dc9c1845baf24fc6db',ramdisk_id='',reservation_id='r-5gdx0woc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1752653874',owner_user_name='tempest-TaggedBootDevicesTest_v242-1752653874-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:59:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b66af1e9e094d3fa78454b91757d6cf',uuid=2dbd7449-2081-4377-a31d-e4d202679da1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5624a417-cdef-4be1-8586-16ca7bfdc8b9", "address": "fa:16:3e:3a:9b:65", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5624a417-cd", "ovs_interfaceid": "5624a417-cdef-4be1-8586-16ca7bfdc8b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:00:13.490853 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converting VIF {"id": "5624a417-cdef-4be1-8586-16ca7bfdc8b9", "address": "fa:16:3e:3a:9b:65", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5624a417-cd", "ovs_interfaceid": "5624a417-cdef-4be1-8586-16ca7bfdc8b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:13.491237 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:9b:65,bridge_name='br-int',has_traffic_filtering=True,id=5624a417-cdef-4be1-8586-16ca7bfdc8b9,network=Network(6280a6b4-4539-4dd4-8845-12626e668c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5624a417-cd') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:13.491771 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1792575949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1792575949',id=19,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1P9ZawshZj4d2nh1lOk0Fv8roeGP0Y7qMP0EmUJ750BqsN/Fcq/c3OR67lR1+FLd77FwgEUGC4BrSbDELBraS3IiHPO2T5AnpM+EnT2CfWDwC/fytu8FA54TM0d8j/A==',key_name='tempest-keypair-2104888731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54eb635d961644dc9c1845baf24fc6db',ramdisk_id='',reservation_id='r-5gdx0woc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1752653874',owner_user_name='tempest-TaggedBootDevicesTest_v242-1752653874-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:59:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b66af1e9e094d3fa78454b91757d6cf',uuid=2dbd7449-2081-4377-a31d-e4d202679da1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3de085f7-074a-44c7-99ab-7093e0ddc084", "address": "fa:16:3e:ab:a0:32", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de085f7-07", "ovs_interfaceid": "3de085f7-074a-44c7-99ab-7093e0ddc084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:00:13.491894 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converting VIF {"id": "3de085f7-074a-44c7-99ab-7093e0ddc084", "address": "fa:16:3e:ab:a0:32", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de085f7-07", "ovs_interfaceid": "3de085f7-074a-44c7-99ab-7093e0ddc084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:13.492225 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:a0:32,bridge_name='br-int',has_traffic_filtering=True,id=3de085f7-074a-44c7-99ab-7093e0ddc084,network=Network(6280a6b4-4539-4dd4-8845-12626e668c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de085f7-07') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:13.492779 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1792575949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1792575949',id=19,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1P9ZawshZj4d2nh1lOk0Fv8roeGP0Y7qMP0EmUJ750BqsN/Fcq/c3OR67lR1+FLd77FwgEUGC4BrSbDELBraS3IiHPO2T5AnpM+EnT2CfWDwC/fytu8FA54TM0d8j/A==',key_name='tempest-keypair-2104888731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54eb635d961644dc9c1845baf24fc6db',ramdisk_id='',reservation_id='r-5gdx0woc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1752653874',owner_user_name='tempest-TaggedBootDevicesTest_v242-1752653874-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:59:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b66af1e9e094d3fa78454b91757d6cf',uuid=2dbd7449-2081-4377-a31d-e4d202679da1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02325a90-5e85-4e9f-a65e-c1bd91c39e80", "address": "fa:16:3e:e0:c1:49", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02325a90-5e", "ovs_interfaceid": "02325a90-5e85-4e9f-a65e-c1bd91c39e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:00:13.492913 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converting VIF {"id": "02325a90-5e85-4e9f-a65e-c1bd91c39e80", "address": "fa:16:3e:e0:c1:49", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02325a90-5e", "ovs_interfaceid": "02325a90-5e85-4e9f-a65e-c1bd91c39e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:13.493248 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c1:49,bridge_name='br-int',has_traffic_filtering=True,id=02325a90-5e85-4e9f-a65e-c1bd91c39e80,network=Network(6280a6b4-4539-4dd4-8845-12626e668c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02325a90-5e') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:13.493879 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1792575949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1792575949',id=19,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1P9ZawshZj4d2nh1lOk0Fv8roeGP0Y7qMP0EmUJ750BqsN/Fcq/c3OR67lR1+FLd77FwgEUGC4BrSbDELBraS3IiHPO2T5AnpM+EnT2CfWDwC/fytu8FA54TM0d8j/A==',key_name='tempest-keypair-2104888731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54eb635d961644dc9c1845baf24fc6db',ramdisk_id='',reservation_id='r-5gdx0woc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1752653874',owner_user_name='tempest-TaggedBootDevicesTest_v242-1752653874-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:59:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b66af1e9e094d3fa78454b91757d6cf',uuid=2dbd7449-2081-4377-a31d-e4d202679da1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59a7e22c-8c09-4a33-9b95-58ee955f6895", "address": "fa:16:3e:1b:8b:e7", "network": {"id": "0a64f131-06a0-4c34-a1d8-06f8419256bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-288972260", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59a7e22c-8c", "ovs_interfaceid": "59a7e22c-8c09-4a33-9b95-58ee955f6895", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:00:13.494111 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converting VIF {"id": "59a7e22c-8c09-4a33-9b95-58ee955f6895", "address": "fa:16:3e:1b:8b:e7", "network": {"id": "0a64f131-06a0-4c34-a1d8-06f8419256bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-288972260", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59a7e22c-8c", "ovs_interfaceid": "59a7e22c-8c09-4a33-9b95-58ee955f6895", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:13.494316 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:8b:e7,bridge_name='br-int',has_traffic_filtering=True,id=59a7e22c-8c09-4a33-9b95-58ee955f6895,network=Network(0a64f131-06a0-4c34-a1d8-06f8419256bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59a7e22c-8c') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:13.494805 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1792575949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1792575949',id=19,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1P9ZawshZj4d2nh1lOk0Fv8roeGP0Y7qMP0EmUJ750BqsN/Fcq/c3OR67lR1+FLd77FwgEUGC4BrSbDELBraS3IiHPO2T5AnpM+EnT2CfWDwC/fytu8FA54TM0d8j/A==',key_name='tempest-keypair-2104888731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54eb635d961644dc9c1845baf24fc6db',ramdisk_id='',reservation_id='r-5gdx0woc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1752653874',owner_user_name='tempest-TaggedBootDevicesTest_v242-1752653874-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:59:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b66af1e9e094d3fa78454b91757d6cf',uuid=2dbd7449-2081-4377-a31d-e4d202679da1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1b61752-f189-4f02-b9eb-92326fb29830", "address": "fa:16:3e:40:00:63", "network": {"id": "0a64f131-06a0-4c34-a1d8-06f8419256bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-288972260", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b61752-f1", "ovs_interfaceid": "d1b61752-f189-4f02-b9eb-92326fb29830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:00:13.494977 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converting VIF {"id": "d1b61752-f189-4f02-b9eb-92326fb29830", "address": "fa:16:3e:40:00:63", "network": {"id": "0a64f131-06a0-4c34-a1d8-06f8419256bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-288972260", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b61752-f1", "ovs_interfaceid": "d1b61752-f189-4f02-b9eb-92326fb29830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:13.495384 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:00:63,bridge_name='br-int',has_traffic_filtering=True,id=d1b61752-f189-4f02-b9eb-92326fb29830,network=Network(0a64f131-06a0-4c34-a1d8-06f8419256bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1b61752-f1') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:13.495874 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lazy-loading 'pci_devices' on Instance uuid 2dbd7449-2081-4377-a31d-e4d202679da1 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:00:13.533447 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Detaching volume e6d37c59-727a-44bb-992c-7034d5fc6131
May 28 01:00:13.577168 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Attempting to driver detach volume e6d37c59-727a-44bb-992c-7034d5fc6131 from mountpoint /dev/vdb
May 28 01:00:13.585388 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Found disk vdb by alias ua-e6d37c59-727a-44bb-992c-7034d5fc6131 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:00:13.587679 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Found disk vdb by alias ua-e6d37c59-727a-44bb-992c-7034d5fc6131 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:00:13.587679 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Attempting to detach device vdb from instance ebae9109-a600-4788-9008-74a8c320b803 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:00:13.587679 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:00:13.587679 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:00:13.587679 np0000001577 nova-compute[98319]:   <alias name="ua-e6d37c59-727a-44bb-992c-7034d5fc6131"/>
May 28 01:00:13.587679 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 28 01:00:13.587679 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:00:13.587679 np0000001577 nova-compute[98319]:   <serial>e6d37c59-727a-44bb-992c-7034d5fc6131</serial>
May 28 01:00:13.587679 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:00:13.587679 np0000001577 nova-compute[98319]: </disk>
May 28 01:00:13.587679 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:00:13.601613 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Successfully detached device vdb from instance ebae9109-a600-4788-9008-74a8c320b803 from the persistent domain config.
May 28 01:00:13.601706 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] (1/8): Attempting to detach device vdb with device alias ua-e6d37c59-727a-44bb-992c-7034d5fc6131 from instance ebae9109-a600-4788-9008-74a8c320b803 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:00:13.601928 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:00:13.601928 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:00:13.601928 np0000001577 nova-compute[98319]:   <alias name="ua-e6d37c59-727a-44bb-992c-7034d5fc6131"/>
May 28 01:00:13.601928 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 28 01:00:13.601928 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:00:13.601928 np0000001577 nova-compute[98319]:   <serial>e6d37c59-727a-44bb-992c-7034d5fc6131</serial>
May 28 01:00:13.601928 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:00:13.601928 np0000001577 nova-compute[98319]: </disk>
May 28 01:00:13.601928 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:00:13.765761 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lazy-loading 'flavor' on Instance uuid 2d2183ad-dbdb-4525-b678-39b72c7ab85d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:00:13.785402 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:13.785940 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:13.887083 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.708s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:13.887404 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:00:13.902016 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-494627b8-aeaf-498b-95a2-c35b27c20254 req-075c8fa9-0046-46ee-8688-641beac03a70 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:13.932227 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] End _get_guest_xml xml=<domain type="qemu">
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:   <uuid>d87bb95b-a1e9-4786-8bee-16f2cfaabf2d</uuid>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:   <name>instance-00000015</name>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       <nova:name>multiattach-server-0</nova:name>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:00:13</nova:creationTime>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:         <nova:user uuid="f8586a18edcf42cab0a60028135ae401">tempest-AttachVolumeMultiAttachTest-89204095-project-member</nova:user>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:         <nova:project uuid="938c2829112843edb2054984e80ce7ad">tempest-AttachVolumeMultiAttachTest-89204095</nova:project>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:         <nova:port uuid="3ed3d348-6b93-4492-9c18-7b0eecc6454a">
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:     <system>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       <entry name="serial">d87bb95b-a1e9-4786-8bee-16f2cfaabf2d</entry>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       <entry name="uuid">d87bb95b-a1e9-4786-8bee-16f2cfaabf2d</entry>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:     </system>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:   <os>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:   </os>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:   <features>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:   </features>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:   <devices>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk"/>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:     </disk>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk.config"/>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:     </disk>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:28:56:65"/>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       <target dev="tap3ed3d348-6b"/>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:     </interface>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/console.log" append="off"/>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:     </serial>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:     <video>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:     </video>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:     </rng>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:   </devices>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]: </domain>
May 28 01:00:13.932227 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:00:13.934323 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Preparing to wait for external event network-vif-plugged-3ed3d348-6b93-4492-9c18-7b0eecc6454a {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:00:13.934323 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:13.934323 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:13.934323 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:13.934323 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='multiattach-server-0',id=21,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7fHo3fyBWUybZxdNVpYEXXxMYY3ACB7D4odfvDXtuf5uMmk/o2XggiQakoJbwdRCXKjpHaMcmXgSyAS8x+3bDHMUWn1qlznnyXp/nDVRmoqTgLFpV2Do6YlUuA3zZ+mw==',key_name='tempest-keypair-627531643',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938c2829112843edb2054984e80ce7ad',ramdisk_id='',reservation_id='r-vg7s0e6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-89204095',owner_user_name='tempest-AttachVolumeMultiAttachTest-89204095-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:00:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8586a18edcf42cab0a60028135ae401',uuid=d87bb95b-a1e9-4786-8bee-16f2cfaabf2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "address": "fa:16:3e:28:56:65", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3d348-6b", "ovs_interfaceid": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:00:13.934323 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converting VIF {"id": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "address": "fa:16:3e:28:56:65", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3d348-6b", "ovs_interfaceid": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:13.934590 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:56:65,bridge_name='br-int',has_traffic_filtering=True,id=3ed3d348-6b93-4492-9c18-7b0eecc6454a,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed3d348-6b') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:13.935029 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:56:65,bridge_name='br-int',has_traffic_filtering=True,id=3ed3d348-6b93-4492-9c18-7b0eecc6454a,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed3d348-6b') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:00:13.935324 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:13.936408 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:13.936408 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:00:13.937849 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:13.938219 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68204bd2-1745-5314-9959-da8903b9b9ec', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:13.941363 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:13.942103 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:13.944113 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:13.947862 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:13.948013 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ed3d348-6b, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:13.948370 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ed3d348-6b, col_values=(('qos', UUID('24dc7b4c-f0a4-4717-8b19-171bd0919155')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:13.948515 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ed3d348-6b, col_values=(('external_ids', {'iface-id': '3ed3d348-6b93-4492-9c18-7b0eecc6454a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:56:65', 'vm-uuid': 'd87bb95b-a1e9-4786-8bee-16f2cfaabf2d'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:13.950890 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:13.951945 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:13.958714 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:13.960011 np0000001577 nova-compute[98319]: INFO os_vif [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:56:65,bridge_name='br-int',has_traffic_filtering=True,id=3ed3d348-6b93-4492-9c18-7b0eecc6454a,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed3d348-6b')
May 28 01:00:13.999514 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] End _get_guest_xml xml=<domain type="qemu">
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:   <uuid>2dbd7449-2081-4377-a31d-e4d202679da1</uuid>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:   <name>instance-00000013</name>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <nova:name>tempest-device-tagging-server-1792575949</nova:name>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:00:02</nova:creationTime>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:         <nova:user uuid="0b66af1e9e094d3fa78454b91757d6cf">tempest-TaggedBootDevicesTest_v242-1752653874-project-member</nova:user>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:         <nova:project uuid="54eb635d961644dc9c1845baf24fc6db">tempest-TaggedBootDevicesTest_v242-1752653874</nova:project>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:         <nova:port uuid="8a85618a-56c3-4690-af32-885b836a2c19">
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:         <nova:port uuid="7de931f4-ea15-4c26-9bd7-00b40cd57781">
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.1.83" ipVersion="4"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:         <nova:port uuid="5624a417-cdef-4be1-8586-16ca7bfdc8b9">
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.1.46" ipVersion="4"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:         <nova:port uuid="3de085f7-074a-44c7-99ab-7093e0ddc084">
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.1.69" ipVersion="4"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:         <nova:port uuid="02325a90-5e85-4e9f-a65e-c1bd91c39e80">
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.1.51" ipVersion="4"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:         <nova:port uuid="59a7e22c-8c09-4a33-9b95-58ee955f6895">
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:         <nova:port uuid="d1b61752-f189-4f02-b9eb-92326fb29830">
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     <system>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <entry name="serial">2dbd7449-2081-4377-a31d-e4d202679da1</entry>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <entry name="uuid">2dbd7449-2081-4377-a31d-e4d202679da1</entry>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     </system>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:   <os>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:   </os>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:   <features>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:   </features>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:   <devices>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/2dbd7449-2081-4377-a31d-e4d202679da1/disk.config"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     </disk>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <alias name="ua-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-0"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <serial>39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea</serial>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     </disk>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <alias name="ua-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-4"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <serial>d22fca90-ede2-4d3c-a61b-f5cffaf76d2f</serial>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     </disk>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <alias name="ua-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-5"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <target dev="vdc" bus="virtio"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <serial>edef1fd4-4646-4d7f-aad4-df2fc2a4dcca</serial>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     </disk>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:8f:58:e7"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <target dev="tap8a85618a-56"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     </interface>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:d8:03:80"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <target dev="tap7de931f4-ea"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     </interface>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:3a:9b:65"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <target dev="tap5624a417-cd"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     </interface>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:ab:a0:32"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <target dev="tap3de085f7-07"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     </interface>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:e0:c1:49"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <target dev="tap02325a90-5e"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     </interface>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:1b:8b:e7"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <target dev="tap59a7e22c-8c"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     </interface>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:40:00:63"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <target dev="tapd1b61752-f1"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     </interface>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/2dbd7449-2081-4377-a31d-e4d202679da1/console.log" append="off"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     </serial>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     <video>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     </video>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     </rng>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:   </devices>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]: </domain>
May 28 01:00:13.999514 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:00:14.006202 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Preparing to wait for external event network-vif-plugged-8a85618a-56c3-4690-af32-885b836a2c19 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:00:14.006202 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:14.006202 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:14.006202 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:14.006202 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Preparing to wait for external event network-vif-plugged-7de931f4-ea15-4c26-9bd7-00b40cd57781 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:00:14.006202 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:14.006202 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:14.006202 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:14.006202 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Preparing to wait for external event network-vif-plugged-5624a417-cdef-4be1-8586-16ca7bfdc8b9 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:00:14.006202 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:14.006202 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:14.006202 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:14.006202 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Preparing to wait for external event network-vif-plugged-3de085f7-074a-44c7-99ab-7093e0ddc084 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:00:14.006202 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:14.006202 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:14.006202 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:14.006202 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Preparing to wait for external event network-vif-plugged-02325a90-5e85-4e9f-a65e-c1bd91c39e80 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:00:14.006202 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:14.006202 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:14.006202 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:14.006202 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Preparing to wait for external event network-vif-plugged-59a7e22c-8c09-4a33-9b95-58ee955f6895 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:00:14.006202 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:14.006202 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:14.006202 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:14.006202 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Preparing to wait for external event network-vif-plugged-d1b61752-f189-4f02-b9eb-92326fb29830 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:00:14.006202 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:14.006202 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:14.006202 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:14.008328 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1792575949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1792575949',id=19,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1P9ZawshZj4d2nh1lOk0Fv8roeGP0Y7qMP0EmUJ750BqsN/Fcq/c3OR67lR1+FLd77FwgEUGC4BrSbDELBraS3IiHPO2T5AnpM+EnT2CfWDwC/fytu8FA54TM0d8j/A==',key_name='tempest-keypair-2104888731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54eb635d961644dc9c1845baf24fc6db',ramdisk_id='',reservation_id='r-5gdx0woc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1752653874',owner_user_name='tempest-TaggedBootDevicesTest_v242-1752653874-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:59:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b66af1e9e094d3fa78454b91757d6cf',uuid=2dbd7449-2081-4377-a31d-e4d202679da1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a85618a-56c3-4690-af32-885b836a2c19", "address": "fa:16:3e:8f:58:e7", "network": {"id": "4fae2e1c-05e1-4891-8645-b0200336c3ab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1018677949-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a85618a-56", "ovs_interfaceid": "8a85618a-56c3-4690-af32-885b836a2c19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:00:14.008328 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converting VIF {"id": "8a85618a-56c3-4690-af32-885b836a2c19", "address": "fa:16:3e:8f:58:e7", "network": {"id": "4fae2e1c-05e1-4891-8645-b0200336c3ab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1018677949-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a85618a-56", "ovs_interfaceid": "8a85618a-56c3-4690-af32-885b836a2c19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:14.008328 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:58:e7,bridge_name='br-int',has_traffic_filtering=True,id=8a85618a-56c3-4690-af32-885b836a2c19,network=Network(4fae2e1c-05e1-4891-8645-b0200336c3ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a85618a-56') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:14.008328 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:58:e7,bridge_name='br-int',has_traffic_filtering=True,id=8a85618a-56c3-4690-af32-885b836a2c19,network=Network(4fae2e1c-05e1-4891-8645-b0200336c3ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a85618a-56') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:00:14.008328 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.008328 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.008328 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:00:14.008328 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.008328 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fef8aa98-c9ef-5258-bbb1-88bcf504f63f', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.008328 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.008328 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:14.012284 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.014474 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.014680 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a85618a-56, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.015059 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a85618a-56, col_values=(('qos', UUID('aeb06d52-f275-4488-9fef-7c39803bbf30')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.015243 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a85618a-56, col_values=(('external_ids', {'iface-id': '8a85618a-56c3-4690-af32-885b836a2c19', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:58:e7', 'vm-uuid': '2dbd7449-2081-4377-a31d-e4d202679da1'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.016060 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.017558 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:14.025394 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.026535 np0000001577 nova-compute[98319]: INFO os_vif [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:58:e7,bridge_name='br-int',has_traffic_filtering=True,id=8a85618a-56c3-4690-af32-885b836a2c19,network=Network(4fae2e1c-05e1-4891-8645-b0200336c3ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a85618a-56')
May 28 01:00:14.027133 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1792575949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1792575949',id=19,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1P9ZawshZj4d2nh1lOk0Fv8roeGP0Y7qMP0EmUJ750BqsN/Fcq/c3OR67lR1+FLd77FwgEUGC4BrSbDELBraS3IiHPO2T5AnpM+EnT2CfWDwC/fytu8FA54TM0d8j/A==',key_name='tempest-keypair-2104888731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54eb635d961644dc9c1845baf24fc6db',ramdisk_id='',reservation_id='r-5gdx0woc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1752653874',owner_user_name='tempest-TaggedBootDevicesTest_v242-1752653874-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:59:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b66af1e9e094d3fa78454b91757d6cf',uuid=2dbd7449-2081-4377-a31d-e4d202679da1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7de931f4-ea15-4c26-9bd7-00b40cd57781", "address": "fa:16:3e:d8:03:80", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de931f4-ea", "ovs_interfaceid": "7de931f4-ea15-4c26-9bd7-00b40cd57781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:00:14.027264 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converting VIF {"id": "7de931f4-ea15-4c26-9bd7-00b40cd57781", "address": "fa:16:3e:d8:03:80", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de931f4-ea", "ovs_interfaceid": "7de931f4-ea15-4c26-9bd7-00b40cd57781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:14.027676 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:03:80,bridge_name='br-int',has_traffic_filtering=True,id=7de931f4-ea15-4c26-9bd7-00b40cd57781,network=Network(6280a6b4-4539-4dd4-8845-12626e668c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7de931f4-ea') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:14.027868 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:03:80,bridge_name='br-int',has_traffic_filtering=True,id=7de931f4-ea15-4c26-9bd7-00b40cd57781,network=Network(6280a6b4-4539-4dd4-8845-12626e668c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7de931f4-ea') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:00:14.028091 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.028269 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.028449 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:00:14.029181 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.029331 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab9d3b1d-ad10-598f-90be-b80f5aa941d5', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.030323 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.030930 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:14.040472 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.043217 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.043412 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7de931f4-ea, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.043797 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7de931f4-ea, col_values=(('qos', UUID('b81ca76c-6b38-4e4c-9bf0-0e6b1e83ee82')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.043989 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7de931f4-ea, col_values=(('external_ids', {'iface-id': '7de931f4-ea15-4c26-9bd7-00b40cd57781', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:03:80', 'vm-uuid': '2dbd7449-2081-4377-a31d-e4d202679da1'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.045322 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.046837 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:14.060219 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.061217 np0000001577 nova-compute[98319]: INFO os_vif [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:03:80,bridge_name='br-int',has_traffic_filtering=True,id=7de931f4-ea15-4c26-9bd7-00b40cd57781,network=Network(6280a6b4-4539-4dd4-8845-12626e668c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7de931f4-ea')
May 28 01:00:14.061893 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1792575949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1792575949',id=19,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1P9ZawshZj4d2nh1lOk0Fv8roeGP0Y7qMP0EmUJ750BqsN/Fcq/c3OR67lR1+FLd77FwgEUGC4BrSbDELBraS3IiHPO2T5AnpM+EnT2CfWDwC/fytu8FA54TM0d8j/A==',key_name='tempest-keypair-2104888731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54eb635d961644dc9c1845baf24fc6db',ramdisk_id='',reservation_id='r-5gdx0woc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1752653874',owner_user_name='tempest-TaggedBootDevicesTest_v242-1752653874-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:59:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b66af1e9e094d3fa78454b91757d6cf',uuid=2dbd7449-2081-4377-a31d-e4d202679da1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5624a417-cdef-4be1-8586-16ca7bfdc8b9", "address": "fa:16:3e:3a:9b:65", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5624a417-cd", "ovs_interfaceid": "5624a417-cdef-4be1-8586-16ca7bfdc8b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:00:14.062136 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converting VIF {"id": "5624a417-cdef-4be1-8586-16ca7bfdc8b9", "address": "fa:16:3e:3a:9b:65", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5624a417-cd", "ovs_interfaceid": "5624a417-cdef-4be1-8586-16ca7bfdc8b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:14.062584 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:9b:65,bridge_name='br-int',has_traffic_filtering=True,id=5624a417-cdef-4be1-8586-16ca7bfdc8b9,network=Network(6280a6b4-4539-4dd4-8845-12626e668c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5624a417-cd') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:14.062875 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:9b:65,bridge_name='br-int',has_traffic_filtering=True,id=5624a417-cdef-4be1-8586-16ca7bfdc8b9,network=Network(6280a6b4-4539-4dd4-8845-12626e668c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5624a417-cd') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:00:14.063036 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.063222 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.063399 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:00:14.064273 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.064418 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '65b75bcc-2cfe-52b3-a11b-2deba4b6f2a7', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.065277 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.065913 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:14.079339 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.081274 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.081765 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5624a417-cd, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.081765 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5624a417-cd, col_values=(('qos', UUID('fdf60133-8e0d-4fa1-bbfe-b641ef475743')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.081880 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5624a417-cd, col_values=(('external_ids', {'iface-id': '5624a417-cdef-4be1-8586-16ca7bfdc8b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:9b:65', 'vm-uuid': '2dbd7449-2081-4377-a31d-e4d202679da1'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.085203 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:14.101523 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.102849 np0000001577 nova-compute[98319]: INFO os_vif [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:9b:65,bridge_name='br-int',has_traffic_filtering=True,id=5624a417-cdef-4be1-8586-16ca7bfdc8b9,network=Network(6280a6b4-4539-4dd4-8845-12626e668c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5624a417-cd')
May 28 01:00:14.103461 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1792575949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1792575949',id=19,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1P9ZawshZj4d2nh1lOk0Fv8roeGP0Y7qMP0EmUJ750BqsN/Fcq/c3OR67lR1+FLd77FwgEUGC4BrSbDELBraS3IiHPO2T5AnpM+EnT2CfWDwC/fytu8FA54TM0d8j/A==',key_name='tempest-keypair-2104888731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54eb635d961644dc9c1845baf24fc6db',ramdisk_id='',reservation_id='r-5gdx0woc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1752653874',owner_user_name='tempest-TaggedBootDevicesTest_v242-1752653874-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:59:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b66af1e9e094d3fa78454b91757d6cf',uuid=2dbd7449-2081-4377-a31d-e4d202679da1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3de085f7-074a-44c7-99ab-7093e0ddc084", "address": "fa:16:3e:ab:a0:32", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de085f7-07", "ovs_interfaceid": "3de085f7-074a-44c7-99ab-7093e0ddc084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:00:14.103796 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converting VIF {"id": "3de085f7-074a-44c7-99ab-7093e0ddc084", "address": "fa:16:3e:ab:a0:32", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de085f7-07", "ovs_interfaceid": "3de085f7-074a-44c7-99ab-7093e0ddc084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:14.104058 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:a0:32,bridge_name='br-int',has_traffic_filtering=True,id=3de085f7-074a-44c7-99ab-7093e0ddc084,network=Network(6280a6b4-4539-4dd4-8845-12626e668c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de085f7-07') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:14.104253 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:a0:32,bridge_name='br-int',has_traffic_filtering=True,id=3de085f7-074a-44c7-99ab-7093e0ddc084,network=Network(6280a6b4-4539-4dd4-8845-12626e668c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de085f7-07') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:00:14.107622 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.107957 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.108038 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:00:14.110382 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.110382 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee340afb-08f0-502e-a3b8-c1495cee562c', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.111250 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:14.114353 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930014.1140404, ebae9109-a600-4788-9008-74a8c320b803 => ua-e6d37c59-727a-44bb-992c-7034d5fc6131> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:00:14.117590 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e6d37c59-727a-44bb-992c-7034d5fc6131 for instance ebae9109-a600-4788-9008-74a8c320b803 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:00:14.120807 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Successfully detached device vdb from instance ebae9109-a600-4788-9008-74a8c320b803 from the live domain config.
May 28 01:00:14.121683 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:00:14.121977 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131', 'iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6d37c59-727a-44bb-992c-7034d5fc6131', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:00:14.122127 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:00:14.122465 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:00:14.122734 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131', 'iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6d37c59-727a-44bb-992c-7034d5fc6131', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:00:14.122875 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:00:14.133767 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.135927 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.136117 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3de085f7-07, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.136437 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3de085f7-07, col_values=(('qos', UUID('2ebfe968-b123-4c71-8e75-097581e6630a')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.136630 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3de085f7-07, col_values=(('external_ids', {'iface-id': '3de085f7-074a-44c7-99ab-7093e0ddc084', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:a0:32', 'vm-uuid': '2dbd7449-2081-4377-a31d-e4d202679da1'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.138015 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.139581 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:14.160206 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:14.160206 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:14.160206 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:14.160206 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:14.160206 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:14.160206 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:14.160206 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:14.160206 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:14.160206 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:14.160206 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:14.160206 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:00:14.160510 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:14.160510 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:14.160510 np0000001577 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:14.160510 np0000001577 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131 (non-flash)
May 28 01:00:14.160510 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:14.160510 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:14.160510 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:14.160510 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:14.160510 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:14.160510 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:14.160510 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:00:14.160510 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', '37')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:00:14.160510 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131', '29')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:00:14.161416 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131', '30')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:00:14.162295 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c984c52f600>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131'): ({'sde'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:00:14.162537 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Removing multipathed devices sde, sdd {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:00:14.162715 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Flush multipath device 330000000b4ee91f3 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:00:14.179044 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.182825 np0000001577 nova-compute[98319]: INFO os_vif [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:a0:32,bridge_name='br-int',has_traffic_filtering=True,id=3de085f7-074a-44c7-99ab-7093e0ddc084,network=Network(6280a6b4-4539-4dd4-8845-12626e668c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de085f7-07')
May 28 01:00:14.183714 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1792575949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1792575949',id=19,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1P9ZawshZj4d2nh1lOk0Fv8roeGP0Y7qMP0EmUJ750BqsN/Fcq/c3OR67lR1+FLd77FwgEUGC4BrSbDELBraS3IiHPO2T5AnpM+EnT2CfWDwC/fytu8FA54TM0d8j/A==',key_name='tempest-keypair-2104888731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54eb635d961644dc9c1845baf24fc6db',ramdisk_id='',reservation_id='r-5gdx0woc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1752653874',owner_user_name='tempest-TaggedBootDevicesTest_v242-1752653874-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:59:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b66af1e9e094d3fa78454b91757d6cf',uuid=2dbd7449-2081-4377-a31d-e4d202679da1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02325a90-5e85-4e9f-a65e-c1bd91c39e80", "address": "fa:16:3e:e0:c1:49", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02325a90-5e", "ovs_interfaceid": "02325a90-5e85-4e9f-a65e-c1bd91c39e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:00:14.184416 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converting VIF {"id": "02325a90-5e85-4e9f-a65e-c1bd91c39e80", "address": "fa:16:3e:e0:c1:49", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02325a90-5e", "ovs_interfaceid": "02325a90-5e85-4e9f-a65e-c1bd91c39e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:14.184518 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c1:49,bridge_name='br-int',has_traffic_filtering=True,id=02325a90-5e85-4e9f-a65e-c1bd91c39e80,network=Network(6280a6b4-4539-4dd4-8845-12626e668c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02325a90-5e') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:14.184881 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c1:49,bridge_name='br-int',has_traffic_filtering=True,id=02325a90-5e85-4e9f-a65e-c1bd91c39e80,network=Network(6280a6b4-4539-4dd4-8845-12626e668c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02325a90-5e') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:00:14.185120 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.185340 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.185606 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:00:14.186665 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.186857 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dc3fff16-990c-5106-a9f2-7104fd12cf2e', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.187580 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.188387 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:14.198120 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:00:14.215446 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.218874 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.220993 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02325a90-5e, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.220993 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap02325a90-5e, col_values=(('qos', UUID('247ca135-8a28-45f6-a19b-c3782434e900')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.220993 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap02325a90-5e, col_values=(('external_ids', {'iface-id': '02325a90-5e85-4e9f-a65e-c1bd91c39e80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:c1:49', 'vm-uuid': '2dbd7449-2081-4377-a31d-e4d202679da1'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.222369 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:14.245828 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:00:14.253857 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.257720 np0000001577 nova-compute[98319]: INFO os_vif [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c1:49,bridge_name='br-int',has_traffic_filtering=True,id=02325a90-5e85-4e9f-a65e-c1bd91c39e80,network=Network(6280a6b4-4539-4dd4-8845-12626e668c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02325a90-5e')
May 28 01:00:14.257720 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1792575949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1792575949',id=19,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1P9ZawshZj4d2nh1lOk0Fv8roeGP0Y7qMP0EmUJ750BqsN/Fcq/c3OR67lR1+FLd77FwgEUGC4BrSbDELBraS3IiHPO2T5AnpM+EnT2CfWDwC/fytu8FA54TM0d8j/A==',key_name='tempest-keypair-2104888731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54eb635d961644dc9c1845baf24fc6db',ramdisk_id='',reservation_id='r-5gdx0woc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1752653874',owner_user_name='tempest-TaggedBootDevicesTest_v242-1752653874-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:59:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b66af1e9e094d3fa78454b91757d6cf',uuid=2dbd7449-2081-4377-a31d-e4d202679da1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59a7e22c-8c09-4a33-9b95-58ee955f6895", "address": "fa:16:3e:1b:8b:e7", "network": {"id": "0a64f131-06a0-4c34-a1d8-06f8419256bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-288972260", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59a7e22c-8c", "ovs_interfaceid": "59a7e22c-8c09-4a33-9b95-58ee955f6895", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:00:14.257720 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converting VIF {"id": "59a7e22c-8c09-4a33-9b95-58ee955f6895", "address": "fa:16:3e:1b:8b:e7", "network": {"id": "0a64f131-06a0-4c34-a1d8-06f8419256bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-288972260", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59a7e22c-8c", "ovs_interfaceid": "59a7e22c-8c09-4a33-9b95-58ee955f6895", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:14.261512 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:8b:e7,bridge_name='br-int',has_traffic_filtering=True,id=59a7e22c-8c09-4a33-9b95-58ee955f6895,network=Network(0a64f131-06a0-4c34-a1d8-06f8419256bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59a7e22c-8c') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:14.261799 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:8b:e7,bridge_name='br-int',has_traffic_filtering=True,id=59a7e22c-8c09-4a33-9b95-58ee955f6895,network=Network(0a64f131-06a0-4c34-a1d8-06f8419256bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59a7e22c-8c') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:00:14.262156 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.262983 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.265125 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-494627b8-aeaf-498b-95a2-c35b27c20254 req-075c8fa9-0046-46ee-8688-641beac03a70 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:14.266759 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:00:14.270736 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.270885 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1915d1ee-ee1f-58dc-9c96-aed76516e2b6', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.272800 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:14.284972 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:00:14.285134 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:00:14.290486 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:00:14.291966 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:00:14.307369 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:00:14.308589 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:00:14.311096 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.316347 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.316501 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59a7e22c-8c, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.316861 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap59a7e22c-8c, col_values=(('qos', UUID('7340e13e-ecd5-40eb-8cfa-0fd222f6356e')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.317027 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap59a7e22c-8c, col_values=(('external_ids', {'iface-id': '59a7e22c-8c09-4a33-9b95-58ee955f6895', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:8b:e7', 'vm-uuid': '2dbd7449-2081-4377-a31d-e4d202679da1'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.319353 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:14.322766 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:14.354775 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.359363 np0000001577 nova-compute[98319]: INFO os_vif [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:8b:e7,bridge_name='br-int',has_traffic_filtering=True,id=59a7e22c-8c09-4a33-9b95-58ee955f6895,network=Network(0a64f131-06a0-4c34-a1d8-06f8419256bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59a7e22c-8c')
May 28 01:00:14.360806 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1792575949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1792575949',id=19,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1P9ZawshZj4d2nh1lOk0Fv8roeGP0Y7qMP0EmUJ750BqsN/Fcq/c3OR67lR1+FLd77FwgEUGC4BrSbDELBraS3IiHPO2T5AnpM+EnT2CfWDwC/fytu8FA54TM0d8j/A==',key_name='tempest-keypair-2104888731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54eb635d961644dc9c1845baf24fc6db',ramdisk_id='',reservation_id='r-5gdx0woc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1752653874',owner_user_name='tempest-TaggedBootDevicesTest_v242-1752653874-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T00:59:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b66af1e9e094d3fa78454b91757d6cf',uuid=2dbd7449-2081-4377-a31d-e4d202679da1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1b61752-f189-4f02-b9eb-92326fb29830", "address": "fa:16:3e:40:00:63", "network": {"id": "0a64f131-06a0-4c34-a1d8-06f8419256bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-288972260", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b61752-f1", "ovs_interfaceid": "d1b61752-f189-4f02-b9eb-92326fb29830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:00:14.361234 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converting VIF {"id": "d1b61752-f189-4f02-b9eb-92326fb29830", "address": "fa:16:3e:40:00:63", "network": {"id": "0a64f131-06a0-4c34-a1d8-06f8419256bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-288972260", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b61752-f1", "ovs_interfaceid": "d1b61752-f189-4f02-b9eb-92326fb29830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:14.361848 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:00:63,bridge_name='br-int',has_traffic_filtering=True,id=d1b61752-f189-4f02-b9eb-92326fb29830,network=Network(0a64f131-06a0-4c34-a1d8-06f8419256bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1b61752-f1') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:14.362019 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:00:63,bridge_name='br-int',has_traffic_filtering=True,id=d1b61752-f189-4f02-b9eb-92326fb29830,network=Network(0a64f131-06a0-4c34-a1d8-06f8419256bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1b61752-f1') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:00:14.362490 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131, portal: 192.168.40.100,3260]
May 28 01:00:14.362490 np0000001577 nova-compute[98319]: Logout of [sid: 29, target: iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131, portal: 192.168.40.100,3260] successful.
May 28 01:00:14.362490 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:14.362748 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.362996 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.363274 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:00:14.365093 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.365093 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd1bfde9-9c99-5458-911e-f4337f36f3b2', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.366110 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.366832 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:14.390686 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:14.395645 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:00:14.395645 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:00:14.395645 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:14.395772 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:14.403896 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:14.407456 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.412571 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.412571 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1b61752-f1, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.412571 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd1b61752-f1, col_values=(('qos', UUID('a677fb4c-60ba-461a-8ec1-402430ae6522')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.412571 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd1b61752-f1, col_values=(('external_ids', {'iface-id': 'd1b61752-f189-4f02-b9eb-92326fb29830', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:00:63', 'vm-uuid': '2dbd7449-2081-4377-a31d-e4d202679da1'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:14.414771 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.415284 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:14.440587 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131, portal: 192.168.50.100,3260]
May 28 01:00:14.440587 np0000001577 nova-compute[98319]: Logout of [sid: 30, target: iqn.2023-03.storpool.com:os--volume-e6d37c59-727a-44bb-992c-7034d5fc6131, portal: 192.168.50.100,3260] successful.
May 28 01:00:14.440587 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:14.454640 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:14.455046 np0000001577 nova-compute[98319]: INFO os_vif [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:00:63,bridge_name='br-int',has_traffic_filtering=True,id=d1b61752-f189-4f02-b9eb-92326fb29830,network=Network(0a64f131-06a0-4c34-a1d8-06f8419256bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1b61752-f1')
May 28 01:00:14.457538 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:14.458715 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:00:14.458715 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] <== disconnect_volume: return (336ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:00:14.458715 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:00:14.464804 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-494627b8-aeaf-498b-95a2-c35b27c20254 req-075c8fa9-0046-46ee-8688-641beac03a70 service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Updated VIF entry in instance network info cache for port 3ed3d348-6b93-4492-9c18-7b0eecc6454a. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:00:14.465630 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-494627b8-aeaf-498b-95a2-c35b27c20254 req-075c8fa9-0046-46ee-8688-641beac03a70 service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Updating instance_info_cache with network_info: [{"id": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "address": "fa:16:3e:28:56:65", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3d348-6b", "ovs_interfaceid": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:00:14.511183 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb8bed94f4864e6696094a671fc6ef4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caedf1b88e96476bacbd226b0510ed55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:00:14.777399 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.520s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:14.846834 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:14.846834 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:14.853136 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:00:14.853136 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Claim successful on node np0000001577
May 28 01:00:14.903750 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:00:14.968044 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-494627b8-aeaf-498b-95a2-c35b27c20254 req-075c8fa9-0046-46ee-8688-641beac03a70 service nova] Releasing lock "refresh_cache-d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:00:15.019178 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lazy-loading 'flavor' on Instance uuid ebae9109-a600-4788-9008-74a8c320b803 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:00:15.039388 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Successfully created port: 20df759b-14e4-420f-a938-58b5276b3cd9 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:00:15.408334 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:00:15.477876 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:00:15.477876 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:00:15.477876 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No VIF found with MAC fa:16:3e:28:56:65, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:00:15.478734 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Using config drive
May 28 01:00:15.561005 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Successfully updated port: 20df759b-14e4-420f-a938-58b5276b3cd9 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:00:15.606761 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:15.751948 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f2b90386-d692-47a6-9d31-88392c650aba req-8120e017-9916-409c-bca4-cb379877224f service nova] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Received event network-changed-20df759b-14e4-420f-a938-58b5276b3cd9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:15.753218 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f2b90386-d692-47a6-9d31-88392c650aba req-8120e017-9916-409c-bca4-cb379877224f service nova] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Refreshing instance network info cache due to event network-changed-20df759b-14e4-420f-a938-58b5276b3cd9. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:00:15.753378 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f2b90386-d692-47a6-9d31-88392c650aba req-8120e017-9916-409c-bca4-cb379877224f service nova] Acquiring lock "refresh_cache-11d1c78c-76d0-4b3a-8a7d-9de7e37148d2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:00:15.756332 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f2b90386-d692-47a6-9d31-88392c650aba req-8120e017-9916-409c-bca4-cb379877224f service nova] Acquired lock "refresh_cache-11d1c78c-76d0-4b3a-8a7d-9de7e37148d2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:00:15.756590 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-f2b90386-d692-47a6-9d31-88392c650aba req-8120e017-9916-409c-bca4-cb379877224f service nova] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Refreshing network info cache for port 20df759b-14e4-420f-a938-58b5276b3cd9 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:00:15.834013 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:15.834199 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:15.834420 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Attaching volume a390b885-c2b5-4116-b7ea-4ad467d6145f to /dev/vdb
May 28 01:00:15.884351 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:00:15.895707 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:00:15.919908 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:15.957636 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:00:15.957878 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:00:15.965992 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:00:15.967395 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe75:1c46', 'fe80::8c3:73ff:fe68:9ea1', 'fe80::fc16:3eff:fe85:df78', 'fe80::3834:39ff:fe20:36ec', 'fe80::fc16:3eff:fef0:246e', 'fe80::fc16:3eff:feca:a831', 'fe80::e8d7:d3ff:fe11:4890', 'fe80::fc16:3eff:febd:1fa1', 'fe80::743e:7eff:fe2c:709c', 'fe80::fc16:3eff:fe12:3f51', 'fe80::64e0:a4ff:fe34:ffd6', 'fe80::fc16:3eff:fe72:df47', 'fe80::fc16:3eff:fed9:e218', 'fe80::8069:41ff:fec5:b665', 'fe80::fc16:3eff:fe3e:2329'] 
May 28 01:00:15.967490 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:00:15.967648 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:00:15.967982 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:00:15.969431 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Updating existing volume attachment record: 0016581c-1849-4926-8702-b6978a5ebf37 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:00:15.979278 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:00:15.979631 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:00:15.980046 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] No VIF found with MAC fa:16:3e:8f:58:e7, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:00:15.980046 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] No VIF found with MAC fa:16:3e:e0:c1:49, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:00:15.980738 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Using config drive
May 28 01:00:15.991938 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:16.018492 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:16.042259 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c635ff4f-5f67-4901-9fe8-40f343730eaa tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "ebae9109-a600-4788-9008-74a8c320b803" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.012s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:16.063911 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Acquiring lock "refresh_cache-11d1c78c-76d0-4b3a-8a7d-9de7e37148d2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:00:16.209443 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Creating config drive at /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk.config
May 28 01:00:16.218582 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgzeamg0r {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:16.262910 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-f2b90386-d692-47a6-9d31-88392c650aba req-8120e017-9916-409c-bca4-cb379877224f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:16.276103 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgzeamg0r" returned: 0 in 0.058s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:16.328145 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-33372b60-b8bc-4d52-a410-6de714f40895 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "ebae9109-a600-4788-9008-74a8c320b803" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:16.328413 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-33372b60-b8bc-4d52-a410-6de714f40895 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "ebae9109-a600-4788-9008-74a8c320b803" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:16.328689 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-33372b60-b8bc-4d52-a410-6de714f40895 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "ebae9109-a600-4788-9008-74a8c320b803-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:16.328845 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-33372b60-b8bc-4d52-a410-6de714f40895 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "ebae9109-a600-4788-9008-74a8c320b803-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:16.328965 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-33372b60-b8bc-4d52-a410-6de714f40895 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "ebae9109-a600-4788-9008-74a8c320b803-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:16.333959 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-33372b60-b8bc-4d52-a410-6de714f40895 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Terminating instance
May 28 01:00:16.347049 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-f2b90386-d692-47a6-9d31-88392c650aba req-8120e017-9916-409c-bca4-cb379877224f service nova] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:00:16.422361 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:00:16.424290 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:00:16.424853 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Creating image(s)
May 28 01:00:16.426368 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Acquiring lock "/opt/stack/data/nova/instances/11d1c78c-76d0-4b3a-8a7d-9de7e37148d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:16.426600 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "/opt/stack/data/nova/instances/11d1c78c-76d0-4b3a-8a7d-9de7e37148d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:16.427205 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "/opt/stack/data/nova/instances/11d1c78c-76d0-4b3a-8a7d-9de7e37148d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:16.428086 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:00:16.432190 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:00:16.435435 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:16.510442 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:16.539776 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.104s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:16.541938 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:16.542227 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:16.542680 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:00:16.548281 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:00:16.549029 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:16.584293 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-f2b90386-d692-47a6-9d31-88392c650aba req-8120e017-9916-409c-bca4-cb379877224f service nova] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:00:16.595078 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:00:16.596355 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a390b885-c2b5-4116-b7ea-4ad467d6145f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:00:16.596713 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:00:16.598825 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:00:16.598825 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a390b885-c2b5-4116-b7ea-4ad467d6145f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:00:16.630627 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:00:16.630627 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:00:16.630627 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:00:16.630627 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:00:16.630946 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:00:16.630990 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:00:16.645414 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:00:16.645414 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:16.653209 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:00:16.653209 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:16.653723 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.105s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:16.654853 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/11d1c78c-76d0-4b3a-8a7d-9de7e37148d2/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:16.683642 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f] added
May 28 01:00:16.683642 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:00:16.683642 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:00:16.683642 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:00:16.683642 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:00:16.683642 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:00:16.683642 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:16.684076 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:00:16.684573 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0543(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:00:16.686795 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f] added
May 28 01:00:16.686795 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:00:16.686795 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:00:16.686795 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:00:16.686795 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:00:16.686795 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:00:16.686795 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:16.687028 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:00:16.689645 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0562(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:00:16.689645 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:00:16.689645 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:00:16.704674 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/11d1c78c-76d0-4b3a-8a7d-9de7e37148d2/disk 1073741824" returned: 0 in 0.050s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:16.705236 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.163s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:16.708614 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:16.786542 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Creating config drive at /opt/stack/data/nova/instances/2dbd7449-2081-4377-a31d-e4d202679da1/disk.config
May 28 01:00:16.790203 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2dbd7449-2081-4377-a31d-e4d202679da1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmgw3qd9m {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:16.810069 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.100s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:16.810069 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11d1c78c-76d0-4b3a-8a7d-9de7e37148d2/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:00:16.810688 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11d1c78c-76d0-4b3a-8a7d-9de7e37148d2/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:16.844155 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-33372b60-b8bc-4d52-a410-6de714f40895 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:00:16.847881 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2dbd7449-2081-4377-a31d-e4d202679da1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmgw3qd9m" returned: 0 in 0.057s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:16.847881 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:16.915106 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:16.921012 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11d1c78c-76d0-4b3a-8a7d-9de7e37148d2/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:16.921350 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Cannot resize image /opt/stack/data/nova/instances/11d1c78c-76d0-4b3a-8a7d-9de7e37148d2/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:00:16.922206 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:00:16.922206 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Ensure instance console log exists: /opt/stack/data/nova/instances/11d1c78c-76d0-4b3a-8a7d-9de7e37148d2/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:00:16.923577 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:16.923577 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:16.924086 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:16.960576 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:00:16.960576 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:00:16.978846 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:16.985247 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:17.036209 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:17.078616 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:17.098636 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f2b90386-d692-47a6-9d31-88392c650aba req-8120e017-9916-409c-bca4-cb379877224f service nova] Releasing lock "refresh_cache-11d1c78c-76d0-4b3a-8a7d-9de7e37148d2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:00:17.099589 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Acquired lock "refresh_cache-11d1c78c-76d0-4b3a-8a7d-9de7e37148d2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:00:17.099781 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:00:17.103663 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:17.170969 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:17.402528 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999615917000028 future=<Future at 0x7c987042f260 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:00:17.412359 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: ebae9109-a600-4788-9008-74a8c320b803] Instance destroyed successfully.
May 28 01:00:17.413687 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-33372b60-b8bc-4d52-a410-6de714f40895 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lazy-loading 'resources' on Instance uuid ebae9109-a600-4788-9008-74a8c320b803 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:00:17.463825 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:00:17.517145 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:17.552386 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:17.621015 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:17.680373 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:17.690672 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:00:17.692514 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:00:17.704144 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:00:17.713535 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:00:17.713535 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:00:17.718675 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:00:17.718675 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:17.744839 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:17.752893 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:17.775704 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:17.775704 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:17.775704 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:17.775704 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:17.775704 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:17.775704 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:17.775704 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:17.775704 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:17.775704 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:00:17.775893 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:17.775893 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:17.775893 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:17.775893 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:17.775893 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:17.775893 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:17.775893 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:17.775893 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:17.775893 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:00:17.788103 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:17.788103 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:17.788103 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:17.788103 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:17.788103 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:17.788103 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:17.788103 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:17.788103 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:17.788103 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:00:17.788103 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:17.788103 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:17.788103 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:17.788103 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:17.788103 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:17.788103 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:17.788103 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:17.788103 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:17.788103 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:00:17.810879 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:17.816282 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f, portal: 192.168.50.100,3260]
May 28 01:00:17.816282 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f, portal: 192.168.50.100,3260] successful.
May 28 01:00:17.816282 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:17.823582 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:17.842252 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:17.850713 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:17.881043 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:17.886645 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f, portal: 192.168.40.100,3260]
May 28 01:00:17.886645 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f, portal: 192.168.40.100,3260] successful.
May 28 01:00:17.886645 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:17.887216 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:17.887216 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:17.887216 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:17.887216 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:17.887216 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:17.887216 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:17.887216 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:17.887216 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:17.887216 np0000001577 nova-compute[98319]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:17.887216 np0000001577 nova-compute[98319]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:17.887216 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:00:17.887496 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:17.887496 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:17.887496 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:17.887496 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:17.887496 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:17.887496 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:17.887496 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:17.887496 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:17.887496 np0000001577 nova-compute[98319]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:17.887496 np0000001577 nova-compute[98319]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:17.887496 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:00:17.888888 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.257s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:00:17.888888 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:00:17.888888 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] HCTL ('9', '-', '-', 0) found on session 38 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:00:17.888888 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:00:17.902003 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:17.919758 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-33372b60-b8bc-4d52-a410-6de714f40895 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:58:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-756428160',display_name='tempest-VolumesBackupsTest-instance-756428160',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumesbackupstest-instance-756428160',id=11,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK97goX4/Mk9CRCWqwBu0BG5UIZZl/AJBLguOHFIko7C5AyGAHKiRCQDVTp751nZid77AB4v/HBNGzL7dQgWH1b1vtiA/9jSdmXvX78JdxK+9AAQJrADRyOHUlGmNrc3Zw==',key_name='tempest-keypair-933242402',keypairs=<?>,launch_index=0,launched_at=2026-05-28T00:59:00Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b80759164bf4465b0bd873db74c9c49',ramdisk_id='',reservation_id='r-0ile47bv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-2139172395',owner_user_name='tempest-VolumesBackupsTest-2139172395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T00:59:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f43f6f5427ba4a5b896019555a2ef47a',uuid=ebae9109-a600-4788-9008-74a8c320b803,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d13e4109-188d-4b19-916a-486f62a27eea", "address": "fa:16:3e:85:df:78", "network": {"id": "be63e483-23b8-4753-b2fa-d9fc516b53f9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-518223995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b80759164bf4465b0bd873db74c9c49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13e4109-18", "ovs_interfaceid": "d13e4109-188d-4b19-916a-486f62a27eea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:00:17.919758 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-33372b60-b8bc-4d52-a410-6de714f40895 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Converting VIF {"id": "d13e4109-188d-4b19-916a-486f62a27eea", "address": "fa:16:3e:85:df:78", "network": {"id": "be63e483-23b8-4753-b2fa-d9fc516b53f9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-518223995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b80759164bf4465b0bd873db74c9c49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13e4109-18", "ovs_interfaceid": "d13e4109-188d-4b19-916a-486f62a27eea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:17.919758 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-33372b60-b8bc-4d52-a410-6de714f40895 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:df:78,bridge_name='br-int',has_traffic_filtering=True,id=d13e4109-188d-4b19-916a-486f62a27eea,network=Network(be63e483-23b8-4753-b2fa-d9fc516b53f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd13e4109-18') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:17.920077 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-33372b60-b8bc-4d52-a410-6de714f40895 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:df:78,bridge_name='br-int',has_traffic_filtering=True,id=d13e4109-188d-4b19-916a-486f62a27eea,network=Network(be63e483-23b8-4753-b2fa-d9fc516b53f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd13e4109-18') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:00:17.922321 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Searching for a device in session 38 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:00:17.922321 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a390b885-c2b5-4116-b7ea-4ad467d6145f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:00:17.924296 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:17.925629 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd13e4109-18, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:17.927844 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:17.930320 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:17.930320 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:17.930320 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:17.930320 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:17.930320 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:17.930320 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:17.930320 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:17.930320 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:17.930320 np0000001577 nova-compute[98319]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:17.930320 np0000001577 nova-compute[98319]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:17.930320 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:00:17.931367 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:17.931367 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:17.931367 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:17.931367 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:17.931367 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:17.931367 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:17.931367 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:17.931367 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:17.931367 np0000001577 nova-compute[98319]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:17.931367 np0000001577 nova-compute[98319]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:17.931367 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:00:17.931367 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.301s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:00:17.931367 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:00:17.934996 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] HCTL ('10', '-', '-', 0) found on session 39 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:00:17.935510 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:00:17.950426 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:17.952461 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:17.952461 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc339cb5-2bbd-4de2-b451-a392feddf639) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:17.964597 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:17.967889 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Searching for a device in session 39 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:00:17.967889 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a390b885-c2b5-4116-b7ea-4ad467d6145f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:00:17.972933 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.126s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:17.982271 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:17.986607 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:17.988846 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:00:17.995464 np0000001577 nova-compute[98319]: INFO os_vif [None req-33372b60-b8bc-4d52-a410-6de714f40895 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:df:78,bridge_name='br-int',has_traffic_filtering=True,id=d13e4109-188d-4b19-916a-486f62a27eea,network=Network(be63e483-23b8-4753-b2fa-d9fc516b53f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd13e4109-18')
May 28 01:00:17.997813 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-33372b60-b8bc-4d52-a410-6de714f40895 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Deleting instance files /opt/stack/data/nova/instances/ebae9109-a600-4788-9008-74a8c320b803_del
May 28 01:00:17.997813 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-33372b60-b8bc-4d52-a410-6de714f40895 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Deletion of /opt/stack/data/nova/instances/ebae9109-a600-4788-9008-74a8c320b803_del complete
May 28 01:00:18.028723 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:18.068768 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:18.089922 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:18.107365 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:18.138009 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:18.165403 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:18.177154 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:18.221929 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4bc0cea6-8abb-4324-8174-de4f89037e64 req-6dc0feab-65c3-4b31-a8be-ba53ada35d43 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-plugged-7de931f4-ea15-4c26-9bd7-00b40cd57781 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:18.228655 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4bc0cea6-8abb-4324-8174-de4f89037e64 req-6dc0feab-65c3-4b31-a8be-ba53ada35d43 service nova] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:18.228655 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4bc0cea6-8abb-4324-8174-de4f89037e64 req-6dc0feab-65c3-4b31-a8be-ba53ada35d43 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:18.228655 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4bc0cea6-8abb-4324-8174-de4f89037e64 req-6dc0feab-65c3-4b31-a8be-ba53ada35d43 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:18.228655 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4bc0cea6-8abb-4324-8174-de4f89037e64 req-6dc0feab-65c3-4b31-a8be-ba53ada35d43 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Processing event network-vif-plugged-7de931f4-ea15-4c26-9bd7-00b40cd57781 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:00:18.235622 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:18.251090 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:18.348215 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:18.424583 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:18.433462 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Updating instance_info_cache with network_info: [{"id": "20df759b-14e4-420f-a938-58b5276b3cd9", "address": "fa:16:3e:2c:3d:fa", "network": {"id": "92076d1f-65e0-44ef-afce-207d3e18dc80", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906118401-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "caedf1b88e96476bacbd226b0510ed55", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20df759b-14", "ovs_interfaceid": "20df759b-14e4-420f-a938-58b5276b3cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:00:18.440036 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930018.438694, d87bb95b-a1e9-4786-8bee-16f2cfaabf2d => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:00:18.440036 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] VM Started (Lifecycle Event)
May 28 01:00:18.483946 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:18.503310 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:00:18.503521 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:00:18.503863 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:18.504163 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:18.514111 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:18.525262 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-33372b60-b8bc-4d52-a410-6de714f40895 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Took 1.68 seconds to destroy the instance on the hypervisor.
May 28 01:00:18.525262 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-33372b60-b8bc-4d52-a410-6de714f40895 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:00:18.525262 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: ebae9109-a600-4788-9008-74a8c320b803] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:00:18.525262 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: ebae9109-a600-4788-9008-74a8c320b803] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:00:18.525262 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:18.593365 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:18.631557 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:00:18.665391 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e2684c1dc140407b91687ee5abadef9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c5a1da6bb242e9a58cb82855897726', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:00:18.708338 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:18.760451 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:18.762381 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:18.767216 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:18.790464 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:18.937152 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Releasing lock "refresh_cache-11d1c78c-76d0-4b3a-8a7d-9de7e37148d2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:00:18.937813 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Instance network_info: |[{"id": "20df759b-14e4-420f-a938-58b5276b3cd9", "address": "fa:16:3e:2c:3d:fa", "network": {"id": "92076d1f-65e0-44ef-afce-207d3e18dc80", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906118401-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "caedf1b88e96476bacbd226b0510ed55", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20df759b-14", "ovs_interfaceid": "20df759b-14e4-420f-a938-58b5276b3cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:00:18.940317 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Start _get_guest_xml network_info=[{"id": "20df759b-14e4-420f-a938-58b5276b3cd9", "address": "fa:16:3e:2c:3d:fa", "network": {"id": "92076d1f-65e0-44ef-afce-207d3e18dc80", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906118401-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "caedf1b88e96476bacbd226b0510ed55", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20df759b-14", "ovs_interfaceid": "20df759b-14e4-420f-a938-58b5276b3cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:00:18.942886 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:18.943951 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:00:18.945810 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-1737599647', uuid='11d1c78c-76d0-4b3a-8a7d-9de7e37148d2'), owner=OwnerMeta(userid='bb8bed94f4864e6696094a671fc6ef4f', username='tempest-ServersNegativeTestJSON-811169851-project-member', projectid='caedf1b88e96476bacbd226b0510ed55', projectname='tempest-ServersNegativeTestJSON-811169851'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "20df759b-14e4-420f-a938-58b5276b3cd9", "address": "fa:16:3e:2c:3d:fa", "network": {"id": "92076d1f-65e0-44ef-afce-207d3e18dc80", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906118401-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "caedf1b88e96476bacbd226b0510ed55", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20df759b-14", "ovs_interfaceid": "20df759b-14e4-420f-a938-58b5276b3cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930018.9454412) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:00:18.955730 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:00:18.956082 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930018.9557645, d87bb95b-a1e9-4786-8bee-16f2cfaabf2d => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:00:18.956364 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] VM Paused (Lifecycle Event)
May 28 01:00:18.957712 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:00:18.962466 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:00:18.962466 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:00:18.964339 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:00:18.964339 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:00:18.964339 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:00:18.964339 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:00:18.965810 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:00:18.965945 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:00:18.966131 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:00:18.966263 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:00:18.966380 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:00:18.966503 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:00:18.966631 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:00:18.966757 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:00:18.979381 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:00:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1737599647',display_name='tempest-ServersNegativeTestJSON-server-1737599647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serversnegativetestjson-server-1737599647',id=22,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='caedf1b88e96476bacbd226b0510ed55',ramdisk_id='',reservation_id='r-xfh0a03h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-811169851',owner_user_name='tempest-ServersNegativeTestJSON-811169851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:00:15Z,user_data=None,user_id='bb8bed94f4864e6696094a671fc6ef4f',uuid=11d1c78c-76d0-4b3a-8a7d-9de7e37148d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20df759b-14e4-420f-a938-58b5276b3cd9", "address": "fa:16:3e:2c:3d:fa", "network": {"id": "92076d1f-65e0-44ef-afce-207d3e18dc80", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906118401-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "caedf1b88e96476bacbd226b0510ed55", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20df759b-14", "ovs_interfaceid": "20df759b-14e4-420f-a938-58b5276b3cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:00:18.979643 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Converting VIF {"id": "20df759b-14e4-420f-a938-58b5276b3cd9", "address": "fa:16:3e:2c:3d:fa", "network": {"id": "92076d1f-65e0-44ef-afce-207d3e18dc80", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906118401-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "caedf1b88e96476bacbd226b0510ed55", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20df759b-14", "ovs_interfaceid": "20df759b-14e4-420f-a938-58b5276b3cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:18.980241 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:3d:fa,bridge_name='br-int',has_traffic_filtering=True,id=20df759b-14e4-420f-a938-58b5276b3cd9,network=Network(92076d1f-65e0-44ef-afce-207d3e18dc80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20df759b-14') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:18.981016 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lazy-loading 'pci_devices' on Instance uuid 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:00:19.010469 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:00:19.026425 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c812df31-c65d-492a-b08b-7820c4af23a2 req-637587fb-fac5-4fdc-b39b-7510d265b092 service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Received event network-vif-plugged-3ed3d348-6b93-4492-9c18-7b0eecc6454a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:19.026578 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c812df31-c65d-492a-b08b-7820c4af23a2 req-637587fb-fac5-4fdc-b39b-7510d265b092 service nova] Acquiring lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:19.026853 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c812df31-c65d-492a-b08b-7820c4af23a2 req-637587fb-fac5-4fdc-b39b-7510d265b092 service nova] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:19.027211 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c812df31-c65d-492a-b08b-7820c4af23a2 req-637587fb-fac5-4fdc-b39b-7510d265b092 service nova] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:19.027342 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c812df31-c65d-492a-b08b-7820c4af23a2 req-637587fb-fac5-4fdc-b39b-7510d265b092 service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Processing event network-vif-plugged-3ed3d348-6b93-4492-9c18-7b0eecc6454a {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:00:19.029921 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:00:19.039151 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:00:19.042965 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Instance spawned successfully.
May 28 01:00:19.044732 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:00:19.089672 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:19.323483 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:19.326856 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:19.459315 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:19.463497 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930019.4631376, d87bb95b-a1e9-4786-8bee-16f2cfaabf2d => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:00:19.466254 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] VM Resumed (Lifecycle Event)
May 28 01:00:19.487942 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] End _get_guest_xml xml=<domain type="qemu">
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:   <uuid>11d1c78c-76d0-4b3a-8a7d-9de7e37148d2</uuid>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:   <name>instance-00000016</name>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       <nova:name>tempest-ServersNegativeTestJSON-server-1737599647</nova:name>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:00:18</nova:creationTime>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:         <nova:user uuid="bb8bed94f4864e6696094a671fc6ef4f">tempest-ServersNegativeTestJSON-811169851-project-member</nova:user>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:         <nova:project uuid="caedf1b88e96476bacbd226b0510ed55">tempest-ServersNegativeTestJSON-811169851</nova:project>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:         <nova:port uuid="20df759b-14e4-420f-a938-58b5276b3cd9">
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:     <system>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       <entry name="serial">11d1c78c-76d0-4b3a-8a7d-9de7e37148d2</entry>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       <entry name="uuid">11d1c78c-76d0-4b3a-8a7d-9de7e37148d2</entry>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:     </system>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:   <os>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:   </os>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:   <features>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:   </features>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:   <devices>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/11d1c78c-76d0-4b3a-8a7d-9de7e37148d2/disk"/>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:     </disk>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/11d1c78c-76d0-4b3a-8a7d-9de7e37148d2/disk.config"/>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:     </disk>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:2c:3d:fa"/>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       <target dev="tap20df759b-14"/>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:     </interface>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/11d1c78c-76d0-4b3a-8a7d-9de7e37148d2/console.log" append="off"/>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:     </serial>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:     <video>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:     </video>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:     </rng>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:   </devices>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]: </domain>
May 28 01:00:19.487942 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:00:19.493845 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Preparing to wait for external event network-vif-plugged-20df759b-14e4-420f-a938-58b5276b3cd9 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:00:19.493845 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Acquiring lock "11d1c78c-76d0-4b3a-8a7d-9de7e37148d2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:19.493845 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "11d1c78c-76d0-4b3a-8a7d-9de7e37148d2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:19.493845 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "11d1c78c-76d0-4b3a-8a7d-9de7e37148d2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:19.493845 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:00:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1737599647',display_name='tempest-ServersNegativeTestJSON-server-1737599647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serversnegativetestjson-server-1737599647',id=22,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='caedf1b88e96476bacbd226b0510ed55',ramdisk_id='',reservation_id='r-xfh0a03h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-811169851',owner_user_name='tempest-ServersNegativeTestJSON-811169851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:00:15Z,user_data=None,user_id='bb8bed94f4864e6696094a671fc6ef4f',uuid=11d1c78c-76d0-4b3a-8a7d-9de7e37148d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20df759b-14e4-420f-a938-58b5276b3cd9", "address": "fa:16:3e:2c:3d:fa", "network": {"id": "92076d1f-65e0-44ef-afce-207d3e18dc80", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906118401-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "caedf1b88e96476bacbd226b0510ed55", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20df759b-14", "ovs_interfaceid": "20df759b-14e4-420f-a938-58b5276b3cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:00:19.493845 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Converting VIF {"id": "20df759b-14e4-420f-a938-58b5276b3cd9", "address": "fa:16:3e:2c:3d:fa", "network": {"id": "92076d1f-65e0-44ef-afce-207d3e18dc80", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906118401-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "caedf1b88e96476bacbd226b0510ed55", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20df759b-14", "ovs_interfaceid": "20df759b-14e4-420f-a938-58b5276b3cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:19.493845 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:3d:fa,bridge_name='br-int',has_traffic_filtering=True,id=20df759b-14e4-420f-a938-58b5276b3cd9,network=Network(92076d1f-65e0-44ef-afce-207d3e18dc80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20df759b-14') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:19.493845 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:3d:fa,bridge_name='br-int',has_traffic_filtering=True,id=20df759b-14e4-420f-a938-58b5276b3cd9,network=Network(92076d1f-65e0-44ef-afce-207d3e18dc80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20df759b-14') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:00:19.493845 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:19.493845 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:19.493845 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:00:19.499138 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:19.499138 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cbd2671a-6a8b-5a3c-81e4-e0208f17b462', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:19.503971 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:19.503971 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:19.513168 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:19.513314 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20df759b-14, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:19.513688 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap20df759b-14, col_values=(('qos', UUID('4357b0a0-f863-4f2b-a358-1700aa0db72e')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:19.514388 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap20df759b-14, col_values=(('external_ids', {'iface-id': '20df759b-14e4-420f-a938-58b5276b3cd9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:3d:fa', 'vm-uuid': '11d1c78c-76d0-4b3a-8a7d-9de7e37148d2'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:19.516860 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:19.522216 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:00:19.529441 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:19.529955 np0000001577 nova-compute[98319]: INFO os_vif [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:3d:fa,bridge_name='br-int',has_traffic_filtering=True,id=20df759b-14e4-420f-a938-58b5276b3cd9,network=Network(92076d1f-65e0-44ef-afce-207d3e18dc80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20df759b-14')
May 28 01:00:19.556489 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:19.556489 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:19.556946 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:19.557455 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:19.557717 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:19.559190 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:19.559190 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:19.652211 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Found WWN 33000000018e747c1 for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:00:19.652211 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.053s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:00:19.652211 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] <== connect_volume: return (3055ms) {'type': 'block', 'scsi_wwn': '33000000018e747c1', 'path': '/dev/dm-1', 'multipath_id': '33000000018e747c1'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:00:19.652211 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000018e747c1', 'path': '/dev/dm-1', 'multipath_id': '33000000018e747c1'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:00:19.660317 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lazy-loading 'flavor' on Instance uuid 2d2183ad-dbdb-4525-b678-39b72c7ab85d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:00:19.786462 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Successfully created port: 9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:00:19.966992 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:19.971028 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:00:20.067797 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:20.071823 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Took 8.75 seconds to spawn the instance on the hypervisor.
May 28 01:00:20.072284 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:20.073122 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:20.079848 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:20.117320 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:20.165953 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Attempting to attach volume a390b885-c2b5-4116-b7ea-4ad467d6145f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:00:20.170414 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:00:20.170414 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:00:20.170414 np0000001577 nova-compute[98319]:   <alias name="ua-a390b885-c2b5-4116-b7ea-4ad467d6145f"/>
May 28 01:00:20.170414 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 28 01:00:20.170414 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:00:20.170414 np0000001577 nova-compute[98319]:   <serial>a390b885-c2b5-4116-b7ea-4ad467d6145f</serial>
May 28 01:00:20.170414 np0000001577 nova-compute[98319]: </disk>
May 28 01:00:20.170414 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:00:20.249655 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: ebae9109-a600-4788-9008-74a8c320b803] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:00:20.469002 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:20.474423 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:00:20.476505 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930020.4748704, 2dbd7449-2081-4377-a31d-e4d202679da1 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:00:20.476505 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] VM Started (Lifecycle Event)
May 28 01:00:20.479762 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:20.501118 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Successfully updated port: 9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:00:20.533942 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-fbbc2a41-1fe4-406a-9729-51be1129a51b req-30997b52-22c5-409d-a06c-93ba844122e1 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-plugged-7de931f4-ea15-4c26-9bd7-00b40cd57781 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:20.534132 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fbbc2a41-1fe4-406a-9729-51be1129a51b req-30997b52-22c5-409d-a06c-93ba844122e1 service nova] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:20.534296 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fbbc2a41-1fe4-406a-9729-51be1129a51b req-30997b52-22c5-409d-a06c-93ba844122e1 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:20.534403 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fbbc2a41-1fe4-406a-9729-51be1129a51b req-30997b52-22c5-409d-a06c-93ba844122e1 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:20.534787 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-fbbc2a41-1fe4-406a-9729-51be1129a51b req-30997b52-22c5-409d-a06c-93ba844122e1 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] No event matching network-vif-plugged-7de931f4-ea15-4c26-9bd7-00b40cd57781 in dict_keys([('network-vif-plugged', '8a85618a-56c3-4690-af32-885b836a2c19'), ('network-vif-plugged', '5624a417-cdef-4be1-8586-16ca7bfdc8b9'), ('network-vif-plugged', '3de085f7-074a-44c7-99ab-7093e0ddc084'), ('network-vif-plugged', '02325a90-5e85-4e9f-a65e-c1bd91c39e80'), ('network-vif-plugged', '59a7e22c-8c09-4a33-9b95-58ee955f6895'), ('network-vif-plugged', 'd1b61752-f189-4f02-b9eb-92326fb29830')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 01:00:20.534787 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-fbbc2a41-1fe4-406a-9729-51be1129a51b req-30997b52-22c5-409d-a06c-93ba844122e1 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received unexpected event network-vif-plugged-7de931f4-ea15-4c26-9bd7-00b40cd57781 for instance with vm_state building and task_state spawning.
May 28 01:00:20.534989 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-fbbc2a41-1fe4-406a-9729-51be1129a51b req-30997b52-22c5-409d-a06c-93ba844122e1 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-plugged-3de085f7-074a-44c7-99ab-7093e0ddc084 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:20.535074 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fbbc2a41-1fe4-406a-9729-51be1129a51b req-30997b52-22c5-409d-a06c-93ba844122e1 service nova] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:20.535218 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fbbc2a41-1fe4-406a-9729-51be1129a51b req-30997b52-22c5-409d-a06c-93ba844122e1 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:20.539320 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:00:20.540561 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fbbc2a41-1fe4-406a-9729-51be1129a51b req-30997b52-22c5-409d-a06c-93ba844122e1 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:20.540561 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-fbbc2a41-1fe4-406a-9729-51be1129a51b req-30997b52-22c5-409d-a06c-93ba844122e1 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Processing event network-vif-plugged-3de085f7-074a-44c7-99ab-7093e0ddc084 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:00:20.540714 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-fbbc2a41-1fe4-406a-9729-51be1129a51b req-30997b52-22c5-409d-a06c-93ba844122e1 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-plugged-3de085f7-074a-44c7-99ab-7093e0ddc084 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:20.540868 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fbbc2a41-1fe4-406a-9729-51be1129a51b req-30997b52-22c5-409d-a06c-93ba844122e1 service nova] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:20.541069 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:00:20.541192 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fbbc2a41-1fe4-406a-9729-51be1129a51b req-30997b52-22c5-409d-a06c-93ba844122e1 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:20.541510 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fbbc2a41-1fe4-406a-9729-51be1129a51b req-30997b52-22c5-409d-a06c-93ba844122e1 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:20.541636 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-fbbc2a41-1fe4-406a-9729-51be1129a51b req-30997b52-22c5-409d-a06c-93ba844122e1 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] No event matching network-vif-plugged-3de085f7-074a-44c7-99ab-7093e0ddc084 in dict_keys([('network-vif-plugged', '8a85618a-56c3-4690-af32-885b836a2c19'), ('network-vif-plugged', '5624a417-cdef-4be1-8586-16ca7bfdc8b9'), ('network-vif-plugged', '02325a90-5e85-4e9f-a65e-c1bd91c39e80'), ('network-vif-plugged', '59a7e22c-8c09-4a33-9b95-58ee955f6895'), ('network-vif-plugged', 'd1b61752-f189-4f02-b9eb-92326fb29830')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 01:00:20.541739 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-fbbc2a41-1fe4-406a-9729-51be1129a51b req-30997b52-22c5-409d-a06c-93ba844122e1 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received unexpected event network-vif-plugged-3de085f7-074a-44c7-99ab-7093e0ddc084 for instance with vm_state building and task_state spawning.
May 28 01:00:20.541847 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-fbbc2a41-1fe4-406a-9729-51be1129a51b req-30997b52-22c5-409d-a06c-93ba844122e1 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-plugged-02325a90-5e85-4e9f-a65e-c1bd91c39e80 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:20.541945 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fbbc2a41-1fe4-406a-9729-51be1129a51b req-30997b52-22c5-409d-a06c-93ba844122e1 service nova] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:20.542112 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fbbc2a41-1fe4-406a-9729-51be1129a51b req-30997b52-22c5-409d-a06c-93ba844122e1 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:20.542209 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fbbc2a41-1fe4-406a-9729-51be1129a51b req-30997b52-22c5-409d-a06c-93ba844122e1 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:20.542335 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-fbbc2a41-1fe4-406a-9729-51be1129a51b req-30997b52-22c5-409d-a06c-93ba844122e1 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Processing event network-vif-plugged-02325a90-5e85-4e9f-a65e-c1bd91c39e80 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:00:20.542424 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-fbbc2a41-1fe4-406a-9729-51be1129a51b req-30997b52-22c5-409d-a06c-93ba844122e1 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-plugged-02325a90-5e85-4e9f-a65e-c1bd91c39e80 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:20.542517 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fbbc2a41-1fe4-406a-9729-51be1129a51b req-30997b52-22c5-409d-a06c-93ba844122e1 service nova] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:20.542591 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fbbc2a41-1fe4-406a-9729-51be1129a51b req-30997b52-22c5-409d-a06c-93ba844122e1 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:20.542716 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fbbc2a41-1fe4-406a-9729-51be1129a51b req-30997b52-22c5-409d-a06c-93ba844122e1 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:20.543300 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Creating image(s)
May 28 01:00:20.543871 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:20.543871 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "/opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:20.544687 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "/opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:20.544834 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-fbbc2a41-1fe4-406a-9729-51be1129a51b req-30997b52-22c5-409d-a06c-93ba844122e1 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] No event matching network-vif-plugged-02325a90-5e85-4e9f-a65e-c1bd91c39e80 in dict_keys([('network-vif-plugged', '8a85618a-56c3-4690-af32-885b836a2c19'), ('network-vif-plugged', '5624a417-cdef-4be1-8586-16ca7bfdc8b9'), ('network-vif-plugged', '59a7e22c-8c09-4a33-9b95-58ee955f6895'), ('network-vif-plugged', 'd1b61752-f189-4f02-b9eb-92326fb29830')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 01:00:20.544962 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-fbbc2a41-1fe4-406a-9729-51be1129a51b req-30997b52-22c5-409d-a06c-93ba844122e1 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received unexpected event network-vif-plugged-02325a90-5e85-4e9f-a65e-c1bd91c39e80 for instance with vm_state building and task_state spawning.
May 28 01:00:20.545677 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:00:20.549918 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:00:20.554679 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:20.615975 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Took 14.58 seconds to build instance.
May 28 01:00:20.683869 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.129s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:20.684904 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:20.686486 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:20.686486 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:00:20.691359 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:00:20.692067 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:20.756582 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: ebae9109-a600-4788-9008-74a8c320b803] Took 2.23 seconds to deallocate network for instance.
May 28 01:00:20.806258 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.114s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:20.810034 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:20.879793 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/disk 1073741824" returned: 0 in 0.073s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:20.884221 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:20.884975 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:20.984777 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:20.992920 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930020.992, 2dbd7449-2081-4377-a31d-e4d202679da1 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:00:20.992920 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] VM Paused (Lifecycle Event)
May 28 01:00:21.006093 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "refresh_cache-bb62eb94-ea3e-47ec-bae7-43acb74061ef" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:00:21.006301 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquired lock "refresh_cache-bb62eb94-ea3e-47ec-bae7-43acb74061ef" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:00:21.006370 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:00:21.010529 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.126s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:21.011389 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:00:21.011389 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:21.034669 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:21.061135 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:00:21.061296 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:00:21.061451 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] No VIF found with MAC fa:16:3e:2c:3d:fa, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:00:21.062208 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Using config drive
May 28 01:00:21.114601 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:21.114990 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Cannot resize image /opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:00:21.115462 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:00:21.115643 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Ensure instance console log exists: /opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:00:21.115940 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:21.116187 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:21.116484 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:21.119318 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.088s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:21.148675 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Received event network-vif-plugged-3ed3d348-6b93-4492-9c18-7b0eecc6454a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:21.148675 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] Acquiring lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:21.153022 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:21.153285 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:21.153468 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] No waiting events found dispatching network-vif-plugged-3ed3d348-6b93-4492-9c18-7b0eecc6454a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:00:21.153666 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Received unexpected event network-vif-plugged-3ed3d348-6b93-4492-9c18-7b0eecc6454a for instance with vm_state active and task_state None.
May 28 01:00:21.153832 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] [instance: ebae9109-a600-4788-9008-74a8c320b803] Received event network-vif-unplugged-d13e4109-188d-4b19-916a-486f62a27eea {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:21.154036 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] Acquiring lock "ebae9109-a600-4788-9008-74a8c320b803-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:21.154221 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] Lock "ebae9109-a600-4788-9008-74a8c320b803-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:21.154365 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] Lock "ebae9109-a600-4788-9008-74a8c320b803-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:21.154507 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] [instance: ebae9109-a600-4788-9008-74a8c320b803] No waiting events found dispatching network-vif-unplugged-d13e4109-188d-4b19-916a-486f62a27eea {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:00:21.154748 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] [instance: ebae9109-a600-4788-9008-74a8c320b803] Received unexpected event network-vif-unplugged-d13e4109-188d-4b19-916a-486f62a27eea for instance with vm_state deleted and task_state None.
May 28 01:00:21.154950 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] [instance: ebae9109-a600-4788-9008-74a8c320b803] Received event network-vif-deleted-d13e4109-188d-4b19-916a-486f62a27eea {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:21.155115 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-plugged-8a85618a-56c3-4690-af32-885b836a2c19 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:21.155318 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:21.155580 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:21.155626 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:21.156278 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Processing event network-vif-plugged-8a85618a-56c3-4690-af32-885b836a2c19 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:00:21.156700 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-plugged-8a85618a-56c3-4690-af32-885b836a2c19 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:21.156700 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:21.156958 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:21.156958 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:21.157887 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] No event matching network-vif-plugged-8a85618a-56c3-4690-af32-885b836a2c19 in dict_keys([('network-vif-plugged', '5624a417-cdef-4be1-8586-16ca7bfdc8b9'), ('network-vif-plugged', '59a7e22c-8c09-4a33-9b95-58ee955f6895'), ('network-vif-plugged', 'd1b61752-f189-4f02-b9eb-92326fb29830')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 01:00:21.157887 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received unexpected event network-vif-plugged-8a85618a-56c3-4690-af32-885b836a2c19 for instance with vm_state building and task_state spawning.
May 28 01:00:21.157887 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-plugged-d1b61752-f189-4f02-b9eb-92326fb29830 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:21.157887 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:21.157887 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:21.157887 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:21.158129 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Processing event network-vif-plugged-d1b61752-f189-4f02-b9eb-92326fb29830 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:00:21.158292 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-plugged-d1b61752-f189-4f02-b9eb-92326fb29830 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:21.158865 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:21.158958 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:21.159058 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:21.159218 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] No event matching network-vif-plugged-d1b61752-f189-4f02-b9eb-92326fb29830 in dict_keys([('network-vif-plugged', '5624a417-cdef-4be1-8586-16ca7bfdc8b9'), ('network-vif-plugged', '59a7e22c-8c09-4a33-9b95-58ee955f6895')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 01:00:21.159351 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-2bc05629-1179-4c23-80ad-bc8797e31354 req-e40d6bd9-8cf3-44e3-a040-171ffacb2d7f service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received unexpected event network-vif-plugged-d1b61752-f189-4f02-b9eb-92326fb29830 for instance with vm_state building and task_state spawning.
May 28 01:00:21.277181 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-33372b60-b8bc-4d52-a410-6de714f40895 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:21.277421 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-33372b60-b8bc-4d52-a410-6de714f40895 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:21.496386 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:21.501399 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:00:21.541842 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "0ac8b011-d80b-4dad-a020-a7a59908608f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:21.542791 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "0ac8b011-d80b-4dad-a020-a7a59908608f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:21.576351 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:21.751022 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:00:21.872495 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Creating config drive at /opt/stack/data/nova/instances/11d1c78c-76d0-4b3a-8a7d-9de7e37148d2/disk.config
May 28 01:00:21.878039 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/11d1c78c-76d0-4b3a-8a7d-9de7e37148d2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmc3db_3x {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:21.913537 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:00:21.913685 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:00:21.913807 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:00:21.913922 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] No VIF found with MAC fa:16:3e:bd:1f:a1, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:00:21.925082 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/11d1c78c-76d0-4b3a-8a7d-9de7e37148d2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmc3db_3x" returned: 0 in 0.047s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:22.004826 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:00:22.018537 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:22.046798 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:00:22.164418 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-33372b60-b8bc-4d52-a410-6de714f40895 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:00:22.164570 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-33372b60-b8bc-4d52-a410-6de714f40895 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:00:22.253686 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Updating instance_info_cache with network_info: [{"id": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "address": "fa:16:3e:df:9f:b0", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab3e003-1c", "ovs_interfaceid": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:00:22.423137 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:22.459496 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:22.468002 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:22.578581 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:22.623733 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:22.635865 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:22.644619 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-05c54e8c-a514-4033-9b7e-8f8141c7a666 req-37290aba-0c1c-4cdf-9cdc-7a057d9ec641 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Received event network-changed-9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:22.645607 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-05c54e8c-a514-4033-9b7e-8f8141c7a666 req-37290aba-0c1c-4cdf-9cdc-7a057d9ec641 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Refreshing instance network info cache due to event network-changed-9ab3e003-1c3a-467a-ad12-abbd852f7eaa. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:00:22.646056 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-05c54e8c-a514-4033-9b7e-8f8141c7a666 req-37290aba-0c1c-4cdf-9cdc-7a057d9ec641 service nova] Acquiring lock "refresh_cache-bb62eb94-ea3e-47ec-bae7-43acb74061ef" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:00:22.669374 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-33372b60-b8bc-4d52-a410-6de714f40895 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:00:22.755685 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Releasing lock "refresh_cache-bb62eb94-ea3e-47ec-bae7-43acb74061ef" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:00:22.756117 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Instance network_info: |[{"id": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "address": "fa:16:3e:df:9f:b0", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab3e003-1c", "ovs_interfaceid": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:00:22.756656 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-05c54e8c-a514-4033-9b7e-8f8141c7a666 req-37290aba-0c1c-4cdf-9cdc-7a057d9ec641 service nova] Acquired lock "refresh_cache-bb62eb94-ea3e-47ec-bae7-43acb74061ef" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:00:22.756854 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-05c54e8c-a514-4033-9b7e-8f8141c7a666 req-37290aba-0c1c-4cdf-9cdc-7a057d9ec641 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Refreshing network info cache for port 9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:00:22.760527 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Start _get_guest_xml network_info=[{"id": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "address": "fa:16:3e:df:9f:b0", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab3e003-1c", "ovs_interfaceid": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:00:22.764952 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:00:22.771649 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-240361421', uuid='bb62eb94-ea3e-47ec-bae7-43acb74061ef'), owner=OwnerMeta(userid='e2684c1dc140407b91687ee5abadef9d', username='tempest-ServerRescueNegativeTestJSON-509890320-project-member', projectid='a3c5a1da6bb242e9a58cb82855897726', projectname='tempest-ServerRescueNegativeTestJSON-509890320'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "address": "fa:16:3e:df:9f:b0", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab3e003-1c", "ovs_interfaceid": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930022.7711713) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:00:22.774311 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:00:22.774495 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:00:22.776295 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:00:22.776295 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:00:22.777225 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:00:22.777530 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:00:22.777758 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:00:22.777837 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:00:22.777965 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:00:22.778062 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:00:22.778355 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:00:22.778355 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:00:22.778671 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:00:22.778671 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:00:22.778671 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:00:22.778759 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:00:22.805432 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:00:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-240361421',display_name='tempest-ServerRescueNegativeTestJSON-server-240361421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serverrescuenegativetestjson-server-240361421',id=23,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKn7tTGLKk5GWx/qXsTtMMPyTqpWzMQ3+xGcXKydQCCNbo47i9cV9uNt/ZMr4p7wotQSWkHq9iYZow9PLIPuvBzizYu/67KPau/RyQOJogkvkzBvtRSy37knH43xmdD1+w==',key_name='tempest-keypair-172442327',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3c5a1da6bb242e9a58cb82855897726',ramdisk_id='',reservation_id='r-dygf7jik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-509890320',owner_user_name='tempest-ServerRescueNegativeTestJSON-509890320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:00:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e2684c1dc140407b91687ee5abadef9d',uuid=bb62eb94-ea3e-47ec-bae7-43acb74061ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "address": "fa:16:3e:df:9f:b0", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab3e003-1c", "ovs_interfaceid": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:00:22.805432 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Converting VIF {"id": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "address": "fa:16:3e:df:9f:b0", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab3e003-1c", "ovs_interfaceid": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:22.805819 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:9f:b0,bridge_name='br-int',has_traffic_filtering=True,id=9ab3e003-1c3a-467a-ad12-abbd852f7eaa,network=Network(1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ab3e003-1c') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:22.806364 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'pci_devices' on Instance uuid bb62eb94-ea3e-47ec-bae7-43acb74061ef {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:00:23.088234 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:23.088747 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:23.176024 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-33372b60-b8bc-4d52-a410-6de714f40895 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.899s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:23.178484 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.541s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:23.184274 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:00:23.184373 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Claim successful on node np0000001577
May 28 01:00:23.241984 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-17ce7809-1025-4d26-bfaf-ad88a115fc01 req-2a82d60d-dcee-4d8c-b69d-5147de5fb948 service nova] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Received event network-changed-d540d8c6-c40d-45db-a88e-e9b062d033fb {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:23.246591 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-17ce7809-1025-4d26-bfaf-ad88a115fc01 req-2a82d60d-dcee-4d8c-b69d-5147de5fb948 service nova] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Refreshing instance network info cache due to event network-changed-d540d8c6-c40d-45db-a88e-e9b062d033fb. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:00:23.246591 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-17ce7809-1025-4d26-bfaf-ad88a115fc01 req-2a82d60d-dcee-4d8c-b69d-5147de5fb948 service nova] Acquiring lock "refresh_cache-d988b526-836d-48b8-a381-1f7679caf41d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:00:23.246591 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-17ce7809-1025-4d26-bfaf-ad88a115fc01 req-2a82d60d-dcee-4d8c-b69d-5147de5fb948 service nova] Acquired lock "refresh_cache-d988b526-836d-48b8-a381-1f7679caf41d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:00:23.246934 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-17ce7809-1025-4d26-bfaf-ad88a115fc01 req-2a82d60d-dcee-4d8c-b69d-5147de5fb948 service nova] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Refreshing network info cache for port d540d8c6-c40d-45db-a88e-e9b062d033fb {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:00:23.254962 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-33372b60-b8bc-4d52-a410-6de714f40895 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Deleted allocations for instance ebae9109-a600-4788-9008-74a8c320b803
May 28 01:00:23.262714 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-05c54e8c-a514-4033-9b7e-8f8141c7a666 req-37290aba-0c1c-4cdf-9cdc-7a057d9ec641 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:23.309969 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] End _get_guest_xml xml=<domain type="qemu">
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:   <uuid>bb62eb94-ea3e-47ec-bae7-43acb74061ef</uuid>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:   <name>instance-00000017</name>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-240361421</nova:name>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:00:22</nova:creationTime>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:         <nova:user uuid="e2684c1dc140407b91687ee5abadef9d">tempest-ServerRescueNegativeTestJSON-509890320-project-member</nova:user>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:         <nova:project uuid="a3c5a1da6bb242e9a58cb82855897726">tempest-ServerRescueNegativeTestJSON-509890320</nova:project>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:         <nova:port uuid="9ab3e003-1c3a-467a-ad12-abbd852f7eaa">
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:     <system>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       <entry name="serial">bb62eb94-ea3e-47ec-bae7-43acb74061ef</entry>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       <entry name="uuid">bb62eb94-ea3e-47ec-bae7-43acb74061ef</entry>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:     </system>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:   <os>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:   </os>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:   <features>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:   </features>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:   <devices>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/disk"/>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:     </disk>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/disk.config"/>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:     </disk>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:df:9f:b0"/>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       <target dev="tap9ab3e003-1c"/>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:     </interface>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/console.log" append="off"/>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:     </serial>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:     <video>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:     </video>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:     </rng>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:   </devices>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]: </domain>
May 28 01:00:23.309969 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:00:23.313170 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Preparing to wait for external event network-vif-plugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:00:23.313170 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:23.313170 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:23.313170 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:23.313170 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:00:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-240361421',display_name='tempest-ServerRescueNegativeTestJSON-server-240361421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serverrescuenegativetestjson-server-240361421',id=23,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKn7tTGLKk5GWx/qXsTtMMPyTqpWzMQ3+xGcXKydQCCNbo47i9cV9uNt/ZMr4p7wotQSWkHq9iYZow9PLIPuvBzizYu/67KPau/RyQOJogkvkzBvtRSy37knH43xmdD1+w==',key_name='tempest-keypair-172442327',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3c5a1da6bb242e9a58cb82855897726',ramdisk_id='',reservation_id='r-dygf7jik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-509890320',owner_user_name='tempest-ServerRescueNegativeTestJSON-509890320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:00:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e2684c1dc140407b91687ee5abadef9d',uuid=bb62eb94-ea3e-47ec-bae7-43acb74061ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "address": "fa:16:3e:df:9f:b0", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab3e003-1c", "ovs_interfaceid": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:00:23.313170 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Converting VIF {"id": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "address": "fa:16:3e:df:9f:b0", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab3e003-1c", "ovs_interfaceid": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:23.313516 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:9f:b0,bridge_name='br-int',has_traffic_filtering=True,id=9ab3e003-1c3a-467a-ad12-abbd852f7eaa,network=Network(1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ab3e003-1c') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:23.313516 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:9f:b0,bridge_name='br-int',has_traffic_filtering=True,id=9ab3e003-1c3a-467a-ad12-abbd852f7eaa,network=Network(1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ab3e003-1c') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:00:23.314593 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:23.314823 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:23.315088 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:00:23.317204 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:23.318320 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '88dc26f5-fef0-56d1-803a-558fcbe058bc', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:23.319401 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:23.319974 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:23.323889 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:23.331002 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:23.331251 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ab3e003-1c, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:23.331707 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9ab3e003-1c, col_values=(('qos', UUID('fc70cef9-faf4-4ee7-a2df-28979977b1e4')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:23.332153 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9ab3e003-1c, col_values=(('external_ids', {'iface-id': '9ab3e003-1c3a-467a-ad12-abbd852f7eaa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:9f:b0', 'vm-uuid': 'bb62eb94-ea3e-47ec-bae7-43acb74061ef'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:23.333139 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:23.334252 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:23.339976 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:23.341230 np0000001577 nova-compute[98319]: INFO os_vif [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:9f:b0,bridge_name='br-int',has_traffic_filtering=True,id=9ab3e003-1c3a-467a-ad12-abbd852f7eaa,network=Network(1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ab3e003-1c')
May 28 01:00:23.385699 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "04880ef4-5eee-4221-ad42-29788eb26358" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:23.385886 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "04880ef4-5eee-4221-ad42-29788eb26358" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:23.397648 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930023.397244, 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:00:23.397925 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] VM Started (Lifecycle Event)
May 28 01:00:23.476885 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-72aec222-208c-4e1f-9be9-f59ec1c7d48f tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.641s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:23.592725 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:00:23.628145 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-05c54e8c-a514-4033-9b7e-8f8141c7a666 req-37290aba-0c1c-4cdf-9cdc-7a057d9ec641 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:23.752492 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-17ce7809-1025-4d26-bfaf-ad88a115fc01 req-2a82d60d-dcee-4d8c-b69d-5147de5fb948 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:23.794967 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-05c54e8c-a514-4033-9b7e-8f8141c7a666 req-37290aba-0c1c-4cdf-9cdc-7a057d9ec641 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Updated VIF entry in instance network info cache for port 9ab3e003-1c3a-467a-ad12-abbd852f7eaa. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:00:23.795286 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-05c54e8c-a514-4033-9b7e-8f8141c7a666 req-37290aba-0c1c-4cdf-9cdc-7a057d9ec641 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Updating instance_info_cache with network_info: [{"id": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "address": "fa:16:3e:df:9f:b0", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab3e003-1c", "ovs_interfaceid": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:00:23.888902 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:00:23.900612 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:23.907286 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930023.9069993, 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:00:23.907447 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] VM Paused (Lifecycle Event)
May 28 01:00:23.932299 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00028968300011911197 future=<Future at 0x7c984c57b6e0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:00:23.932299 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:00:23.932299 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=8.469924821999939 future=<Future at 0x7c987042f260 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:00:23.932299 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=8.46984601600002 future=<Future at 0x7c987042f260 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:00:24.068683 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-17ce7809-1025-4d26-bfaf-ad88a115fc01 req-2a82d60d-dcee-4d8c-b69d-5147de5fb948 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:24.160212 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:24.253073 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-17ce7809-1025-4d26-bfaf-ad88a115fc01 req-2a82d60d-dcee-4d8c-b69d-5147de5fb948 service nova] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Updated VIF entry in instance network info cache for port d540d8c6-c40d-45db-a88e-e9b062d033fb. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:00:24.253378 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-17ce7809-1025-4d26-bfaf-ad88a115fc01 req-2a82d60d-dcee-4d8c-b69d-5147de5fb948 service nova] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Updating instance_info_cache with network_info: [{"id": "d540d8c6-c40d-45db-a88e-e9b062d033fb", "address": "fa:16:3e:ca:a8:31", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd540d8c6-c4", "ovs_interfaceid": "d540d8c6-c40d-45db-a88e-e9b062d033fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:00:24.266292 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-33372b60-b8bc-4d52-a410-6de714f40895 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "ebae9109-a600-4788-9008-74a8c320b803" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.937s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:24.299179 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-05c54e8c-a514-4033-9b7e-8f8141c7a666 req-37290aba-0c1c-4cdf-9cdc-7a057d9ec641 service nova] Releasing lock "refresh_cache-bb62eb94-ea3e-47ec-bae7-43acb74061ef" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:00:24.412969 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:24.414794 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:00:24.447189 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:24.703149 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-455f8ff5-4110-4120-87d9-43565f2fc6f5 req-12ea0f8d-bc86-4dec-8ff4-376b7caa5f40 service nova] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Received event network-vif-plugged-20df759b-14e4-420f-a938-58b5276b3cd9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:24.703710 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-455f8ff5-4110-4120-87d9-43565f2fc6f5 req-12ea0f8d-bc86-4dec-8ff4-376b7caa5f40 service nova] Acquiring lock "11d1c78c-76d0-4b3a-8a7d-9de7e37148d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:24.703710 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-455f8ff5-4110-4120-87d9-43565f2fc6f5 req-12ea0f8d-bc86-4dec-8ff4-376b7caa5f40 service nova] Lock "11d1c78c-76d0-4b3a-8a7d-9de7e37148d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:24.703710 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-455f8ff5-4110-4120-87d9-43565f2fc6f5 req-12ea0f8d-bc86-4dec-8ff4-376b7caa5f40 service nova] Lock "11d1c78c-76d0-4b3a-8a7d-9de7e37148d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:24.703710 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-455f8ff5-4110-4120-87d9-43565f2fc6f5 req-12ea0f8d-bc86-4dec-8ff4-376b7caa5f40 service nova] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Processing event network-vif-plugged-20df759b-14e4-420f-a938-58b5276b3cd9 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:00:24.703936 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-455f8ff5-4110-4120-87d9-43565f2fc6f5 req-12ea0f8d-bc86-4dec-8ff4-376b7caa5f40 service nova] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Received event network-vif-plugged-20df759b-14e4-420f-a938-58b5276b3cd9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:24.703936 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-455f8ff5-4110-4120-87d9-43565f2fc6f5 req-12ea0f8d-bc86-4dec-8ff4-376b7caa5f40 service nova] Acquiring lock "11d1c78c-76d0-4b3a-8a7d-9de7e37148d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:24.704094 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-455f8ff5-4110-4120-87d9-43565f2fc6f5 req-12ea0f8d-bc86-4dec-8ff4-376b7caa5f40 service nova] Lock "11d1c78c-76d0-4b3a-8a7d-9de7e37148d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:24.704184 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-455f8ff5-4110-4120-87d9-43565f2fc6f5 req-12ea0f8d-bc86-4dec-8ff4-376b7caa5f40 service nova] Lock "11d1c78c-76d0-4b3a-8a7d-9de7e37148d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:24.704281 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-455f8ff5-4110-4120-87d9-43565f2fc6f5 req-12ea0f8d-bc86-4dec-8ff4-376b7caa5f40 service nova] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] No waiting events found dispatching network-vif-plugged-20df759b-14e4-420f-a938-58b5276b3cd9 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:00:24.704985 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:00:24.705254 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-455f8ff5-4110-4120-87d9-43565f2fc6f5 req-12ea0f8d-bc86-4dec-8ff4-376b7caa5f40 service nova] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Received unexpected event network-vif-plugged-20df759b-14e4-420f-a938-58b5276b3cd9 for instance with vm_state building and task_state spawning.
May 28 01:00:24.710633 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:00:24.715216 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Instance spawned successfully.
May 28 01:00:24.715734 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:00:24.756693 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-17ce7809-1025-4d26-bfaf-ad88a115fc01 req-2a82d60d-dcee-4d8c-b69d-5147de5fb948 service nova] Releasing lock "refresh_cache-d988b526-836d-48b8-a381-1f7679caf41d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:00:24.763872 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-17ce7809-1025-4d26-bfaf-ad88a115fc01 req-2a82d60d-dcee-4d8c-b69d-5147de5fb948 service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Received event network-changed-3ed3d348-6b93-4492-9c18-7b0eecc6454a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:24.764025 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-17ce7809-1025-4d26-bfaf-ad88a115fc01 req-2a82d60d-dcee-4d8c-b69d-5147de5fb948 service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Refreshing instance network info cache due to event network-changed-3ed3d348-6b93-4492-9c18-7b0eecc6454a. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:00:24.765573 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-17ce7809-1025-4d26-bfaf-ad88a115fc01 req-2a82d60d-dcee-4d8c-b69d-5147de5fb948 service nova] Acquiring lock "refresh_cache-d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:00:24.765754 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-17ce7809-1025-4d26-bfaf-ad88a115fc01 req-2a82d60d-dcee-4d8c-b69d-5147de5fb948 service nova] Acquired lock "refresh_cache-d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:00:24.765916 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-17ce7809-1025-4d26-bfaf-ad88a115fc01 req-2a82d60d-dcee-4d8c-b69d-5147de5fb948 service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Refreshing network info cache for port 3ed3d348-6b93-4492-9c18-7b0eecc6454a {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:00:24.843008 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-dbe30d1b-fc78-48f2-8410-520e9145c720 req-50eeeb49-f0ba-4da6-b450-ea30e78f0136 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-plugged-5624a417-cdef-4be1-8586-16ca7bfdc8b9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:24.843008 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dbe30d1b-fc78-48f2-8410-520e9145c720 req-50eeeb49-f0ba-4da6-b450-ea30e78f0136 service nova] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:24.843123 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dbe30d1b-fc78-48f2-8410-520e9145c720 req-50eeeb49-f0ba-4da6-b450-ea30e78f0136 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:24.843169 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dbe30d1b-fc78-48f2-8410-520e9145c720 req-50eeeb49-f0ba-4da6-b450-ea30e78f0136 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:24.843379 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-dbe30d1b-fc78-48f2-8410-520e9145c720 req-50eeeb49-f0ba-4da6-b450-ea30e78f0136 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Processing event network-vif-plugged-5624a417-cdef-4be1-8586-16ca7bfdc8b9 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:00:24.873430 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:00:24.873678 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:00:24.873784 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] No VIF found with MAC fa:16:3e:df:9f:b0, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:00:24.876803 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Using config drive
May 28 01:00:24.920377 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:00:24.920607 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930024.9204502, 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:00:24.920707 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] VM Resumed (Lifecycle Event)
May 28 01:00:24.980896 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:00:24.981068 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:00:25.223859 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:25.224336 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:25.224402 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:25.224683 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:25.224982 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:25.225295 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:25.271019 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-17ce7809-1025-4d26-bfaf-ad88a115fc01 req-2a82d60d-dcee-4d8c-b69d-5147de5fb948 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:25.283787 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Stashing vm_state: active {{(pid=98319) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 28 01:00:25.389834 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:25.427611 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:25.432089 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:00:25.483938 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:00:25.534217 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Creating config drive at /opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/disk.config
May 28 01:00:25.538307 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1lsum06u {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:25.588078 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1lsum06u" returned: 0 in 0.049s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:25.679348 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-17ce7809-1025-4d26-bfaf-ad88a115fc01 req-2a82d60d-dcee-4d8c-b69d-5147de5fb948 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:25.732240 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Took 9.31 seconds to spawn the instance on the hypervisor.
May 28 01:00:25.732644 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:25.814181 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-17ce7809-1025-4d26-bfaf-ad88a115fc01 req-2a82d60d-dcee-4d8c-b69d-5147de5fb948 service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Updated VIF entry in instance network info cache for port 3ed3d348-6b93-4492-9c18-7b0eecc6454a. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:00:25.814598 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-17ce7809-1025-4d26-bfaf-ad88a115fc01 req-2a82d60d-dcee-4d8c-b69d-5147de5fb948 service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Updating instance_info_cache with network_info: [{"id": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "address": "fa:16:3e:28:56:65", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3d348-6b", "ovs_interfaceid": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:00:25.837277 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:25.934449 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:00:25.990830 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.815s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:25.991252 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:00:25.993223 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.832s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:25.996698 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:00:25.996867 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Claim successful on node np0000001577
May 28 01:00:26.024935 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:26.041209 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:26.072462 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:26.081620 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:26.155015 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:26.234743 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:26.246499 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Took 15.14 seconds to build instance.
May 28 01:00:26.319783 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-17ce7809-1025-4d26-bfaf-ad88a115fc01 req-2a82d60d-dcee-4d8c-b69d-5147de5fb948 service nova] Releasing lock "refresh_cache-d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:00:26.497518 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:00:26.497713 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:00:26.497938 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:26.498151 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:26.581749 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c803ddeaf4f4b3db07587419087b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050f928f1ce449d6a447cd343dc4ff80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:00:26.748139 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74deadf-cb10-4aa7-bd8a-d58ab697b99e tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "11d1c78c-76d0-4b3a-8a7d-9de7e37148d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.656s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:26.772987 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5a6d4ebc-e550-4028-9d31-7189cc68eb67 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Acquiring lock "11d1c78c-76d0-4b3a-8a7d-9de7e37148d2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:26.773174 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5a6d4ebc-e550-4028-9d31-7189cc68eb67 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "11d1c78c-76d0-4b3a-8a7d-9de7e37148d2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:26.773338 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5a6d4ebc-e550-4028-9d31-7189cc68eb67 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Acquiring lock "11d1c78c-76d0-4b3a-8a7d-9de7e37148d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:26.773567 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5a6d4ebc-e550-4028-9d31-7189cc68eb67 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "11d1c78c-76d0-4b3a-8a7d-9de7e37148d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:26.773567 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5a6d4ebc-e550-4028-9d31-7189cc68eb67 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "11d1c78c-76d0-4b3a-8a7d-9de7e37148d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:26.781778 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-5a6d4ebc-e550-4028-9d31-7189cc68eb67 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Terminating instance
May 28 01:00:26.912615 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-plugged-5624a417-cdef-4be1-8586-16ca7bfdc8b9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:26.912615 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:26.912615 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:26.912615 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:26.912615 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] No event matching network-vif-plugged-5624a417-cdef-4be1-8586-16ca7bfdc8b9 in dict_keys([('network-vif-plugged', '59a7e22c-8c09-4a33-9b95-58ee955f6895')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 01:00:26.912615 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received unexpected event network-vif-plugged-5624a417-cdef-4be1-8586-16ca7bfdc8b9 for instance with vm_state building and task_state spawning.
May 28 01:00:26.912615 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-plugged-59a7e22c-8c09-4a33-9b95-58ee955f6895 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:26.912615 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:26.912615 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:26.912615 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:26.912615 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Processing event network-vif-plugged-59a7e22c-8c09-4a33-9b95-58ee955f6895 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:00:26.912615 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-plugged-59a7e22c-8c09-4a33-9b95-58ee955f6895 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:26.913536 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:26.916197 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:26.916644 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:26.917249 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Instance event wait completed in 7 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:00:26.917703 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] No waiting events found dispatching network-vif-plugged-59a7e22c-8c09-4a33-9b95-58ee955f6895 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:00:26.917703 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received unexpected event network-vif-plugged-59a7e22c-8c09-4a33-9b95-58ee955f6895 for instance with vm_state building and task_state spawning.
May 28 01:00:26.917703 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Received event network-vif-unplugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:26.918092 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] Acquiring lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:26.918297 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:26.918460 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:26.919019 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] No event matching network-vif-unplugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa in dict_keys([('network-vif-plugged', '9ab3e003-1c3a-467a-ad12-abbd852f7eaa')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 01:00:26.920605 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Received unexpected event network-vif-unplugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa for instance with vm_state building and task_state spawning.
May 28 01:00:26.920605 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Received event network-vif-plugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:26.920605 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] Acquiring lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:26.920605 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:26.920605 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:26.920605 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Processing event network-vif-plugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:00:26.920605 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Received event network-vif-plugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:26.920605 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] Acquiring lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:26.920605 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:26.920605 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:26.920605 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] No waiting events found dispatching network-vif-plugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:00:26.920605 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-e4e53c5e-d427-45d1-95e6-8e4594d42c45 req-23c13c03-42bd-4e15-96ad-4db20aa03ec0 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Received unexpected event network-vif-plugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa for instance with vm_state building and task_state spawning.
May 28 01:00:26.923266 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930026.9228168, 2dbd7449-2081-4377-a31d-e4d202679da1 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:00:26.923538 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] VM Resumed (Lifecycle Event)
May 28 01:00:26.925929 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:00:26.928808 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Instance spawned successfully.
May 28 01:00:26.929227 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:00:26.996216 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:00:27.000754 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:00:27.013824 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:00:27.017655 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Instance spawned successfully.
May 28 01:00:27.017655 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:00:27.104590 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Successfully created port: cad47b5d-4350-4300-b32b-23b298c89aa6 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:00:27.287089 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-5a6d4ebc-e550-4028-9d31-7189cc68eb67 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:00:27.315980 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:27.321510 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:27.346194 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:27.426625 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:27.430846 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:00:27.443054 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:27.443054 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:27.443054 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:27.443054 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:27.443054 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:27.443054 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:27.480173 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9f0dae2d-8487-449a-a016-7c1c71586c67 req-aa2e04f3-5200-423f-a92a-937e02ea1d9f service nova] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Received event network-vif-unplugged-20df759b-14e4-420f-a938-58b5276b3cd9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:27.480416 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9f0dae2d-8487-449a-a016-7c1c71586c67 req-aa2e04f3-5200-423f-a92a-937e02ea1d9f service nova] Acquiring lock "11d1c78c-76d0-4b3a-8a7d-9de7e37148d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:27.480585 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9f0dae2d-8487-449a-a016-7c1c71586c67 req-aa2e04f3-5200-423f-a92a-937e02ea1d9f service nova] Lock "11d1c78c-76d0-4b3a-8a7d-9de7e37148d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:27.480743 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9f0dae2d-8487-449a-a016-7c1c71586c67 req-aa2e04f3-5200-423f-a92a-937e02ea1d9f service nova] Lock "11d1c78c-76d0-4b3a-8a7d-9de7e37148d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:27.480892 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9f0dae2d-8487-449a-a016-7c1c71586c67 req-aa2e04f3-5200-423f-a92a-937e02ea1d9f service nova] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] No waiting events found dispatching network-vif-unplugged-20df759b-14e4-420f-a938-58b5276b3cd9 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:00:27.481057 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9f0dae2d-8487-449a-a016-7c1c71586c67 req-aa2e04f3-5200-423f-a92a-937e02ea1d9f service nova] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Received event network-vif-unplugged-20df759b-14e4-420f-a938-58b5276b3cd9 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:00:27.508635 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:27.515219 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:27.516827 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:00:27.536626 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:27.536626 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:27.536626 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:27.536626 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:27.536626 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:27.537108 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:27.611879 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:27.633793 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Instance destroyed successfully.
May 28 01:00:27.634252 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-5a6d4ebc-e550-4028-9d31-7189cc68eb67 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lazy-loading 'resources' on Instance uuid 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:00:27.741847 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Successfully updated port: cad47b5d-4350-4300-b32b-23b298c89aa6 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:00:27.938269 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:00:27.938614 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930027.9383454, bb62eb94-ea3e-47ec-bae7-43acb74061ef => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:00:27.938614 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] VM Started (Lifecycle Event)
May 28 01:00:27.948677 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:00:27.948677 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:00:27.951391 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Took 33.93 seconds to spawn the instance on the hypervisor.
May 28 01:00:27.951517 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:28.024964 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Booting with volume 4690b2ca-c824-422a-9feb-f48b1f047a8a at /dev/vda
May 28 01:00:28.049136 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Took 7.51 seconds to spawn the instance on the hypervisor.
May 28 01:00:28.049306 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:28.073471 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:00:28.084103 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:00:28.102319 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:28.138101 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-5a6d4ebc-e550-4028-9d31-7189cc68eb67 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:00:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1737599647',display_name='tempest-ServersNegativeTestJSON-server-1737599647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serversnegativetestjson-server-1737599647',id=22,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:00:25Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='caedf1b88e96476bacbd226b0510ed55',ramdisk_id='',reservation_id='r-xfh0a03h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-811169851',owner_user_name='tempest-ServersNegativeTestJSON-811169851-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:00:26Z,user_data=None,user_id='bb8bed94f4864e6696094a671fc6ef4f',uuid=11d1c78c-76d0-4b3a-8a7d-9de7e37148d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20df759b-14e4-420f-a938-58b5276b3cd9", "address": "fa:16:3e:2c:3d:fa", "network": {"id": "92076d1f-65e0-44ef-afce-207d3e18dc80", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906118401-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "caedf1b88e96476bacbd226b0510ed55", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20df759b-14", "ovs_interfaceid": "20df759b-14e4-420f-a938-58b5276b3cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:00:28.138307 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5a6d4ebc-e550-4028-9d31-7189cc68eb67 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Converting VIF {"id": "20df759b-14e4-420f-a938-58b5276b3cd9", "address": "fa:16:3e:2c:3d:fa", "network": {"id": "92076d1f-65e0-44ef-afce-207d3e18dc80", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906118401-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "caedf1b88e96476bacbd226b0510ed55", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20df759b-14", "ovs_interfaceid": "20df759b-14e4-420f-a938-58b5276b3cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:28.140334 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5a6d4ebc-e550-4028-9d31-7189cc68eb67 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:3d:fa,bridge_name='br-int',has_traffic_filtering=True,id=20df759b-14e4-420f-a938-58b5276b3cd9,network=Network(92076d1f-65e0-44ef-afce-207d3e18dc80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20df759b-14') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:28.141125 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:00:28.141399 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-5a6d4ebc-e550-4028-9d31-7189cc68eb67 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:3d:fa,bridge_name='br-int',has_traffic_filtering=True,id=20df759b-14e4-420f-a938-58b5276b3cd9,network=Network(92076d1f-65e0-44ef-afce-207d3e18dc80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20df759b-14') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:00:28.141888 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:00:28.144790 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:28.145270 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20df759b-14, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:28.148326 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:28.149819 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:28.152078 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:00:28.153866 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe75:1c46', 'fe80::8c3:73ff:fe68:9ea1', 'fe80::fc16:3eff:fef0:246e', 'fe80::fc16:3eff:feca:a831', 'fe80::e8d7:d3ff:fe11:4890', 'fe80::fc16:3eff:febd:1fa1', 'fe80::743e:7eff:fe2c:709c', 'fe80::fc16:3eff:fe12:3f51', 'fe80::64e0:a4ff:fe34:ffd6', 'fe80::fc16:3eff:fe72:df47', 'fe80::fc16:3eff:fed9:e218', 'fe80::8069:41ff:fec5:b665', 'fe80::fc16:3eff:fe3e:2329', 'fe80::fc16:3eff:fe28:5665', 'fe80::fc16:3eff:fe8f:58e7', 'fe80::8c50:49ff:fe54:f5d', 'fe80::fc16:3eff:fed8:380', 'fe80::fc16:3eff:fe3a:9b65', 'fe80::fc16:3eff:feab:a032', 'fe80::fc16:3eff:fee0:c149', 'fe80::fc16:3eff:fe1b:8be7', 'fe80::cc9e:aff:fedb:875f', 'fe80::fc16:3eff:fe40:63', 'fe80::8ba:53ff:fe4b:b4ff', 'fe80::fc16:3eff:fedf:9fb0'] 
May 28 01:00:28.153992 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:00:28.154085 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:00:28.154321 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] <== get_connector_properties: return (80ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:00:28.154492 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Updating existing volume attachment record: cbf80ec1-7f89-47f4-8bcf-43d0d990652d {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:00:28.158079 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:28.158168 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4357b0a0-f863-4f2b-a358-1700aa0db72e) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:28.159298 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:28.161571 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:28.161571 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:28.162329 np0000001577 nova-compute[98319]: INFO os_vif [None req-5a6d4ebc-e550-4028-9d31-7189cc68eb67 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:3d:fa,bridge_name='br-int',has_traffic_filtering=True,id=20df759b-14e4-420f-a938-58b5276b3cd9,network=Network(92076d1f-65e0-44ef-afce-207d3e18dc80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20df759b-14')
May 28 01:00:28.163191 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5a6d4ebc-e550-4028-9d31-7189cc68eb67 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Deleting instance files /opt/stack/data/nova/instances/11d1c78c-76d0-4b3a-8a7d-9de7e37148d2_del
May 28 01:00:28.163893 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5a6d4ebc-e550-4028-9d31-7189cc68eb67 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Deletion of /opt/stack/data/nova/instances/11d1c78c-76d0-4b3a-8a7d-9de7e37148d2_del complete
May 28 01:00:28.244135 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "refresh_cache-0ac8b011-d80b-4dad-a020-a7a59908608f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:00:28.244277 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquired lock "refresh_cache-0ac8b011-d80b-4dad-a020-a7a59908608f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:00:28.244380 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:00:28.441941 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:28.444734 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:00:28.450455 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:00:28.469114 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Took 46.07 seconds to build instance.
May 28 01:00:28.557912 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Took 13.76 seconds to build instance.
May 28 01:00:28.670074 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-5a6d4ebc-e550-4028-9d31-7189cc68eb67 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Took 1.38 seconds to destroy the instance on the hypervisor.
May 28 01:00:28.670915 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-5a6d4ebc-e550-4028-9d31-7189cc68eb67 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:00:28.671192 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:00:28.671298 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:00:28.671581 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:28.781213 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:28.808676 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:00:28.947773 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930028.9474218, bb62eb94-ea3e-47ec-bae7-43acb74061ef => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:00:28.948236 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] VM Paused (Lifecycle Event)
May 28 01:00:28.956861 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.965s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:28.957274 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:00:28.963072 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.516s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:28.970340 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:00:28.970340 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Claim successful on node np0000001577
May 28 01:00:28.972481 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b21847e-d7df-4e93-bfd8-66daf707b239 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "2dbd7449-2081-4377-a31d-e4d202679da1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 47.584s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:29.004852 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:29.010413 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-62fc73c8-8532-47f5-a34d-39bdac85deb1 req-32d0c2a5-b428-4f4a-aeb9-e8dc0f7a1020 service nova] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Received event network-changed-cad47b5d-4350-4300-b32b-23b298c89aa6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:29.010413 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-62fc73c8-8532-47f5-a34d-39bdac85deb1 req-32d0c2a5-b428-4f4a-aeb9-e8dc0f7a1020 service nova] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Refreshing instance network info cache due to event network-changed-cad47b5d-4350-4300-b32b-23b298c89aa6. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:00:29.010413 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-62fc73c8-8532-47f5-a34d-39bdac85deb1 req-32d0c2a5-b428-4f4a-aeb9-e8dc0f7a1020 service nova] Acquiring lock "refresh_cache-0ac8b011-d80b-4dad-a020-a7a59908608f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:00:29.060167 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-476d4a51-1bfa-4d7d-acd5-a25e90ab97b8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.274s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:29.194105 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Updating instance_info_cache with network_info: [{"id": "cad47b5d-4350-4300-b32b-23b298c89aa6", "address": "fa:16:3e:c1:85:1d", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcad47b5d-43", "ovs_interfaceid": "cad47b5d-4350-4300-b32b-23b298c89aa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:00:29.453843 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:29.455442 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930029.455236, bb62eb94-ea3e-47ec-bae7-43acb74061ef => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:00:29.455591 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] VM Resumed (Lifecycle Event)
May 28 01:00:29.469848 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:00:29.473680 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:00:29.473680 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:29.473680 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:29.553537 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '84e218b589ef4968828db0c740eaa72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ee6b376bb14dffb5664085cca58288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:00:29.558479 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9cc3e963-82e7-4723-9861-73449cfa2650 req-d4145b67-467b-437f-b026-630bcaa67b8b service nova] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Received event network-vif-unplugged-20df759b-14e4-420f-a938-58b5276b3cd9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:29.558953 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9cc3e963-82e7-4723-9861-73449cfa2650 req-d4145b67-467b-437f-b026-630bcaa67b8b service nova] Acquiring lock "11d1c78c-76d0-4b3a-8a7d-9de7e37148d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:29.558953 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9cc3e963-82e7-4723-9861-73449cfa2650 req-d4145b67-467b-437f-b026-630bcaa67b8b service nova] Lock "11d1c78c-76d0-4b3a-8a7d-9de7e37148d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:29.559171 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9cc3e963-82e7-4723-9861-73449cfa2650 req-d4145b67-467b-437f-b026-630bcaa67b8b service nova] Lock "11d1c78c-76d0-4b3a-8a7d-9de7e37148d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:29.559171 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9cc3e963-82e7-4723-9861-73449cfa2650 req-d4145b67-467b-437f-b026-630bcaa67b8b service nova] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] No waiting events found dispatching network-vif-unplugged-20df759b-14e4-420f-a938-58b5276b3cd9 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:00:29.560388 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9cc3e963-82e7-4723-9861-73449cfa2650 req-d4145b67-467b-437f-b026-630bcaa67b8b service nova] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Received event network-vif-unplugged-20df759b-14e4-420f-a938-58b5276b3cd9 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:00:29.560528 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9cc3e963-82e7-4723-9861-73449cfa2650 req-d4145b67-467b-437f-b026-630bcaa67b8b service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-changed-8a85618a-56c3-4690-af32-885b836a2c19 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:29.560665 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9cc3e963-82e7-4723-9861-73449cfa2650 req-d4145b67-467b-437f-b026-630bcaa67b8b service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Refreshing instance network info cache due to event network-changed-8a85618a-56c3-4690-af32-885b836a2c19. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:00:29.560977 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9cc3e963-82e7-4723-9861-73449cfa2650 req-d4145b67-467b-437f-b026-630bcaa67b8b service nova] Acquiring lock "refresh_cache-2dbd7449-2081-4377-a31d-e4d202679da1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:00:29.561134 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9cc3e963-82e7-4723-9861-73449cfa2650 req-d4145b67-467b-437f-b026-630bcaa67b8b service nova] Acquired lock "refresh_cache-2dbd7449-2081-4377-a31d-e4d202679da1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:00:29.561329 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-9cc3e963-82e7-4723-9861-73449cfa2650 req-d4145b67-467b-437f-b026-630bcaa67b8b service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Refreshing network info cache for port 8a85618a-56c3-4690-af32-885b836a2c19 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:00:29.756476 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Releasing lock "refresh_cache-0ac8b011-d80b-4dad-a020-a7a59908608f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:00:29.757217 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Instance network_info: |[{"id": "cad47b5d-4350-4300-b32b-23b298c89aa6", "address": "fa:16:3e:c1:85:1d", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcad47b5d-43", "ovs_interfaceid": "cad47b5d-4350-4300-b32b-23b298c89aa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:00:29.757217 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:00:29.773076 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-62fc73c8-8532-47f5-a34d-39bdac85deb1 req-32d0c2a5-b428-4f4a-aeb9-e8dc0f7a1020 service nova] Acquired lock "refresh_cache-0ac8b011-d80b-4dad-a020-a7a59908608f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:00:29.773230 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-62fc73c8-8532-47f5-a34d-39bdac85deb1 req-32d0c2a5-b428-4f4a-aeb9-e8dc0f7a1020 service nova] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Refreshing network info cache for port cad47b5d-4350-4300-b32b-23b298c89aa6 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:00:29.961327 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:29.963134 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:00:29.971239 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:00:30.286279 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-9cc3e963-82e7-4723-9861-73449cfa2650 req-d4145b67-467b-437f-b026-630bcaa67b8b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:30.287776 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Took 1.62 seconds to deallocate network for instance.
May 28 01:00:30.301061 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-62fc73c8-8532-47f5-a34d-39bdac85deb1 req-32d0c2a5-b428-4f4a-aeb9-e8dc0f7a1020 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:30.303293 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:00:30.306140 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:00:30.307598 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Creating image(s)
May 28 01:00:30.307928 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:00:30.308085 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Ensure instance console log exists: /opt/stack/data/nova/instances/0ac8b011-d80b-4dad-a020-a7a59908608f/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:00:30.309564 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:30.309751 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:30.309900 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:30.313841 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Start _get_guest_xml network_info=[{"id": "cad47b5d-4350-4300-b32b-23b298c89aa6", "address": "fa:16:3e:c1:85:1d", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcad47b5d-43", "ovs_interfaceid": "cad47b5d-4350-4300-b32b-23b298c89aa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a', 'iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4690b2ca-c824-422a-9feb-f48b1f047a8a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '0ac8b011-d80b-4dad-a020-a7a59908608f', 'attached_at': '', 'detached_at': '', 'volume_id': '4690b2ca-c824-422a-9feb-f48b1f047a8a', 'serial': '4690b2ca-c824-422a-9feb-f48b1f047a8a'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'cbf80ec1-7f89-47f4-8bcf-43d0d990652d', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:00:30.316354 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Successfully created port: b1c5ca58-a892-4f67-840e-810089b1fe6a {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:00:30.319685 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:00:30.320667 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-779472629', uuid='0ac8b011-d80b-4dad-a020-a7a59908608f'), owner=OwnerMeta(userid='0c803ddeaf4f4b3db07587419087b3b2', username='tempest-TestVolumeBootPattern-1449742411-project-member', projectid='050f928f1ce449d6a447cd343dc4ff80', projectname='tempest-TestVolumeBootPattern-1449742411'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cad47b5d-4350-4300-b32b-23b298c89aa6", "address": "fa:16:3e:c1:85:1d", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcad47b5d-43", "ovs_interfaceid": "cad47b5d-4350-4300-b32b-23b298c89aa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930030.3203552) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:00:30.323670 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:00:30.324379 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:00:30.327620 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:00:30.327866 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:00:30.328908 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:00:30.329242 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:00:30.329428 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:00:30.329557 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:00:30.329718 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:00:30.329834 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:00:30.329972 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:00:30.330151 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:00:30.334094 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:00:30.334369 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:00:30.334520 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:00:30.334691 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:00:30.357437 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:00:30.357957 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a', 'iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4690b2ca-c824-422a-9feb-f48b1f047a8a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:00:30.358051 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:00:30.467744 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999729057000195 future=<Future at 0x7c984c5305f0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:00:30.479749 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:00:30.762473 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-62fc73c8-8532-47f5-a34d-39bdac85deb1 req-32d0c2a5-b428-4f4a-aeb9-e8dc0f7a1020 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:30.798498 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5a6d4ebc-e550-4028-9d31-7189cc68eb67 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:30.809920 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.452s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:00:30.810532 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a', 'iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4690b2ca-c824-422a-9feb-f48b1f047a8a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:00:30.825434 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:00:30.825925 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:00:30.826339 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:00:30.826600 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:00:30.827112 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:00:30.827112 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:00:30.846099 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:00:30.846099 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:30.855317 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:00:30.855317 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:30.865601 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a] added
May 28 01:00:30.865601 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:00:30.865601 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:00:30.865601 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:00:30.865601 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:00:30.865601 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:00:30.865601 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:30.866374 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:00:30.866822 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0402(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:00:30.867115 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:00:30.869482 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a] added
May 28 01:00:30.869482 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:00:30.869482 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:00:30.869482 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:00:30.869482 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:00:30.869482 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:00:30.869482 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:30.870274 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:00:30.870333 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0433(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:00:30.870471 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:00:30.875118 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-9cc3e963-82e7-4723-9861-73449cfa2650 req-d4145b67-467b-437f-b026-630bcaa67b8b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:30.900924 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Successfully updated port: b1c5ca58-a892-4f67-840e-810089b1fe6a {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:00:30.969415 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:00:30.969825 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:00:30.979057 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-62fc73c8-8532-47f5-a34d-39bdac85deb1 req-32d0c2a5-b428-4f4a-aeb9-e8dc0f7a1020 service nova] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Updated VIF entry in instance network info cache for port cad47b5d-4350-4300-b32b-23b298c89aa6. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:00:30.981601 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-62fc73c8-8532-47f5-a34d-39bdac85deb1 req-32d0c2a5-b428-4f4a-aeb9-e8dc0f7a1020 service nova] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Updating instance_info_cache with network_info: [{"id": "cad47b5d-4350-4300-b32b-23b298c89aa6", "address": "fa:16:3e:c1:85:1d", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcad47b5d-43", "ovs_interfaceid": "cad47b5d-4350-4300-b32b-23b298c89aa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:00:30.983868 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:00:30.984393 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:00:31.026760 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:31.055105 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-9cc3e963-82e7-4723-9861-73449cfa2650 req-d4145b67-467b-437f-b026-630bcaa67b8b service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Updated VIF entry in instance network info cache for port 8a85618a-56c3-4690-af32-885b836a2c19. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:00:31.056878 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-9cc3e963-82e7-4723-9861-73449cfa2650 req-d4145b67-467b-437f-b026-630bcaa67b8b service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Updating instance_info_cache with network_info: [{"id": "8a85618a-56c3-4690-af32-885b836a2c19", "address": "fa:16:3e:8f:58:e7", "network": {"id": "4fae2e1c-05e1-4891-8645-b0200336c3ab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1018677949-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a85618a-56", "ovs_interfaceid": "8a85618a-56c3-4690-af32-885b836a2c19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7de931f4-ea15-4c26-9bd7-00b40cd57781", "address": "fa:16:3e:d8:03:80", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de931f4-ea", "ovs_interfaceid": "7de931f4-ea15-4c26-9bd7-00b40cd57781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5624a417-cdef-4be1-8586-16ca7bfdc8b9", "address": "fa:16:3e:3a:9b:65", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5624a417-cd", "ovs_interfaceid": "5624a417-cdef-4be1-8586-16ca7bfdc8b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3de085f7-074a-44c7-99ab-7093e0ddc084", "address": "fa:16:3e:ab:a0:32", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de085f7-07", "ovs_interfaceid": "3de085f7-074a-44c7-99ab-7093e0ddc084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02325a90-5e85-4e9f-a65e-c1bd91c39e80", "address": "fa:16:3e:e0:c1:49", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02325a90-5e", "ovs_interfaceid": "02325a90-5e85-4e9f-a65e-c1bd91c39e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "59a7e22c-8c09-4a33-9b95-58ee955f6895", "address": "fa:16:3e:1b:8b:e7", "network": {"id": "0a64f131-06a0-4c34-a1d8-06f8419256bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-288972260", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59a7e22c-8c", "ovs_interfaceid": "59a7e22c-8c09-4a33-9b95-58ee955f6895", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d1b61752-f189-4f02-b9eb-92326fb29830", "address": "fa:16:3e:40:00:63", "network": {"id": "0a64f131-06a0-4c34-a1d8-06f8419256bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-288972260", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b61752-f1", "ovs_interfaceid": "d1b61752-f189-4f02-b9eb-92326fb29830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:00:31.086056 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9c30bef2-9a8d-47d1-a9bf-4fed81463a32 req-f9daf560-7c35-426f-9e7c-0c146baf5990 service nova] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Received event network-vif-deleted-20df759b-14e4-420f-a938-58b5276b3cd9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:31.086369 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9c30bef2-9a8d-47d1-a9bf-4fed81463a32 req-f9daf560-7c35-426f-9e7c-0c146baf5990 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Received event network-changed-b1c5ca58-a892-4f67-840e-810089b1fe6a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:31.086759 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9c30bef2-9a8d-47d1-a9bf-4fed81463a32 req-f9daf560-7c35-426f-9e7c-0c146baf5990 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Refreshing instance network info cache due to event network-changed-b1c5ca58-a892-4f67-840e-810089b1fe6a. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:00:31.086759 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9c30bef2-9a8d-47d1-a9bf-4fed81463a32 req-f9daf560-7c35-426f-9e7c-0c146baf5990 service nova] Acquiring lock "refresh_cache-e2cc3304-bf2b-4196-b6c8-8ad56da19af4" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:00:31.086759 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9c30bef2-9a8d-47d1-a9bf-4fed81463a32 req-f9daf560-7c35-426f-9e7c-0c146baf5990 service nova] Acquired lock "refresh_cache-e2cc3304-bf2b-4196-b6c8-8ad56da19af4" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:00:31.086951 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-9c30bef2-9a8d-47d1-a9bf-4fed81463a32 req-f9daf560-7c35-426f-9e7c-0c146baf5990 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Refreshing network info cache for port b1c5ca58-a892-4f67-840e-810089b1fe6a {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:00:31.405285 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "refresh_cache-e2cc3304-bf2b-4196-b6c8-8ad56da19af4" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:00:31.471735 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:00:31.488527 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-62fc73c8-8532-47f5-a34d-39bdac85deb1 req-32d0c2a5-b428-4f4a-aeb9-e8dc0f7a1020 service nova] Releasing lock "refresh_cache-0ac8b011-d80b-4dad-a020-a7a59908608f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:00:31.496337 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:00:31.499098 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:00:31.500878 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Creating image(s)
May 28 01:00:31.502117 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:31.504073 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "/opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:31.505140 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "/opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:31.506490 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:00:31.511364 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:00:31.513095 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:31.559430 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9cc3e963-82e7-4723-9861-73449cfa2650 req-d4145b67-467b-437f-b026-630bcaa67b8b service nova] Releasing lock "refresh_cache-2dbd7449-2081-4377-a31d-e4d202679da1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:00:31.588978 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-9c30bef2-9a8d-47d1-a9bf-4fed81463a32 req-f9daf560-7c35-426f-9e7c-0c146baf5990 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:31.593360 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.080s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:31.593692 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:31.594482 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:31.594980 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:00:31.598327 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:00:31.598722 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:31.631918 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-3fe08473-5f86-450e-bad4-9c7b8412f054 req-9b51a07e-a3db-471e-958b-563e35bad818 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Received event network-changed-9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:31.631918 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-3fe08473-5f86-450e-bad4-9c7b8412f054 req-9b51a07e-a3db-471e-958b-563e35bad818 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Refreshing instance network info cache due to event network-changed-9ab3e003-1c3a-467a-ad12-abbd852f7eaa. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:00:31.631918 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3fe08473-5f86-450e-bad4-9c7b8412f054 req-9b51a07e-a3db-471e-958b-563e35bad818 service nova] Acquiring lock "refresh_cache-bb62eb94-ea3e-47ec-bae7-43acb74061ef" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:00:31.631918 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3fe08473-5f86-450e-bad4-9c7b8412f054 req-9b51a07e-a3db-471e-958b-563e35bad818 service nova] Acquired lock "refresh_cache-bb62eb94-ea3e-47ec-bae7-43acb74061ef" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:00:31.631918 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-3fe08473-5f86-450e-bad4-9c7b8412f054 req-9b51a07e-a3db-471e-958b-563e35bad818 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Refreshing network info cache for port 9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:00:31.698799 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-9c30bef2-9a8d-47d1-a9bf-4fed81463a32 req-f9daf560-7c35-426f-9e7c-0c146baf5990 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:00:31.702247 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.103s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:31.704388 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:31.765866 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk 1073741824" returned: 0 in 0.061s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:31.766357 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.172s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:31.766826 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:31.871199 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:00:31.872073 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:00:31.874444 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.108s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:31.875187 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:00:31.875187 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:00:31.902340 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:00:31.902340 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:00:31.906215 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:00:31.906215 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:31.919445 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:31.930442 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:31.943427 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-9c30bef2-9a8d-47d1-a9bf-4fed81463a32 req-f9daf560-7c35-426f-9e7c-0c146baf5990 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:00:31.945899 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:31.945899 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:31.945899 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:31.945899 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:31.945899 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:31.945899 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:31.945899 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:31.945899 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:31.945899 np0000001577 nova-compute[98319]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:31.945899 np0000001577 nova-compute[98319]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:31.945899 np0000001577 nova-compute[98319]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf41f2fd-819e-4e73-a33a-6e08a1d7dabe (non-flash)
May 28 01:00:31.945899 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:00:31.945899 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:31.945899 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:31.945899 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:31.945899 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:31.945899 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:31.945899 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:31.945899 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:31.945899 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:31.945899 np0000001577 nova-compute[98319]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:31.945899 np0000001577 nova-compute[98319]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:31.945899 np0000001577 nova-compute[98319]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf41f2fd-819e-4e73-a33a-6e08a1d7dabe (non-flash)
May 28 01:00:31.945899 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:00:31.952615 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:31.952615 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:31.952615 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:31.952615 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:31.952615 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:31.952615 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:31.952615 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:31.952615 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:31.952615 np0000001577 nova-compute[98319]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:31.952615 np0000001577 nova-compute[98319]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:31.952615 np0000001577 nova-compute[98319]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf41f2fd-819e-4e73-a33a-6e08a1d7dabe (non-flash)
May 28 01:00:31.952615 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:00:31.952615 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:31.952615 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:31.952615 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:31.952615 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:31.952615 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:31.952615 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:31.952615 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:31.952615 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:31.952615 np0000001577 nova-compute[98319]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:31.952615 np0000001577 nova-compute[98319]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:31.952615 np0000001577 nova-compute[98319]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf41f2fd-819e-4e73-a33a-6e08a1d7dabe (non-flash)
May 28 01:00:31.952615 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:00:31.979896 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.017s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:31.981823 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:00:31.987629 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 6.144s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:31.987897 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:00:31.988060 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 01:00:31.988245 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:00:31.994203 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a, portal: 192.168.50.100,3260]
May 28 01:00:31.994203 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a, portal: 192.168.50.100,3260] successful.
May 28 01:00:31.994203 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:31.994907 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:31.995523 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Cannot resize image /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:00:31.995950 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:00:31.996643 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Ensure instance console log exists: /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:00:31.997040 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:31.997820 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:31.997820 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:32.004030 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a, portal: 192.168.40.100,3260]
May 28 01:00:32.004030 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a, portal: 192.168.40.100,3260] successful.
May 28 01:00:32.004030 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:32.010873 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:32.019703 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:32.035698 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:32.035698 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:32.035698 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:32.035698 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:32.035698 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:32.035698 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:32.035698 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:32.035698 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:32.035698 np0000001577 nova-compute[98319]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:32.035698 np0000001577 nova-compute[98319]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:32.035698 np0000001577 nova-compute[98319]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf41f2fd-819e-4e73-a33a-6e08a1d7dabe (non-flash)
May 28 01:00:32.035698 np0000001577 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a (non-flash)
May 28 01:00:32.035698 np0000001577 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a (non-flash)
May 28 01:00:32.035698 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:00:32.035698 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:32.035698 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:32.035698 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:32.035698 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:32.035698 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:32.035698 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:32.035698 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:32.035698 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:32.035698 np0000001577 nova-compute[98319]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:32.035698 np0000001577 nova-compute[98319]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:32.035698 np0000001577 nova-compute[98319]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf41f2fd-819e-4e73-a33a-6e08a1d7dabe (non-flash)
May 28 01:00:32.035698 np0000001577 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a (non-flash)
May 28 01:00:32.035698 np0000001577 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a (non-flash)
May 28 01:00:32.035698 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:00:32.035698 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.209s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:00:32.036384 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:00:32.037616 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] HCTL ('16', '-', '-', 0) found on session 41 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:00:32.037762 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:00:32.048762 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:32.048762 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:32.048762 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:32.048762 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:32.048762 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:32.048762 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:32.048762 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:32.048762 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:32.048762 np0000001577 nova-compute[98319]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:32.048762 np0000001577 nova-compute[98319]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:32.048762 np0000001577 nova-compute[98319]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf41f2fd-819e-4e73-a33a-6e08a1d7dabe (non-flash)
May 28 01:00:32.048762 np0000001577 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a (non-flash)
May 28 01:00:32.048762 np0000001577 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a (non-flash)
May 28 01:00:32.048762 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:00:32.049122 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:32.049122 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:32.049122 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:32.049122 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:32.049122 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:32.049122 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:32.049122 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:32.049122 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:32.049122 np0000001577 nova-compute[98319]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:32.049122 np0000001577 nova-compute[98319]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:32.049122 np0000001577 nova-compute[98319]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf41f2fd-819e-4e73-a33a-6e08a1d7dabe (non-flash)
May 28 01:00:32.049122 np0000001577 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a (non-flash)
May 28 01:00:32.049122 np0000001577 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a (non-flash)
May 28 01:00:32.049122 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:00:32.049347 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.223s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:00:32.049444 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:00:32.052249 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] HCTL ('17', '-', '-', 0) found on session 42 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:00:32.052365 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:00:32.053676 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching for a device in session 41 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:00:32.058206 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4690b2ca-c824-422a-9feb-f48b1f047a8a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:00:32.068025 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching for a device in session 42 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:00:32.068025 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4690b2ca-c824-422a-9feb-f48b1f047a8a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:00:32.135738 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-3fe08473-5f86-450e-bad4-9c7b8412f054 req-9b51a07e-a3db-471e-958b-563e35bad818 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:32.402517 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0003501490000417107 future=<Future at 0x7c987042f260 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:00:32.403133 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Emitting event <LifecycleEvent: 1779930017.402032, ebae9109-a600-4788-9008-74a8c320b803 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:00:32.403318 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] VM Stopped (Lifecycle Event)
May 28 01:00:32.404979 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:00:32.405647 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=13.061998658999983 future=<Future at 0x7c984c5305f0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:00:32.405647 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=13.06187061200012 future=<Future at 0x7c984c5305f0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:00:32.446904 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9c30bef2-9a8d-47d1-a9bf-4fed81463a32 req-f9daf560-7c35-426f-9e7c-0c146baf5990 service nova] Releasing lock "refresh_cache-e2cc3304-bf2b-4196-b6c8-8ad56da19af4" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:00:32.447575 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquired lock "refresh_cache-e2cc3304-bf2b-4196-b6c8-8ad56da19af4" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:00:32.447804 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:00:32.500290 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:00:32.500290 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:00:32.500290 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:32.500290 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:32.503183 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:32.513787 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:00:32.514005 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Claim successful on node np0000001577
May 28 01:00:32.523586 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-3fe08473-5f86-450e-bad4-9c7b8412f054 req-9b51a07e-a3db-471e-958b-563e35bad818 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:32.581923 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8586a18edcf42cab0a60028135ae401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938c2829112843edb2054984e80ce7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:00:32.676276 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-3fe08473-5f86-450e-bad4-9c7b8412f054 req-9b51a07e-a3db-471e-958b-563e35bad818 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Updated VIF entry in instance network info cache for port 9ab3e003-1c3a-467a-ad12-abbd852f7eaa. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:00:32.676648 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-3fe08473-5f86-450e-bad4-9c7b8412f054 req-9b51a07e-a3db-471e-958b-563e35bad818 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Updating instance_info_cache with network_info: [{"id": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "address": "fa:16:3e:df:9f:b0", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab3e003-1c", "ovs_interfaceid": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:00:32.830035 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:00:32.910633 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: ebae9109-a600-4788-9008-74a8c320b803] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:33.004037 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:00:33.027101 np0000001577 nova-compute[98319]: INFO nova.compute.resource_tracker [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Updating resource usage from migration a82f5535-dd02-4a4b-b896-35ce6d6587fe
May 28 01:00:33.057115 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:00:33.151389 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Successfully created port: d80f49b7-bd41-46df-9743-8ad514696557 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:00:33.160574 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:33.178777 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3fe08473-5f86-450e-bad4-9c7b8412f054 req-9b51a07e-a3db-471e-958b-563e35bad818 service nova] Releasing lock "refresh_cache-bb62eb94-ea3e-47ec-bae7-43acb74061ef" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:00:33.335719 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:33.500642 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Updating instance_info_cache with network_info: [{"id": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "address": "fa:16:3e:9d:98:58", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c5ca58-a8", "ovs_interfaceid": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:00:33.513185 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:00:33.851213 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Found WWN 33000000076fa1048 for multipath device dm-6 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:00:33.854755 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.043s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:00:33.858094 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] <== connect_volume: return (3499ms) {'type': 'block', 'scsi_wwn': '33000000076fa1048', 'path': '/dev/disk/by-id/os-brick+dev+dm-6', 'multipath_id': '33000000076fa1048'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:00:33.863034 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Successfully updated port: d80f49b7-bd41-46df-9743-8ad514696557 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:00:33.868472 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000076fa1048', 'path': '/dev/disk/by-id/os-brick+dev+dm-6', 'multipath_id': '33000000076fa1048'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:00:33.913817 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8ba2d174-ea17-4392-8407-b4ef45c0d465 req-00ab3b93-fc23-4268-99f3-ac8d8c8364de service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Received event network-changed-d80f49b7-bd41-46df-9743-8ad514696557 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:33.913935 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8ba2d174-ea17-4392-8407-b4ef45c0d465 req-00ab3b93-fc23-4268-99f3-ac8d8c8364de service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Refreshing instance network info cache due to event network-changed-d80f49b7-bd41-46df-9743-8ad514696557. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:00:33.914120 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8ba2d174-ea17-4392-8407-b4ef45c0d465 req-00ab3b93-fc23-4268-99f3-ac8d8c8364de service nova] Acquiring lock "refresh_cache-04880ef4-5eee-4221-ad42-29788eb26358" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:00:33.914171 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8ba2d174-ea17-4392-8407-b4ef45c0d465 req-00ab3b93-fc23-4268-99f3-ac8d8c8364de service nova] Acquired lock "refresh_cache-04880ef4-5eee-4221-ad42-29788eb26358" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:00:33.914338 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-8ba2d174-ea17-4392-8407-b4ef45c0d465 req-00ab3b93-fc23-4268-99f3-ac8d8c8364de service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Refreshing network info cache for port d80f49b7-bd41-46df-9743-8ad514696557 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:00:33.933384 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a', 'iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4690b2ca-c824-422a-9feb-f48b1f047a8a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, 'status': 'reserved', 'instance': '0ac8b011-d80b-4dad-a020-a7a59908608f', 'attached_at': '', 'detached_at': '', 'volume_id': '4690b2ca-c824-422a-9feb-f48b1f047a8a', 'serial': '4690b2ca-c824-422a-9feb-f48b1f047a8a'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 01:00:33.933964 np0000001577 nova-compute[98319]: WARNING stevedore.named [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 01:00:33.934123 np0000001577 nova-compute[98319]: WARNING castellan.key_manager [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:00:33.936209 np0000001577 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:00:33.963275 np0000001577 nova-compute[98319]: WARNING os_brick.encryptors.luks [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 28 01:00:33.963435 np0000001577 nova-compute[98319]: WARNING stevedore.named [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 01:00:33.963659 np0000001577 nova-compute[98319]: WARNING castellan.key_manager [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:00:33.963887 np0000001577 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:00:33.964670 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x7c984c513020>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a', 'iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4690b2ca-c824-422a-9feb-f48b1f047a8a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, 'status': 'reserved', 'instance': '0ac8b011-d80b-4dad-a020-a7a59908608f', 'attached_at': '', 'detached_at': '', 'volume_id': '4690b2ca-c824-422a-9feb-f48b1f047a8a', 'serial': '4690b2ca-c824-422a-9feb-f48b1f047a8a'} {{(pid=98319) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 01:00:33.964842 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors.luks [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] formatting encrypted volume /dev/dm-6 {{(pid=98319) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 28 01:00:34.002995 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Releasing lock "refresh_cache-e2cc3304-bf2b-4196-b6c8-8ad56da19af4" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:00:34.006839 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Instance network_info: |[{"id": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "address": "fa:16:3e:9d:98:58", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c5ca58-a8", "ovs_interfaceid": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:00:34.009264 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Start _get_guest_xml network_info=[{"id": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "address": "fa:16:3e:9d:98:58", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c5ca58-a8", "ovs_interfaceid": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:00:34.021378 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:00:34.022786 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-tempest.common.compute-instance-778733213', uuid='e2cc3304-bf2b-4196-b6c8-8ad56da19af4'), owner=OwnerMeta(userid='84e218b589ef4968828db0c740eaa72b', username='tempest-ServerActionsTestOtherA-1279266727-project-member', projectid='73ee6b376bb14dffb5664085cca58288', projectname='tempest-ServerActionsTestOtherA-1279266727'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "address": "fa:16:3e:9d:98:58", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c5ca58-a8", "ovs_interfaceid": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930034.022411) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:00:34.024045 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:00:34.024270 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:00:34.025593 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:00:34.025781 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:00:34.026860 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:00:34.027238 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:00:34.027403 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:00:34.027524 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:00:34.027697 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:00:34.027805 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:00:34.027957 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:00:34.028140 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:00:34.028269 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:00:34.028405 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:00:34.028536 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:00:34.028726 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:00:34.047959 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-778733213',display_name='tempest-tempest.common.compute-instance-778733213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-tempest-common-compute-instance-778733213',id=25,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkiPLdYbCo1S3Q8zHTI1NipWScu+iP6NIHT7weBqNR/4DW9uVU8JGbzlGA44pLzm48mu9WdSdzEcSZJe6dOWPJFIyxn7tMsGB3fbMiFLIYEXAldqT3xnfulQjdD578NKQ==',key_name='tempest-keypair-1759049740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73ee6b376bb14dffb5664085cca58288',ramdisk_id='',reservation_id='r-0r9cnnkw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1279266727',owner_user_name='tempest-ServerActionsTestOtherA-1279266727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:00:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84e218b589ef4968828db0c740eaa72b',uuid=e2cc3304-bf2b-4196-b6c8-8ad56da19af4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "address": "fa:16:3e:9d:98:58", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c5ca58-a8", "ovs_interfaceid": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:00:34.047959 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Converting VIF {"id": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "address": "fa:16:3e:9d:98:58", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c5ca58-a8", "ovs_interfaceid": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:34.048688 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:98:58,bridge_name='br-int',has_traffic_filtering=True,id=b1c5ca58-a892-4f67-840e-810089b1fe6a,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c5ca58-a8') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:34.049769 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lazy-loading 'pci_devices' on Instance uuid e2cc3304-bf2b-4196-b6c8-8ad56da19af4 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:00:34.074525 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:00:34.074776 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:00:34.369861 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "refresh_cache-04880ef4-5eee-4221-ad42-29788eb26358" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:00:34.423503 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-8ba2d174-ea17-4392-8407-b4ef45c0d465 req-00ab3b93-fc23-4268-99f3-ac8d8c8364de service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:34.514145 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-8ba2d174-ea17-4392-8407-b4ef45c0d465 req-00ab3b93-fc23-4268-99f3-ac8d8c8364de service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:00:34.527619 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:00:34.527619 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:00:34.528886 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Creating image(s)
May 28 01:00:34.531096 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "/opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:34.532839 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "/opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:34.534339 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "/opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:34.535392 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:00:34.538083 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:00:34.538858 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:34.567221 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] End _get_guest_xml xml=<domain type="qemu">
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:   <uuid>e2cc3304-bf2b-4196-b6c8-8ad56da19af4</uuid>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:   <name>instance-00000019</name>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       <nova:name>tempest-tempest.common.compute-instance-778733213</nova:name>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:00:34</nova:creationTime>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:         <nova:user uuid="84e218b589ef4968828db0c740eaa72b">tempest-ServerActionsTestOtherA-1279266727-project-member</nova:user>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:         <nova:project uuid="73ee6b376bb14dffb5664085cca58288">tempest-ServerActionsTestOtherA-1279266727</nova:project>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:         <nova:port uuid="b1c5ca58-a892-4f67-840e-810089b1fe6a">
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:     <system>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       <entry name="serial">e2cc3304-bf2b-4196-b6c8-8ad56da19af4</entry>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       <entry name="uuid">e2cc3304-bf2b-4196-b6c8-8ad56da19af4</entry>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:     </system>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:   <os>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:   </os>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:   <features>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:   </features>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:   <devices>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk"/>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:     </disk>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk.config"/>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:     </disk>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:9d:98:58"/>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       <target dev="tapb1c5ca58-a8"/>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:     </interface>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/console.log" append="off"/>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:     </serial>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:     <video>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:     </video>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:     </rng>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:   </devices>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]: </domain>
May 28 01:00:34.567221 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:00:34.571110 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Preparing to wait for external event network-vif-plugged-b1c5ca58-a892-4f67-840e-810089b1fe6a {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:00:34.571110 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:34.571110 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:34.571110 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:34.572148 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-778733213',display_name='tempest-tempest.common.compute-instance-778733213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-tempest-common-compute-instance-778733213',id=25,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkiPLdYbCo1S3Q8zHTI1NipWScu+iP6NIHT7weBqNR/4DW9uVU8JGbzlGA44pLzm48mu9WdSdzEcSZJe6dOWPJFIyxn7tMsGB3fbMiFLIYEXAldqT3xnfulQjdD578NKQ==',key_name='tempest-keypair-1759049740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73ee6b376bb14dffb5664085cca58288',ramdisk_id='',reservation_id='r-0r9cnnkw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1279266727',owner_user_name='tempest-ServerActionsTestOtherA-1279266727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:00:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84e218b589ef4968828db0c740eaa72b',uuid=e2cc3304-bf2b-4196-b6c8-8ad56da19af4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "address": "fa:16:3e:9d:98:58", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c5ca58-a8", "ovs_interfaceid": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:00:34.572336 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Converting VIF {"id": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "address": "fa:16:3e:9d:98:58", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c5ca58-a8", "ovs_interfaceid": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:34.573922 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:98:58,bridge_name='br-int',has_traffic_filtering=True,id=b1c5ca58-a892-4f67-840e-810089b1fe6a,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c5ca58-a8') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:34.574327 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:98:58,bridge_name='br-int',has_traffic_filtering=True,id=b1c5ca58-a892-4f67-840e-810089b1fe6a,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c5ca58-a8') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:00:34.579608 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:34.580004 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:34.580322 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:00:34.582825 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:34.583176 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8478021a-7644-5894-9110-90f81d9c7d6d', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:34.586077 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:00:34.593352 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:34.594730 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:34.599348 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:34.599596 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1c5ca58-a8, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:34.599872 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb1c5ca58-a8, col_values=(('qos', UUID('d0a2d299-0b34-41ca-a98a-d1c908602e80')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:34.600058 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb1c5ca58-a8, col_values=(('external_ids', {'iface-id': 'b1c5ca58-a892-4f67-840e-810089b1fe6a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:98:58', 'vm-uuid': 'e2cc3304-bf2b-4196-b6c8-8ad56da19af4'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:34.608605 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:34.611183 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:34.611183 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:34.612046 np0000001577 nova-compute[98319]: INFO os_vif [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:98:58,bridge_name='br-int',has_traffic_filtering=True,id=b1c5ca58-a892-4f67-840e-810089b1fe6a,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c5ca58-a8')
May 28 01:00:34.639085 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.100s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:34.639486 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:34.639977 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:34.640439 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:00:34.644435 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:00:34.650338 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:34.756119 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-8ba2d174-ea17-4392-8407-b4ef45c0d465 req-00ab3b93-fc23-4268-99f3-ac8d8c8364de service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:00:34.759797 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.110s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:34.760493 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:34.823710 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk 1073741824" returned: 0 in 0.062s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:34.825202 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:34.825202 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:34.909446 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.084s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:34.910113 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Checking if we can resize image /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:00:34.910836 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:35.021459 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:35.022232 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Cannot resize image /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:00:35.022950 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:00:35.023183 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Ensure instance console log exists: /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:00:35.023569 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:35.023850 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:35.024059 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:35.101807 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 3.121s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:35.102759 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5a6d4ebc-e550-4028-9d31-7189cc68eb67 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 4.304s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:35.103559 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Migrating
May 28 01:00:35.104420 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:00:35.104851 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquired lock "compute-rpcapi-router" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:00:35.260790 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8ba2d174-ea17-4392-8407-b4ef45c0d465 req-00ab3b93-fc23-4268-99f3-ac8d8c8364de service nova] Releasing lock "refresh_cache-04880ef4-5eee-4221-ad42-29788eb26358" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:00:35.261072 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquired lock "refresh_cache-04880ef4-5eee-4221-ad42-29788eb26358" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:00:35.261223 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:00:35.619573 np0000001577 nova-compute[98319]: INFO nova.compute.rpcapi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Automatically selected compute RPC version 6.5 from minimum service version 72
May 28 01:00:35.619573 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Releasing lock "compute-rpcapi-router" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:00:35.619825 np0000001577 nova-compute[98319]: DEBUG nova.compute.rpcapi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98319) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 01:00:35.834690 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:00:36.019609 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:36.029911 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:36.061748 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5a6d4ebc-e550-4028-9d31-7189cc68eb67 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:00:36.061929 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-5a6d4ebc-e550-4028-9d31-7189cc68eb67 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:00:36.143828 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:00:36.145627 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:00:36.145627 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] No VIF found with MAC fa:16:3e:9d:98:58, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:00:36.145627 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Using config drive
May 28 01:00:36.174684 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "refresh_cache-2d2183ad-dbdb-4525-b678-39b72c7ab85d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:00:36.176614 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquired lock "refresh_cache-2d2183ad-dbdb-4525-b678-39b72c7ab85d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:00:36.177044 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:00:36.213029 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Updating instance_info_cache with network_info: [{"id": "d80f49b7-bd41-46df-9743-8ad514696557", "address": "fa:16:3e:e7:fe:bd", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80f49b7-bd", "ovs_interfaceid": "d80f49b7-bd41-46df-9743-8ad514696557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:00:36.564583 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-5a6d4ebc-e550-4028-9d31-7189cc68eb67 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:00:36.651858 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:36.686289 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:36.717578 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Releasing lock "refresh_cache-04880ef4-5eee-4221-ad42-29788eb26358" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:00:36.718302 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Instance network_info: |[{"id": "d80f49b7-bd41-46df-9743-8ad514696557", "address": "fa:16:3e:e7:fe:bd", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80f49b7-bd", "ovs_interfaceid": "d80f49b7-bd41-46df-9743-8ad514696557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:00:36.720652 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Start _get_guest_xml network_info=[{"id": "d80f49b7-bd41-46df-9743-8ad514696557", "address": "fa:16:3e:e7:fe:bd", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80f49b7-bd", "ovs_interfaceid": "d80f49b7-bd41-46df-9743-8ad514696557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:00:36.722481 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:00:36.723582 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='04880ef4-5eee-4221-ad42-29788eb26358'), owner=OwnerMeta(userid='f8586a18edcf42cab0a60028135ae401', username='tempest-AttachVolumeMultiAttachTest-89204095-project-member', projectid='938c2829112843edb2054984e80ce7ad', projectname='tempest-AttachVolumeMultiAttachTest-89204095'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d80f49b7-bd41-46df-9743-8ad514696557", "address": "fa:16:3e:e7:fe:bd", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80f49b7-bd", "ovs_interfaceid": "d80f49b7-bd41-46df-9743-8ad514696557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930036.72327) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:00:36.724350 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:00:36.724747 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:00:36.725327 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:00:36.725489 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:00:36.726564 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:00:36.726854 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:00:36.727135 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:00:36.727135 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:00:36.727308 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:00:36.727308 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:00:36.727308 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:00:36.727676 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:00:36.727676 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:00:36.727676 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:00:36.728015 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:00:36.728015 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:00:36.744980 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='multiattach-server-1',id=26,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7fHo3fyBWUybZxdNVpYEXXxMYY3ACB7D4odfvDXtuf5uMmk/o2XggiQakoJbwdRCXKjpHaMcmXgSyAS8x+3bDHMUWn1qlznnyXp/nDVRmoqTgLFpV2Do6YlUuA3zZ+mw==',key_name='tempest-keypair-627531643',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938c2829112843edb2054984e80ce7ad',ramdisk_id='',reservation_id='r-v6qv000f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-89204095',owner_user_name='tempest-AttachVolumeMultiAttachTest-89204095-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:00:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8586a18edcf42cab0a60028135ae401',uuid=04880ef4-5eee-4221-ad42-29788eb26358,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d80f49b7-bd41-46df-9743-8ad514696557", "address": "fa:16:3e:e7:fe:bd", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80f49b7-bd", "ovs_interfaceid": "d80f49b7-bd41-46df-9743-8ad514696557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:00:36.744980 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converting VIF {"id": "d80f49b7-bd41-46df-9743-8ad514696557", "address": "fa:16:3e:e7:fe:bd", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80f49b7-bd", "ovs_interfaceid": "d80f49b7-bd41-46df-9743-8ad514696557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:36.744980 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:fe:bd,bridge_name='br-int',has_traffic_filtering=True,id=d80f49b7-bd41-46df-9743-8ad514696557,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd80f49b7-bd') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:36.748938 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lazy-loading 'pci_devices' on Instance uuid 04880ef4-5eee-4221-ad42-29788eb26358 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:00:36.860518 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Creating config drive at /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk.config
May 28 01:00:36.889650 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf_qjcj2y {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:36.963337 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf_qjcj2y" returned: 0 in 0.073s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:37.075015 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5a6d4ebc-e550-4028-9d31-7189cc68eb67 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.973s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:37.078101 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 4.572s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:37.078333 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:37.079591 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Auditing locally available compute resources for np0000001577 (node: np0000001577) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 01:00:37.140921 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:37.155613 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-5a6d4ebc-e550-4028-9d31-7189cc68eb67 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Deleted allocations for instance 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2
May 28 01:00:37.253090 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] End _get_guest_xml xml=<domain type="qemu">
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:   <uuid>04880ef4-5eee-4221-ad42-29788eb26358</uuid>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:   <name>instance-0000001a</name>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       <nova:name>multiattach-server-1</nova:name>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:00:36</nova:creationTime>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:         <nova:user uuid="f8586a18edcf42cab0a60028135ae401">tempest-AttachVolumeMultiAttachTest-89204095-project-member</nova:user>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:         <nova:project uuid="938c2829112843edb2054984e80ce7ad">tempest-AttachVolumeMultiAttachTest-89204095</nova:project>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:         <nova:port uuid="d80f49b7-bd41-46df-9743-8ad514696557">
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:     <system>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       <entry name="serial">04880ef4-5eee-4221-ad42-29788eb26358</entry>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       <entry name="uuid">04880ef4-5eee-4221-ad42-29788eb26358</entry>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:     </system>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:   <os>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:   </os>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:   <features>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:   </features>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:   <devices>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk"/>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:     </disk>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk.config"/>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:     </disk>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:e7:fe:bd"/>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       <target dev="tapd80f49b7-bd"/>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:     </interface>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/console.log" append="off"/>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:     </serial>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:     <video>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:     </video>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:     </rng>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:   </devices>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]: </domain>
May 28 01:00:37.253090 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:00:37.257731 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Preparing to wait for external event network-vif-plugged-d80f49b7-bd41-46df-9743-8ad514696557 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:00:37.257731 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "04880ef4-5eee-4221-ad42-29788eb26358-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:37.257731 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "04880ef4-5eee-4221-ad42-29788eb26358-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:37.257731 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "04880ef4-5eee-4221-ad42-29788eb26358-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:37.257731 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='multiattach-server-1',id=26,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7fHo3fyBWUybZxdNVpYEXXxMYY3ACB7D4odfvDXtuf5uMmk/o2XggiQakoJbwdRCXKjpHaMcmXgSyAS8x+3bDHMUWn1qlznnyXp/nDVRmoqTgLFpV2Do6YlUuA3zZ+mw==',key_name='tempest-keypair-627531643',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938c2829112843edb2054984e80ce7ad',ramdisk_id='',reservation_id='r-v6qv000f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-89204095',owner_user_name='tempest-AttachVolumeMultiAttachTest-89204095-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:00:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8586a18edcf42cab0a60028135ae401',uuid=04880ef4-5eee-4221-ad42-29788eb26358,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d80f49b7-bd41-46df-9743-8ad514696557", "address": "fa:16:3e:e7:fe:bd", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80f49b7-bd", "ovs_interfaceid": "d80f49b7-bd41-46df-9743-8ad514696557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:00:37.257731 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converting VIF {"id": "d80f49b7-bd41-46df-9743-8ad514696557", "address": "fa:16:3e:e7:fe:bd", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80f49b7-bd", "ovs_interfaceid": "d80f49b7-bd41-46df-9743-8ad514696557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:37.257731 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:fe:bd,bridge_name='br-int',has_traffic_filtering=True,id=d80f49b7-bd41-46df-9743-8ad514696557,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd80f49b7-bd') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:37.257731 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:fe:bd,bridge_name='br-int',has_traffic_filtering=True,id=d80f49b7-bd41-46df-9743-8ad514696557,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd80f49b7-bd') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:00:37.257731 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:37.258306 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:37.262792 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:00:37.264035 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:37.264256 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e21fee8-42c4-53fc-8d0a-52ab596b4fd5', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:37.286433 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:37.286433 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:37.293612 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:37.298062 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:37.298062 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd80f49b7-bd, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:37.298062 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd80f49b7-bd, col_values=(('qos', UUID('fcd772e3-ee5f-46b9-b434-3f2007a84989')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:37.298062 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd80f49b7-bd, col_values=(('external_ids', {'iface-id': 'd80f49b7-bd41-46df-9743-8ad514696557', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:fe:bd', 'vm-uuid': '04880ef4-5eee-4221-ad42-29788eb26358'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:37.300618 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:37.303705 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:37.313563 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:37.314748 np0000001577 nova-compute[98319]: INFO os_vif [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:fe:bd,bridge_name='br-int',has_traffic_filtering=True,id=d80f49b7-bd41-46df-9743-8ad514696557,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd80f49b7-bd')
May 28 01:00:37.332767 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Updating instance_info_cache with network_info: [{"id": "0d344ede-14be-4d59-b796-097c682389f9", "address": "fa:16:3e:bd:1f:a1", "network": {"id": "8dc9ea08-c48e-4321-b325-d1191e9557b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1143389599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78d410e4c6ea40ef87f92e84f362fa43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d344ede-14", "ovs_interfaceid": "0d344ede-14be-4d59-b796-097c682389f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:00:37.435124 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:37.480447 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:37.486724 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:37.568715 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:37.646074 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:37.653480 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:37.733481 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4b7448d6-3fd3-4ac7-850f-d7fd7600e803 req-712ed544-fc1b-4fd0-843b-6bb1dc688b5f service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Received event network-vif-plugged-b1c5ca58-a892-4f67-840e-810089b1fe6a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:37.734658 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4b7448d6-3fd3-4ac7-850f-d7fd7600e803 req-712ed544-fc1b-4fd0-843b-6bb1dc688b5f service nova] Acquiring lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:37.734834 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4b7448d6-3fd3-4ac7-850f-d7fd7600e803 req-712ed544-fc1b-4fd0-843b-6bb1dc688b5f service nova] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:37.734977 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4b7448d6-3fd3-4ac7-850f-d7fd7600e803 req-712ed544-fc1b-4fd0-843b-6bb1dc688b5f service nova] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:37.735122 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4b7448d6-3fd3-4ac7-850f-d7fd7600e803 req-712ed544-fc1b-4fd0-843b-6bb1dc688b5f service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Processing event network-vif-plugged-b1c5ca58-a892-4f67-840e-810089b1fe6a {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:00:37.836478 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Releasing lock "refresh_cache-2d2183ad-dbdb-4525-b678-39b72c7ab85d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:00:38.170242 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5a6d4ebc-e550-4028-9d31-7189cc68eb67 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "11d1c78c-76d0-4b3a-8a7d-9de7e37148d2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.396s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:38.413219 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930038.4128542, e2cc3304-bf2b-4196-b6c8-8ad56da19af4 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:00:38.414109 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:00:38.414667 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] VM Started (Lifecycle Event)
May 28 01:00:38.417282 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:00:38.419237 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Instance spawned successfully.
May 28 01:00:38.419487 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:00:38.718144 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:38.810662 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:38.811849 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:38.841733 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:00:38.841915 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:00:38.842144 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No VIF found with MAC fa:16:3e:e7:fe:bd, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:00:38.846808 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Using config drive
May 28 01:00:38.917365 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:38.922217 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:00:38.926946 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:38.927088 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:38.927319 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:38.927528 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:38.927816 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:38.928107 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:38.931869 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:38.935925 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:39.007426 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 01:00:39.007426 np0000001577 nova-compute[98319]:   <usage type="volume">
May 28 01:00:39.007426 np0000001577 nova-compute[98319]:     <volume>4690b2ca-c824-422a-9feb-f48b1f047a8a</volume>
May 28 01:00:39.007426 np0000001577 nova-compute[98319]:   </usage>
May 28 01:00:39.007426 np0000001577 nova-compute[98319]: </secret>
May 28 01:00:39.007426 np0000001577 nova-compute[98319]:  {{(pid=98319) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 01:00:39.056306 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:39.056871 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:39.155233 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:39.163158 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cb44d19-8ed5-4c83-aedd-5fa187c05b00/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:39.302513 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cb44d19-8ed5-4c83-aedd-5fa187c05b00/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:39.303247 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cb44d19-8ed5-4c83-aedd-5fa187c05b00/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:39.371185 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:39.374935 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Starting migrate_disk_and_power_off {{(pid=98319) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 28 01:00:39.408565 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:39.411170 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:39.422798 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cb44d19-8ed5-4c83-aedd-5fa187c05b00/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:39.425914 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:39.453663 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:00:39.454807 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930039.45434, e2cc3304-bf2b-4196-b6c8-8ad56da19af4 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:00:39.456701 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Took 7.96 seconds to spawn the instance on the hypervisor.
May 28 01:00:39.457515 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:39.460721 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] VM Paused (Lifecycle Event)
May 28 01:00:39.463928 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:39.479846 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:39.525732 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:00:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-779472629',display_name='tempest-TestVolumeBootPattern-server-779472629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpattern-server-779472629',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='050f928f1ce449d6a447cd343dc4ff80',ramdisk_id='',reservation_id='r-n97kshm5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1449742411',owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:00:28Z,user_data=None,user_id='0c803ddeaf4f4b3db07587419087b3b2',uuid=0ac8b011-d80b-4dad-a020-a7a59908608f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cad47b5d-4350-4300-b32b-23b298c89aa6", "address": "fa:16:3e:c1:85:1d", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcad47b5d-43", "ovs_interfaceid": "cad47b5d-4350-4300-b32b-23b298c89aa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:00:39.525732 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converting VIF {"id": "cad47b5d-4350-4300-b32b-23b298c89aa6", "address": "fa:16:3e:c1:85:1d", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcad47b5d-43", "ovs_interfaceid": "cad47b5d-4350-4300-b32b-23b298c89aa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:39.526463 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:85:1d,bridge_name='br-int',has_traffic_filtering=True,id=cad47b5d-4350-4300-b32b-23b298c89aa6,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcad47b5d-43') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:39.527105 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ac8b011-d80b-4dad-a020-a7a59908608f {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:00:39.546716 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:39.547123 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:39.610764 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Creating config drive at /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk.config
May 28 01:00:39.613743 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpik60qgv_ {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:39.645335 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:39.655395 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:39.691965 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpik60qgv_" returned: 0 in 0.078s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:39.753401 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:39.753959 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:39.834727 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ba1c5066-3b53-4992-8df5-78e5f39cd3fa req-da2223ca-831a-4161-8fd2-9ab5dbfbf765 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Received event network-vif-plugged-b1c5ca58-a892-4f67-840e-810089b1fe6a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:39.835084 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ba1c5066-3b53-4992-8df5-78e5f39cd3fa req-da2223ca-831a-4161-8fd2-9ab5dbfbf765 service nova] Acquiring lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:39.837176 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ba1c5066-3b53-4992-8df5-78e5f39cd3fa req-da2223ca-831a-4161-8fd2-9ab5dbfbf765 service nova] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:39.837681 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ba1c5066-3b53-4992-8df5-78e5f39cd3fa req-da2223ca-831a-4161-8fd2-9ab5dbfbf765 service nova] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:39.837851 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ba1c5066-3b53-4992-8df5-78e5f39cd3fa req-da2223ca-831a-4161-8fd2-9ab5dbfbf765 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] No waiting events found dispatching network-vif-plugged-b1c5ca58-a892-4f67-840e-810089b1fe6a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:00:39.838496 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-ba1c5066-3b53-4992-8df5-78e5f39cd3fa req-da2223ca-831a-4161-8fd2-9ab5dbfbf765 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Received unexpected event network-vif-plugged-b1c5ca58-a892-4f67-840e-810089b1fe6a for instance with vm_state active and task_state None.
May 28 01:00:39.838666 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ba1c5066-3b53-4992-8df5-78e5f39cd3fa req-da2223ca-831a-4161-8fd2-9ab5dbfbf765 service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Received event network-vif-unplugged-0d344ede-14be-4d59-b796-097c682389f9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:39.838788 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ba1c5066-3b53-4992-8df5-78e5f39cd3fa req-da2223ca-831a-4161-8fd2-9ab5dbfbf765 service nova] Acquiring lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:39.838917 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ba1c5066-3b53-4992-8df5-78e5f39cd3fa req-da2223ca-831a-4161-8fd2-9ab5dbfbf765 service nova] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:39.839118 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ba1c5066-3b53-4992-8df5-78e5f39cd3fa req-da2223ca-831a-4161-8fd2-9ab5dbfbf765 service nova] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:39.839241 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ba1c5066-3b53-4992-8df5-78e5f39cd3fa req-da2223ca-831a-4161-8fd2-9ab5dbfbf765 service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] No waiting events found dispatching network-vif-unplugged-0d344ede-14be-4d59-b796-097c682389f9 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:00:39.839335 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-ba1c5066-3b53-4992-8df5-78e5f39cd3fa req-da2223ca-831a-4161-8fd2-9ab5dbfbf765 service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Received unexpected event network-vif-unplugged-0d344ede-14be-4d59-b796-097c682389f9 for instance with vm_state active and task_state resize_migrating.
May 28 01:00:39.841916 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Instance destroyed successfully.
May 28 01:00:39.843504 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-126815204',display_name='tempest-ServerActionsTestOtherB-server-126815204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serveractionstestotherb-server-126815204',id=17,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHowHxSKo/GbZ3/T/DuqsFzaBQyor5k7f+0IXzkeGeXUAEkx6L+ijA0U/nuHnUHla5vZzHw/uAJ60OyJL0qlD41uqiYRDGnW+sKtXyVuDHBRaZp3vxryet5baLwLYdDdtg==',key_name='tempest-keypair-1717835047',keypairs=<?>,launch_index=0,launched_at=2026-05-28T00:59:33Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='78d410e4c6ea40ef87f92e84f362fa43',ramdisk_id='',reservation_id='r-6x23ytl1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-243435399',owner_user_name='tempest-ServerActionsTestOtherB-243435399-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:00:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c45fdc9fb964707b5e02c1b5c0ff1d8',uuid=2d2183ad-dbdb-4525-b678-39b72c7ab85d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d344ede-14be-4d59-b796-097c682389f9", "address": "fa:16:3e:bd:1f:a1", "network": {"id": "8dc9ea08-c48e-4321-b325-d1191e9557b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1143389599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1143389599-network", "vif_mac": "fa:16:3e:bd:1f:a1"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78d410e4c6ea40ef87f92e84f362fa43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d344ede-14", "ovs_interfaceid": "0d344ede-14be-4d59-b796-097c682389f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:00:39.843800 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Converting VIF {"id": "0d344ede-14be-4d59-b796-097c682389f9", "address": "fa:16:3e:bd:1f:a1", "network": {"id": "8dc9ea08-c48e-4321-b325-d1191e9557b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1143389599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1143389599-network", "vif_mac": "fa:16:3e:bd:1f:a1"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78d410e4c6ea40ef87f92e84f362fa43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d344ede-14", "ovs_interfaceid": "0d344ede-14be-4d59-b796-097c682389f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:39.844625 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:1f:a1,bridge_name='br-int',has_traffic_filtering=True,id=0d344ede-14be-4d59-b796-097c682389f9,network=Network(8dc9ea08-c48e-4321-b325-d1191e9557b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d344ede-14') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:39.844967 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:1f:a1,bridge_name='br-int',has_traffic_filtering=True,id=0d344ede-14be-4d59-b796-097c682389f9,network=Network(8dc9ea08-c48e-4321-b325-d1191e9557b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d344ede-14') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:00:39.848817 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:39.848817 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d344ede-14, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:39.850019 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:39.850845 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:39.858159 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:39.860797 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:39.861013 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=74623575-0dd2-44e3-8e57-ac0a41681fc6) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:39.862572 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:39.862572 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:39.865684 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:39.870170 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:39.882458 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:39.889582 np0000001577 nova-compute[98319]: INFO os_vif [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:1f:a1,bridge_name='br-int',has_traffic_filtering=True,id=0d344ede-14be-4d59-b796-097c682389f9,network=Network(8dc9ea08-c48e-4321-b325-d1191e9557b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d344ede-14')
May 28 01:00:39.895470 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:00:39.896302 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a390b885-c2b5-4116-b7ea-4ad467d6145f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:00:39.896926 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:00:39.897797 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:00:39.898341 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a390b885-c2b5-4116-b7ea-4ad467d6145f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:00:39.898617 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:00:39.930915 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:39.930915 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:39.930915 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:39.930915 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:39.930915 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:39.930915 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:39.930915 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:39.930915 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:39.930915 np0000001577 nova-compute[98319]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:39.930915 np0000001577 nova-compute[98319]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:39.930915 np0000001577 nova-compute[98319]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf41f2fd-819e-4e73-a33a-6e08a1d7dabe (non-flash)
May 28 01:00:39.930915 np0000001577 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a (non-flash)
May 28 01:00:39.930915 np0000001577 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a (non-flash)
May 28 01:00:39.930915 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:00:39.931617 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:39.931617 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:39.931617 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:39.931617 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:39.931617 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:39.931617 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:39.931617 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:39.931617 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:39.931617 np0000001577 nova-compute[98319]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:39.931617 np0000001577 nova-compute[98319]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:39.931617 np0000001577 nova-compute[98319]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bf41f2fd-819e-4e73-a33a-6e08a1d7dabe (non-flash)
May 28 01:00:39.931617 np0000001577 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a (non-flash)
May 28 01:00:39.931617 np0000001577 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a (non-flash)
May 28 01:00:39.931617 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:00:39.931617 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', '39'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bf41f2fd-819e-4e73-a33a-6e08a1d7dabe', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a', '41'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a', '42')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:00:39.931617 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', '39')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:00:39.933715 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', '38')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:00:39.934620 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c984c443a60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f'): ({'sdd'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:00:39.934833 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Removing multipathed devices sde, sdd {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:00:39.935077 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Flush multipath device 33000000018e747c1 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:00:39.961626 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:39.966647 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:39.978916 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:39.980334 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:00:39.989188 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Took 15.89 seconds to build instance.
May 28 01:00:39.993377 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930039.9931178, e2cc3304-bf2b-4196-b6c8-8ad56da19af4 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:00:39.993517 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] VM Resumed (Lifecycle Event)
May 28 01:00:40.033586 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] End _get_guest_xml xml=<domain type="qemu">
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:   <uuid>0ac8b011-d80b-4dad-a020-a7a59908608f</uuid>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:   <name>instance-00000018</name>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestVolumeBootPattern-server-779472629</nova:name>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:00:30</nova:creationTime>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       <nova:image uuid="">
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:         <nova:properties/>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:         <nova:user uuid="0c803ddeaf4f4b3db07587419087b3b2">tempest-TestVolumeBootPattern-1449742411-project-member</nova:user>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:         <nova:project uuid="050f928f1ce449d6a447cd343dc4ff80">tempest-TestVolumeBootPattern-1449742411</nova:project>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:         <nova:port uuid="cad47b5d-4350-4300-b32b-23b298c89aa6">
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:     <system>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       <entry name="serial">0ac8b011-d80b-4dad-a020-a7a59908608f</entry>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       <entry name="uuid">0ac8b011-d80b-4dad-a020-a7a59908608f</entry>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:     </system>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:   <os>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:   </os>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:   <features>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:   </features>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:   <devices>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/0ac8b011-d80b-4dad-a020-a7a59908608f/disk.config"/>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:     </disk>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       <alias name="ua-4690b2ca-c824-422a-9feb-f48b1f047a8a"/>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-6"/>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       <serial>4690b2ca-c824-422a-9feb-f48b1f047a8a</serial>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       <encryption format="luks">
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:         <secret type="passphrase" uuid="8fc4cdf6-4738-4b17-a779-87e1567fd0da"/>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       </encryption>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:     </disk>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:c1:85:1d"/>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       <target dev="tapcad47b5d-43"/>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:     </interface>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/0ac8b011-d80b-4dad-a020-a7a59908608f/console.log" append="off"/>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:     </serial>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:     <video>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:     </video>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:     </rng>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:   </devices>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]: </domain>
May 28 01:00:40.033586 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:00:40.036098 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:00:40.036940 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Preparing to wait for external event network-vif-plugged-cad47b5d-4350-4300-b32b-23b298c89aa6 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:00:40.036940 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "0ac8b011-d80b-4dad-a020-a7a59908608f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:40.036940 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "0ac8b011-d80b-4dad-a020-a7a59908608f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:40.037180 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "0ac8b011-d80b-4dad-a020-a7a59908608f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:40.038260 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:00:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-779472629',display_name='tempest-TestVolumeBootPattern-server-779472629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpattern-server-779472629',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='050f928f1ce449d6a447cd343dc4ff80',ramdisk_id='',reservation_id='r-n97kshm5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1449742411',owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:00:28Z,user_data=None,user_id='0c803ddeaf4f4b3db07587419087b3b2',uuid=0ac8b011-d80b-4dad-a020-a7a59908608f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cad47b5d-4350-4300-b32b-23b298c89aa6", "address": "fa:16:3e:c1:85:1d", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcad47b5d-43", "ovs_interfaceid": "cad47b5d-4350-4300-b32b-23b298c89aa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:00:40.038260 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converting VIF {"id": "cad47b5d-4350-4300-b32b-23b298c89aa6", "address": "fa:16:3e:c1:85:1d", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcad47b5d-43", "ovs_interfaceid": "cad47b5d-4350-4300-b32b-23b298c89aa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:40.039038 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:85:1d,bridge_name='br-int',has_traffic_filtering=True,id=cad47b5d-4350-4300-b32b-23b298c89aa6,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcad47b5d-43') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:40.039038 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:85:1d,bridge_name='br-int',has_traffic_filtering=True,id=cad47b5d-4350-4300-b32b-23b298c89aa6,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcad47b5d-43') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:00:40.040911 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:40.040911 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:40.040911 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:00:40.042150 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:40.042356 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5d7a7605-c9d8-5d78-8118-2cdefed8c553', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:40.044135 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:40.044892 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:40.052154 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:40.056601 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:40.056806 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcad47b5d-43, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:40.057282 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcad47b5d-43, col_values=(('qos', UUID('d0571e66-082d-40b5-a501-29f600b1ae95')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:40.057508 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcad47b5d-43, col_values=(('external_ids', {'iface-id': 'cad47b5d-4350-4300-b32b-23b298c89aa6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:85:1d', 'vm-uuid': '0ac8b011-d80b-4dad-a020-a7a59908608f'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:40.058499 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:40.058880 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:40.060744 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:40.066022 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:40.080510 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:40.083386 np0000001577 nova-compute[98319]: INFO os_vif [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:85:1d,bridge_name='br-int',has_traffic_filtering=True,id=cad47b5d-4350-4300-b32b-23b298c89aa6,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcad47b5d-43')
May 28 01:00:40.085143 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:00:40.085598 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:00:40.089074 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:00:40.103272 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:00:40.103528 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:00:40.116205 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:40.157217 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f, portal: 192.168.40.100,3260]
May 28 01:00:40.157217 np0000001577 nova-compute[98319]: Logout of [sid: 39, target: iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f, portal: 192.168.40.100,3260] successful.
May 28 01:00:40.157217 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:40.160007 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:40.160510 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:40.185831 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:40.198795 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:40.247569 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:40.249384 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f, portal: 192.168.50.100,3260]
May 28 01:00:40.249384 np0000001577 nova-compute[98319]: Logout of [sid: 38, target: iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f, portal: 192.168.50.100,3260] successful.
May 28 01:00:40.249384 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:40.278822 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:40.282465 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:40.282465 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:00:40.282465 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] <== disconnect_volume: return (385ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:00:40.282465 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:00:40.288169 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:40.290983 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:40.306083 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:40.395378 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:40.396142 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:40.416265 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:40.418883 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:40.419950 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:40.474892 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:40.481841 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:40.491941 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.403s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:40.496913 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:40.499818 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:00:40.507857 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:40.508028 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:00:40.509802 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d_resize/disk /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:40.530472 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:40.540917 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:00:40.541056 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:00:40.541056 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-5 (vdc) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:00:40.547456 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-9 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:00:40.552077 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:40.579380 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-149690e1-068f-4e82-b5a0-f2b0253718cd req-c00bc69e-1e30-485d-b628-1f98f13188ab service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Received event network-vif-plugged-d80f49b7-bd41-46df-9743-8ad514696557 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:40.580187 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-149690e1-068f-4e82-b5a0-f2b0253718cd req-c00bc69e-1e30-485d-b628-1f98f13188ab service nova] Acquiring lock "04880ef4-5eee-4221-ad42-29788eb26358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:40.580758 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-149690e1-068f-4e82-b5a0-f2b0253718cd req-c00bc69e-1e30-485d-b628-1f98f13188ab service nova] Lock "04880ef4-5eee-4221-ad42-29788eb26358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:40.580758 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-149690e1-068f-4e82-b5a0-f2b0253718cd req-c00bc69e-1e30-485d-b628-1f98f13188ab service nova] Lock "04880ef4-5eee-4221-ad42-29788eb26358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:40.581046 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-149690e1-068f-4e82-b5a0-f2b0253718cd req-c00bc69e-1e30-485d-b628-1f98f13188ab service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Processing event network-vif-plugged-d80f49b7-bd41-46df-9743-8ad514696557 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:00:40.605585 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] CMD "cp -r /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d_resize/disk /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk" returned: 0 in 0.097s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:40.606216 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d_resize/disk.config /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk.config {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:40.657816 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] CMD "cp -r /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d_resize/disk.config /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk.config" returned: 0 in 0.052s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:40.658268 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d_resize/disk.info /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk.info {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:40.693873 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:40.695387 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:40.722731 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] CMD "cp -r /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d_resize/disk.info /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk.info" returned: 0 in 0.064s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:40.808439 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:40.813931 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk.rescue --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:40.904980 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk.rescue --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:40.908715 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk.rescue --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:40.998790 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk.rescue --force-share --output=json" returned: 0 in 0.093s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:41.002260 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:41.018902 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.99906815899999 future=<Future at 0x7c984c674110 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:00:41.034713 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:41.117072 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:41.121953 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:41.246415 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:41.257042 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:41.305577 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:00:41.306245 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930041.3058128, 04880ef4-5eee-4221-ad42-29788eb26358 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:00:41.306666 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] VM Started (Lifecycle Event)
May 28 01:00:41.314324 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:00:41.316682 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Instance spawned successfully.
May 28 01:00:41.317083 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:00:41.346576 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:41.349132 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:41.429118 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:41.429784 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:00:41.433278 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:00:41.434121 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:41.480410 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "env LANG=C uptime" returned: 0 in 0.046s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:41.480979 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Hypervisor/Node resource view: name=np0000001577 free_ram=10502MB free_disk=74.33395767211914GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 01:00:41.481162 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:41.481532 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:41.663961 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:00:41.664121 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:00:41.664200 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] No VIF found with MAC fa:16:3e:c1:85:1d, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:00:41.664673 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Using config drive
May 28 01:00:41.816119 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:41.818737 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:00:41.827148 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:41.827291 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:41.827665 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:41.827934 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:41.828255 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:41.829664 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:41.904133 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:41.904751 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:41.971151 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2c8daa8a-fd42-44bb-a430-668f2ef6f988 req-4ae9124f-b025-4791-8d13-8407f915583c service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Received event network-vif-unplugged-0d344ede-14be-4d59-b796-097c682389f9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:41.971151 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2c8daa8a-fd42-44bb-a430-668f2ef6f988 req-4ae9124f-b025-4791-8d13-8407f915583c service nova] Acquiring lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:41.971151 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2c8daa8a-fd42-44bb-a430-668f2ef6f988 req-4ae9124f-b025-4791-8d13-8407f915583c service nova] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:41.971151 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2c8daa8a-fd42-44bb-a430-668f2ef6f988 req-4ae9124f-b025-4791-8d13-8407f915583c service nova] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:41.971151 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2c8daa8a-fd42-44bb-a430-668f2ef6f988 req-4ae9124f-b025-4791-8d13-8407f915583c service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] No waiting events found dispatching network-vif-unplugged-0d344ede-14be-4d59-b796-097c682389f9 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:00:41.971151 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-2c8daa8a-fd42-44bb-a430-668f2ef6f988 req-4ae9124f-b025-4791-8d13-8407f915583c service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Received unexpected event network-vif-unplugged-0d344ede-14be-4d59-b796-097c682389f9 for instance with vm_state active and task_state resize_migrating.
May 28 01:00:41.971151 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2c8daa8a-fd42-44bb-a430-668f2ef6f988 req-4ae9124f-b025-4791-8d13-8407f915583c service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Received event network-changed-b1c5ca58-a892-4f67-840e-810089b1fe6a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:41.971151 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2c8daa8a-fd42-44bb-a430-668f2ef6f988 req-4ae9124f-b025-4791-8d13-8407f915583c service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Refreshing instance network info cache due to event network-changed-b1c5ca58-a892-4f67-840e-810089b1fe6a. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:00:41.971151 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2c8daa8a-fd42-44bb-a430-668f2ef6f988 req-4ae9124f-b025-4791-8d13-8407f915583c service nova] Acquiring lock "refresh_cache-e2cc3304-bf2b-4196-b6c8-8ad56da19af4" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:00:41.971151 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2c8daa8a-fd42-44bb-a430-668f2ef6f988 req-4ae9124f-b025-4791-8d13-8407f915583c service nova] Acquired lock "refresh_cache-e2cc3304-bf2b-4196-b6c8-8ad56da19af4" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:00:41.971151 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-2c8daa8a-fd42-44bb-a430-668f2ef6f988 req-4ae9124f-b025-4791-8d13-8407f915583c service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Refreshing network info cache for port b1c5ca58-a892-4f67-840e-810089b1fe6a {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:00:42.007609 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Port 0d344ede-14be-4d59-b796-097c682389f9 binding to destination host np0000001577 is already ACTIVE {{(pid=98319) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 01:00:42.173872 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:42.327064 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:00:42.327453 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930042.3272448, 04880ef4-5eee-4221-ad42-29788eb26358 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:00:42.327540 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] VM Paused (Lifecycle Event)
May 28 01:00:42.340773 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Took 7.81 seconds to spawn the instance on the hypervisor.
May 28 01:00:42.341288 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:42.344853 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Creating config drive at /opt/stack/data/nova/instances/0ac8b011-d80b-4dad-a020-a7a59908608f/disk.config
May 28 01:00:42.352988 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0ac8b011-d80b-4dad-a020-a7a59908608f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpaljz5_a5 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:42.415936 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0ac8b011-d80b-4dad-a020-a7a59908608f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpaljz5_a5" returned: 0 in 0.063s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:42.473939 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-2c8daa8a-fd42-44bb-a430-668f2ef6f988 req-4ae9124f-b025-4791-8d13-8407f915583c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:42.497874 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Applying migration context for instance 2d2183ad-dbdb-4525-b678-39b72c7ab85d as it has an incoming, in-progress migration a82f5535-dd02-4a4b-b896-35ce6d6587fe. Migration status is migrating {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 28 01:00:42.500698 np0000001577 nova-compute[98319]: INFO nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Updating resource usage from migration a82f5535-dd02-4a4b-b896-35ce6d6587fe
May 28 01:00:42.593035 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 8bca25d8-071e-4b2d-960c-50582381cc75 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:00:42.593419 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance d09e5674-c5ab-4ace-9952-554361002541 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:00:42.593845 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance d988b526-836d-48b8-a381-1f7679caf41d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:00:42.594090 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance dccaa2b7-3c00-45f9-bf40-1a8a15030825 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:00:42.594299 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance b73b73f0-79a5-448c-a374-bbb182da41a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:00:42.594534 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance f2b64af8-9a7b-4726-b298-cf9d2cb24498 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:00:42.594761 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 2dbd7449-2081-4377-a31d-e4d202679da1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:00:42.594941 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 6cb44d19-8ed5-4c83-aedd-5fa187c05b00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:00:42.595148 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance d87bb95b-a1e9-4786-8bee-16f2cfaabf2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:00:42.595326 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance bb62eb94-ea3e-47ec-bae7-43acb74061ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:00:42.595656 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 0ac8b011-d80b-4dad-a020-a7a59908608f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:00:42.595846 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance e2cc3304-bf2b-4196-b6c8-8ad56da19af4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:00:42.596048 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 04880ef4-5eee-4221-ad42-29788eb26358 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:00:42.596240 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Migration a82f5535-dd02-4a4b-b896-35ce6d6587fe is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 28 01:00:42.596417 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 2d2183ad-dbdb-4525-b678-39b72c7ab85d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:00:42.596744 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 01:00:42.597002 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Final resource view: name=np0000001577 phys_ram=24030MB used_ram=3456MB phys_disk=95GB used_disk=12GB total_vcpus=12 used_vcpus=15 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:00:41 up 32 min,  2 users,  load average: 9.72, 5.96, 2.83\n', 'num_instances': '14', 'num_vm_active': '11', 'num_task_None': '11', 'num_os_type_None': '14', 'num_proj_938c2829112843edb2054984e80ce7ad': '5', 'io_workload': '3', 'num_proj_a3c5a1da6bb242e9a58cb82855897726': '3', 'num_vm_rescued': '1', 'num_task_resize_migrating': '1', 'num_proj_78d410e4c6ea40ef87f92e84f362fa43': '1', 'num_proj_73ee6b376bb14dffb5664085cca58288': '2', 'num_proj_54eb635d961644dc9c1845baf24fc6db': '1', 'num_proj_caedf1b88e96476bacbd226b0510ed55': '1', 'num_vm_building': '2', 'num_task_spawning': '2', 'num_proj_050f928f1ce449d6a447cd343dc4ff80': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 01:00:42.642139 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-543eee93-99de-4769-8d3f-d8fec17e97be req-c1bada40-7b09-416d-ac5c-7980df314edc service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Received event network-vif-plugged-d80f49b7-bd41-46df-9743-8ad514696557 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:42.642409 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-543eee93-99de-4769-8d3f-d8fec17e97be req-c1bada40-7b09-416d-ac5c-7980df314edc service nova] Acquiring lock "04880ef4-5eee-4221-ad42-29788eb26358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:42.642971 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-543eee93-99de-4769-8d3f-d8fec17e97be req-c1bada40-7b09-416d-ac5c-7980df314edc service nova] Lock "04880ef4-5eee-4221-ad42-29788eb26358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:42.643144 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-543eee93-99de-4769-8d3f-d8fec17e97be req-c1bada40-7b09-416d-ac5c-7980df314edc service nova] Lock "04880ef4-5eee-4221-ad42-29788eb26358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:42.643281 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-543eee93-99de-4769-8d3f-d8fec17e97be req-c1bada40-7b09-416d-ac5c-7980df314edc service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] No waiting events found dispatching network-vif-plugged-d80f49b7-bd41-46df-9743-8ad514696557 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:00:42.643413 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-543eee93-99de-4769-8d3f-d8fec17e97be req-c1bada40-7b09-416d-ac5c-7980df314edc service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Received unexpected event network-vif-plugged-d80f49b7-bd41-46df-9743-8ad514696557 for instance with vm_state active and task_state None.
May 28 01:00:42.833229 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:42.835909 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930042.835473, 04880ef4-5eee-4221-ad42-29788eb26358 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:00:42.838644 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] VM Resumed (Lifecycle Event)
May 28 01:00:42.873722 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Took 18.48 seconds to build instance.
May 28 01:00:42.921164 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-2c8daa8a-fd42-44bb-a430-668f2ef6f988 req-4ae9124f-b025-4791-8d13-8407f915583c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:42.974204 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:43.010569 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:43.020749 np0000001577 nova-compute[98319]: DEBUG nova.compute.rpcapi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98319) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 01:00:43.052165 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:43.054441 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:43.054633 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:43.121831 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:43.198185 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-2c8daa8a-fd42-44bb-a430-668f2ef6f988 req-4ae9124f-b025-4791-8d13-8407f915583c service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Updated VIF entry in instance network info cache for port b1c5ca58-a892-4f67-840e-810089b1fe6a. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:00:43.198597 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-2c8daa8a-fd42-44bb-a430-668f2ef6f988 req-4ae9124f-b025-4791-8d13-8407f915583c service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Updating instance_info_cache with network_info: [{"id": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "address": "fa:16:3e:9d:98:58", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c5ca58-a8", "ovs_interfaceid": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:00:43.348585 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:43.355238 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:00:43.374630 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "04880ef4-5eee-4221-ad42-29788eb26358" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.989s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:43.421935 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:43.427788 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:43.433112 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:43.465601 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:43.686210 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:00:43.686459 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:00:43.702238 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2c8daa8a-fd42-44bb-a430-668f2ef6f988 req-4ae9124f-b025-4791-8d13-8407f915583c service nova] Releasing lock "refresh_cache-e2cc3304-bf2b-4196-b6c8-8ad56da19af4" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:00:44.034757 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-cce124ff-8c70-41ae-9e1e-14d1a97583ca req-b2510267-5034-4844-a4a8-cd696a7f3341 service nova] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Received event network-vif-plugged-cad47b5d-4350-4300-b32b-23b298c89aa6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:44.034948 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cce124ff-8c70-41ae-9e1e-14d1a97583ca req-b2510267-5034-4844-a4a8-cd696a7f3341 service nova] Acquiring lock "0ac8b011-d80b-4dad-a020-a7a59908608f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:44.035094 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cce124ff-8c70-41ae-9e1e-14d1a97583ca req-b2510267-5034-4844-a4a8-cd696a7f3341 service nova] Lock "0ac8b011-d80b-4dad-a020-a7a59908608f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:44.035231 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cce124ff-8c70-41ae-9e1e-14d1a97583ca req-b2510267-5034-4844-a4a8-cd696a7f3341 service nova] Lock "0ac8b011-d80b-4dad-a020-a7a59908608f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:44.036272 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-cce124ff-8c70-41ae-9e1e-14d1a97583ca req-b2510267-5034-4844-a4a8-cd696a7f3341 service nova] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Processing event network-vif-plugged-cad47b5d-4350-4300-b32b-23b298c89aa6 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:00:44.036414 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-cce124ff-8c70-41ae-9e1e-14d1a97583ca req-b2510267-5034-4844-a4a8-cd696a7f3341 service nova] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Received event network-vif-plugged-cad47b5d-4350-4300-b32b-23b298c89aa6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:44.036572 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cce124ff-8c70-41ae-9e1e-14d1a97583ca req-b2510267-5034-4844-a4a8-cd696a7f3341 service nova] Acquiring lock "0ac8b011-d80b-4dad-a020-a7a59908608f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:44.036751 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cce124ff-8c70-41ae-9e1e-14d1a97583ca req-b2510267-5034-4844-a4a8-cd696a7f3341 service nova] Lock "0ac8b011-d80b-4dad-a020-a7a59908608f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:44.036923 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cce124ff-8c70-41ae-9e1e-14d1a97583ca req-b2510267-5034-4844-a4a8-cd696a7f3341 service nova] Lock "0ac8b011-d80b-4dad-a020-a7a59908608f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:44.037004 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-cce124ff-8c70-41ae-9e1e-14d1a97583ca req-b2510267-5034-4844-a4a8-cd696a7f3341 service nova] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] No waiting events found dispatching network-vif-plugged-cad47b5d-4350-4300-b32b-23b298c89aa6 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:00:44.037132 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-cce124ff-8c70-41ae-9e1e-14d1a97583ca req-b2510267-5034-4844-a4a8-cd696a7f3341 service nova] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Received unexpected event network-vif-plugged-cad47b5d-4350-4300-b32b-23b298c89aa6 for instance with vm_state building and task_state spawning.
May 28 01:00:44.057911 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:44.190327 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:00:44.205870 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "refresh_cache-2d2183ad-dbdb-4525-b678-39b72c7ab85d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:00:44.206377 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquired lock "refresh_cache-2d2183ad-dbdb-4525-b678-39b72c7ab85d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:00:44.206701 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:00:44.707404 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Compute_service record updated for np0000001577:np0000001577 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 01:00:44.707404 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.226s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:44.709701 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:00:44.710510 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:44.747308 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-57090153-3f2a-4e2b-a0fa-005f8913db84 req-c927a759-1f50-4b38-bcb7-9da21a32188b service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Received event network-changed-3ed3d348-6b93-4492-9c18-7b0eecc6454a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:44.747469 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-57090153-3f2a-4e2b-a0fa-005f8913db84 req-c927a759-1f50-4b38-bcb7-9da21a32188b service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Refreshing instance network info cache due to event network-changed-3ed3d348-6b93-4492-9c18-7b0eecc6454a. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:00:44.747691 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-57090153-3f2a-4e2b-a0fa-005f8913db84 req-c927a759-1f50-4b38-bcb7-9da21a32188b service nova] Acquiring lock "refresh_cache-d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:00:44.747783 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-57090153-3f2a-4e2b-a0fa-005f8913db84 req-c927a759-1f50-4b38-bcb7-9da21a32188b service nova] Acquired lock "refresh_cache-d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:00:44.747921 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-57090153-3f2a-4e2b-a0fa-005f8913db84 req-c927a759-1f50-4b38-bcb7-9da21a32188b service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Refreshing network info cache for port 3ed3d348-6b93-4492-9c18-7b0eecc6454a {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:00:45.040211 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e30bf160-0b44-4fae-aafb-106bd4fdead0 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Acquiring lock "6cb44d19-8ed5-4c83-aedd-5fa187c05b00" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:45.040361 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e30bf160-0b44-4fae-aafb-106bd4fdead0 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "6cb44d19-8ed5-4c83-aedd-5fa187c05b00" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:45.040517 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e30bf160-0b44-4fae-aafb-106bd4fdead0 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Acquiring lock "6cb44d19-8ed5-4c83-aedd-5fa187c05b00-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:45.040655 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e30bf160-0b44-4fae-aafb-106bd4fdead0 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "6cb44d19-8ed5-4c83-aedd-5fa187c05b00-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:45.040764 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e30bf160-0b44-4fae-aafb-106bd4fdead0 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "6cb44d19-8ed5-4c83-aedd-5fa187c05b00-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:45.047878 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e30bf160-0b44-4fae-aafb-106bd4fdead0 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Terminating instance
May 28 01:00:45.061808 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:45.092988 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:00:45.092988 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930045.0923724, 0ac8b011-d80b-4dad-a020-a7a59908608f => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:00:45.092988 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] VM Started (Lifecycle Event)
May 28 01:00:45.095395 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:00:45.097474 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Instance spawned successfully.
May 28 01:00:45.098331 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:00:45.164453 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:45.254006 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-57090153-3f2a-4e2b-a0fa-005f8913db84 req-c927a759-1f50-4b38-bcb7-9da21a32188b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:45.372570 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Updating instance_info_cache with network_info: [{"id": "0d344ede-14be-4d59-b796-097c682389f9", "address": "fa:16:3e:bd:1f:a1", "network": {"id": "8dc9ea08-c48e-4321-b325-d1191e9557b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1143389599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78d410e4c6ea40ef87f92e84f362fa43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d344ede-14", "ovs_interfaceid": "0d344ede-14be-4d59-b796-097c682389f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:00:45.468576 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0004239499999130203 future=<Future at 0x7c984c5305f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:00:45.468576 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:00:45.468576 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=10.549883003999867 future=<Future at 0x7c984c674110 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:00:45.468576 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=10.549765856999784 future=<Future at 0x7c984c674110 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:00:45.469260 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Emitting event <LifecycleEvent: 1779930030.4672322, 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:00:45.469374 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] VM Stopped (Lifecycle Event)
May 28 01:00:45.553857 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e30bf160-0b44-4fae-aafb-106bd4fdead0 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:00:45.564566 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-57090153-3f2a-4e2b-a0fa-005f8913db84 req-c927a759-1f50-4b38-bcb7-9da21a32188b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:45.585827 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:45.597746 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:45.605400 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:00:45.610745 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:45.613654 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:45.613654 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:45.613654 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:45.613654 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:45.613654 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:00:45.618503 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:45.653197 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:45.706454 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:00:45.706929 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:00:45.706929 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:00:45.707178 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:00:45.708510 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:00:45.708510 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:00:45.708510 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.27 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:00:45.768412 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-57090153-3f2a-4e2b-a0fa-005f8913db84 req-c927a759-1f50-4b38-bcb7-9da21a32188b service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Updated VIF entry in instance network info cache for port 3ed3d348-6b93-4492-9c18-7b0eecc6454a. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:00:45.768782 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-57090153-3f2a-4e2b-a0fa-005f8913db84 req-c927a759-1f50-4b38-bcb7-9da21a32188b service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Updating instance_info_cache with network_info: [{"id": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "address": "fa:16:3e:28:56:65", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3d348-6b", "ovs_interfaceid": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:00:45.809278 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-83b87134-4087-4dec-8371-ce5212461813 req-1351a05b-cc96-4fc7-9abd-ad2d069c0420 service nova] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Received event network-vif-unplugged-789466ca-15ad-48a2-a426-0af41bc52b1b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:45.809671 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-83b87134-4087-4dec-8371-ce5212461813 req-1351a05b-cc96-4fc7-9abd-ad2d069c0420 service nova] Acquiring lock "6cb44d19-8ed5-4c83-aedd-5fa187c05b00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:45.809872 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-83b87134-4087-4dec-8371-ce5212461813 req-1351a05b-cc96-4fc7-9abd-ad2d069c0420 service nova] Lock "6cb44d19-8ed5-4c83-aedd-5fa187c05b00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:45.810025 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-83b87134-4087-4dec-8371-ce5212461813 req-1351a05b-cc96-4fc7-9abd-ad2d069c0420 service nova] Lock "6cb44d19-8ed5-4c83-aedd-5fa187c05b00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:45.810158 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-83b87134-4087-4dec-8371-ce5212461813 req-1351a05b-cc96-4fc7-9abd-ad2d069c0420 service nova] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] No waiting events found dispatching network-vif-unplugged-789466ca-15ad-48a2-a426-0af41bc52b1b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:00:45.810687 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-83b87134-4087-4dec-8371-ce5212461813 req-1351a05b-cc96-4fc7-9abd-ad2d069c0420 service nova] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Received event network-vif-unplugged-789466ca-15ad-48a2-a426-0af41bc52b1b for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:00:45.873875 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Releasing lock "refresh_cache-2d2183ad-dbdb-4525-b678-39b72c7ab85d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:00:45.925136 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Instance destroyed successfully.
May 28 01:00:45.925667 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-e30bf160-0b44-4fae-aafb-106bd4fdead0 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lazy-loading 'resources' on Instance uuid 6cb44d19-8ed5-4c83-aedd-5fa187c05b00 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:00:45.942950 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:45.972143 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 11d1c78c-76d0-4b3a-8a7d-9de7e37148d2] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:46.041513 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:46.108700 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:00:46.108891 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930046.1087475, 0ac8b011-d80b-4dad-a020-a7a59908608f => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:00:46.109007 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] VM Paused (Lifecycle Event)
May 28 01:00:46.119239 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Took 15.82 seconds to spawn the instance on the hypervisor.
May 28 01:00:46.119239 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:46.197674 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:46.198833 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:46.271330 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-57090153-3f2a-4e2b-a0fa-005f8913db84 req-c927a759-1f50-4b38-bcb7-9da21a32188b service nova] Releasing lock "refresh_cache-d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:00:46.271519 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-57090153-3f2a-4e2b-a0fa-005f8913db84 req-c927a759-1f50-4b38-bcb7-9da21a32188b service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Received event network-changed-d80f49b7-bd41-46df-9743-8ad514696557 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:46.271683 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-57090153-3f2a-4e2b-a0fa-005f8913db84 req-c927a759-1f50-4b38-bcb7-9da21a32188b service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Refreshing instance network info cache due to event network-changed-d80f49b7-bd41-46df-9743-8ad514696557. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:00:46.271846 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-57090153-3f2a-4e2b-a0fa-005f8913db84 req-c927a759-1f50-4b38-bcb7-9da21a32188b service nova] Acquiring lock "refresh_cache-04880ef4-5eee-4221-ad42-29788eb26358" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:00:46.271959 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-57090153-3f2a-4e2b-a0fa-005f8913db84 req-c927a759-1f50-4b38-bcb7-9da21a32188b service nova] Acquired lock "refresh_cache-04880ef4-5eee-4221-ad42-29788eb26358" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:00:46.272117 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-57090153-3f2a-4e2b-a0fa-005f8913db84 req-c927a759-1f50-4b38-bcb7-9da21a32188b service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Refreshing network info cache for port d80f49b7-bd41-46df-9743-8ad514696557 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:00:46.383434 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:00:46.399924 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:00:46.419838 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:46.440357 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-e30bf160-0b44-4fae-aafb-106bd4fdead0 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1031123220',display_name='tempest-ServersNegativeTestJSON-server-1031123220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serversnegativetestjson-server-1031123220',id=20,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:00:07Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='caedf1b88e96476bacbd226b0510ed55',ramdisk_id='',reservation_id='r-f62mlp01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-811169851',owner_user_name='tempest-ServersNegativeTestJSON-811169851-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:00:07Z,user_data=None,user_id='bb8bed94f4864e6696094a671fc6ef4f',uuid=6cb44d19-8ed5-4c83-aedd-5fa187c05b00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "789466ca-15ad-48a2-a426-0af41bc52b1b", "address": "fa:16:3e:d9:e2:18", "network": {"id": "92076d1f-65e0-44ef-afce-207d3e18dc80", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906118401-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "caedf1b88e96476bacbd226b0510ed55", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap789466ca-15", "ovs_interfaceid": "789466ca-15ad-48a2-a426-0af41bc52b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:00:46.440714 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-e30bf160-0b44-4fae-aafb-106bd4fdead0 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Converting VIF {"id": "789466ca-15ad-48a2-a426-0af41bc52b1b", "address": "fa:16:3e:d9:e2:18", "network": {"id": "92076d1f-65e0-44ef-afce-207d3e18dc80", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906118401-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "caedf1b88e96476bacbd226b0510ed55", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap789466ca-15", "ovs_interfaceid": "789466ca-15ad-48a2-a426-0af41bc52b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:46.441908 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-e30bf160-0b44-4fae-aafb-106bd4fdead0 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e2:18,bridge_name='br-int',has_traffic_filtering=True,id=789466ca-15ad-48a2-a426-0af41bc52b1b,network=Network(92076d1f-65e0-44ef-afce-207d3e18dc80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap789466ca-15') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:46.442468 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-e30bf160-0b44-4fae-aafb-106bd4fdead0 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e2:18,bridge_name='br-int',has_traffic_filtering=True,id=789466ca-15ad-48a2-a426-0af41bc52b1b,network=Network(92076d1f-65e0-44ef-afce-207d3e18dc80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap789466ca-15') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:00:46.446604 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:46.446604 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap789466ca-15, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:46.448755 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:46.450095 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:46.455752 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:46.457033 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=64cd9e31-9fae-492d-a42a-02da21489744) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:46.460773 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:46.461730 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:46.463488 np0000001577 nova-compute[98319]: INFO os_vif [None req-e30bf160-0b44-4fae-aafb-106bd4fdead0 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e2:18,bridge_name='br-int',has_traffic_filtering=True,id=789466ca-15ad-48a2-a426-0af41bc52b1b,network=Network(92076d1f-65e0-44ef-afce-207d3e18dc80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap789466ca-15')
May 28 01:00:46.463792 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-e30bf160-0b44-4fae-aafb-106bd4fdead0 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Deleting instance files /opt/stack/data/nova/instances/6cb44d19-8ed5-4c83-aedd-5fa187c05b00_del
May 28 01:00:46.464496 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-e30bf160-0b44-4fae-aafb-106bd4fdead0 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Deletion of /opt/stack/data/nova/instances/6cb44d19-8ed5-4c83-aedd-5fa187c05b00_del complete
May 28 01:00:46.467800 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:00:46.468694 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:00:46.480602 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:00:46.480602 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe75:1c46', 'fe80::8c3:73ff:fe68:9ea1', 'fe80::fc16:3eff:fef0:246e', 'fe80::fc16:3eff:feca:a831', 'fe80::e8d7:d3ff:fe11:4890', 'fe80::fc16:3eff:fe12:3f51', 'fe80::64e0:a4ff:fe34:ffd6', 'fe80::fc16:3eff:fe72:df47', 'fe80::fc16:3eff:fe3e:2329', 'fe80::fc16:3eff:fe28:5665', 'fe80::fc16:3eff:fe8f:58e7', 'fe80::8c50:49ff:fe54:f5d', 'fe80::fc16:3eff:fed8:380', 'fe80::fc16:3eff:fe3a:9b65', 'fe80::fc16:3eff:feab:a032', 'fe80::fc16:3eff:fee0:c149', 'fe80::fc16:3eff:fe1b:8be7', 'fe80::cc9e:aff:fedb:875f', 'fe80::fc16:3eff:fe40:63', 'fe80::8ba:53ff:fe4b:b4ff', 'fe80::fc16:3eff:fedf:9fb0', 'fe80::fc16:3eff:fe9d:9858', 'fe80::fc16:3eff:fee7:febd', 'fe80::fc16:3eff:fec1:851d', 'fe80::e873:f8ff:fed0:1522'] 
May 28 01:00:46.480602 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:00:46.480602 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:00:46.481631 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:00:46.615703 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:46.619111 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930046.6187832, 0ac8b011-d80b-4dad-a020-a7a59908608f => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:00:46.619287 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] VM Resumed (Lifecycle Event)
May 28 01:00:46.629446 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Took 24.07 seconds to build instance.
May 28 01:00:46.702318 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lazy-loading 'flavor' on Instance uuid d87bb95b-a1e9-4786-8bee-16f2cfaabf2d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:00:46.774788 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-57090153-3f2a-4e2b-a0fa-005f8913db84 req-c927a759-1f50-4b38-bcb7-9da21a32188b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:46.973393 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e30bf160-0b44-4fae-aafb-106bd4fdead0 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Took 1.42 seconds to destroy the instance on the hypervisor.
May 28 01:00:46.975231 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-e30bf160-0b44-4fae-aafb-106bd4fdead0 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:00:46.975528 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:00:46.975648 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:00:46.975833 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:47.109762 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:47.123429 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:47.127531 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:00:47.134262 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "0ac8b011-d80b-4dad-a020-a7a59908608f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.591s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:47.228707 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-57090153-3f2a-4e2b-a0fa-005f8913db84 req-c927a759-1f50-4b38-bcb7-9da21a32188b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:47.427630 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-57090153-3f2a-4e2b-a0fa-005f8913db84 req-c927a759-1f50-4b38-bcb7-9da21a32188b service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Updated VIF entry in instance network info cache for port d80f49b7-bd41-46df-9743-8ad514696557. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:00:47.427858 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-57090153-3f2a-4e2b-a0fa-005f8913db84 req-c927a759-1f50-4b38-bcb7-9da21a32188b service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Updating instance_info_cache with network_info: [{"id": "d80f49b7-bd41-46df-9743-8ad514696557", "address": "fa:16:3e:e7:fe:bd", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80f49b7-bd", "ovs_interfaceid": "d80f49b7-bd41-46df-9743-8ad514696557", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:00:47.447129 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c50ea974-dd90-4882-ad80-ce7426f751ef req-f092434f-93c5-4380-8cdd-16b7b6a393c1 service nova] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Received event network-vif-deleted-789466ca-15ad-48a2-a426-0af41bc52b1b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:47.447129 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-c50ea974-dd90-4882-ad80-ce7426f751ef req-f092434f-93c5-4380-8cdd-16b7b6a393c1 service nova] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Neutron deleted interface 789466ca-15ad-48a2-a426-0af41bc52b1b; detaching it from the instance and deleting it from the info cache
May 28 01:00:47.447129 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c50ea974-dd90-4882-ad80-ce7426f751ef req-f092434f-93c5-4380-8cdd-16b7b6a393c1 service nova] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Detach interface failed, port_id=789466ca-15ad-48a2-a426-0af41bc52b1b, reason: Instance 6cb44d19-8ed5-4c83-aedd-5fa187c05b00 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:00:47.631788 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999729677999994 future=<Future at 0x7c984c6b5790 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:00:47.643759 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Starting finish_migration {{(pid=98319) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 28 01:00:47.644406 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Instance directory exists: not creating {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 01:00:47.644691 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Creating image(s)
May 28 01:00:47.645522 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:47.710620 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:47.728679 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.082s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:47.729151 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:00:47.729478 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:47.818160 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "0ac8b011-d80b-4dad-a020-a7a59908608f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:47.818526 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "0ac8b011-d80b-4dad-a020-a7a59908608f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:47.818786 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "0ac8b011-d80b-4dad-a020-a7a59908608f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:47.818958 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "0ac8b011-d80b-4dad-a020-a7a59908608f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:47.819139 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "0ac8b011-d80b-4dad-a020-a7a59908608f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:47.822765 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Terminating instance
May 28 01:00:47.829668 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:47.830574 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Cannot resize image /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:00:47.863595 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1bc90627-3a01-41c5-bf5a-b6a0173fdc8d req-f200f495-de22-46eb-a509-9f7ee2b7bba5 service nova] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Received event network-vif-unplugged-789466ca-15ad-48a2-a426-0af41bc52b1b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:47.864160 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1bc90627-3a01-41c5-bf5a-b6a0173fdc8d req-f200f495-de22-46eb-a509-9f7ee2b7bba5 service nova] Acquiring lock "6cb44d19-8ed5-4c83-aedd-5fa187c05b00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:47.864300 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1bc90627-3a01-41c5-bf5a-b6a0173fdc8d req-f200f495-de22-46eb-a509-9f7ee2b7bba5 service nova] Lock "6cb44d19-8ed5-4c83-aedd-5fa187c05b00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:47.864474 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1bc90627-3a01-41c5-bf5a-b6a0173fdc8d req-f200f495-de22-46eb-a509-9f7ee2b7bba5 service nova] Lock "6cb44d19-8ed5-4c83-aedd-5fa187c05b00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:47.864599 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1bc90627-3a01-41c5-bf5a-b6a0173fdc8d req-f200f495-de22-46eb-a509-9f7ee2b7bba5 service nova] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] No waiting events found dispatching network-vif-unplugged-789466ca-15ad-48a2-a426-0af41bc52b1b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:00:47.864703 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1bc90627-3a01-41c5-bf5a-b6a0173fdc8d req-f200f495-de22-46eb-a509-9f7ee2b7bba5 service nova] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Received event network-vif-unplugged-789466ca-15ad-48a2-a426-0af41bc52b1b for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:00:47.882259 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:00:47.929716 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-57090153-3f2a-4e2b-a0fa-005f8913db84 req-c927a759-1f50-4b38-bcb7-9da21a32188b service nova] Releasing lock "refresh_cache-04880ef4-5eee-4221-ad42-29788eb26358" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:00:48.327949 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:00:48.333070 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:00:48.333489 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Ensure instance console log exists: /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:00:48.334721 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:48.334721 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:48.335068 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:48.342721 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Start _get_guest_xml network_info=[{"id": "0d344ede-14be-4d59-b796-097c682389f9", "address": "fa:16:3e:bd:1f:a1", "network": {"id": "8dc9ea08-c48e-4321-b325-d1191e9557b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1143389599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1143389599-network", "vif_mac": "fa:16:3e:bd:1f:a1"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78d410e4c6ea40ef87f92e84f362fa43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d344ede-14", "ovs_interfaceid": "0d344ede-14be-4d59-b796-097c682389f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a390b885-c2b5-4116-b7ea-4ad467d6145f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '2d2183ad-dbdb-4525-b678-39b72c7ab85d', 'attached_at': '2026-05-28T01:00:47.000000', 'detached_at': '', 'volume_id': 'a390b885-c2b5-4116-b7ea-4ad467d6145f', 'serial': 'a390b885-c2b5-4116-b7ea-4ad467d6145f'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '1d6dbc34-31f1-474b-9183-2645f50a0656', 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:00:48.345777 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:00:48.347690 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-126815204', uuid='2d2183ad-dbdb-4525-b678-39b72c7ab85d'), owner=OwnerMeta(userid='2c45fdc9fb964707b5e02c1b5c0ff1d8', username='tempest-ServerActionsTestOtherB-243435399-project-member', projectid='78d410e4c6ea40ef87f92e84f362fa43', projectname='tempest-ServerActionsTestOtherB-243435399'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0d344ede-14be-4d59-b796-097c682389f9", "address": "fa:16:3e:bd:1f:a1", "network": {"id": "8dc9ea08-c48e-4321-b325-d1191e9557b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1143389599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1143389599-network", "vif_mac": "fa:16:3e:bd:1f:a1"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78d410e4c6ea40ef87f92e84f362fa43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d344ede-14", "ovs_interfaceid": "0d344ede-14be-4d59-b796-097c682389f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930048.3470592) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:00:48.350515 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:00:48.350515 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:00:48.353231 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:00:48.356016 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:00:48.356016 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:00:48.356016 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:00:48.356016 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:00:48.356016 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:00:48.356016 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:00:48.356703 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:00:48.357714 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:00:48.358205 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:00:48.358731 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:48.360652 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:00:48.360652 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:00:48.360950 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:00:48.361236 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:00:48.369956 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:48.395069 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Took 1.42 seconds to deallocate network for instance.
May 28 01:00:48.396515 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:48.408424 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk.config --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:48.424200 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:48.510172 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk.config --force-share --output=json" returned: 0 in 0.102s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:00:48.510473 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:48.510728 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "/opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:48.511213 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "/opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:48.511714 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:00:48.512144 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a390b885-c2b5-4116-b7ea-4ad467d6145f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:00:48.512323 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:00:48.512665 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:00:48.512911 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a390b885-c2b5-4116-b7ea-4ad467d6145f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:00:48.523489 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:00:48.523994 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:00:48.524606 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:00:48.524889 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:00:48.525400 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:00:48.525582 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:00:48.541486 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:00:48.541486 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:48.541922 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:00:48.541922 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:48.558776 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f] added
May 28 01:00:48.558776 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:00:48.558776 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:00:48.558776 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:00:48.558776 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:00:48.558776 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:00:48.558776 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:48.559222 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:00:48.559873 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f] added
May 28 01:00:48.559873 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:00:48.559873 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:00:48.559873 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:00:48.559873 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:00:48.559873 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:00:48.559873 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:48.560256 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0352(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:00:48.560495 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:00:48.562616 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:00:48.562616 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0351(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:00:48.562853 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:00:48.676459 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.998721494999927 future=<Future at 0x7c984c6b44d0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:00:48.677301 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Instance destroyed successfully.
May 28 01:00:48.678158 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lazy-loading 'resources' on Instance uuid 0ac8b011-d80b-4dad-a020-a7a59908608f {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:00:48.773386 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:48.773594 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:48.773895 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Attaching volume d15f465c-138e-4c23-9b17-0b08887300f1 to /dev/vdb
May 28 01:00:48.814811 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:00:48.826427 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:00:48.848459 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:00:48.900352 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:00:48.900748 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:00:48.908828 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:00:48.910403 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe75:1c46', 'fe80::8c3:73ff:fe68:9ea1', 'fe80::fc16:3eff:fef0:246e', 'fe80::fc16:3eff:feca:a831', 'fe80::e8d7:d3ff:fe11:4890', 'fe80::fc16:3eff:fe12:3f51', 'fe80::64e0:a4ff:fe34:ffd6', 'fe80::fc16:3eff:fe72:df47', 'fe80::fc16:3eff:fe3e:2329', 'fe80::fc16:3eff:fe28:5665', 'fe80::fc16:3eff:fe8f:58e7', 'fe80::8c50:49ff:fe54:f5d', 'fe80::fc16:3eff:fed8:380', 'fe80::fc16:3eff:fe3a:9b65', 'fe80::fc16:3eff:feab:a032', 'fe80::fc16:3eff:fee0:c149', 'fe80::fc16:3eff:fe1b:8be7', 'fe80::cc9e:aff:fedb:875f', 'fe80::fc16:3eff:fe40:63', 'fe80::8ba:53ff:fe4b:b4ff', 'fe80::fc16:3eff:fedf:9fb0', 'fe80::fc16:3eff:fe9d:9858', 'fe80::fc16:3eff:fee7:febd'] 
May 28 01:00:48.910504 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:00:48.910621 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:00:48.910823 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:00:48.911058 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Updating existing volume attachment record: e2c2489a-5f63-47fb-b6c8-5bdfc2d1fc2d {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:00:48.933117 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e30bf160-0b44-4fae-aafb-106bd4fdead0 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:48.933117 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e30bf160-0b44-4fae-aafb-106bd4fdead0 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:49.181907 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:00:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-779472629',display_name='tempest-TestVolumeBootPattern-server-779472629',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpattern-server-779472629',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:00:46Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='050f928f1ce449d6a447cd343dc4ff80',ramdisk_id='',reservation_id='r-n97kshm5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestVolumeBootPattern-1449742411',owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:00:46Z,user_data=None,user_id='0c803ddeaf4f4b3db07587419087b3b2',uuid=0ac8b011-d80b-4dad-a020-a7a59908608f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cad47b5d-4350-4300-b32b-23b298c89aa6", "address": "fa:16:3e:c1:85:1d", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcad47b5d-43", "ovs_interfaceid": "cad47b5d-4350-4300-b32b-23b298c89aa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:00:49.182151 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converting VIF {"id": "cad47b5d-4350-4300-b32b-23b298c89aa6", "address": "fa:16:3e:c1:85:1d", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcad47b5d-43", "ovs_interfaceid": "cad47b5d-4350-4300-b32b-23b298c89aa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:49.182709 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:85:1d,bridge_name='br-int',has_traffic_filtering=True,id=cad47b5d-4350-4300-b32b-23b298c89aa6,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcad47b5d-43') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:49.182971 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:85:1d,bridge_name='br-int',has_traffic_filtering=True,id=cad47b5d-4350-4300-b32b-23b298c89aa6,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcad47b5d-43') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:00:49.184307 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:49.184637 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcad47b5d-43, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:49.186173 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:49.187604 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:49.188951 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:49.189188 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d0571e66-082d-40b5-a501-29f600b1ae95) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:49.189937 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:49.192094 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:49.192094 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:49.193010 np0000001577 nova-compute[98319]: INFO os_vif [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:85:1d,bridge_name='br-int',has_traffic_filtering=True,id=cad47b5d-4350-4300-b32b-23b298c89aa6,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcad47b5d-43')
May 28 01:00:49.195239 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:00:49.195601 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a', 'iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4690b2ca-c824-422a-9feb-f48b1f047a8a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:00:49.195740 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:00:49.459884 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:00:49.460191 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd15f465c-138e-4c23-9b17-0b08887300f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:00:49.460295 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:00:49.529639 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-eed159ff-09c1-4c35-97b5-7c30db673c33 req-42e32ed5-77b8-4e0c-90f3-7ae6c895b761 service nova] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Received event network-vif-unplugged-cad47b5d-4350-4300-b32b-23b298c89aa6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:49.529857 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-eed159ff-09c1-4c35-97b5-7c30db673c33 req-42e32ed5-77b8-4e0c-90f3-7ae6c895b761 service nova] Acquiring lock "0ac8b011-d80b-4dad-a020-a7a59908608f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:49.530046 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-eed159ff-09c1-4c35-97b5-7c30db673c33 req-42e32ed5-77b8-4e0c-90f3-7ae6c895b761 service nova] Lock "0ac8b011-d80b-4dad-a020-a7a59908608f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:49.530203 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-eed159ff-09c1-4c35-97b5-7c30db673c33 req-42e32ed5-77b8-4e0c-90f3-7ae6c895b761 service nova] Lock "0ac8b011-d80b-4dad-a020-a7a59908608f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:49.535555 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-eed159ff-09c1-4c35-97b5-7c30db673c33 req-42e32ed5-77b8-4e0c-90f3-7ae6c895b761 service nova] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] No waiting events found dispatching network-vif-unplugged-cad47b5d-4350-4300-b32b-23b298c89aa6 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:00:49.535749 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-eed159ff-09c1-4c35-97b5-7c30db673c33 req-42e32ed5-77b8-4e0c-90f3-7ae6c895b761 service nova] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Received event network-vif-unplugged-cad47b5d-4350-4300-b32b-23b298c89aa6 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:00:49.535860 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-eed159ff-09c1-4c35-97b5-7c30db673c33 req-42e32ed5-77b8-4e0c-90f3-7ae6c895b761 service nova] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Received event network-vif-unplugged-cad47b5d-4350-4300-b32b-23b298c89aa6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:49.536043 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-eed159ff-09c1-4c35-97b5-7c30db673c33 req-42e32ed5-77b8-4e0c-90f3-7ae6c895b761 service nova] Acquiring lock "0ac8b011-d80b-4dad-a020-a7a59908608f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:49.536179 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-eed159ff-09c1-4c35-97b5-7c30db673c33 req-42e32ed5-77b8-4e0c-90f3-7ae6c895b761 service nova] Lock "0ac8b011-d80b-4dad-a020-a7a59908608f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:49.536330 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-eed159ff-09c1-4c35-97b5-7c30db673c33 req-42e32ed5-77b8-4e0c-90f3-7ae6c895b761 service nova] Lock "0ac8b011-d80b-4dad-a020-a7a59908608f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:49.536489 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-eed159ff-09c1-4c35-97b5-7c30db673c33 req-42e32ed5-77b8-4e0c-90f3-7ae6c895b761 service nova] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] No waiting events found dispatching network-vif-unplugged-cad47b5d-4350-4300-b32b-23b298c89aa6 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:00:49.536667 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-eed159ff-09c1-4c35-97b5-7c30db673c33 req-42e32ed5-77b8-4e0c-90f3-7ae6c895b761 service nova] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Received event network-vif-unplugged-cad47b5d-4350-4300-b32b-23b298c89aa6 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:00:49.563388 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:00:49.564887 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:00:49.577984 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:00:49.577984 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:00:49.580114 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:00:49.580114 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:49.592194 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:49.600410 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:49.616100 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:49.616100 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:49.616100 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:49.616100 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:49.616100 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:49.616100 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:49.616100 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:49.616100 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:49.616100 np0000001577 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a (non-flash)
May 28 01:00:49.616100 np0000001577 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a (non-flash)
May 28 01:00:49.616100 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:00:49.616542 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:49.616542 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:49.616542 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:49.616542 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:49.616542 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:49.616542 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:49.616542 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:49.616542 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:49.616542 np0000001577 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a (non-flash)
May 28 01:00:49.616542 np0000001577 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a (non-flash)
May 28 01:00:49.616542 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:00:49.621676 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:49.621676 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:49.621676 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:49.621676 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:49.621676 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:49.621676 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:49.621676 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:49.621676 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:49.621676 np0000001577 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a (non-flash)
May 28 01:00:49.621676 np0000001577 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a (non-flash)
May 28 01:00:49.621676 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:00:49.622030 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:49.622030 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:49.622030 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:49.622030 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:49.622030 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:49.622030 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:49.622030 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:49.622030 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:49.622030 np0000001577 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a (non-flash)
May 28 01:00:49.622030 np0000001577 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a (non-flash)
May 28 01:00:49.622030 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:00:49.642114 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e30bf160-0b44-4fae-aafb-106bd4fdead0 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:00:49.642114 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-e30bf160-0b44-4fae-aafb-106bd4fdead0 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:00:49.667953 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f, portal: 192.168.40.100,3260]
May 28 01:00:49.667953 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f, portal: 192.168.40.100,3260] successful.
May 28 01:00:49.667953 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:49.678285 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f, portal: 192.168.50.100,3260]
May 28 01:00:49.678285 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f, portal: 192.168.50.100,3260] successful.
May 28 01:00:49.678285 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:49.682915 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:49.688928 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:49.700884 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:49.700884 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:49.700884 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:49.700884 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:49.700884 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:49.700884 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:49.700884 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:49.700884 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:49.700884 np0000001577 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a (non-flash)
May 28 01:00:49.700884 np0000001577 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a (non-flash)
May 28 01:00:49.700884 np0000001577 nova-compute[98319]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:49.700884 np0000001577 nova-compute[98319]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:49.700884 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:00:49.701242 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:49.701242 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:49.701242 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:49.701242 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:49.701242 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:49.701242 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:49.701242 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:49.701242 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:49.701242 np0000001577 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a (non-flash)
May 28 01:00:49.701242 np0000001577 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a (non-flash)
May 28 01:00:49.701242 np0000001577 nova-compute[98319]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:49.701242 np0000001577 nova-compute[98319]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:49.701242 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:00:49.701500 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:00:49.701500 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:00:49.702817 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] HCTL ('9', '-', '-', 0) found on session 43 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:00:49.702927 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:00:49.712693 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:49.712693 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:49.712693 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:49.712693 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:49.712693 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:49.712693 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:49.712693 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:49.712693 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:49.712693 np0000001577 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a (non-flash)
May 28 01:00:49.712693 np0000001577 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a (non-flash)
May 28 01:00:49.712693 np0000001577 nova-compute[98319]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:49.712693 np0000001577 nova-compute[98319]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:49.712693 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:00:49.713051 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:49.713051 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:49.713051 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:49.713051 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:49.713051 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:49.713051 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:49.713051 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:49.713051 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:49.713051 np0000001577 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a (non-flash)
May 28 01:00:49.713051 np0000001577 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a (non-flash)
May 28 01:00:49.713051 np0000001577 nova-compute[98319]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:49.713051 np0000001577 nova-compute[98319]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:49.713051 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:00:49.713396 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.188s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:00:49.713396 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:00:49.715257 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] HCTL ('10', '-', '-', 0) found on session 44 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:00:49.715257 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:00:49.722065 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Searching for a device in session 43 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:00:49.722065 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a390b885-c2b5-4116-b7ea-4ad467d6145f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:00:49.730052 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Searching for a device in session 44 and hctl ['10', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:00:50.147331 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-e30bf160-0b44-4fae-aafb-106bd4fdead0 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:00:50.655611 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e30bf160-0b44-4fae-aafb-106bd4fdead0 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.723s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:50.716364 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-e30bf160-0b44-4fae-aafb-106bd4fdead0 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Deleted allocations for instance 6cb44d19-8ed5-4c83-aedd-5fa187c05b00
May 28 01:00:50.730195 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Searching for a device in session 44 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:00:50.730320 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a390b885-c2b5-4116-b7ea-4ad467d6145f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:00:51.048024 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:51.541311 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Found WWN 33000000018e747c1 for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:00:51.541678 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:00:51.541678 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] <== connect_volume: return (3028ms) {'type': 'block', 'scsi_wwn': '33000000018e747c1', 'path': '/dev/dm-1', 'multipath_id': '33000000018e747c1'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:00:51.541800 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000018e747c1', 'path': '/dev/dm-1', 'multipath_id': '33000000018e747c1'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:00:51.542451 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.347s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:00:51.542890 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a', 'iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4690b2ca-c824-422a-9feb-f48b1f047a8a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:00:51.543068 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:00:51.572063 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:51.572063 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:51.572063 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:51.572063 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:51.572063 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:51.572063 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:51.572063 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:51.572063 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:51.572063 np0000001577 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a (non-flash)
May 28 01:00:51.572063 np0000001577 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a (non-flash)
May 28 01:00:51.572063 np0000001577 nova-compute[98319]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:51.572063 np0000001577 nova-compute[98319]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:51.572063 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:00:51.572449 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:51.572449 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:51.572449 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:51.572449 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:51.572449 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:51.572449 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:51.572449 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:51.572449 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:51.572449 np0000001577 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a (non-flash)
May 28 01:00:51.572449 np0000001577 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a (non-flash)
May 28 01:00:51.572449 np0000001577 nova-compute[98319]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:51.572449 np0000001577 nova-compute[98319]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:51.572449 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:00:51.572449 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a', '41'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', '43'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', '44')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:00:51.572449 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a', '42')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:00:51.573512 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a', '41')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:00:51.574529 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c98704da700>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a'): ({'sdk'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:00:51.574760 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Removing multipathed devices sdk, sdl {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:00:51.574983 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Flush multipath device 33000000076fa1048 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:00:51.605805 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:00:51.656426 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:00:51.695821 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Checking to see if SCSI volumes sdk, sdl have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:00:51.695989 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] SCSI volumes sdk, sdl have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:00:51.697141 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Checking to see if device paths {'sdk', 'sdl'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:00:51.709044 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Device paths {'sdk', 'sdl'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:00:51.709244 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:00:51.722731 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:51.727375 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e30bf160-0b44-4fae-aafb-106bd4fdead0 tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Lock "6cb44d19-8ed5-4c83-aedd-5fa187c05b00" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.687s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:51.763796 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a, portal: 192.168.40.100,3260]
May 28 01:00:51.763796 np0000001577 nova-compute[98319]: Logout of [sid: 42, target: iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a, portal: 192.168.40.100,3260] successful.
May 28 01:00:51.763796 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:51.793164 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:51.805469 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:51.852752 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a, portal: 192.168.50.100,3260]
May 28 01:00:51.852752 np0000001577 nova-compute[98319]: Logout of [sid: 41, target: iqn.2023-03.storpool.com:os--volume-4690b2ca-c824-422a-9feb-f48b1f047a8a, portal: 192.168.50.100,3260] successful.
May 28 01:00:51.852752 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:51.873510 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:51.874897 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:00:51.875035 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] <== disconnect_volume: return (2679ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:00:51.875169 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:00:51.875774 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.415s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:00:51.876109 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd15f465c-138e-4c23-9b17-0b08887300f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:00:51.876500 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Deleting instance files /opt/stack/data/nova/instances/0ac8b011-d80b-4dad-a020-a7a59908608f_del
May 28 01:00:51.877027 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Deletion of /opt/stack/data/nova/instances/0ac8b011-d80b-4dad-a020-a7a59908608f_del complete
May 28 01:00:51.887713 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:00:51.888381 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:00:51.889610 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:00:51.889805 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:00:51.890653 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:00:51.890833 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:00:51.903857 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:00:51.903857 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:51.916609 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:00:51.916609 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:51.917170 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1] added
May 28 01:00:51.917170 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:00:51.917170 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:00:51.917170 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:00:51.917170 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:00:51.917170 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:00:51.917170 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:51.917307 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:00:51.917467 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0276(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:00:51.917863 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:00:51.929462 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1] added
May 28 01:00:51.929462 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:00:51.929462 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:00:51.929462 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:00:51.929462 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:00:51.929462 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:00:51.929462 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:51.929950 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:00:51.929950 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0389(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:00:51.929950 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:00:52.047639 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-126815204',display_name='tempest-ServerActionsTestOtherB-server-126815204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001577',hostname='tempest-serveractionstestotherb-server-126815204',id=17,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHowHxSKo/GbZ3/T/DuqsFzaBQyor5k7f+0IXzkeGeXUAEkx6L+ijA0U/nuHnUHla5vZzHw/uAJ60OyJL0qlD41uqiYRDGnW+sKtXyVuDHBRaZp3vxryet5baLwLYdDdtg==',key_name='tempest-keypair-1717835047',keypairs=<?>,launch_index=0,launched_at=2026-05-28T00:59:33Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001577',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='78d410e4c6ea40ef87f92e84f362fa43',ramdisk_id='',reservation_id='r-6x23ytl1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-243435399',owner_user_name='tempest-ServerActionsTestOtherB-243435399-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:00:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c45fdc9fb964707b5e02c1b5c0ff1d8',uuid=2d2183ad-dbdb-4525-b678-39b72c7ab85d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d344ede-14be-4d59-b796-097c682389f9", "address": "fa:16:3e:bd:1f:a1", "network": {"id": "8dc9ea08-c48e-4321-b325-d1191e9557b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1143389599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1143389599-network", "vif_mac": "fa:16:3e:bd:1f:a1"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78d410e4c6ea40ef87f92e84f362fa43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d344ede-14", "ovs_interfaceid": "0d344ede-14be-4d59-b796-097c682389f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:00:52.047818 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Converting VIF {"id": "0d344ede-14be-4d59-b796-097c682389f9", "address": "fa:16:3e:bd:1f:a1", "network": {"id": "8dc9ea08-c48e-4321-b325-d1191e9557b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1143389599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1143389599-network", "vif_mac": "fa:16:3e:bd:1f:a1"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78d410e4c6ea40ef87f92e84f362fa43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d344ede-14", "ovs_interfaceid": "0d344ede-14be-4d59-b796-097c682389f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:52.048218 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:1f:a1,bridge_name='br-int',has_traffic_filtering=True,id=0d344ede-14be-4d59-b796-097c682389f9,network=Network(8dc9ea08-c48e-4321-b325-d1191e9557b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d344ede-14') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:52.049584 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] End _get_guest_xml xml=<domain type="qemu">
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:   <uuid>2d2183ad-dbdb-4525-b678-39b72c7ab85d</uuid>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:   <name>instance-00000011</name>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:   <memory>262144</memory>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <nova:name>tempest-ServerActionsTestOtherB-server-126815204</nova:name>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:00:48</nova:creationTime>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.micro" id="84">
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:         <nova:memory>256</nova:memory>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:         <nova:user uuid="2c45fdc9fb964707b5e02c1b5c0ff1d8">tempest-ServerActionsTestOtherB-243435399-project-member</nova:user>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:         <nova:project uuid="78d410e4c6ea40ef87f92e84f362fa43">tempest-ServerActionsTestOtherB-243435399</nova:project>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:         <nova:port uuid="0d344ede-14be-4d59-b796-097c682389f9">
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:     <system>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <entry name="serial">2d2183ad-dbdb-4525-b678-39b72c7ab85d</entry>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <entry name="uuid">2d2183ad-dbdb-4525-b678-39b72c7ab85d</entry>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:     </system>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:   <os>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:   </os>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:   <features>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:   </features>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:   <devices>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk"/>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:     </disk>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk.config"/>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:     </disk>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <alias name="ua-a390b885-c2b5-4116-b7ea-4ad467d6145f"/>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-1"/>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <serial>a390b885-c2b5-4116-b7ea-4ad467d6145f</serial>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:     </disk>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:bd:1f:a1"/>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <target dev="tap0d344ede-14"/>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:     </interface>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/console.log" append="off"/>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:     </serial>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:     <video>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:     </video>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:     </rng>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:   </devices>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]: </domain>
May 28 01:00:52.049584 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:00:52.052819 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-126815204',display_name='tempest-ServerActionsTestOtherB-server-126815204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001577',hostname='tempest-serveractionstestotherb-server-126815204',id=17,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHowHxSKo/GbZ3/T/DuqsFzaBQyor5k7f+0IXzkeGeXUAEkx6L+ijA0U/nuHnUHla5vZzHw/uAJ60OyJL0qlD41uqiYRDGnW+sKtXyVuDHBRaZp3vxryet5baLwLYdDdtg==',key_name='tempest-keypair-1717835047',keypairs=<?>,launch_index=0,launched_at=2026-05-28T00:59:33Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001577',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='78d410e4c6ea40ef87f92e84f362fa43',ramdisk_id='',reservation_id='r-6x23ytl1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-243435399',owner_user_name='tempest-ServerActionsTestOtherB-243435399-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:00:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c45fdc9fb964707b5e02c1b5c0ff1d8',uuid=2d2183ad-dbdb-4525-b678-39b72c7ab85d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d344ede-14be-4d59-b796-097c682389f9", "address": "fa:16:3e:bd:1f:a1", "network": {"id": "8dc9ea08-c48e-4321-b325-d1191e9557b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1143389599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1143389599-network", "vif_mac": "fa:16:3e:bd:1f:a1"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78d410e4c6ea40ef87f92e84f362fa43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d344ede-14", "ovs_interfaceid": "0d344ede-14be-4d59-b796-097c682389f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:00:52.052819 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Converting VIF {"id": "0d344ede-14be-4d59-b796-097c682389f9", "address": "fa:16:3e:bd:1f:a1", "network": {"id": "8dc9ea08-c48e-4321-b325-d1191e9557b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1143389599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1143389599-network", "vif_mac": "fa:16:3e:bd:1f:a1"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78d410e4c6ea40ef87f92e84f362fa43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d344ede-14", "ovs_interfaceid": "0d344ede-14be-4d59-b796-097c682389f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:00:52.052819 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:1f:a1,bridge_name='br-int',has_traffic_filtering=True,id=0d344ede-14be-4d59-b796-097c682389f9,network=Network(8dc9ea08-c48e-4321-b325-d1191e9557b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d344ede-14') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:00:52.052819 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:1f:a1,bridge_name='br-int',has_traffic_filtering=True,id=0d344ede-14be-4d59-b796-097c682389f9,network=Network(8dc9ea08-c48e-4321-b325-d1191e9557b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d344ede-14') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:00:52.052819 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:52.053184 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:52.053326 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:00:52.054791 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:52.054977 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ace69347-2c6a-537b-ace2-983b15e1e242', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:52.063462 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:52.064608 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:52.066375 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:52.069184 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:52.069402 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d344ede-14, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:52.069940 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0d344ede-14, col_values=(('qos', UUID('dc21c4d5-9283-47fb-8032-ab08f6a75ecf')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:52.070317 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0d344ede-14, col_values=(('external_ids', {'iface-id': '0d344ede-14be-4d59-b796-097c682389f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:1f:a1', 'vm-uuid': '2d2183ad-dbdb-4525-b678-39b72c7ab85d'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:00:52.071312 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:52.072855 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:00:52.078247 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:52.079478 np0000001577 nova-compute[98319]: INFO os_vif [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:1f:a1,bridge_name='br-int',has_traffic_filtering=True,id=0d344ede-14be-4d59-b796-097c682389f9,network=Network(8dc9ea08-c48e-4321-b325-d1191e9557b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d344ede-14')
May 28 01:00:52.385229 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Took 4.06 seconds to destroy the instance on the hypervisor.
May 28 01:00:52.385933 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:00:52.386145 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:00:52.386325 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:00:52.386623 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:52.525534 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:52.823705 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-472e9a9c-440d-449f-a785-3899ed109cea req-902797bf-0e7a-48b2-a851-fcd16425d490 service nova] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Received event network-vif-deleted-cad47b5d-4350-4300-b32b-23b298c89aa6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:52.824628 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-472e9a9c-440d-449f-a785-3899ed109cea req-902797bf-0e7a-48b2-a851-fcd16425d490 service nova] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Neutron deleted interface cad47b5d-4350-4300-b32b-23b298c89aa6; detaching it from the instance and deleting it from the info cache
May 28 01:00:52.825587 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-472e9a9c-440d-449f-a785-3899ed109cea req-902797bf-0e7a-48b2-a851-fcd16425d490 service nova] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Detach interface failed, port_id=cad47b5d-4350-4300-b32b-23b298c89aa6, reason: Instance 0ac8b011-d80b-4dad-a020-a7a59908608f could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:00:52.918265 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:00:52.930429 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:00:52.936819 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:00:52.936819 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:00:52.946030 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:00:52.946030 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:52.954218 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:52.960803 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:52.982042 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:52.982042 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:52.982042 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:52.982042 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:52.982042 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:52.982042 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:52.982042 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:52.982042 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:52.982042 np0000001577 nova-compute[98319]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:52.982042 np0000001577 nova-compute[98319]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:52.982042 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:00:52.982304 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:52.982304 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:52.982304 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:52.982304 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:52.982304 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:52.982304 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:52.982304 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:52.982304 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:52.982304 np0000001577 nova-compute[98319]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:52.982304 np0000001577 nova-compute[98319]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:52.982304 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:00:52.982598 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:52.982598 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:52.982598 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:52.982598 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:52.982598 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:52.982598 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:52.982598 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:52.982598 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:52.982598 np0000001577 nova-compute[98319]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:52.982598 np0000001577 nova-compute[98319]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:52.982598 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:00:52.983327 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:52.983327 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:52.983327 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:52.983327 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:52.983327 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:52.983327 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:52.983327 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:52.983327 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:52.983327 np0000001577 nova-compute[98319]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:52.983327 np0000001577 nova-compute[98319]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:52.983327 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:00:53.025077 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1, portal: 192.168.40.100,3260]
May 28 01:00:53.025077 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1, portal: 192.168.40.100,3260] successful.
May 28 01:00:53.025077 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:53.031963 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1, portal: 192.168.50.100,3260]
May 28 01:00:53.031963 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1, portal: 192.168.50.100,3260] successful.
May 28 01:00:53.031963 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:53.037717 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:53.045376 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:00:53.061567 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:53.061567 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:53.061567 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:53.061567 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:53.061567 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:53.061567 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:53.061567 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:53.061567 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:53.061567 np0000001577 nova-compute[98319]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:53.061567 np0000001577 nova-compute[98319]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:53.061567 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:00:53.061567 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:00:53.061567 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:00:53.062171 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:53.062171 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:53.062171 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:53.062171 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:53.062171 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:53.062171 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:53.062171 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:53.062171 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:53.062171 np0000001577 nova-compute[98319]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:53.062171 np0000001577 nova-compute[98319]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:53.062171 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:00:53.062171 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:00:53.062171 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:00:53.062171 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:00:53.062171 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:00:53.063352 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] HCTL ('15', '-', '-', 0) found on session 45 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:00:53.063459 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:00:53.066088 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:53.066088 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:53.066088 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:53.066088 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:53.066088 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:53.066088 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:53.066088 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:53.066088 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:53.066088 np0000001577 nova-compute[98319]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:53.066088 np0000001577 nova-compute[98319]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:53.066088 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:00:53.066088 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:00:53.066088 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:00:53.066529 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:53.066529 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:00:53.066529 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:53.066529 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:00:53.066529 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:53.066529 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:00:53.066529 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:53.066529 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:00:53.066529 np0000001577 nova-compute[98319]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:53.066529 np0000001577 nova-compute[98319]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:00:53.066529 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:00:53.066529 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:00:53.066529 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:00:53.066529 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.176s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:00:53.066529 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:00:53.067498 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] HCTL ('16', '-', '-', 0) found on session 46 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:00:53.067633 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:00:53.086349 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Searching for a device in session 45 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:00:53.086349 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd15f465c-138e-4c23-9b17-0b08887300f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:00:53.086349 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Searching for a device in session 46 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:00:53.086349 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd15f465c-138e-4c23-9b17-0b08887300f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:00:53.281503 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:00:53.553967 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:53.597442 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:00:53.597580 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:00:53.597682 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:00:53.597814 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] No VIF found with MAC fa:16:3e:bd:1f:a1, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:00:53.598274 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Using config drive
May 28 01:00:53.783501 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Took 1.40 seconds to deallocate network for instance.
May 28 01:00:53.889589 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:00:54.027376 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:54.065771 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:54.156342 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:54.296532 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ce2a0e69-e969-4ac5-b3f1-27005bf9c589 req-1b13e80a-2f68-4d18-a092-cf9bf20c2603 service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Received event network-vif-plugged-0d344ede-14be-4d59-b796-097c682389f9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:54.297350 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ce2a0e69-e969-4ac5-b3f1-27005bf9c589 req-1b13e80a-2f68-4d18-a092-cf9bf20c2603 service nova] Acquiring lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:54.297758 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ce2a0e69-e969-4ac5-b3f1-27005bf9c589 req-1b13e80a-2f68-4d18-a092-cf9bf20c2603 service nova] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:54.298160 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ce2a0e69-e969-4ac5-b3f1-27005bf9c589 req-1b13e80a-2f68-4d18-a092-cf9bf20c2603 service nova] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:54.298587 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ce2a0e69-e969-4ac5-b3f1-27005bf9c589 req-1b13e80a-2f68-4d18-a092-cf9bf20c2603 service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] No waiting events found dispatching network-vif-plugged-0d344ede-14be-4d59-b796-097c682389f9 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:00:54.299131 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-ce2a0e69-e969-4ac5-b3f1-27005bf9c589 req-1b13e80a-2f68-4d18-a092-cf9bf20c2603 service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Received unexpected event network-vif-plugged-0d344ede-14be-4d59-b796-097c682389f9 for instance with vm_state active and task_state resize_finish.
May 28 01:00:54.339423 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Took 0.55 seconds to detach 1 volumes for instance.
May 28 01:00:54.413179 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:54.440391 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:54.847755 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:54.847755 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:54.915799 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Found WWN 330000000d00ec62f for multipath device dm-6 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:00:54.916206 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:00:54.916337 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] <== connect_volume: return (5455ms) {'type': 'block', 'scsi_wwn': '330000000d00ec62f', 'path': '/dev/dm-6', 'multipath_id': '330000000d00ec62f'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:00:54.916519 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d00ec62f', 'path': '/dev/dm-6', 'multipath_id': '330000000d00ec62f'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:00:54.922370 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lazy-loading 'flavor' on Instance uuid d87bb95b-a1e9-4786-8bee-16f2cfaabf2d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:00:54.938669 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Removed pending STOPPED event for 2d2183ad-dbdb-4525-b678-39b72c7ab85d due to new event <LifecycleEvent: 1779930054.9382102, 2d2183ad-dbdb-4525-b678-39b72c7ab85d => Resumed> {{(pid=98319) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 01:00:54.939029 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930054.9382102, 2d2183ad-dbdb-4525-b678-39b72c7ab85d => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:00:54.939233 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] VM Resumed (Lifecycle Event)
May 28 01:00:54.945720 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Instance event wait completed in 0 seconds for  {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:00:54.954914 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Instance running successfully.
May 28 01:00:54.955922 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Failed to set time: agent not configured {{(pid=98319) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 28 01:00:54.956144 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b9e66679-7eeb-40f1-94bd-3cc7be2ac215 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] finish_migration finished successfully. {{(pid=98319) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 28 01:00:55.425818 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Attempting to attach volume d15f465c-138e-4c23-9b17-0b08887300f1 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:00:55.427534 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:00:55.427534 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:00:55.427534 np0000001577 nova-compute[98319]:   <alias name="ua-d15f465c-138e-4c23-9b17-0b08887300f1"/>
May 28 01:00:55.427534 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-6"/>
May 28 01:00:55.427534 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:00:55.427534 np0000001577 nova-compute[98319]:   <serial>d15f465c-138e-4c23-9b17-0b08887300f1</serial>
May 28 01:00:55.427534 np0000001577 nova-compute[98319]:   <shareable/>
May 28 01:00:55.427534 np0000001577 nova-compute[98319]: </disk>
May 28 01:00:55.427534 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:00:55.454391 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:55.458434 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:00:55.683266 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:00:55.683447 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:00:55.961677 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 28 01:00:55.961677 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930055.9614818, 2d2183ad-dbdb-4525-b678-39b72c7ab85d => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:00:55.962076 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] VM Started (Lifecycle Event)
May 28 01:00:56.018340 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0004192979999970703 future=<Future at 0x7c984c674110 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:00:56.020370 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:00:56.020370 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=6.612914940999872 future=<Future at 0x7c984c6b5790 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:00:56.020370 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=6.61279553899999 future=<Future at 0x7c984c6b5790 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:00:56.053992 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:56.162192 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:00:56.186625 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:00:56.435895 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8863187d-868a-4cdb-9618-3e80cee627cd req-4a948700-d11e-4bd8-8efc-905b568fde6d service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Received event network-vif-plugged-0d344ede-14be-4d59-b796-097c682389f9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:00:56.436332 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8863187d-868a-4cdb-9618-3e80cee627cd req-4a948700-d11e-4bd8-8efc-905b568fde6d service nova] Acquiring lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:56.436477 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8863187d-868a-4cdb-9618-3e80cee627cd req-4a948700-d11e-4bd8-8efc-905b568fde6d service nova] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:56.436569 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8863187d-868a-4cdb-9618-3e80cee627cd req-4a948700-d11e-4bd8-8efc-905b568fde6d service nova] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:56.436705 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8863187d-868a-4cdb-9618-3e80cee627cd req-4a948700-d11e-4bd8-8efc-905b568fde6d service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] No waiting events found dispatching network-vif-plugged-0d344ede-14be-4d59-b796-097c682389f9 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:00:56.436836 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-8863187d-868a-4cdb-9618-3e80cee627cd req-4a948700-d11e-4bd8-8efc-905b568fde6d service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Received unexpected event network-vif-plugged-0d344ede-14be-4d59-b796-097c682389f9 for instance with vm_state resized and task_state resize_reverting.
May 28 01:00:56.464337 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:00:56.466113 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:00:56.699779 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.852s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:56.757334 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Deleted allocations for instance 0ac8b011-d80b-4dad-a020-a7a59908608f
May 28 01:00:56.870808 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:56.968336 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] During sync_power_state the instance has a pending task (resize_reverting). Skip.
May 28 01:00:57.061631 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:57.061921 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:57.062116 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:57.072193 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:57.091567 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:00:57.091704 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:00:57.091815 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:00:57.091911 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No VIF found with MAC fa:16:3e:28:56:65, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:00:57.129612 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Port 0d344ede-14be-4d59-b796-097c682389f9 binding to destination host np0000001577 is already ACTIVE {{(pid=98319) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 01:00:57.129816 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "refresh_cache-2d2183ad-dbdb-4525-b678-39b72c7ab85d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:00:57.129884 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquired lock "refresh_cache-2d2183ad-dbdb-4525-b678-39b72c7ab85d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:00:57.130044 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:00:57.634626 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:57.787146 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fa785273-c35e-4a8a-9d3c-30b2cbcaade5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "0ac8b011-d80b-4dad-a020-a7a59908608f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.969s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:57.815762 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:58.163314 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:00:58.337942 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Updating instance_info_cache with network_info: [{"id": "0d344ede-14be-4d59-b796-097c682389f9", "address": "fa:16:3e:bd:1f:a1", "network": {"id": "8dc9ea08-c48e-4321-b325-d1191e9557b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1143389599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78d410e4c6ea40ef87f92e84f362fa43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d344ede-14", "ovs_interfaceid": "0d344ede-14be-4d59-b796-097c682389f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:00:58.665971 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7762049a-25af-4c16-81df-7ce5f0270f2c tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.892s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:00:58.840019 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Releasing lock "refresh_cache-2d2183ad-dbdb-4525-b678-39b72c7ab85d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:00:59.297166 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "04880ef4-5eee-4221-ad42-29788eb26358" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:00:59.298066 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "04880ef4-5eee-4221-ad42-29788eb26358" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:00:59.343971 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Creating tmpfile /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/tmphajuoyes to verify with other compute node that the instance is on the same shared storage. {{(pid=98319) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10552}}
May 28 01:00:59.344240 np0000001577 nova-compute[98319]: DEBUG nova.compute.rpcapi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98319) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 01:00:59.801165 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lazy-loading 'flavor' on Instance uuid 04880ef4-5eee-4221-ad42-29788eb26358 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:00:59.882694 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:59.901610 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:59.906246 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:59.926827 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:00:59.933041 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:00.140765 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:00.155455 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:00.184852 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999703288999854 future=<Future at 0x7c984c511f70 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:00.186628 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Instance destroyed successfully.
May 28 01:01:00.187176 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lazy-loading 'resources' on Instance uuid 2d2183ad-dbdb-4525-b678-39b72c7ab85d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:01:00.200568 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:00.691467 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-126815204',display_name='tempest-ServerActionsTestOtherB-server-126815204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001577',hostname='tempest-serveractionstestotherb-server-126815204',id=17,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHowHxSKo/GbZ3/T/DuqsFzaBQyor5k7f+0IXzkeGeXUAEkx6L+ijA0U/nuHnUHla5vZzHw/uAJ60OyJL0qlD41uqiYRDGnW+sKtXyVuDHBRaZp3vxryet5baLwLYdDdtg==',key_name='tempest-keypair-1717835047',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:00:55Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=Flavor(12),node='np0000001577',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='78d410e4c6ea40ef87f92e84f362fa43',ramdisk_id='',reservation_id='r-6x23ytl1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-243435399',owner_user_name='tempest-ServerActionsTestOtherB-243435399-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:00:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c45fdc9fb964707b5e02c1b5c0ff1d8',uuid=2d2183ad-dbdb-4525-b678-39b72c7ab85d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "0d344ede-14be-4d59-b796-097c682389f9", "address": "fa:16:3e:bd:1f:a1", "network": {"id": "8dc9ea08-c48e-4321-b325-d1191e9557b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1143389599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78d410e4c6ea40ef87f92e84f362fa43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d344ede-14", "ovs_interfaceid": "0d344ede-14be-4d59-b796-097c682389f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:01:00.692065 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Converting VIF {"id": "0d344ede-14be-4d59-b796-097c682389f9", "address": "fa:16:3e:bd:1f:a1", "network": {"id": "8dc9ea08-c48e-4321-b325-d1191e9557b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1143389599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78d410e4c6ea40ef87f92e84f362fa43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d344ede-14", "ovs_interfaceid": "0d344ede-14be-4d59-b796-097c682389f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:01:00.692215 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:1f:a1,bridge_name='br-int',has_traffic_filtering=True,id=0d344ede-14be-4d59-b796-097c682389f9,network=Network(8dc9ea08-c48e-4321-b325-d1191e9557b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d344ede-14') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:01:00.692409 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:1f:a1,bridge_name='br-int',has_traffic_filtering=True,id=0d344ede-14be-4d59-b796-097c682389f9,network=Network(8dc9ea08-c48e-4321-b325-d1191e9557b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d344ede-14') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:01:00.697182 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:00.697390 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d344ede-14, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:00.698516 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:00.699107 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:00.700354 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:00.701996 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:00.702149 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc21c4d5-9283-47fb-8032-ab08f6a75ecf) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:00.702611 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:00.703715 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:00.709098 np0000001577 nova-compute[98319]: INFO os_vif [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:1f:a1,bridge_name='br-int',has_traffic_filtering=True,id=0d344ede-14be-4d59-b796-097c682389f9,network=Network(8dc9ea08-c48e-4321-b325-d1191e9557b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d344ede-14')
May 28 01:01:00.712231 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:01:00.712484 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a390b885-c2b5-4116-b7ea-4ad467d6145f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:01:00.712600 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:01:00.712901 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:01:00.713166 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a390b885-c2b5-4116-b7ea-4ad467d6145f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:01:00.713275 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:01:00.749276 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:00.749276 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:00.749276 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:00.749276 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:00.749276 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:00.749276 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:00.749276 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:00.749276 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:00.749276 np0000001577 nova-compute[98319]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:00.749276 np0000001577 nova-compute[98319]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:00.749276 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:00.749276 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:00.749276 np0000001577 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbc7d1f-4e79-4039-b27a-4c6e489d7bb4 (non-flash)
May 28 01:01:00.749276 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:01:00.749725 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:00.749725 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:00.749725 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:00.749725 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:00.749725 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:00.749725 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:00.749725 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:00.749725 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:00.749725 np0000001577 nova-compute[98319]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:00.749725 np0000001577 nova-compute[98319]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:00.749725 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:00.749725 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:00.749725 np0000001577 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbc7d1f-4e79-4039-b27a-4c6e489d7bb4 (non-flash)
May 28 01:01:00.749725 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:01:00.749725 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', '43'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8bbc7d1f-4e79-4039-b27a-4c6e489d7bb4', '47')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:01:00.749725 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', '43')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:01:00.750664 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', '44')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:01:00.751598 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c98704daf20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f'): ({'sde'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:01:00.751772 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Removing multipathed devices sde, sdd {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:01:00.752063 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Flush multipath device 33000000018e747c1 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:01:00.793419 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:01:00.810251 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "04880ef4-5eee-4221-ad42-29788eb26358" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:00.842569 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:01:00.901066 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:01:00.901227 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:01:00.902403 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:01:00.914001 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:01:00.914183 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:01:00.927725 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:00.968848 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f, portal: 192.168.40.100,3260]
May 28 01:01:00.968848 np0000001577 nova-compute[98319]: Logout of [sid: 43, target: iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f, portal: 192.168.40.100,3260] successful.
May 28 01:01:00.968848 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:00.988689 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:01.000804 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:01.038101 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f, portal: 192.168.50.100,3260]
May 28 01:01:01.038101 np0000001577 nova-compute[98319]: Logout of [sid: 44, target: iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f, portal: 192.168.50.100,3260] successful.
May 28 01:01:01.038101 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:01.054497 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:01.064755 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:01.065058 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:01:01.065197 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] <== disconnect_volume: return (352ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:01:01.065319 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:01:01.875834 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "04880ef4-5eee-4221-ad42-29788eb26358" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:01.876111 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "04880ef4-5eee-4221-ad42-29788eb26358" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:01.876358 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Attaching volume d15f465c-138e-4c23-9b17-0b08887300f1 to /dev/vdb
May 28 01:01:01.919185 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:01:01.931839 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:01:01.953423 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:01.989571 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "dc47e3bc-028d-4166-b702-91cbbd62f80e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:01.989974 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "dc47e3bc-028d-4166-b702-91cbbd62f80e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:02.002981 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:01:02.003481 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:01:02.011247 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:01:02.012857 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe75:1c46', 'fe80::8c3:73ff:fe68:9ea1', 'fe80::fc16:3eff:fef0:246e', 'fe80::fc16:3eff:feca:a831', 'fe80::e8d7:d3ff:fe11:4890', 'fe80::fc16:3eff:fe12:3f51', 'fe80::64e0:a4ff:fe34:ffd6', 'fe80::fc16:3eff:fe72:df47', 'fe80::fc16:3eff:fe3e:2329', 'fe80::fc16:3eff:fe28:5665', 'fe80::fc16:3eff:fe8f:58e7', 'fe80::8c50:49ff:fe54:f5d', 'fe80::fc16:3eff:fed8:380', 'fe80::fc16:3eff:fe3a:9b65', 'fe80::fc16:3eff:feab:a032', 'fe80::fc16:3eff:fee0:c149', 'fe80::fc16:3eff:fe1b:8be7', 'fe80::cc9e:aff:fedb:875f', 'fe80::fc16:3eff:fe40:63', 'fe80::8ba:53ff:fe4b:b4ff', 'fe80::fc16:3eff:fedf:9fb0', 'fe80::fc16:3eff:fe9d:9858', 'fe80::fc16:3eff:fee7:febd'] 
May 28 01:01:02.013091 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:01:02.013091 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:01:02.013351 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] <== get_connector_properties: return (93ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:01:02.013602 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Updating existing volume attachment record: ef7342a4-593c-4646-baf9-6dacd2a61f79 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:01:02.203428 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:02.203631 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:02.493586 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:01:02.570771 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:01:02.571063 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd15f465c-138e-4c23-9b17-0b08887300f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:01:02.571287 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:01:02.571733 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:01:02.572018 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd15f465c-138e-4c23-9b17-0b08887300f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:01:02.584943 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:01:02.588626 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:01:02.589107 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:01:02.589527 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:01:02.589729 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:01:02.589945 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.startup = automatic
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.session.scan = manual
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:01:02.601195 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:01:02.601195 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.startup = automatic
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.session.scan = manual
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:01:02.609030 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:01:02.609030 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:02.613645 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:02.622082 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:02.632914 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0013653030000568833 future=<Future at 0x7c984c6b5790 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:02.633727 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Emitting event <LifecycleEvent: 1779930047.6314235, 6cb44d19-8ed5-4c83-aedd-5fa187c05b00 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:01:02.633866 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] VM Stopped (Lifecycle Event)
May 28 01:01:02.635006 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:02.635149 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=1.0400062579999485 future=<Future at 0x7c984c6b44d0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:02.635245 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=1.039899529999957 future=<Future at 0x7c984c6b44d0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:02.636332 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:02.636332 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:02.636332 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:02.636332 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:02.636332 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:02.636332 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:02.636332 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:02.636332 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:02.636332 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:02.636332 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:02.636332 np0000001577 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbc7d1f-4e79-4039-b27a-4c6e489d7bb4 (non-flash)
May 28 01:01:02.636332 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:01:02.636704 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:02.636704 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:02.636704 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:02.636704 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:02.636704 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:02.636704 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:02.636704 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:02.636704 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:02.636704 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:02.636704 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:02.636704 np0000001577 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbc7d1f-4e79-4039-b27a-4c6e489d7bb4 (non-flash)
May 28 01:01:02.636704 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:01:02.636976 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.047s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:01:02.636976 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:01:02.637504 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] HCTL ('15', '0', '0', 0) found on session 45 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:01:02.637639 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Scanning host 15 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:01:02.646350 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:02.646350 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:02.646350 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:02.646350 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:02.646350 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:02.646350 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:02.646350 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:02.646350 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:02.646350 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:02.646350 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:02.646350 np0000001577 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbc7d1f-4e79-4039-b27a-4c6e489d7bb4 (non-flash)
May 28 01:01:02.646350 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:01:02.646350 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:02.646350 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:02.646350 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:02.646350 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:02.646350 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:02.646350 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:02.646350 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:02.646350 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:02.646350 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:02.646350 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:02.646350 np0000001577 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8bbc7d1f-4e79-4039-b27a-4c6e489d7bb4 (non-flash)
May 28 01:01:02.646350 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:01:02.646350 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.057s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:01:02.646350 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:01:02.647572 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] HCTL ('16', '0', '0', 0) found on session 46 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:01:02.647964 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Scanning host 16 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:01:02.649459 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Searching for a device in session 45 and hctl ('15', '0', '0', 0) yield: sdj {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:01:02.649613 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd15f465c-138e-4c23-9b17-0b08887300f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:01:02.662245 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Searching for a device in session 46 and hctl ('16', '0', '0', 0) yield: sdk {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:01:02.662245 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd15f465c-138e-4c23-9b17-0b08887300f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:01:02.706062 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lazy-loading 'migration_context' on Instance uuid 2d2183ad-dbdb-4525-b678-39b72c7ab85d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:01:03.041001 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:03.136811 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 6cb44d19-8ed5-4c83-aedd-5fa187c05b00] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:03.185568 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "03f1821a-592e-4e02-b609-74f3d7e69b53" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:03.185725 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "03f1821a-592e-4e02-b609-74f3d7e69b53" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:03.208065 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Object Instance<2d2183ad-dbdb-4525-b678-39b72c7ab85d> lazy-loaded attributes: resources,migration_context {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:01:03.589760 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:01:03.675655 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0004722940000192466 future=<Future at 0x7c984c6b44d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:03.675886 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:03.676001 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=11.508531362999975 future=<Future at 0x7c984c511f70 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:03.676076 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=11.508445173999917 future=<Future at 0x7c984c511f70 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:03.676446 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Emitting event <LifecycleEvent: 1779930048.6750708, 0ac8b011-d80b-4dad-a020-a7a59908608f => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:01:03.677684 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] VM Stopped (Lifecycle Event)
May 28 01:01:03.687622 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:01:03.889851 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:01:03.890055 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:01:04.179493 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 0ac8b011-d80b-4dad-a020-a7a59908608f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:04.247245 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:04.396437 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:01:04.608725 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Found WWN 330000000d00ec62f for multipath device dm-6 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:01:04.608993 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.037s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:01:04.609172 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] <== connect_volume: return (2037ms) {'type': 'block', 'scsi_wwn': '330000000d00ec62f', 'path': '/dev/dm-6', 'multipath_id': '330000000d00ec62f'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:01:04.609317 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d00ec62f', 'path': '/dev/dm-6', 'multipath_id': '330000000d00ec62f'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:01:04.611240 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lazy-loading 'flavor' on Instance uuid 04880ef4-5eee-4221-ad42-29788eb26358 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:01:04.825998 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8b11cf9d-3d59-445e-8981-2e7268f15fc0 req-1784aa3f-efa2-45f0-b6a4-90de1e41df9a service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Received event network-vif-unplugged-0d344ede-14be-4d59-b796-097c682389f9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:04.826406 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8b11cf9d-3d59-445e-8981-2e7268f15fc0 req-1784aa3f-efa2-45f0-b6a4-90de1e41df9a service nova] Acquiring lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:04.826601 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8b11cf9d-3d59-445e-8981-2e7268f15fc0 req-1784aa3f-efa2-45f0-b6a4-90de1e41df9a service nova] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:04.826714 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8b11cf9d-3d59-445e-8981-2e7268f15fc0 req-1784aa3f-efa2-45f0-b6a4-90de1e41df9a service nova] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:04.826802 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8b11cf9d-3d59-445e-8981-2e7268f15fc0 req-1784aa3f-efa2-45f0-b6a4-90de1e41df9a service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] No waiting events found dispatching network-vif-unplugged-0d344ede-14be-4d59-b796-097c682389f9 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:04.826990 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-8b11cf9d-3d59-445e-8981-2e7268f15fc0 req-1784aa3f-efa2-45f0-b6a4-90de1e41df9a service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Received unexpected event network-vif-unplugged-0d344ede-14be-4d59-b796-097c682389f9 for instance with vm_state resized and task_state resize_reverting.
May 28 01:01:05.113694 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Attempting to attach volume d15f465c-138e-4c23-9b17-0b08887300f1 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:01:05.116130 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:01:05.116130 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:01:05.116130 np0000001577 nova-compute[98319]:   <alias name="ua-d15f465c-138e-4c23-9b17-0b08887300f1"/>
May 28 01:01:05.116130 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-6"/>
May 28 01:01:05.116130 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:01:05.116130 np0000001577 nova-compute[98319]:   <serial>d15f465c-138e-4c23-9b17-0b08887300f1</serial>
May 28 01:01:05.116130 np0000001577 nova-compute[98319]:   <shareable/>
May 28 01:01:05.116130 np0000001577 nova-compute[98319]: </disk>
May 28 01:01:05.116130 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:01:05.407044 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 3.203s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:05.407965 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.366s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:05.408159 np0000001577 nova-compute[98319]: DEBUG nova.compute.rpcapi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98319) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 01:01:05.420395 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:01:05.420531 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Claim successful on node np0000001577
May 28 01:01:05.703922 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:06.057117 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:06.369241 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:06.369621 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:06.790858 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:01:06.791266 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:01:06.791266 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:01:06.791266 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No VIF found with MAC fa:16:3e:e7:fe:bd, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:01:06.877018 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'flavor' on Instance uuid bb62eb94-ea3e-47ec-bae7-43acb74061ef {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:01:06.882118 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-41add8f2-da7d-4ce5-ae4b-ea943a76e693 req-c70fa7ea-48c9-447e-aa34-c04b9b9a8886 service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Received event network-vif-unplugged-0d344ede-14be-4d59-b796-097c682389f9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:06.882307 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-41add8f2-da7d-4ce5-ae4b-ea943a76e693 req-c70fa7ea-48c9-447e-aa34-c04b9b9a8886 service nova] Acquiring lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:06.882700 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-41add8f2-da7d-4ce5-ae4b-ea943a76e693 req-c70fa7ea-48c9-447e-aa34-c04b9b9a8886 service nova] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:06.883275 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-41add8f2-da7d-4ce5-ae4b-ea943a76e693 req-c70fa7ea-48c9-447e-aa34-c04b9b9a8886 service nova] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:06.886566 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-41add8f2-da7d-4ce5-ae4b-ea943a76e693 req-c70fa7ea-48c9-447e-aa34-c04b9b9a8886 service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] No waiting events found dispatching network-vif-unplugged-0d344ede-14be-4d59-b796-097c682389f9 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:06.886566 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-41add8f2-da7d-4ce5-ae4b-ea943a76e693 req-c70fa7ea-48c9-447e-aa34-c04b9b9a8886 service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Received unexpected event network-vif-unplugged-0d344ede-14be-4d59-b796-097c682389f9 for instance with vm_state resized and task_state resize_reverting.
May 28 01:01:07.008813 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Swapping old allocation on dict_keys(['78eed366-a2f0-4ead-b3a1-1ceb637e76c2']) held by migration a82f5535-dd02-4a4b-b896-35ce6d6587fe for instance
May 28 01:01:07.131174 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Overwriting current allocation {'allocations': {'78eed366-a2f0-4ead-b3a1-1ceb637e76c2': {'resources': {'VCPU': 1, 'MEMORY_MB': 256, 'DISK_GB': 1}, 'generation': 32}}, 'project_id': '78d410e4c6ea40ef87f92e84f362fa43', 'user_id': '2c45fdc9fb964707b5e02c1b5c0ff1d8', 'consumer_generation': 1} on consumer 2d2183ad-dbdb-4525-b678-39b72c7ab85d {{(pid=98319) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2036}}
May 28 01:01:07.227595 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:07.263590 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:01:07.263945 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:01:07.300647 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "refresh_cache-2d2183ad-dbdb-4525-b678-39b72c7ab85d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:01:07.300647 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquired lock "refresh_cache-2d2183ad-dbdb-4525-b678-39b72c7ab85d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:01:07.300776 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:01:07.766446 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:01:07.802387 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:07.881298 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:08.118292 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:08.272814 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.866s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:08.273475 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.026s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:08.273475 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:01:08.278796 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:01:08.278796 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Claim successful on node np0000001577
May 28 01:01:08.284564 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Updating instance_info_cache with network_info: [{"id": "0d344ede-14be-4d59-b796-097c682389f9", "address": "fa:16:3e:bd:1f:a1", "network": {"id": "8dc9ea08-c48e-4321-b325-d1191e9557b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1143389599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78d410e4c6ea40ef87f92e84f362fa43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d344ede-14", "ovs_interfaceid": "0d344ede-14be-4d59-b796-097c682389f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:01:08.339623 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-88076de6-4735-4b90-acc4-dd3fdaa03ea7 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "04880ef4-5eee-4221-ad42-29788eb26358" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.463s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:08.786911 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:01:08.792449 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Releasing lock "refresh_cache-2d2183ad-dbdb-4525-b678-39b72c7ab85d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:01:08.793005 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:01:08.794182 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:01:08.795939 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:08.795939 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:08.807027 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:01:08.827520 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:08.874273 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:01:08.874610 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:01:08.883295 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:01:08.884921 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe75:1c46', 'fe80::8c3:73ff:fe68:9ea1', 'fe80::fc16:3eff:fef0:246e', 'fe80::fc16:3eff:feca:a831', 'fe80::e8d7:d3ff:fe11:4890', 'fe80::fc16:3eff:fe12:3f51', 'fe80::64e0:a4ff:fe34:ffd6', 'fe80::fc16:3eff:fe72:df47', 'fe80::fc16:3eff:fe3e:2329', 'fe80::fc16:3eff:fe28:5665', 'fe80::fc16:3eff:fe8f:58e7', 'fe80::8c50:49ff:fe54:f5d', 'fe80::fc16:3eff:fed8:380', 'fe80::fc16:3eff:fe3a:9b65', 'fe80::fc16:3eff:feab:a032', 'fe80::fc16:3eff:fee0:c149', 'fe80::fc16:3eff:fe1b:8be7', 'fe80::cc9e:aff:fedb:875f', 'fe80::fc16:3eff:fe40:63', 'fe80::8ba:53ff:fe4b:b4ff', 'fe80::fc16:3eff:fedf:9fb0', 'fe80::fc16:3eff:fe9d:9858', 'fe80::fc16:3eff:fee7:febd'] 
May 28 01:01:08.885081 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:01:08.885182 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:01:08.885419 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:01:08.911277 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c803ddeaf4f4b3db07587419087b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050f928f1ce449d6a447cd343dc4ff80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:01:08.988818 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:08.989031 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:08.989245 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Attaching volume 6cd99b2a-2938-4324-8370-3666d88f3a56 to /dev/vdb
May 28 01:01:09.035386 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:01:09.045362 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:01:09.063772 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:09.098496 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:01:09.098747 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:01:09.107198 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:01:09.112173 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe75:1c46', 'fe80::8c3:73ff:fe68:9ea1', 'fe80::fc16:3eff:fef0:246e', 'fe80::fc16:3eff:feca:a831', 'fe80::e8d7:d3ff:fe11:4890', 'fe80::fc16:3eff:fe12:3f51', 'fe80::64e0:a4ff:fe34:ffd6', 'fe80::fc16:3eff:fe72:df47', 'fe80::fc16:3eff:fe3e:2329', 'fe80::fc16:3eff:fe28:5665', 'fe80::fc16:3eff:fe8f:58e7', 'fe80::8c50:49ff:fe54:f5d', 'fe80::fc16:3eff:fed8:380', 'fe80::fc16:3eff:fe3a:9b65', 'fe80::fc16:3eff:feab:a032', 'fe80::fc16:3eff:fee0:c149', 'fe80::fc16:3eff:fe1b:8be7', 'fe80::cc9e:aff:fedb:875f', 'fe80::fc16:3eff:fe40:63', 'fe80::8ba:53ff:fe4b:b4ff', 'fe80::fc16:3eff:fedf:9fb0', 'fe80::fc16:3eff:fe9d:9858', 'fe80::fc16:3eff:fee7:febd'] 
May 28 01:01:09.112335 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:01:09.112438 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:01:09.112737 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] <== get_connector_properties: return (76ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:01:09.113015 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Updating existing volume attachment record: d9b5860d-7526-4779-8645-c8da88fe789d {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:01:09.292374 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:01:09.331484 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Successfully created port: f28aa177-6927-4987-8127-d3f565bd347e {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:01:09.671185 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:01:09.671516 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56', 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6cd99b2a-2938-4324-8370-3666d88f3a56', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:01:09.672917 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:01:09.675496 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:01:09.675727 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56', 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6cd99b2a-2938-4324-8370-3666d88f3a56', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:01:09.691432 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:01:09.692163 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:01:09.695118 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:01:09.695338 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:01:09.695873 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:01:09.695873 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:01:09.709919 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:01:09.709919 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:09.717712 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:01:09.717712 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:09.723933 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56] added
May 28 01:01:09.723933 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:01:09.723933 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:01:09.723933 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:01:09.723933 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:01:09.723933 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:01:09.723933 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:09.724214 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:01:09.724214 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0288(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:01:09.724294 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:01:09.730975 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56] added
May 28 01:01:09.730975 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:01:09.730975 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:01:09.730975 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:01:09.730975 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:01:09.730975 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:01:09.730975 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:09.731186 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:01:09.731229 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0354(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:01:09.731418 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:01:09.796329 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Stashing vm_state: active {{(pid=98319) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 28 01:01:09.806794 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:01:09.967618 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Successfully updated port: f28aa177-6927-4987-8127-d3f565bd347e {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:01:10.002100 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Starting finish_revert_migration {{(pid=98319) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12932}}
May 28 01:01:10.016782 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Start _get_guest_xml network_info=[{"id": "0d344ede-14be-4d59-b796-097c682389f9", "address": "fa:16:3e:bd:1f:a1", "network": {"id": "8dc9ea08-c48e-4321-b325-d1191e9557b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1143389599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78d410e4c6ea40ef87f92e84f362fa43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d344ede-14", "ovs_interfaceid": "0d344ede-14be-4d59-b796-097c682389f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a390b885-c2b5-4116-b7ea-4ad467d6145f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '2d2183ad-dbdb-4525-b678-39b72c7ab85d', 'attached_at': '2026-05-28T01:01:09.000000', 'detached_at': '', 'volume_id': 'a390b885-c2b5-4116-b7ea-4ad467d6145f', 'serial': 'a390b885-c2b5-4116-b7ea-4ad467d6145f'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '49af3eef-5da3-414a-bee1-69a78f9d8e1d', 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:01:10.017017 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:01:10.018411 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-126815204', uuid='2d2183ad-dbdb-4525-b678-39b72c7ab85d'), owner=OwnerMeta(userid='2c45fdc9fb964707b5e02c1b5c0ff1d8', username='tempest-ServerActionsTestOtherB-243435399-project-member', projectid='78d410e4c6ea40ef87f92e84f362fa43', projectname='tempest-ServerActionsTestOtherB-243435399'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0d344ede-14be-4d59-b796-097c682389f9", "address": "fa:16:3e:bd:1f:a1", "network": {"id": "8dc9ea08-c48e-4321-b325-d1191e9557b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1143389599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78d410e4c6ea40ef87f92e84f362fa43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d344ede-14", "ovs_interfaceid": "0d344ede-14be-4d59-b796-097c682389f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930070.01803) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:01:10.020839 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:01:10.022975 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-03c5bf1a-8892-48f5-9ff4-91fb192a76e7 req-713de4b8-f1cd-4e01-aa2f-548b3f29acd0 service nova] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Received event network-changed-f28aa177-6927-4987-8127-d3f565bd347e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:10.024386 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:01:10.024386 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-03c5bf1a-8892-48f5-9ff4-91fb192a76e7 req-713de4b8-f1cd-4e01-aa2f-548b3f29acd0 service nova] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Refreshing instance network info cache due to event network-changed-f28aa177-6927-4987-8127-d3f565bd347e. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:01:10.024386 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-03c5bf1a-8892-48f5-9ff4-91fb192a76e7 req-713de4b8-f1cd-4e01-aa2f-548b3f29acd0 service nova] Acquiring lock "refresh_cache-dc47e3bc-028d-4166-b702-91cbbd62f80e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:01:10.024386 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-03c5bf1a-8892-48f5-9ff4-91fb192a76e7 req-713de4b8-f1cd-4e01-aa2f-548b3f29acd0 service nova] Acquired lock "refresh_cache-dc47e3bc-028d-4166-b702-91cbbd62f80e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:01:10.024386 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-03c5bf1a-8892-48f5-9ff4-91fb192a76e7 req-713de4b8-f1cd-4e01-aa2f-548b3f29acd0 service nova] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Refreshing network info cache for port f28aa177-6927-4987-8127-d3f565bd347e {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:01:10.026154 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:01:10.026330 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:01:10.027226 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:01:10.027497 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:01:10.027680 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:01:10.027737 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:01:10.027867 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:01:10.027945 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:01:10.028050 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:01:10.028186 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:01:10.028286 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:01:10.028387 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:01:10.028490 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:01:10.028622 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:01:10.028768 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2d2183ad-dbdb-4525-b678-39b72c7ab85d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:01:10.081753 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:01:10.082062 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:01:10.309490 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Booting with volume 3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 at /dev/vda
May 28 01:01:10.354662 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:10.356245 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:01:10.365954 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:01:10.385480 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:10.426121 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:01:10.426405 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:01:10.436049 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:01:10.437741 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe75:1c46', 'fe80::8c3:73ff:fe68:9ea1', 'fe80::fc16:3eff:fef0:246e', 'fe80::fc16:3eff:feca:a831', 'fe80::e8d7:d3ff:fe11:4890', 'fe80::fc16:3eff:fe12:3f51', 'fe80::64e0:a4ff:fe34:ffd6', 'fe80::fc16:3eff:fe72:df47', 'fe80::fc16:3eff:fe3e:2329', 'fe80::fc16:3eff:fe28:5665', 'fe80::fc16:3eff:fe8f:58e7', 'fe80::8c50:49ff:fe54:f5d', 'fe80::fc16:3eff:fed8:380', 'fe80::fc16:3eff:fe3a:9b65', 'fe80::fc16:3eff:feab:a032', 'fe80::fc16:3eff:fee0:c149', 'fe80::fc16:3eff:fe1b:8be7', 'fe80::cc9e:aff:fedb:875f', 'fe80::fc16:3eff:fe40:63', 'fe80::8ba:53ff:fe4b:b4ff', 'fe80::fc16:3eff:fedf:9fb0', 'fe80::fc16:3eff:fe9d:9858', 'fe80::fc16:3eff:fee7:febd'] 
May 28 01:01:10.437879 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:01:10.438037 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:01:10.438284 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] <== get_connector_properties: return (81ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:01:10.438490 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Updating existing volume attachment record: ed3dabb5-e539-46dc-9669-a6a2f3274ffc {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:01:10.470187 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "refresh_cache-dc47e3bc-028d-4166-b702-91cbbd62f80e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:01:10.530654 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-03c5bf1a-8892-48f5-9ff4-91fb192a76e7 req-713de4b8-f1cd-4e01-aa2f-548b3f29acd0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:10.551041 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk.config --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:10.585947 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:01:10.628856 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-03c5bf1a-8892-48f5-9ff4-91fb192a76e7 req-713de4b8-f1cd-4e01-aa2f-548b3f29acd0 service nova] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:01:10.635862 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk.config --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:10.635862 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:10.635862 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "/opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:10.636890 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "/opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:10.637220 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:01:10.637644 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a390b885-c2b5-4116-b7ea-4ad467d6145f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:01:10.637801 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:01:10.708482 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:10.724846 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:01:10.732789 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:01:10.741859 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:01:10.741859 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:01:10.749065 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:01:10.749065 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:10.757346 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:10.765100 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:10.777730 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:10.777730 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:10.777730 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:10.777730 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:10.777730 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:10.777730 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:10.777730 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:10.777730 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:10.777730 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:10.777730 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:10.777730 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:01:10.778108 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:10.778108 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:10.778108 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:10.778108 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:10.778108 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:10.778108 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:10.778108 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:10.778108 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:10.778108 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:10.778108 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:10.778108 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:01:10.780121 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-03c5bf1a-8892-48f5-9ff4-91fb192a76e7 req-713de4b8-f1cd-4e01-aa2f-548b3f29acd0 service nova] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:01:10.785175 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:10.785175 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:10.785175 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:10.785175 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:10.785175 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:10.785175 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:10.785175 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:10.785175 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:10.785175 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:10.785175 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:10.785175 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:01:10.785539 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:10.785539 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:10.785539 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:10.785539 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:10.785539 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:10.785539 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:10.785539 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:10.785539 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:10.785539 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:10.785539 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:10.785539 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:01:10.829578 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56, portal: 192.168.50.100,3260]
May 28 01:01:10.829578 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56, portal: 192.168.50.100,3260] successful.
May 28 01:01:10.829578 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:10.840198 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56, portal: 192.168.40.100,3260]
May 28 01:01:10.840198 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56, portal: 192.168.40.100,3260] successful.
May 28 01:01:10.840198 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:10.842129 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:10.853018 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:10.865638 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:10.865638 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:10.865638 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:10.865638 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:10.865638 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:10.865638 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:10.865638 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:10.865638 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:10.865638 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:10.865638 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:10.865638 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:10.865638 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:10.865638 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:01:10.865929 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:10.865929 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:10.865929 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:10.865929 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:10.865929 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:10.865929 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:10.865929 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:10.865929 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:10.865929 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:10.865929 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:10.865929 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:10.865929 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:10.865929 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:01:10.866148 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:01:10.866616 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:01:10.868012 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] HCTL ('9', '-', '-', 0) found on session 48 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:01:10.868167 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:01:10.876720 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:10.876720 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:10.876720 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:10.876720 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:10.876720 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:10.876720 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:10.876720 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:10.876720 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:10.876720 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:10.876720 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:10.876720 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:10.876720 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:10.876720 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:01:10.877148 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:10.877148 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:10.877148 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:10.877148 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:10.877148 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:10.877148 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:10.877148 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:10.877148 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:10.877148 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:10.877148 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:10.877148 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:10.877148 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:10.877148 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:01:10.877472 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:01:10.877472 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:01:10.879221 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] HCTL ('10', '-', '-', 0) found on session 49 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:01:10.879370 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:01:10.884945 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Searching for a device in session 48 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:01:10.885107 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6cd99b2a-2938-4324-8370-3666d88f3a56', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:01:10.898300 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Searching for a device in session 49 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:01:10.898384 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6cd99b2a-2938-4324-8370-3666d88f3a56', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:01:11.061644 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:11.100667 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.828s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:11.101229 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:01:11.104232 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.750s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:11.282022 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-03c5bf1a-8892-48f5-9ff4-91fb192a76e7 req-713de4b8-f1cd-4e01-aa2f-548b3f29acd0 service nova] Releasing lock "refresh_cache-dc47e3bc-028d-4166-b702-91cbbd62f80e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:01:11.282438 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquired lock "refresh_cache-dc47e3bc-028d-4166-b702-91cbbd62f80e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:01:11.282594 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:01:11.609138 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:01:11.613466 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:01:11.614004 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:01:11.614144 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Claim successful on node np0000001577
May 28 01:01:11.617168 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:11.617653 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:11.685673 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd375089981f8493598b33c4b6f122374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a7090a79f448f3abe4737bf127df53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:01:11.693477 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:01:11.882683 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:01:12.037061 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:12.114540 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:01:12.122329 np0000001577 nova-compute[98319]: INFO nova.compute.resource_tracker [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Updating resource usage from migration ec834ead-e707-4577-add9-25a13637a2e8
May 28 01:01:12.223088 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Updating instance_info_cache with network_info: [{"id": "f28aa177-6927-4987-8127-d3f565bd347e", "address": "fa:16:3e:0b:7f:79", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf28aa177-69", "ovs_interfaceid": "f28aa177-6927-4987-8127-d3f565bd347e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:01:12.271101 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Successfully created port: 95f81148-2a4e-4ca8-ad05-cb73d6f2951f {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:01:12.544409 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:01:12.545276 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:01:12.545502 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Creating image(s)
May 28 01:01:12.545784 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:01:12.545909 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Ensure instance console log exists: /opt/stack/data/nova/instances/dc47e3bc-028d-4166-b702-91cbbd62f80e/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:01:12.546134 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:12.546276 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:12.546377 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:12.620972 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:01:12.707091 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Found WWN 33000000088797cc6 for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:01:12.707371 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:01:12.707531 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '33000000088797cc6', 'path': '/dev/dm-1', 'multipath_id': '33000000088797cc6'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:01:12.707670 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000088797cc6', 'path': '/dev/dm-1', 'multipath_id': '33000000088797cc6'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:01:12.708164 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.070s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:01:12.708377 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a390b885-c2b5-4116-b7ea-4ad467d6145f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:01:12.710002 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'flavor' on Instance uuid bb62eb94-ea3e-47ec-bae7-43acb74061ef {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:01:12.719462 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:01:12.720275 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:01:12.720661 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:01:12.720815 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:01:12.721216 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:01:12.721807 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:01:12.725654 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Releasing lock "refresh_cache-dc47e3bc-028d-4166-b702-91cbbd62f80e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:01:12.725929 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Instance network_info: |[{"id": "f28aa177-6927-4987-8127-d3f565bd347e", "address": "fa:16:3e:0b:7f:79", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf28aa177-69", "ovs_interfaceid": "f28aa177-6927-4987-8127-d3f565bd347e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:01:12.726466 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Start _get_guest_xml network_info=[{"id": "f28aa177-6927-4987-8127-d3f565bd347e", "address": "fa:16:3e:0b:7f:79", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf28aa177-69", "ovs_interfaceid": "f28aa177-6927-4987-8127-d3f565bd347e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'dc47e3bc-028d-4166-b702-91cbbd62f80e', 'attached_at': '', 'detached_at': '', 'volume_id': '3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'serial': '3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'ed3dabb5-e539-46dc-9669-a6a2f3274ffc', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:01:12.730627 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:01:12.734689 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-775064717', uuid='dc47e3bc-028d-4166-b702-91cbbd62f80e'), owner=OwnerMeta(userid='0c803ddeaf4f4b3db07587419087b3b2', username='tempest-TestVolumeBootPattern-1449742411-project-member', projectid='050f928f1ce449d6a447cd343dc4ff80', projectname='tempest-TestVolumeBootPattern-1449742411'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f28aa177-6927-4987-8127-d3f565bd347e", "address": "fa:16:3e:0b:7f:79", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf28aa177-69", "ovs_interfaceid": "f28aa177-6927-4987-8127-d3f565bd347e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930072.7319129) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:01:12.735470 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:01:12.735908 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:01:12.736957 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:01:12.736957 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:12.737256 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:01:12.737697 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:01:12.740010 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:01:12.740010 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:01:12.740010 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:01:12.740010 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:01:12.740010 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:01:12.740010 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:01:12.740255 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:01:12.740255 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:01:12.740430 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:01:12.740634 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:01:12.740793 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:01:12.740984 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:01:12.748061 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:01:12.748061 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:12.757182 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f] added
May 28 01:01:12.757182 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:01:12.757182 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:01:12.757182 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:01:12.757182 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:01:12.757182 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:01:12.757182 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:12.764033 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f] added
May 28 01:01:12.764033 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:01:12.764033 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:01:12.764033 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:01:12.764033 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:01:12.764033 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:01:12.764033 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:12.766614 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:01:12.767279 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:01:12.767632 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:01:12.767924 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:01:12.768590 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.046(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:01:12.768858 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:01:12.769029 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.046(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:01:12.769288 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:01:12.769469 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:01:12.821067 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Successfully updated port: 95f81148-2a4e-4ca8-ad05-cb73d6f2951f {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:01:12.821344 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:12.821480 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "2dbd7449-2081-4377-a31d-e4d202679da1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:12.821651 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:12.821760 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:12.821856 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:12.823770 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Terminating instance
May 28 01:01:12.867133 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-de528ea9-4886-477a-ab6f-98ecb1ba8a69 req-b45d7c02-1134-414f-8f16-2cb7d1005d33 service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Received event network-changed-95f81148-2a4e-4ca8-ad05-cb73d6f2951f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:12.867474 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-de528ea9-4886-477a-ab6f-98ecb1ba8a69 req-b45d7c02-1134-414f-8f16-2cb7d1005d33 service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Refreshing instance network info cache due to event network-changed-95f81148-2a4e-4ca8-ad05-cb73d6f2951f. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:01:12.867656 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-de528ea9-4886-477a-ab6f-98ecb1ba8a69 req-b45d7c02-1134-414f-8f16-2cb7d1005d33 service nova] Acquiring lock "refresh_cache-03f1821a-592e-4e02-b609-74f3d7e69b53" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:01:12.867758 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-de528ea9-4886-477a-ab6f-98ecb1ba8a69 req-b45d7c02-1134-414f-8f16-2cb7d1005d33 service nova] Acquired lock "refresh_cache-03f1821a-592e-4e02-b609-74f3d7e69b53" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:01:12.867851 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-de528ea9-4886-477a-ab6f-98ecb1ba8a69 req-b45d7c02-1134-414f-8f16-2cb7d1005d33 service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Refreshing network info cache for port 95f81148-2a4e-4ca8-ad05-cb73d6f2951f {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:01:12.955944 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:01:12.956159 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:01:13.212730 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Attempting to attach volume 6cd99b2a-2938-4324-8370-3666d88f3a56 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:01:13.213755 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:01:13.213755 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:01:13.213755 np0000001577 nova-compute[98319]:   <alias name="ua-6cd99b2a-2938-4324-8370-3666d88f3a56"/>
May 28 01:01:13.213755 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 28 01:01:13.213755 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:01:13.213755 np0000001577 nova-compute[98319]:   <serial>6cd99b2a-2938-4324-8370-3666d88f3a56</serial>
May 28 01:01:13.213755 np0000001577 nova-compute[98319]: </disk>
May 28 01:01:13.213755 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:01:13.325164 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "refresh_cache-03f1821a-592e-4e02-b609-74f3d7e69b53" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:01:13.326990 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:01:13.351407 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:13.354797 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:13.371978 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-de528ea9-4886-477a-ab6f-98ecb1ba8a69 req-b45d7c02-1134-414f-8f16-2cb7d1005d33 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:13.378877 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:13.382825 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:13.407205 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:13.424987 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:13.458506 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:01:13.529204 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-de528ea9-4886-477a-ab6f-98ecb1ba8a69 req-b45d7c02-1134-414f-8f16-2cb7d1005d33 service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:01:13.542606 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:13.584698 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7a01d563-e199-4a60-82d6-e766fb293b09 req-7440d30e-90a6-4ede-bc76-617c0d46a791 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-unplugged-8a85618a-56c3-4690-af32-885b836a2c19 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:13.585777 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7a01d563-e199-4a60-82d6-e766fb293b09 req-7440d30e-90a6-4ede-bc76-617c0d46a791 service nova] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:13.586053 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7a01d563-e199-4a60-82d6-e766fb293b09 req-7440d30e-90a6-4ede-bc76-617c0d46a791 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:13.586116 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7a01d563-e199-4a60-82d6-e766fb293b09 req-7440d30e-90a6-4ede-bc76-617c0d46a791 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:13.586242 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7a01d563-e199-4a60-82d6-e766fb293b09 req-7440d30e-90a6-4ede-bc76-617c0d46a791 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] No waiting events found dispatching network-vif-unplugged-8a85618a-56c3-4690-af32-885b836a2c19 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:13.586361 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7a01d563-e199-4a60-82d6-e766fb293b09 req-7440d30e-90a6-4ede-bc76-617c0d46a791 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-unplugged-8a85618a-56c3-4690-af32-885b836a2c19 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:01:13.629698 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:01:13.632682 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:01:13.632682 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Creating image(s)
May 28 01:01:13.632682 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "/opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:13.632959 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "/opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:13.633447 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "/opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:13.634304 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:01:13.638198 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:01:13.643496 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:13.658804 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:13.664372 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:13.686215 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:13.688037 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:13.723054 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:13.745837 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:13.748565 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.107s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:13.750804 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:13.751340 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:13.751893 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:01:13.755801 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:01:13.757227 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:13.771994 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:01:13.772870 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:01:13.793834 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:01:13.793834 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:01:13.800089 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:01:13.800089 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:13.808208 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:13.822280 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:13.833226 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:13.860220 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:13.860220 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:13.860220 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:13.860220 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:13.860220 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:13.860220 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:13.860220 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:13.860220 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:13.860220 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:13.860220 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:13.860220 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:13.860220 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:13.860220 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:01:13.860220 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:13.860220 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:13.860220 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:13.860220 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:13.860220 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:13.860220 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:13.860220 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:13.860220 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:13.860220 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:13.860220 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:13.860220 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:13.860220 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:13.860220 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:01:13.861855 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.105s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:13.862972 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:13.887942 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:13.887942 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:13.887942 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:13.887942 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:13.887942 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:13.887942 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:13.887942 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:13.887942 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:13.887942 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:13.887942 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:13.887942 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:13.887942 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:13.887942 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:01:13.888306 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:13.888306 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:13.888306 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:13.888306 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:13.888306 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:13.888306 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:13.888306 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:13.888306 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:13.888306 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:13.888306 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:13.888306 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:13.888306 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:13.888306 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:01:13.909231 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-de528ea9-4886-477a-ab6f-98ecb1ba8a69 req-b45d7c02-1134-414f-8f16-2cb7d1005d33 service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:01:13.935045 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:13.940757 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/disk 1073741824" returned: 0 in 0.078s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:13.944012 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a89b4b6d-9320-4e2a-bfd5-948aa7a1f803 req-c2573a0a-c24e-4108-8954-3c4f3e5d5778 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-unplugged-5624a417-cdef-4be1-8586-16ca7bfdc8b9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:13.944646 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a89b4b6d-9320-4e2a-bfd5-948aa7a1f803 req-c2573a0a-c24e-4108-8954-3c4f3e5d5778 service nova] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:13.944825 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a89b4b6d-9320-4e2a-bfd5-948aa7a1f803 req-c2573a0a-c24e-4108-8954-3c4f3e5d5778 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:13.945230 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a89b4b6d-9320-4e2a-bfd5-948aa7a1f803 req-c2573a0a-c24e-4108-8954-3c4f3e5d5778 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:13.945417 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:13.945761 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:13.968057 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a89b4b6d-9320-4e2a-bfd5-948aa7a1f803 req-c2573a0a-c24e-4108-8954-3c4f3e5d5778 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] No waiting events found dispatching network-vif-unplugged-5624a417-cdef-4be1-8586-16ca7bfdc8b9 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:13.969324 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a89b4b6d-9320-4e2a-bfd5-948aa7a1f803 req-c2573a0a-c24e-4108-8954-3c4f3e5d5778 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-unplugged-5624a417-cdef-4be1-8586-16ca7bfdc8b9 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:01:13.973654 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.869s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:13.975374 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Migrating
May 28 01:01:13.975737 np0000001577 nova-compute[98319]: DEBUG nova.compute.rpcapi [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98319) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 01:01:13.993192 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.027940 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f, portal: 192.168.40.100,3260]
May 28 01:01:14.027940 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f, portal: 192.168.40.100,3260] successful.
May 28 01:01:14.027940 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:14.039024 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.041442 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:14.042794 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f, portal: 192.168.50.100,3260]
May 28 01:01:14.042794 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f, portal: 192.168.50.100,3260] successful.
May 28 01:01:14.042794 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:14.053122 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999601288999884 future=<Future at 0x7c984c54f860 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:14.055484 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Instance destroyed successfully.
May 28 01:01:14.056217 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lazy-loading 'resources' on Instance uuid 2dbd7449-2081-4377-a31d-e4d202679da1 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:01:14.059232 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.113s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:14.059632 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:01:14.059917 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:14.084444 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:14.090466 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:14.090466 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:14.090466 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:14.090466 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:14.090466 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:14.090466 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:14.090466 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:14.090466 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:14.090466 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:14.090466 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:14.090466 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:14.090466 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:14.090466 np0000001577 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:14.090466 np0000001577 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:14.090466 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:01:14.090466 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:14.090466 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:14.090466 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:14.090466 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:14.090466 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:14.090466 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:14.090466 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:14.090466 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:14.090466 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:14.090466 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:14.090466 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:14.090466 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:14.090466 np0000001577 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:14.090466 np0000001577 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:14.090466 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:01:14.090466 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.369s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:01:14.091183 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:01:14.095835 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] HCTL ('17', '-', '-', 0) found on session 50 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:01:14.096071 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:01:14.115010 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:14.115010 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:14.115010 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:14.115010 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:14.115010 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:14.115010 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:14.115010 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:14.115010 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:14.115010 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:14.115010 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:14.115010 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:14.115010 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:14.115010 np0000001577 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:14.115010 np0000001577 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:14.115010 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:01:14.115010 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:14.115010 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:14.115010 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:14.115010 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:14.115010 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:14.115010 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:14.115010 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:14.115010 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:14.115010 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:14.115010 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:14.115010 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:14.115010 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:14.115010 np0000001577 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:14.115010 np0000001577 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:14.115010 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:01:14.115750 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.394s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:01:14.115750 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:01:14.124891 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] HCTL ('18', '-', '-', 0) found on session 51 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:01:14.124891 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:01:14.130737 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Searching for a device in session 50 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:01:14.135764 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a390b885-c2b5-4116-b7ea-4ad467d6145f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:01:14.152761 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Searching for a device in session 51 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:01:14.152761 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a390b885-c2b5-4116-b7ea-4ad467d6145f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:01:14.186245 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:14.187213 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Cannot resize image /opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:01:14.187711 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:01:14.187711 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Ensure instance console log exists: /opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:01:14.188184 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:14.188436 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:14.188654 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:14.417066 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-de528ea9-4886-477a-ab6f-98ecb1ba8a69 req-b45d7c02-1134-414f-8f16-2cb7d1005d33 service nova] Releasing lock "refresh_cache-03f1821a-592e-4e02-b609-74f3d7e69b53" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:01:14.417583 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquired lock "refresh_cache-03f1821a-592e-4e02-b609-74f3d7e69b53" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:01:14.417916 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:01:14.513593 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "refresh_cache-d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:01:14.513593 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquired lock "refresh_cache-d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:01:14.513593 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:01:14.576225 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1792575949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1792575949',id=19,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1P9ZawshZj4d2nh1lOk0Fv8roeGP0Y7qMP0EmUJ750BqsN/Fcq/c3OR67lR1+FLd77FwgEUGC4BrSbDELBraS3IiHPO2T5AnpM+EnT2CfWDwC/fytu8FA54TM0d8j/A==',key_name='tempest-keypair-2104888731',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:00:27Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54eb635d961644dc9c1845baf24fc6db',ramdisk_id='',reservation_id='r-5gdx0woc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1752653874',owner_user_name='tempest-TaggedBootDevicesTest_v242-1752653874-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:00:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b66af1e9e094d3fa78454b91757d6cf',uuid=2dbd7449-2081-4377-a31d-e4d202679da1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a85618a-56c3-4690-af32-885b836a2c19", "address": "fa:16:3e:8f:58:e7", "network": {"id": "4fae2e1c-05e1-4891-8645-b0200336c3ab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1018677949-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a85618a-56", "ovs_interfaceid": "8a85618a-56c3-4690-af32-885b836a2c19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:01:14.576389 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converting VIF {"id": "8a85618a-56c3-4690-af32-885b836a2c19", "address": "fa:16:3e:8f:58:e7", "network": {"id": "4fae2e1c-05e1-4891-8645-b0200336c3ab", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1018677949-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a85618a-56", "ovs_interfaceid": "8a85618a-56c3-4690-af32-885b836a2c19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:01:14.577032 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:58:e7,bridge_name='br-int',has_traffic_filtering=True,id=8a85618a-56c3-4690-af32-885b836a2c19,network=Network(4fae2e1c-05e1-4891-8645-b0200336c3ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a85618a-56') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:01:14.577239 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:58:e7,bridge_name='br-int',has_traffic_filtering=True,id=8a85618a-56c3-4690-af32-885b836a2c19,network=Network(4fae2e1c-05e1-4891-8645-b0200336c3ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a85618a-56') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:01:14.578563 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.579692 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a85618a-56, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:14.581405 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.581623 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:14.604775 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.605869 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.606092 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aeb06d52-f275-4488-9fef-7c39803bbf30) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:14.606864 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.607305 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:14.630084 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.631806 np0000001577 nova-compute[98319]: INFO os_vif [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:58:e7,bridge_name='br-int',has_traffic_filtering=True,id=8a85618a-56c3-4690-af32-885b836a2c19,network=Network(4fae2e1c-05e1-4891-8645-b0200336c3ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a85618a-56')
May 28 01:01:14.632409 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1792575949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1792575949',id=19,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1P9ZawshZj4d2nh1lOk0Fv8roeGP0Y7qMP0EmUJ750BqsN/Fcq/c3OR67lR1+FLd77FwgEUGC4BrSbDELBraS3IiHPO2T5AnpM+EnT2CfWDwC/fytu8FA54TM0d8j/A==',key_name='tempest-keypair-2104888731',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:00:27Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54eb635d961644dc9c1845baf24fc6db',ramdisk_id='',reservation_id='r-5gdx0woc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1752653874',owner_user_name='tempest-TaggedBootDevicesTest_v242-1752653874-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:00:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b66af1e9e094d3fa78454b91757d6cf',uuid=2dbd7449-2081-4377-a31d-e4d202679da1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7de931f4-ea15-4c26-9bd7-00b40cd57781", "address": "fa:16:3e:d8:03:80", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de931f4-ea", "ovs_interfaceid": "7de931f4-ea15-4c26-9bd7-00b40cd57781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:01:14.632580 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converting VIF {"id": "7de931f4-ea15-4c26-9bd7-00b40cd57781", "address": "fa:16:3e:d8:03:80", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de931f4-ea", "ovs_interfaceid": "7de931f4-ea15-4c26-9bd7-00b40cd57781", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:01:14.633051 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:03:80,bridge_name='br-int',has_traffic_filtering=True,id=7de931f4-ea15-4c26-9bd7-00b40cd57781,network=Network(6280a6b4-4539-4dd4-8845-12626e668c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7de931f4-ea') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:01:14.633226 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:03:80,bridge_name='br-int',has_traffic_filtering=True,id=7de931f4-ea15-4c26-9bd7-00b40cd57781,network=Network(6280a6b4-4539-4dd4-8845-12626e668c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7de931f4-ea') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:01:14.633967 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.634125 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7de931f4-ea, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:14.635037 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.635626 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:14.653612 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.654565 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.654711 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b81ca76c-6b38-4e4c-9bf0-0e6b1e83ee82) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:14.655221 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.655584 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:14.674511 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.676846 np0000001577 nova-compute[98319]: INFO os_vif [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:03:80,bridge_name='br-int',has_traffic_filtering=True,id=7de931f4-ea15-4c26-9bd7-00b40cd57781,network=Network(6280a6b4-4539-4dd4-8845-12626e668c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7de931f4-ea')
May 28 01:01:14.677223 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1792575949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1792575949',id=19,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1P9ZawshZj4d2nh1lOk0Fv8roeGP0Y7qMP0EmUJ750BqsN/Fcq/c3OR67lR1+FLd77FwgEUGC4BrSbDELBraS3IiHPO2T5AnpM+EnT2CfWDwC/fytu8FA54TM0d8j/A==',key_name='tempest-keypair-2104888731',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:00:27Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54eb635d961644dc9c1845baf24fc6db',ramdisk_id='',reservation_id='r-5gdx0woc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1752653874',owner_user_name='tempest-TaggedBootDevicesTest_v242-1752653874-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:00:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b66af1e9e094d3fa78454b91757d6cf',uuid=2dbd7449-2081-4377-a31d-e4d202679da1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5624a417-cdef-4be1-8586-16ca7bfdc8b9", "address": "fa:16:3e:3a:9b:65", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5624a417-cd", "ovs_interfaceid": "5624a417-cdef-4be1-8586-16ca7bfdc8b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:01:14.677356 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converting VIF {"id": "5624a417-cdef-4be1-8586-16ca7bfdc8b9", "address": "fa:16:3e:3a:9b:65", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5624a417-cd", "ovs_interfaceid": "5624a417-cdef-4be1-8586-16ca7bfdc8b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:01:14.677796 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:9b:65,bridge_name='br-int',has_traffic_filtering=True,id=5624a417-cdef-4be1-8586-16ca7bfdc8b9,network=Network(6280a6b4-4539-4dd4-8845-12626e668c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5624a417-cd') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:01:14.677997 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:9b:65,bridge_name='br-int',has_traffic_filtering=True,id=5624a417-cdef-4be1-8586-16ca7bfdc8b9,network=Network(6280a6b4-4539-4dd4-8845-12626e668c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5624a417-cd') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:01:14.678675 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.678839 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5624a417-cd, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:14.679897 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.680806 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:14.694443 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.695496 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.695708 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fdf60133-8e0d-4fa1-bbfe-b641ef475743) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:14.696212 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.696696 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:14.711134 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.712699 np0000001577 nova-compute[98319]: INFO os_vif [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:9b:65,bridge_name='br-int',has_traffic_filtering=True,id=5624a417-cdef-4be1-8586-16ca7bfdc8b9,network=Network(6280a6b4-4539-4dd4-8845-12626e668c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5624a417-cd')
May 28 01:01:14.713310 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1792575949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1792575949',id=19,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1P9ZawshZj4d2nh1lOk0Fv8roeGP0Y7qMP0EmUJ750BqsN/Fcq/c3OR67lR1+FLd77FwgEUGC4BrSbDELBraS3IiHPO2T5AnpM+EnT2CfWDwC/fytu8FA54TM0d8j/A==',key_name='tempest-keypair-2104888731',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:00:27Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54eb635d961644dc9c1845baf24fc6db',ramdisk_id='',reservation_id='r-5gdx0woc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1752653874',owner_user_name='tempest-TaggedBootDevicesTest_v242-1752653874-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:00:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b66af1e9e094d3fa78454b91757d6cf',uuid=2dbd7449-2081-4377-a31d-e4d202679da1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3de085f7-074a-44c7-99ab-7093e0ddc084", "address": "fa:16:3e:ab:a0:32", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de085f7-07", "ovs_interfaceid": "3de085f7-074a-44c7-99ab-7093e0ddc084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:01:14.713437 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converting VIF {"id": "3de085f7-074a-44c7-99ab-7093e0ddc084", "address": "fa:16:3e:ab:a0:32", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de085f7-07", "ovs_interfaceid": "3de085f7-074a-44c7-99ab-7093e0ddc084", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:01:14.713917 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:a0:32,bridge_name='br-int',has_traffic_filtering=True,id=3de085f7-074a-44c7-99ab-7093e0ddc084,network=Network(6280a6b4-4539-4dd4-8845-12626e668c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de085f7-07') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:01:14.714152 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:a0:32,bridge_name='br-int',has_traffic_filtering=True,id=3de085f7-074a-44c7-99ab-7093e0ddc084,network=Network(6280a6b4-4539-4dd4-8845-12626e668c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de085f7-07') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:01:14.714736 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.714875 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3de085f7-07, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:14.715653 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.716312 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:14.722463 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:01:14.726542 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.727374 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.727505 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ebfe968-b123-4c71-8e75-097581e6630a) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:14.727911 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.728312 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:14.738797 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.740631 np0000001577 nova-compute[98319]: INFO os_vif [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:a0:32,bridge_name='br-int',has_traffic_filtering=True,id=3de085f7-074a-44c7-99ab-7093e0ddc084,network=Network(6280a6b4-4539-4dd4-8845-12626e668c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de085f7-07')
May 28 01:01:14.741211 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1792575949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1792575949',id=19,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1P9ZawshZj4d2nh1lOk0Fv8roeGP0Y7qMP0EmUJ750BqsN/Fcq/c3OR67lR1+FLd77FwgEUGC4BrSbDELBraS3IiHPO2T5AnpM+EnT2CfWDwC/fytu8FA54TM0d8j/A==',key_name='tempest-keypair-2104888731',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:00:27Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54eb635d961644dc9c1845baf24fc6db',ramdisk_id='',reservation_id='r-5gdx0woc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1752653874',owner_user_name='tempest-TaggedBootDevicesTest_v242-1752653874-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:00:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b66af1e9e094d3fa78454b91757d6cf',uuid=2dbd7449-2081-4377-a31d-e4d202679da1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02325a90-5e85-4e9f-a65e-c1bd91c39e80", "address": "fa:16:3e:e0:c1:49", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02325a90-5e", "ovs_interfaceid": "02325a90-5e85-4e9f-a65e-c1bd91c39e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:01:14.741349 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converting VIF {"id": "02325a90-5e85-4e9f-a65e-c1bd91c39e80", "address": "fa:16:3e:e0:c1:49", "network": {"id": "6280a6b4-4539-4dd4-8845-12626e668c75", "bridge": "br-int", "label": "tempest-device-tagging-net1-186828075", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02325a90-5e", "ovs_interfaceid": "02325a90-5e85-4e9f-a65e-c1bd91c39e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:01:14.741794 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c1:49,bridge_name='br-int',has_traffic_filtering=True,id=02325a90-5e85-4e9f-a65e-c1bd91c39e80,network=Network(6280a6b4-4539-4dd4-8845-12626e668c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02325a90-5e') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:01:14.741992 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c1:49,bridge_name='br-int',has_traffic_filtering=True,id=02325a90-5e85-4e9f-a65e-c1bd91c39e80,network=Network(6280a6b4-4539-4dd4-8845-12626e668c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02325a90-5e') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:01:14.742720 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.742871 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02325a90-5e, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:14.743696 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.744331 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:14.751386 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.752138 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.752259 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=247ca135-8a28-45f6-a19b-c3782434e900) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:14.752633 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.753067 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:14.760318 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.761950 np0000001577 nova-compute[98319]: INFO os_vif [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c1:49,bridge_name='br-int',has_traffic_filtering=True,id=02325a90-5e85-4e9f-a65e-c1bd91c39e80,network=Network(6280a6b4-4539-4dd4-8845-12626e668c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02325a90-5e')
May 28 01:01:14.762487 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1792575949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1792575949',id=19,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1P9ZawshZj4d2nh1lOk0Fv8roeGP0Y7qMP0EmUJ750BqsN/Fcq/c3OR67lR1+FLd77FwgEUGC4BrSbDELBraS3IiHPO2T5AnpM+EnT2CfWDwC/fytu8FA54TM0d8j/A==',key_name='tempest-keypair-2104888731',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:00:27Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54eb635d961644dc9c1845baf24fc6db',ramdisk_id='',reservation_id='r-5gdx0woc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1752653874',owner_user_name='tempest-TaggedBootDevicesTest_v242-1752653874-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:00:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b66af1e9e094d3fa78454b91757d6cf',uuid=2dbd7449-2081-4377-a31d-e4d202679da1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59a7e22c-8c09-4a33-9b95-58ee955f6895", "address": "fa:16:3e:1b:8b:e7", "network": {"id": "0a64f131-06a0-4c34-a1d8-06f8419256bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-288972260", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59a7e22c-8c", "ovs_interfaceid": "59a7e22c-8c09-4a33-9b95-58ee955f6895", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:01:14.762639 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converting VIF {"id": "59a7e22c-8c09-4a33-9b95-58ee955f6895", "address": "fa:16:3e:1b:8b:e7", "network": {"id": "0a64f131-06a0-4c34-a1d8-06f8419256bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-288972260", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap59a7e22c-8c", "ovs_interfaceid": "59a7e22c-8c09-4a33-9b95-58ee955f6895", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:01:14.763068 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:8b:e7,bridge_name='br-int',has_traffic_filtering=True,id=59a7e22c-8c09-4a33-9b95-58ee955f6895,network=Network(0a64f131-06a0-4c34-a1d8-06f8419256bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59a7e22c-8c') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:01:14.763241 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:8b:e7,bridge_name='br-int',has_traffic_filtering=True,id=59a7e22c-8c09-4a33-9b95-58ee955f6895,network=Network(0a64f131-06a0-4c34-a1d8-06f8419256bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59a7e22c-8c') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:01:14.763852 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.764007 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59a7e22c-8c, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:14.764747 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.765461 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:14.769486 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.770199 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.770324 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7340e13e-ecd5-40eb-8cfa-0fd222f6356e) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:14.770698 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.771129 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:14.774711 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.776997 np0000001577 nova-compute[98319]: INFO os_vif [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:8b:e7,bridge_name='br-int',has_traffic_filtering=True,id=59a7e22c-8c09-4a33-9b95-58ee955f6895,network=Network(0a64f131-06a0-4c34-a1d8-06f8419256bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59a7e22c-8c')
May 28 01:01:14.777535 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1792575949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-device-tagging-server-1792575949',id=19,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1P9ZawshZj4d2nh1lOk0Fv8roeGP0Y7qMP0EmUJ750BqsN/Fcq/c3OR67lR1+FLd77FwgEUGC4BrSbDELBraS3IiHPO2T5AnpM+EnT2CfWDwC/fytu8FA54TM0d8j/A==',key_name='tempest-keypair-2104888731',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:00:27Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54eb635d961644dc9c1845baf24fc6db',ramdisk_id='',reservation_id='r-5gdx0woc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1752653874',owner_user_name='tempest-TaggedBootDevicesTest_v242-1752653874-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:00:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b66af1e9e094d3fa78454b91757d6cf',uuid=2dbd7449-2081-4377-a31d-e4d202679da1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1b61752-f189-4f02-b9eb-92326fb29830", "address": "fa:16:3e:40:00:63", "network": {"id": "0a64f131-06a0-4c34-a1d8-06f8419256bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-288972260", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b61752-f1", "ovs_interfaceid": "d1b61752-f189-4f02-b9eb-92326fb29830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:01:14.777701 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converting VIF {"id": "d1b61752-f189-4f02-b9eb-92326fb29830", "address": "fa:16:3e:40:00:63", "network": {"id": "0a64f131-06a0-4c34-a1d8-06f8419256bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-288972260", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "54eb635d961644dc9c1845baf24fc6db", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b61752-f1", "ovs_interfaceid": "d1b61752-f189-4f02-b9eb-92326fb29830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:01:14.778199 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:00:63,bridge_name='br-int',has_traffic_filtering=True,id=d1b61752-f189-4f02-b9eb-92326fb29830,network=Network(0a64f131-06a0-4c34-a1d8-06f8419256bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1b61752-f1') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:01:14.778398 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:00:63,bridge_name='br-int',has_traffic_filtering=True,id=d1b61752-f189-4f02-b9eb-92326fb29830,network=Network(0a64f131-06a0-4c34-a1d8-06f8419256bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1b61752-f1') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:01:14.779375 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.779559 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1b61752-f1, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:14.780361 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.781279 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:14.781458 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.782244 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.782371 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a677fb4c-60ba-461a-8ec1-402430ae6522) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:14.782736 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.783296 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:14.783602 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:14.784980 np0000001577 nova-compute[98319]: INFO os_vif [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:00:63,bridge_name='br-int',has_traffic_filtering=True,id=d1b61752-f189-4f02-b9eb-92326fb29830,network=Network(0a64f131-06a0-4c34-a1d8-06f8419256bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1b61752-f1')
May 28 01:01:14.786450 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:01:14.786760 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', 'iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:01:14.786894 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:01:14.855953 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:01:14.856057 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:01:14.856122 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:01:14.856214 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] No VIF found with MAC fa:16:3e:df:9f:b0, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:01:14.921478 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-unplugged-7de931f4-ea15-4c26-9bd7-00b40cd57781 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:14.922012 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:14.924195 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:14.924195 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:14.924195 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] No waiting events found dispatching network-vif-unplugged-7de931f4-ea15-4c26-9bd7-00b40cd57781 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:14.924771 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-unplugged-7de931f4-ea15-4c26-9bd7-00b40cd57781 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:01:14.925260 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-unplugged-7de931f4-ea15-4c26-9bd7-00b40cd57781 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:14.925260 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:14.925260 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:14.925565 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:14.925762 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] No waiting events found dispatching network-vif-unplugged-7de931f4-ea15-4c26-9bd7-00b40cd57781 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:14.925971 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-unplugged-7de931f4-ea15-4c26-9bd7-00b40cd57781 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:01:14.926164 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-unplugged-02325a90-5e85-4e9f-a65e-c1bd91c39e80 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:14.927128 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:14.927128 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:14.927128 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:14.927128 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] No waiting events found dispatching network-vif-unplugged-02325a90-5e85-4e9f-a65e-c1bd91c39e80 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:14.927128 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-unplugged-02325a90-5e85-4e9f-a65e-c1bd91c39e80 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:01:14.927128 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-unplugged-02325a90-5e85-4e9f-a65e-c1bd91c39e80 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:14.927128 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:14.927128 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:14.927371 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:14.927530 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] No waiting events found dispatching network-vif-unplugged-02325a90-5e85-4e9f-a65e-c1bd91c39e80 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:14.927690 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-unplugged-02325a90-5e85-4e9f-a65e-c1bd91c39e80 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:01:14.927827 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-unplugged-3de085f7-074a-44c7-99ab-7093e0ddc084 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:14.927991 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:14.928173 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:14.928248 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:14.928366 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] No waiting events found dispatching network-vif-unplugged-3de085f7-074a-44c7-99ab-7093e0ddc084 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:14.928437 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-unplugged-3de085f7-074a-44c7-99ab-7093e0ddc084 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:01:14.928533 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-unplugged-3de085f7-074a-44c7-99ab-7093e0ddc084 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:14.928650 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:14.928756 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:14.928840 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:14.929127 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] No waiting events found dispatching network-vif-unplugged-3de085f7-074a-44c7-99ab-7093e0ddc084 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:14.929219 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6ac45161-a9d2-46e5-9e04-3698d36b6c32 req-e451e628-f6ca-4e89-9810-504df78b9764 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-unplugged-3de085f7-074a-44c7-99ab-7093e0ddc084 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:01:14.977525 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:01:15.015384 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:15.136592 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:15.185049 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00035758800004259683 future=<Future at 0x7c984c511f70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:15.185666 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Emitting event <LifecycleEvent: 1779930060.1844652, 2d2183ad-dbdb-4525-b678-39b72c7ab85d => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:01:15.185865 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:15.186346 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] VM Stopped (Lifecycle Event)
May 28 01:01:15.187530 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=13.865178446000073 future=<Future at 0x7c984c54f860 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:15.188236 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=13.864828926999962 future=<Future at 0x7c984c54f860 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:15.287849 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Updating instance_info_cache with network_info: [{"id": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "address": "fa:16:3e:5e:ef:9c", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f81148-2a", "ovs_interfaceid": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:01:15.310593 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:15.436265 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Updating instance_info_cache with network_info: [{"id": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "address": "fa:16:3e:28:56:65", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3d348-6b", "ovs_interfaceid": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:01:15.644034 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-041c2dc5-982c-4108-ab24-484c5acd4326 req-150f59f3-e683-4428-9484-20b956965d52 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-unplugged-8a85618a-56c3-4690-af32-885b836a2c19 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:15.644232 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-041c2dc5-982c-4108-ab24-484c5acd4326 req-150f59f3-e683-4428-9484-20b956965d52 service nova] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:15.644383 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-041c2dc5-982c-4108-ab24-484c5acd4326 req-150f59f3-e683-4428-9484-20b956965d52 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:15.644481 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-041c2dc5-982c-4108-ab24-484c5acd4326 req-150f59f3-e683-4428-9484-20b956965d52 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:15.644618 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-041c2dc5-982c-4108-ab24-484c5acd4326 req-150f59f3-e683-4428-9484-20b956965d52 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] No waiting events found dispatching network-vif-unplugged-8a85618a-56c3-4690-af32-885b836a2c19 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:15.644721 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-041c2dc5-982c-4108-ab24-484c5acd4326 req-150f59f3-e683-4428-9484-20b956965d52 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-unplugged-8a85618a-56c3-4690-af32-885b836a2c19 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:01:15.644812 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-041c2dc5-982c-4108-ab24-484c5acd4326 req-150f59f3-e683-4428-9484-20b956965d52 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-unplugged-d1b61752-f189-4f02-b9eb-92326fb29830 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:15.645046 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-041c2dc5-982c-4108-ab24-484c5acd4326 req-150f59f3-e683-4428-9484-20b956965d52 service nova] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:15.645143 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-041c2dc5-982c-4108-ab24-484c5acd4326 req-150f59f3-e683-4428-9484-20b956965d52 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:15.645231 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-041c2dc5-982c-4108-ab24-484c5acd4326 req-150f59f3-e683-4428-9484-20b956965d52 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:15.645344 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-041c2dc5-982c-4108-ab24-484c5acd4326 req-150f59f3-e683-4428-9484-20b956965d52 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] No waiting events found dispatching network-vif-unplugged-d1b61752-f189-4f02-b9eb-92326fb29830 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:15.645427 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-041c2dc5-982c-4108-ab24-484c5acd4326 req-150f59f3-e683-4428-9484-20b956965d52 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-unplugged-d1b61752-f189-4f02-b9eb-92326fb29830 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:01:15.645515 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-041c2dc5-982c-4108-ab24-484c5acd4326 req-150f59f3-e683-4428-9484-20b956965d52 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-unplugged-d1b61752-f189-4f02-b9eb-92326fb29830 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:15.645654 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-041c2dc5-982c-4108-ab24-484c5acd4326 req-150f59f3-e683-4428-9484-20b956965d52 service nova] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:15.645805 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-041c2dc5-982c-4108-ab24-484c5acd4326 req-150f59f3-e683-4428-9484-20b956965d52 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:15.645903 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-041c2dc5-982c-4108-ab24-484c5acd4326 req-150f59f3-e683-4428-9484-20b956965d52 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:15.645992 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-041c2dc5-982c-4108-ab24-484c5acd4326 req-150f59f3-e683-4428-9484-20b956965d52 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] No waiting events found dispatching network-vif-unplugged-d1b61752-f189-4f02-b9eb-92326fb29830 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:15.646273 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-041c2dc5-982c-4108-ab24-484c5acd4326 req-150f59f3-e683-4428-9484-20b956965d52 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-unplugged-d1b61752-f189-4f02-b9eb-92326fb29830 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:01:15.689125 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:15.736699 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Found WWN 33000000018e747c1 for multipath device dm-7 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:01:15.736969 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:01:15.737129 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] <== connect_volume: return (5099ms) {'type': 'block', 'scsi_wwn': '33000000018e747c1', 'path': '/dev/dm-7', 'multipath_id': '33000000018e747c1'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:01:15.737242 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000018e747c1', 'path': '/dev/dm-7', 'multipath_id': '33000000018e747c1'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:01:15.737841 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.970s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:01:15.738110 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:01:15.749100 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:01:15.749669 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:01:15.750275 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:01:15.750505 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:01:15.750976 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:01:15.751313 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:01:15.761305 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:01:15.761305 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:15.766259 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:01:15.766259 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:15.771437 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7] added
May 28 01:01:15.771437 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:01:15.771437 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:01:15.771437 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:01:15.771437 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:01:15.771437 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:01:15.771437 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:15.771691 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:01:15.771691 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0212(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:01:15.772283 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:01:15.776530 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7] added
May 28 01:01:15.776530 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:01:15.776530 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:01:15.776530 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:01:15.776530 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:01:15.776530 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:01:15.776530 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:15.776776 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:01:15.776776 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0256(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:01:15.776907 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:01:15.789804 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Releasing lock "refresh_cache-03f1821a-592e-4e02-b609-74f3d7e69b53" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:01:15.790106 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Instance network_info: |[{"id": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "address": "fa:16:3e:5e:ef:9c", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f81148-2a", "ovs_interfaceid": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:01:15.791648 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Start _get_guest_xml network_info=[{"id": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "address": "fa:16:3e:5e:ef:9c", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f81148-2a", "ovs_interfaceid": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:01:15.793304 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:01:15.794439 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-115051965', uuid='03f1821a-592e-4e02-b609-74f3d7e69b53'), owner=OwnerMeta(userid='d375089981f8493598b33c4b6f122374', username='tempest-AttachVolumeShelveTestJSON-1260503814-project-member', projectid='f6a7090a79f448f3abe4737bf127df53', projectname='tempest-AttachVolumeShelveTestJSON-1260503814'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "address": "fa:16:3e:5e:ef:9c", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f81148-2a", "ovs_interfaceid": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930075.7941246) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:01:15.795254 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:01:15.795582 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:01:15.796245 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:01:15.796439 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:01:15.797317 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:01:15.797596 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:01:15.797728 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:01:15.797816 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:01:15.797965 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:01:15.798058 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:01:15.798150 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:01:15.798295 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:01:15.798393 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:01:15.798497 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:01:15.798616 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:01:15.798832 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:01:15.808613 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:01:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-115051965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumeshelvetestjson-server-115051965',id=28,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJykW7m/TlAU+aCXrHFQnqiLeGirg6DvP6jvEv6WQuNWyEgZM1BR3mEfPcGdFFvRQCbM6rCIAUsPhy5D6TwkP7OO9xbCj+TqMkt88Fpp/YwpAzmqGqGKPLSLEqkOjvz1A==',key_name='tempest-keypair-636601780',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6a7090a79f448f3abe4737bf127df53',ramdisk_id='',reservation_id='r-oad6jyzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1260503814',owner_user_name='tempest-AttachVolumeShelveTestJSON-1260503814-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:01:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d375089981f8493598b33c4b6f122374',uuid=03f1821a-592e-4e02-b609-74f3d7e69b53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "address": "fa:16:3e:5e:ef:9c", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f81148-2a", "ovs_interfaceid": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:01:15.808751 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Converting VIF {"id": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "address": "fa:16:3e:5e:ef:9c", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f81148-2a", "ovs_interfaceid": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:01:15.809234 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:ef:9c,bridge_name='br-int',has_traffic_filtering=True,id=95f81148-2a4e-4ca8-ad05-cb73d6f2951f,network=Network(e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f81148-2a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:01:15.809704 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lazy-loading 'pci_devices' on Instance uuid 03f1821a-592e-4e02-b609-74f3d7e69b53 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:01:15.938178 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Releasing lock "refresh_cache-d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:01:16.010259 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1245e6f2-5e55-4bc3-a835-8f7926472193 req-404c569e-52b5-4a37-bcb5-cb30e5e13420 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-unplugged-5624a417-cdef-4be1-8586-16ca7bfdc8b9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:16.010495 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1245e6f2-5e55-4bc3-a835-8f7926472193 req-404c569e-52b5-4a37-bcb5-cb30e5e13420 service nova] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:16.010596 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1245e6f2-5e55-4bc3-a835-8f7926472193 req-404c569e-52b5-4a37-bcb5-cb30e5e13420 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:16.010969 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1245e6f2-5e55-4bc3-a835-8f7926472193 req-404c569e-52b5-4a37-bcb5-cb30e5e13420 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:16.011084 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1245e6f2-5e55-4bc3-a835-8f7926472193 req-404c569e-52b5-4a37-bcb5-cb30e5e13420 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] No waiting events found dispatching network-vif-unplugged-5624a417-cdef-4be1-8586-16ca7bfdc8b9 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:16.011187 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1245e6f2-5e55-4bc3-a835-8f7926472193 req-404c569e-52b5-4a37-bcb5-cb30e5e13420 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-unplugged-5624a417-cdef-4be1-8586-16ca7bfdc8b9 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:01:16.011339 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1245e6f2-5e55-4bc3-a835-8f7926472193 req-404c569e-52b5-4a37-bcb5-cb30e5e13420 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-unplugged-59a7e22c-8c09-4a33-9b95-58ee955f6895 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:16.011400 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1245e6f2-5e55-4bc3-a835-8f7926472193 req-404c569e-52b5-4a37-bcb5-cb30e5e13420 service nova] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:16.011510 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1245e6f2-5e55-4bc3-a835-8f7926472193 req-404c569e-52b5-4a37-bcb5-cb30e5e13420 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:16.011642 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1245e6f2-5e55-4bc3-a835-8f7926472193 req-404c569e-52b5-4a37-bcb5-cb30e5e13420 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:16.011763 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1245e6f2-5e55-4bc3-a835-8f7926472193 req-404c569e-52b5-4a37-bcb5-cb30e5e13420 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] No waiting events found dispatching network-vif-unplugged-59a7e22c-8c09-4a33-9b95-58ee955f6895 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:16.011890 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1245e6f2-5e55-4bc3-a835-8f7926472193 req-404c569e-52b5-4a37-bcb5-cb30e5e13420 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-unplugged-59a7e22c-8c09-4a33-9b95-58ee955f6895 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:01:16.012019 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1245e6f2-5e55-4bc3-a835-8f7926472193 req-404c569e-52b5-4a37-bcb5-cb30e5e13420 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-unplugged-59a7e22c-8c09-4a33-9b95-58ee955f6895 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:16.012152 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1245e6f2-5e55-4bc3-a835-8f7926472193 req-404c569e-52b5-4a37-bcb5-cb30e5e13420 service nova] Acquiring lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:16.012290 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1245e6f2-5e55-4bc3-a835-8f7926472193 req-404c569e-52b5-4a37-bcb5-cb30e5e13420 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:16.012692 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1245e6f2-5e55-4bc3-a835-8f7926472193 req-404c569e-52b5-4a37-bcb5-cb30e5e13420 service nova] Lock "2dbd7449-2081-4377-a31d-e4d202679da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:16.012828 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1245e6f2-5e55-4bc3-a835-8f7926472193 req-404c569e-52b5-4a37-bcb5-cb30e5e13420 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] No waiting events found dispatching network-vif-unplugged-59a7e22c-8c09-4a33-9b95-58ee955f6895 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:16.012958 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1245e6f2-5e55-4bc3-a835-8f7926472193 req-404c569e-52b5-4a37-bcb5-cb30e5e13420 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-unplugged-59a7e22c-8c09-4a33-9b95-58ee955f6895 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:01:16.062160 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:16.243610 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-126815204',display_name='tempest-ServerActionsTestOtherB-server-126815204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serveractionstestotherb-server-126815204',id=17,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHowHxSKo/GbZ3/T/DuqsFzaBQyor5k7f+0IXzkeGeXUAEkx6L+ijA0U/nuHnUHla5vZzHw/uAJ60OyJL0qlD41uqiYRDGnW+sKtXyVuDHBRaZp3vxryet5baLwLYdDdtg==',key_name='tempest-keypair-1717835047',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:00:55Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001577',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='78d410e4c6ea40ef87f92e84f362fa43',ramdisk_id='',reservation_id='r-6x23ytl1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-243435399',owner_user_name='tempest-ServerActionsTestOtherB-243435399-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:00:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c45fdc9fb964707b5e02c1b5c0ff1d8',uuid=2d2183ad-dbdb-4525-b678-39b72c7ab85d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "0d344ede-14be-4d59-b796-097c682389f9", "address": "fa:16:3e:bd:1f:a1", "network": {"id": "8dc9ea08-c48e-4321-b325-d1191e9557b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1143389599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78d410e4c6ea40ef87f92e84f362fa43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d344ede-14", "ovs_interfaceid": "0d344ede-14be-4d59-b796-097c682389f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:01:16.243821 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Converting VIF {"id": "0d344ede-14be-4d59-b796-097c682389f9", "address": "fa:16:3e:bd:1f:a1", "network": {"id": "8dc9ea08-c48e-4321-b325-d1191e9557b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1143389599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78d410e4c6ea40ef87f92e84f362fa43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d344ede-14", "ovs_interfaceid": "0d344ede-14be-4d59-b796-097c682389f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:01:16.244372 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:1f:a1,bridge_name='br-int',has_traffic_filtering=True,id=0d344ede-14be-4d59-b796-097c682389f9,network=Network(8dc9ea08-c48e-4321-b325-d1191e9557b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d344ede-14') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:01:16.246064 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] End _get_guest_xml xml=<domain type="qemu">
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:   <uuid>2d2183ad-dbdb-4525-b678-39b72c7ab85d</uuid>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:   <name>instance-00000011</name>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <nova:name>tempest-ServerActionsTestOtherB-server-126815204</nova:name>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:01:10</nova:creationTime>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:         <nova:user uuid="2c45fdc9fb964707b5e02c1b5c0ff1d8">tempest-ServerActionsTestOtherB-243435399-project-member</nova:user>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:         <nova:project uuid="78d410e4c6ea40ef87f92e84f362fa43">tempest-ServerActionsTestOtherB-243435399</nova:project>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:         <nova:port uuid="0d344ede-14be-4d59-b796-097c682389f9">
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:     <system>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <entry name="serial">2d2183ad-dbdb-4525-b678-39b72c7ab85d</entry>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <entry name="uuid">2d2183ad-dbdb-4525-b678-39b72c7ab85d</entry>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:     </system>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:   <os>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:   </os>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:   <features>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:   </features>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:   <devices>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk"/>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:     </disk>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/disk.config"/>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:     </disk>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <alias name="ua-a390b885-c2b5-4116-b7ea-4ad467d6145f"/>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-7"/>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <serial>a390b885-c2b5-4116-b7ea-4ad467d6145f</serial>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:     </disk>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:bd:1f:a1"/>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <target dev="tap0d344ede-14"/>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:     </interface>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d/console.log" append="off"/>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:     </serial>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:     <video>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:     </video>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:     </rng>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:   </devices>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]: </domain>
May 28 01:01:16.246064 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:01:16.249670 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Preparing to wait for external event network-vif-plugged-0d344ede-14be-4d59-b796-097c682389f9 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:01:16.249670 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:16.249670 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:16.249670 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:16.249670 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-126815204',display_name='tempest-ServerActionsTestOtherB-server-126815204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serveractionstestotherb-server-126815204',id=17,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHowHxSKo/GbZ3/T/DuqsFzaBQyor5k7f+0IXzkeGeXUAEkx6L+ijA0U/nuHnUHla5vZzHw/uAJ60OyJL0qlD41uqiYRDGnW+sKtXyVuDHBRaZp3vxryet5baLwLYdDdtg==',key_name='tempest-keypair-1717835047',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:00:55Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001577',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='78d410e4c6ea40ef87f92e84f362fa43',ramdisk_id='',reservation_id='r-6x23ytl1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-243435399',owner_user_name='tempest-ServerActionsTestOtherB-243435399-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:00:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c45fdc9fb964707b5e02c1b5c0ff1d8',uuid=2d2183ad-dbdb-4525-b678-39b72c7ab85d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "0d344ede-14be-4d59-b796-097c682389f9", "address": "fa:16:3e:bd:1f:a1", "network": {"id": "8dc9ea08-c48e-4321-b325-d1191e9557b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1143389599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78d410e4c6ea40ef87f92e84f362fa43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d344ede-14", "ovs_interfaceid": "0d344ede-14be-4d59-b796-097c682389f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:01:16.249670 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Converting VIF {"id": "0d344ede-14be-4d59-b796-097c682389f9", "address": "fa:16:3e:bd:1f:a1", "network": {"id": "8dc9ea08-c48e-4321-b325-d1191e9557b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1143389599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78d410e4c6ea40ef87f92e84f362fa43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d344ede-14", "ovs_interfaceid": "0d344ede-14be-4d59-b796-097c682389f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:01:16.249670 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:1f:a1,bridge_name='br-int',has_traffic_filtering=True,id=0d344ede-14be-4d59-b796-097c682389f9,network=Network(8dc9ea08-c48e-4321-b325-d1191e9557b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d344ede-14') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:01:16.249670 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:1f:a1,bridge_name='br-int',has_traffic_filtering=True,id=0d344ede-14be-4d59-b796-097c682389f9,network=Network(8dc9ea08-c48e-4321-b325-d1191e9557b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d344ede-14') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:01:16.249670 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:16.249670 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:16.249670 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:01:16.249670 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:16.250274 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ace69347-2c6a-537b-ace2-983b15e1e242', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:16.250624 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:16.251407 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:16.251978 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:16.253772 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:16.253931 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d344ede-14, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:16.254226 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0d344ede-14, col_values=(('qos', UUID('4645fac3-43ef-45dd-999d-6c58e8b88ba1')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:16.254405 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0d344ede-14, col_values=(('external_ids', {'iface-id': '0d344ede-14be-4d59-b796-097c682389f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:1f:a1', 'vm-uuid': '2d2183ad-dbdb-4525-b678-39b72c7ab85d'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:16.255363 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:16.256650 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:16.262045 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:16.262638 np0000001577 nova-compute[98319]: INFO os_vif [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:1f:a1,bridge_name='br-int',has_traffic_filtering=True,id=0d344ede-14be-4d59-b796-097c682389f9,network=Network(8dc9ea08-c48e-4321-b325-d1191e9557b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d344ede-14')
May 28 01:01:16.312064 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] End _get_guest_xml xml=<domain type="qemu">
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:   <uuid>03f1821a-592e-4e02-b609-74f3d7e69b53</uuid>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:   <name>instance-0000001c</name>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-115051965</nova:name>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:01:15</nova:creationTime>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:         <nova:user uuid="d375089981f8493598b33c4b6f122374">tempest-AttachVolumeShelveTestJSON-1260503814-project-member</nova:user>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:         <nova:project uuid="f6a7090a79f448f3abe4737bf127df53">tempest-AttachVolumeShelveTestJSON-1260503814</nova:project>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:         <nova:port uuid="95f81148-2a4e-4ca8-ad05-cb73d6f2951f">
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:     <system>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       <entry name="serial">03f1821a-592e-4e02-b609-74f3d7e69b53</entry>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       <entry name="uuid">03f1821a-592e-4e02-b609-74f3d7e69b53</entry>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:     </system>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:   <os>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:   </os>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:   <features>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:   </features>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:   <devices>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/disk"/>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:     </disk>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/disk.config"/>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:     </disk>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:5e:ef:9c"/>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       <target dev="tap95f81148-2a"/>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:     </interface>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/console.log" append="off"/>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:     </serial>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:     <video>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:     </video>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:     </rng>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:   </devices>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]: </domain>
May 28 01:01:16.312064 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:01:16.315156 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Preparing to wait for external event network-vif-plugged-95f81148-2a4e-4ca8-ad05-cb73d6f2951f {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:01:16.315156 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "03f1821a-592e-4e02-b609-74f3d7e69b53-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:16.315156 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "03f1821a-592e-4e02-b609-74f3d7e69b53-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:16.315156 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "03f1821a-592e-4e02-b609-74f3d7e69b53-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:16.315156 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:01:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-115051965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumeshelvetestjson-server-115051965',id=28,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJykW7m/TlAU+aCXrHFQnqiLeGirg6DvP6jvEv6WQuNWyEgZM1BR3mEfPcGdFFvRQCbM6rCIAUsPhy5D6TwkP7OO9xbCj+TqMkt88Fpp/YwpAzmqGqGKPLSLEqkOjvz1A==',key_name='tempest-keypair-636601780',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6a7090a79f448f3abe4737bf127df53',ramdisk_id='',reservation_id='r-oad6jyzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1260503814',owner_user_name='tempest-AttachVolumeShelveTestJSON-1260503814-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:01:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d375089981f8493598b33c4b6f122374',uuid=03f1821a-592e-4e02-b609-74f3d7e69b53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "address": "fa:16:3e:5e:ef:9c", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f81148-2a", "ovs_interfaceid": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:01:16.315156 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Converting VIF {"id": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "address": "fa:16:3e:5e:ef:9c", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f81148-2a", "ovs_interfaceid": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:01:16.315156 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:ef:9c,bridge_name='br-int',has_traffic_filtering=True,id=95f81148-2a4e-4ca8-ad05-cb73d6f2951f,network=Network(e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f81148-2a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:01:16.315156 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:ef:9c,bridge_name='br-int',has_traffic_filtering=True,id=95f81148-2a4e-4ca8-ad05-cb73d6f2951f,network=Network(e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f81148-2a') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:01:16.315156 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:16.315156 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:16.315156 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:01:16.315156 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:16.315918 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '90b9eed8-6c86-5017-a23d-dd081bdb6fdc', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:16.316038 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:16.316723 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:16.323215 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:16.325376 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:16.325376 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95f81148-2a, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:16.325376 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap95f81148-2a, col_values=(('qos', UUID('294b5531-8455-4ac3-997b-75493668adca')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:16.325376 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap95f81148-2a, col_values=(('external_ids', {'iface-id': '95f81148-2a4e-4ca8-ad05-cb73d6f2951f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:ef:9c', 'vm-uuid': '03f1821a-592e-4e02-b609-74f3d7e69b53'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:16.326150 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:16.327478 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:16.335647 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:16.336562 np0000001577 nova-compute[98319]: INFO os_vif [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:ef:9c,bridge_name='br-int',has_traffic_filtering=True,id=95f81148-2a4e-4ca8-ad05-cb73d6f2951f,network=Network(e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f81148-2a')
May 28 01:01:16.399327 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-198e756b-047a-4357-977e-6df974fb84bf tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.410s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:16.664403 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:16.691572 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:16.773306 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:01:16.778226 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:01:16.780723 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:01:16.792257 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:01:16.792257 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:01:16.797113 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:01:16.797113 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:16.813694 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:16.821457 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:16.834303 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:16.834303 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:16.834303 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:16.834303 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:16.834303 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:16.834303 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:16.834303 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:16.834303 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:16.834303 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:16.834303 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:16.834303 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:16.834303 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:16.834303 np0000001577 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:16.834303 np0000001577 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:16.834303 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:01:16.834600 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:16.834600 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:16.834600 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:16.834600 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:16.834600 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:16.834600 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:16.834600 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:16.834600 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:16.834600 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:16.834600 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:16.834600 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:16.834600 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:16.834600 np0000001577 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:16.834600 np0000001577 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:16.834600 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:01:16.843022 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:16.843022 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:16.843022 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:16.843022 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:16.843022 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:16.843022 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:16.843022 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:16.843022 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:16.843022 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:16.843022 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:16.843022 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:16.843022 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:16.843022 np0000001577 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:16.843022 np0000001577 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:16.843022 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:01:16.843420 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:16.843420 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:16.843420 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:16.843420 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:16.843420 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:16.843420 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:16.843420 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:16.843420 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:16.843420 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:16.843420 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:16.843420 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:16.843420 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:16.843420 np0000001577 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:16.843420 np0000001577 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:16.843420 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:01:16.884949 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Rescuing
May 28 01:01:16.885121 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "refresh_cache-bb62eb94-ea3e-47ec-bae7-43acb74061ef" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:01:16.885168 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquired lock "refresh_cache-bb62eb94-ea3e-47ec-bae7-43acb74061ef" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:01:16.885273 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:01:16.890572 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7, portal: 192.168.40.100,3260]
May 28 01:01:16.890572 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7, portal: 192.168.40.100,3260] successful.
May 28 01:01:16.890572 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:16.898419 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7, portal: 192.168.50.100,3260]
May 28 01:01:16.898419 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7, portal: 192.168.50.100,3260] successful.
May 28 01:01:16.898419 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:16.903865 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:16.909895 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:16.930359 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:16.930359 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:16.930359 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:16.930359 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:16.930359 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:16.930359 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:16.930359 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:16.930359 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:16.930359 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:16.930359 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:16.930359 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:16.930359 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:16.930359 np0000001577 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:16.930359 np0000001577 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:16.930359 np0000001577 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:16.930359 np0000001577 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:16.930359 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.181s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:16.931912 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:01:16.932851 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.181s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:01:16.932851 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:01:16.935253 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] HCTL ('19', '-', '-', 0) found on session 52 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:01:16.935335 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:01:16.937010 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] HCTL ('20', '-', '-', 0) found on session 53 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:01:16.937010 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:01:16.953432 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching for a device in session 52 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:01:16.953432 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:01:16.953432 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching for a device in session 53 and hctl ['20', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:01:17.018094 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:17.025985 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:17.031046 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:17.053593 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:17.059902 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:17.382327 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930077.3820071, 2d2183ad-dbdb-4525-b678-39b72c7ab85d => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:01:17.382538 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] VM Started (Lifecycle Event)
May 28 01:01:17.389080 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:17.449848 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Starting migrate_disk_and_power_off {{(pid=98319) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 28 01:01:17.480681 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:17.484164 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:17.504839 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:17.623388 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:17.634892 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:17.699580 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:17.726345 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-74227b95-0c60-488d-bea4-1b1ef67c8757 req-f0bf0e03-4cab-4f76-95ef-ce9f5eddce5c service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Received event network-vif-plugged-0d344ede-14be-4d59-b796-097c682389f9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:17.726801 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-74227b95-0c60-488d-bea4-1b1ef67c8757 req-f0bf0e03-4cab-4f76-95ef-ce9f5eddce5c service nova] Acquiring lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:17.726986 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-74227b95-0c60-488d-bea4-1b1ef67c8757 req-f0bf0e03-4cab-4f76-95ef-ce9f5eddce5c service nova] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:17.727095 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-74227b95-0c60-488d-bea4-1b1ef67c8757 req-f0bf0e03-4cab-4f76-95ef-ce9f5eddce5c service nova] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:17.727216 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-74227b95-0c60-488d-bea4-1b1ef67c8757 req-f0bf0e03-4cab-4f76-95ef-ce9f5eddce5c service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Processing event network-vif-plugged-0d344ede-14be-4d59-b796-097c682389f9 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:01:17.727828 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-74227b95-0c60-488d-bea4-1b1ef67c8757 req-f0bf0e03-4cab-4f76-95ef-ce9f5eddce5c service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Received event network-vif-plugged-0d344ede-14be-4d59-b796-097c682389f9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:17.727828 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-74227b95-0c60-488d-bea4-1b1ef67c8757 req-f0bf0e03-4cab-4f76-95ef-ce9f5eddce5c service nova] Acquiring lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:17.727828 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-74227b95-0c60-488d-bea4-1b1ef67c8757 req-f0bf0e03-4cab-4f76-95ef-ce9f5eddce5c service nova] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:17.728215 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:01:17.728286 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-74227b95-0c60-488d-bea4-1b1ef67c8757 req-f0bf0e03-4cab-4f76-95ef-ce9f5eddce5c service nova] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:17.728357 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-74227b95-0c60-488d-bea4-1b1ef67c8757 req-f0bf0e03-4cab-4f76-95ef-ce9f5eddce5c service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] No waiting events found dispatching network-vif-plugged-0d344ede-14be-4d59-b796-097c682389f9 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:17.728682 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-74227b95-0c60-488d-bea4-1b1ef67c8757 req-f0bf0e03-4cab-4f76-95ef-ce9f5eddce5c service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Received unexpected event network-vif-plugged-0d344ede-14be-4d59-b796-097c682389f9 for instance with vm_state resized and task_state resize_reverting.
May 28 01:01:17.728682 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-74227b95-0c60-488d-bea4-1b1ef67c8757 req-f0bf0e03-4cab-4f76-95ef-ce9f5eddce5c service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Received event network-vif-unplugged-3ed3d348-6b93-4492-9c18-7b0eecc6454a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:17.728682 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-74227b95-0c60-488d-bea4-1b1ef67c8757 req-f0bf0e03-4cab-4f76-95ef-ce9f5eddce5c service nova] Acquiring lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:17.728781 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-74227b95-0c60-488d-bea4-1b1ef67c8757 req-f0bf0e03-4cab-4f76-95ef-ce9f5eddce5c service nova] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:17.728873 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-74227b95-0c60-488d-bea4-1b1ef67c8757 req-f0bf0e03-4cab-4f76-95ef-ce9f5eddce5c service nova] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:17.729216 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-74227b95-0c60-488d-bea4-1b1ef67c8757 req-f0bf0e03-4cab-4f76-95ef-ce9f5eddce5c service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] No waiting events found dispatching network-vif-unplugged-3ed3d348-6b93-4492-9c18-7b0eecc6454a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:17.729325 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-74227b95-0c60-488d-bea4-1b1ef67c8757 req-f0bf0e03-4cab-4f76-95ef-ce9f5eddce5c service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Received unexpected event network-vif-unplugged-3ed3d348-6b93-4492-9c18-7b0eecc6454a for instance with vm_state active and task_state resize_migrating.
May 28 01:01:17.736573 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Instance running successfully.
May 28 01:01:17.738655 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] finish_revert_migration finished successfully. {{(pid=98319) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12978}}
May 28 01:01:17.761090 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:17.772118 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:17.790461 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Instance destroyed successfully.
May 28 01:01:17.791649 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='multiattach-server-0',id=21,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7fHo3fyBWUybZxdNVpYEXXxMYY3ACB7D4odfvDXtuf5uMmk/o2XggiQakoJbwdRCXKjpHaMcmXgSyAS8x+3bDHMUWn1qlznnyXp/nDVRmoqTgLFpV2Do6YlUuA3zZ+mw==',key_name='tempest-keypair-627531643',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:00:20Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='938c2829112843edb2054984e80ce7ad',ramdisk_id='',reservation_id='r-vg7s0e6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-89204095',owner_user_name='tempest-AttachVolumeMultiAttachTest-89204095-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:01:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8586a18edcf42cab0a60028135ae401',uuid=d87bb95b-a1e9-4786-8bee-16f2cfaabf2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "address": "fa:16:3e:28:56:65", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "vif_mac": "fa:16:3e:28:56:65"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3d348-6b", "ovs_interfaceid": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:01:17.791793 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converting VIF {"id": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "address": "fa:16:3e:28:56:65", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "vif_mac": "fa:16:3e:28:56:65"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3d348-6b", "ovs_interfaceid": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:01:17.792423 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:56:65,bridge_name='br-int',has_traffic_filtering=True,id=3ed3d348-6b93-4492-9c18-7b0eecc6454a,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed3d348-6b') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:01:17.793036 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:56:65,bridge_name='br-int',has_traffic_filtering=True,id=3ed3d348-6b93-4492-9c18-7b0eecc6454a,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed3d348-6b') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:01:17.794337 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:17.796610 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ed3d348-6b, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:17.797738 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:17.802311 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:17.804522 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:17.804735 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=24dc7b4c-f0a4-4717-8b19-171bd0919155) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:17.805631 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:17.812218 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:17.814255 np0000001577 nova-compute[98319]: INFO os_vif [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:56:65,bridge_name='br-int',has_traffic_filtering=True,id=3ed3d348-6b93-4492-9c18-7b0eecc6454a,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed3d348-6b')
May 28 01:01:17.842669 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Updating instance_info_cache with network_info: [{"id": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "address": "fa:16:3e:df:9f:b0", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab3e003-1c", "ovs_interfaceid": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:01:17.852177 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:01:17.852332 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:01:17.852437 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] No VIF found with MAC fa:16:3e:5e:ef:9c, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:01:17.852807 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Using config drive
May 28 01:01:17.885151 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:17.887738 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:01:17.953260 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching for a device in session 53 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:01:17.953425 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:01:18.010099 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:18.010596 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:18.345587 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Releasing lock "refresh_cache-bb62eb94-ea3e-47ec-bae7-43acb74061ef" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:01:18.355812 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Detected multiple connections on this host for volume: d15f465c-138e-4c23-9b17-0b08887300f1, skipping target disconnect.
May 28 01:01:18.360234 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:18.363508 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:18.392948 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] During sync_power_state the instance has a pending task (resize_reverting). Skip.
May 28 01:01:18.400570 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930078.3970788, 2d2183ad-dbdb-4525-b678-39b72c7ab85d => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:01:18.400570 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] VM Paused (Lifecycle Event)
May 28 01:01:18.468893 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:18.469290 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:18.514462 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lazy-loading 'flavor' on Instance uuid e2cc3304-bf2b-4196-b6c8-8ad56da19af4 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:01:18.547898 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Creating config drive at /opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/disk.config
May 28 01:01:18.551634 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpz472btq_ {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:18.568621 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:18.569482 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:01:18.570324 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d_resize/disk /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:18.614180 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpz472btq_" returned: 0 in 0.062s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:18.667120 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "cp -r /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d_resize/disk /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk" returned: 0 in 0.096s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:18.667120 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d_resize/disk.config /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk.config {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:18.714234 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "cp -r /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d_resize/disk.config /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk.config" returned: 0 in 0.047s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:18.714713 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d_resize/disk.info /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk.info {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:18.762616 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "cp -r /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d_resize/disk.info /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk.info" returned: 0 in 0.046s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:18.768322 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Found WWN 33000000086c4030c for multipath device dm-8 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:01:18.768973 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:01:18.769954 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] <== connect_volume: return (6002ms) {'type': 'block', 'scsi_wwn': '33000000086c4030c', 'path': '/dev/disk/by-id/os-brick+dev+dm-8', 'multipath_id': '33000000086c4030c'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:01:18.770069 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000086c4030c', 'path': '/dev/disk/by-id/os-brick+dev+dm-8', 'multipath_id': '33000000086c4030c'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:01:18.771513 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.984s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:01:18.771513 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', 'iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:01:18.771513 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:01:18.806755 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:18.806755 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:18.806755 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:18.806755 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:18.806755 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:18.806755 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:18.806755 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:18.806755 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:18.806755 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:18.806755 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:18.806755 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:18.806755 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:18.806755 np0000001577 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:18.806755 np0000001577 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:18.806755 np0000001577 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:18.806755 np0000001577 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:18.806755 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:01:18.808197 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:18.808197 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:18.808197 np0000001577 nova-compute[98319]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:18.808197 np0000001577 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea (non-flash)
May 28 01:01:18.808197 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:18.808197 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:18.808197 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:18.808197 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:18.808197 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:18.808197 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:18.808197 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:18.808197 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:18.808197 np0000001577 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:18.808197 np0000001577 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:18.808197 np0000001577 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:18.808197 np0000001577 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:18.808197 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:01:18.808197 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56', '48'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56', '49'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', '53')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:01:18.808197 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', '32')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:01:18.811180 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea', '33')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:01:18.811180 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c987044e660>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea'): ({'sdc'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:01:18.811180 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Removing multipathed devices sdf, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:01:18.811180 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Flush multipath device 33000000090c17179 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:01:18.816696 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-8'}, 'status': 'reserved', 'instance': 'dc47e3bc-028d-4166-b702-91cbbd62f80e', 'attached_at': '', 'detached_at': '', 'volume_id': '3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'serial': '3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 01:01:18.817356 np0000001577 nova-compute[98319]: WARNING stevedore.named [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 01:01:18.817614 np0000001577 nova-compute[98319]: WARNING castellan.key_manager [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:01:18.817777 np0000001577 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:01:18.818828 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x7c984c7f7020>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-8'}, 'status': 'reserved', 'instance': 'dc47e3bc-028d-4166-b702-91cbbd62f80e', 'attached_at': '', 'detached_at': '', 'volume_id': '3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'serial': '3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7'} {{(pid=98319) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 01:01:18.819007 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98319) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 28 01:01:18.819261 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors.luks [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] opening encrypted volume /dev/dm-8 {{(pid=98319) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 28 01:01:18.845029 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-ca1c746e-5c8e-44fa-ab75-e099b57a5f94 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Updating instance to original state: 'active'
May 28 01:01:18.862084 np0000001577 nova-compute[98319]: WARNING os_brick.encryptors.luks [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 28 01:01:18.862303 np0000001577 nova-compute[98319]: INFO os_brick.encryptors.luks [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] /dev/dm-8 is not a valid LUKS device; formatting device for first use
May 28 01:01:18.862462 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors.luks [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] formatting encrypted volume /dev/dm-8 {{(pid=98319) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 28 01:01:18.874713 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:01:18.904063 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:18.906882 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930078.9064858, 2d2183ad-dbdb-4525-b678-39b72c7ab85d => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:01:18.907135 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] VM Resumed (Lifecycle Event)
May 28 01:01:18.929203 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:01:18.975854 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Checking to see if SCSI volumes sdf, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:01:18.976104 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] SCSI volumes sdf, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:01:18.977365 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Checking to see if device paths {'sdf', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:01:18.988556 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Device paths {'sdf', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:01:18.988804 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:01:19.001514 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:19.042885 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea, portal: 192.168.40.100,3260]
May 28 01:01:19.042885 np0000001577 nova-compute[98319]: Logout of [sid: 32, target: iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea, portal: 192.168.40.100,3260] successful.
May 28 01:01:19.042885 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:19.084516 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:19.089688 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:19.107921 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:19.114962 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:19.157041 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea, portal: 192.168.50.100,3260]
May 28 01:01:19.157041 np0000001577 nova-compute[98319]: Logout of [sid: 33, target: iqn.2023-03.storpool.com:os--volume-39ff2056-a3a2-4aae-8d31-1ddb6b70e3ea, portal: 192.168.50.100,3260] successful.
May 28 01:01:19.157041 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:19.182357 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:19.182655 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:01:19.182809 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] <== disconnect_volume: return (4396ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:01:19.182974 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:01:19.193685 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:01:19.194236 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f', 'iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd22fca90-ede2-4d3c-a61b-f5cffaf76d2f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:01:19.194377 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:01:19.194906 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:01:19.195293 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f', 'iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd22fca90-ede2-4d3c-a61b-f5cffaf76d2f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:01:19.195464 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:01:19.198276 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:19.231146 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:19.231146 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:19.231146 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:19.231146 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:19.231146 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:19.231146 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:19.231146 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:19.231146 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:19.231146 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:19.231146 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:19.231146 np0000001577 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:19.231146 np0000001577 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:19.231146 np0000001577 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:19.231146 np0000001577 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:19.231146 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:01:19.231585 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:19.231585 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:19.231585 np0000001577 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:19.231585 np0000001577 nova-compute[98319]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f (non-flash)
May 28 01:01:19.231585 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:19.231585 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:19.231585 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:19.231585 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:19.231585 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:19.231585 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:19.231585 np0000001577 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:19.231585 np0000001577 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:19.231585 np0000001577 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:19.231585 np0000001577 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:19.231585 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:01:19.231585 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56', '48'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56', '49'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', '53')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:01:19.231978 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f', '34')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:01:19.234563 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f', '35')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:01:19.234563 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c9870423600>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f'): ({'sdh'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:01:19.234563 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Removing multipathed devices sdg, sdh {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:01:19.234563 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Flush multipath device 3300000005f9f3a53 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:01:19.264957 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:01:19.316985 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:01:19.366690 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Checking to see if SCSI volumes sdg, sdh have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:01:19.366909 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] SCSI volumes sdg, sdh have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:01:19.368574 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Checking to see if device paths {'sdg', 'sdh'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:01:19.382137 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Device paths {'sdg', 'sdh'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:01:19.382349 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:01:19.399729 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:19.410175 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:19.416400 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:01:19.444609 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f, portal: 192.168.40.100,3260]
May 28 01:01:19.444609 np0000001577 nova-compute[98319]: Logout of [sid: 34, target: iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f, portal: 192.168.40.100,3260] successful.
May 28 01:01:19.444609 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:19.468591 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:19.471478 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:19.473238 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:19.476878 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:19.487463 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:19.502781 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:19.524727 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7766cb28-4e1e-4c53-9e8d-77674a93df27 req-0209acc7-ebf8-43f5-98d9-059a487b9fd3 service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Received event network-vif-plugged-95f81148-2a4e-4ca8-ad05-cb73d6f2951f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:19.525513 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7766cb28-4e1e-4c53-9e8d-77674a93df27 req-0209acc7-ebf8-43f5-98d9-059a487b9fd3 service nova] Acquiring lock "03f1821a-592e-4e02-b609-74f3d7e69b53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:19.525701 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7766cb28-4e1e-4c53-9e8d-77674a93df27 req-0209acc7-ebf8-43f5-98d9-059a487b9fd3 service nova] Lock "03f1821a-592e-4e02-b609-74f3d7e69b53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:19.525890 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7766cb28-4e1e-4c53-9e8d-77674a93df27 req-0209acc7-ebf8-43f5-98d9-059a487b9fd3 service nova] Lock "03f1821a-592e-4e02-b609-74f3d7e69b53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:19.526430 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7766cb28-4e1e-4c53-9e8d-77674a93df27 req-0209acc7-ebf8-43f5-98d9-059a487b9fd3 service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Processing event network-vif-plugged-95f81148-2a4e-4ca8-ad05-cb73d6f2951f {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:01:19.527140 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f, portal: 192.168.50.100,3260]
May 28 01:01:19.527140 np0000001577 nova-compute[98319]: Logout of [sid: 35, target: iqn.2023-03.storpool.com:os--volume-d22fca90-ede2-4d3c-a61b-f5cffaf76d2f, portal: 192.168.50.100,3260] successful.
May 28 01:01:19.527140 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:19.532608 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.522s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:19.548445 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:19.548881 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:01:19.548881 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] <== disconnect_volume: return (354ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:01:19.548982 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:01:19.550202 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:01:19.550425 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:01:19.550537 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:01:19.550826 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:01:19.551123 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:01:19.551261 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:01:19.579747 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:19.579747 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:19.579747 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:19.579747 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:19.579747 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:19.579747 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:19.579747 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:19.579747 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:19.579747 np0000001577 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:19.579747 np0000001577 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:19.579747 np0000001577 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:19.579747 np0000001577 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:19.579747 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:01:19.580188 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:19.580188 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:19.580188 np0000001577 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:19.580188 np0000001577 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca (non-flash)
May 28 01:01:19.580188 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:19.580188 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:19.580188 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:19.580188 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:19.580188 np0000001577 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:19.580188 np0000001577 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:19.580188 np0000001577 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:19.580188 np0000001577 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:19.580188 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:01:19.580188 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56', '48'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56', '49'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', '53')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:01:19.580188 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', '37')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:01:19.581195 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca', '36')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:01:19.582084 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c98704d99e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca'): ({'sdb'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:01:19.582277 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Removing multipathed devices sdb, sdi {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:01:19.582485 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Flush multipath device 330000000ead4ec9b {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:01:19.612657 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:01:19.670188 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:01:19.711105 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Checking to see if SCSI volumes sdb, sdi have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:01:19.711240 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] SCSI volumes sdb, sdi have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:01:19.712341 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Checking to see if device paths {'sdb', 'sdi'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:01:19.724155 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Device paths {'sdb', 'sdi'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:01:19.724480 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:01:19.738878 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:19.776412 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca, portal: 192.168.40.100,3260]
May 28 01:01:19.776412 np0000001577 nova-compute[98319]: Logout of [sid: 37, target: iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca, portal: 192.168.40.100,3260] successful.
May 28 01:01:19.776412 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:19.799276 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:19.810444 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:19.846113 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5acde8e2-b0fe-4df9-b076-d17537512983 req-efb301a0-5333-4fca-81a3-16c9c2ffcd25 service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Received event network-vif-unplugged-3ed3d348-6b93-4492-9c18-7b0eecc6454a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:19.846787 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca, portal: 192.168.50.100,3260]
May 28 01:01:19.846787 np0000001577 nova-compute[98319]: Logout of [sid: 36, target: iqn.2023-03.storpool.com:os--volume-edef1fd4-4646-4d7f-aad4-df2fc2a4dcca, portal: 192.168.50.100,3260] successful.
May 28 01:01:19.846787 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:19.849176 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5acde8e2-b0fe-4df9-b076-d17537512983 req-efb301a0-5333-4fca-81a3-16c9c2ffcd25 service nova] Acquiring lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:19.849365 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5acde8e2-b0fe-4df9-b076-d17537512983 req-efb301a0-5333-4fca-81a3-16c9c2ffcd25 service nova] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:19.849498 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5acde8e2-b0fe-4df9-b076-d17537512983 req-efb301a0-5333-4fca-81a3-16c9c2ffcd25 service nova] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:19.849655 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5acde8e2-b0fe-4df9-b076-d17537512983 req-efb301a0-5333-4fca-81a3-16c9c2ffcd25 service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] No waiting events found dispatching network-vif-unplugged-3ed3d348-6b93-4492-9c18-7b0eecc6454a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:19.849800 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-5acde8e2-b0fe-4df9-b076-d17537512983 req-efb301a0-5333-4fca-81a3-16c9c2ffcd25 service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Received unexpected event network-vif-unplugged-3ed3d348-6b93-4492-9c18-7b0eecc6454a for instance with vm_state active and task_state resize_migrating.
May 28 01:01:19.866714 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:19.866883 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:01:19.866986 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] <== disconnect_volume: return (316ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:01:19.867087 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:01:19.867427 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Deleting instance files /opt/stack/data/nova/instances/2dbd7449-2081-4377-a31d-e4d202679da1_del
May 28 01:01:19.867914 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Deletion of /opt/stack/data/nova/instances/2dbd7449-2081-4377-a31d-e4d202679da1_del complete
May 28 01:01:19.920104 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999670217999892 future=<Future at 0x7c9870574fe0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:19.950722 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:19.951067 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:19.989375 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:01:19.989877 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930079.989665, 03f1821a-592e-4e02-b609-74f3d7e69b53 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:01:19.989968 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] VM Started (Lifecycle Event)
May 28 01:01:19.991436 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:01:19.993566 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Instance spawned successfully.
May 28 01:01:19.993935 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:01:20.055581 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Port 3ed3d348-6b93-4492-9c18-7b0eecc6454a binding to destination host np0000001577 is already ACTIVE {{(pid=98319) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 01:01:20.066774 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:20.072259 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:20.098599 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:20.291427 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:20.298790 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:20.395022 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Took 7.07 seconds to destroy the instance on the hypervisor.
May 28 01:01:20.396578 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:01:20.396802 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:01:20.397319 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:01:20.397529 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:20.401464 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Instance destroyed successfully.
May 28 01:01:20.402696 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'numa_topology' on Instance uuid bb62eb94-ea3e-47ec-bae7-43acb74061ef {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:01:20.493209 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:20.500216 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:01:20.503662 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:01:20.503809 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:01:20.504228 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:01:20.504502 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:01:20.505208 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:01:20.505208 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:01:20.565703 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:20.653974 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:20.653974 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:20.653974 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Attaching volume 31108657-63be-401c-a00e-137d133f11d8 to /dev/vdb
May 28 01:01:20.735292 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:01:20.763670 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:01:20.801870 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:20.858651 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:01:20.858651 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:01:20.872755 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:01:20.873099 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe75:1c46', 'fe80::8c3:73ff:fe68:9ea1', 'fe80::fc16:3eff:fef0:246e', 'fe80::fc16:3eff:feca:a831', 'fe80::e8d7:d3ff:fe11:4890', 'fe80::fc16:3eff:fe12:3f51', 'fe80::64e0:a4ff:fe34:ffd6', 'fe80::fc16:3eff:fe72:df47', 'fe80::fc16:3eff:fe3e:2329', 'fe80::fc16:3eff:fe9d:9858', 'fe80::fc16:3eff:fee7:febd', 'fe80::fc16:3eff:febd:1fa1', 'fe80::743e:7eff:fe2c:709c', 'fe80::fc16:3eff:fe5e:ef9c', 'fe80::6cd5:f5ff:fe52:2a3e'] 
May 28 01:01:20.873511 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:01:20.873511 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:01:20.873781 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:01:20.874040 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Updating existing volume attachment record: 8bebea02-5dc7-4282-af99-726941616ded {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:01:20.919614 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Attempting rescue
May 28 01:01:20.920232 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98319) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 28 01:01:20.939090 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Instance directory exists: not creating {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 01:01:20.939090 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Creating image(s)
May 28 01:01:20.939980 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:20.940270 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "/opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:20.941293 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "/opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:20.941567 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'trusted_certs' on Instance uuid bb62eb94-ea3e-47ec-bae7-43acb74061ef {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:01:21.008611 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:01:21.008611 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930081.0033534, 03f1821a-592e-4e02-b609-74f3d7e69b53 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:01:21.008611 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] VM Paused (Lifecycle Event)
May 28 01:01:21.013928 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Took 7.38 seconds to spawn the instance on the hypervisor.
May 28 01:01:21.014461 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:21.066887 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:21.072388 np0000001577 nova-compute[98319]: DEBUG nova.compute.rpcapi [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98319) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 01:01:21.086142 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:21.089797 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:21.089797 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:21.111988 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:21.112233 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:21.112413 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:21.112461 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:21.112813 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:21.128753 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Terminating instance
May 28 01:01:21.444652 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Object Instance<bb62eb94-ea3e-47ec-bae7-43acb74061ef> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:01:21.444652 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:01:21.447196 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:01:21.452580 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:21.452580 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:21.452801 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:01:21.463576 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:01:21.463576 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:21.491569 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:01:21.491569 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31108657-63be-401c-a00e-137d133f11d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:01:21.491569 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:01:21.508693 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:21.513826 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930081.5135145, 03f1821a-592e-4e02-b609-74f3d7e69b53 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:01:21.514009 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] VM Resumed (Lifecycle Event)
May 28 01:01:21.537380 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Took 17.34 seconds to build instance.
May 28 01:01:21.568667 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.105s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:21.568667 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/disk.rescue {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:21.671235 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ea9698ef-e58f-4daa-91aa-8d9858a2ae73 req-31596e82-324d-4652-905c-88fc8c564a63 service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Received event network-vif-plugged-95f81148-2a4e-4ca8-ad05-cb73d6f2951f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:21.671235 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ea9698ef-e58f-4daa-91aa-8d9858a2ae73 req-31596e82-324d-4652-905c-88fc8c564a63 service nova] Acquiring lock "03f1821a-592e-4e02-b609-74f3d7e69b53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:21.671235 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ea9698ef-e58f-4daa-91aa-8d9858a2ae73 req-31596e82-324d-4652-905c-88fc8c564a63 service nova] Lock "03f1821a-592e-4e02-b609-74f3d7e69b53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:21.671235 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ea9698ef-e58f-4daa-91aa-8d9858a2ae73 req-31596e82-324d-4652-905c-88fc8c564a63 service nova] Lock "03f1821a-592e-4e02-b609-74f3d7e69b53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:21.671235 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ea9698ef-e58f-4daa-91aa-8d9858a2ae73 req-31596e82-324d-4652-905c-88fc8c564a63 service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] No waiting events found dispatching network-vif-plugged-95f81148-2a4e-4ca8-ad05-cb73d6f2951f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:21.671235 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-ea9698ef-e58f-4daa-91aa-8d9858a2ae73 req-31596e82-324d-4652-905c-88fc8c564a63 service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Received unexpected event network-vif-plugged-95f81148-2a4e-4ca8-ad05-cb73d6f2951f for instance with vm_state active and task_state None.
May 28 01:01:21.671235 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ea9698ef-e58f-4daa-91aa-8d9858a2ae73 req-31596e82-324d-4652-905c-88fc8c564a63 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Received event network-vif-unplugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:21.671235 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ea9698ef-e58f-4daa-91aa-8d9858a2ae73 req-31596e82-324d-4652-905c-88fc8c564a63 service nova] Acquiring lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:21.671235 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ea9698ef-e58f-4daa-91aa-8d9858a2ae73 req-31596e82-324d-4652-905c-88fc8c564a63 service nova] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:21.671235 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ea9698ef-e58f-4daa-91aa-8d9858a2ae73 req-31596e82-324d-4652-905c-88fc8c564a63 service nova] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:21.671235 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ea9698ef-e58f-4daa-91aa-8d9858a2ae73 req-31596e82-324d-4652-905c-88fc8c564a63 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] No waiting events found dispatching network-vif-unplugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:21.671235 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-ea9698ef-e58f-4daa-91aa-8d9858a2ae73 req-31596e82-324d-4652-905c-88fc8c564a63 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Received unexpected event network-vif-unplugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa for instance with vm_state active and task_state rescuing.
May 28 01:01:21.671235 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ea9698ef-e58f-4daa-91aa-8d9858a2ae73 req-31596e82-324d-4652-905c-88fc8c564a63 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Received event network-vif-unplugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:21.671235 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ea9698ef-e58f-4daa-91aa-8d9858a2ae73 req-31596e82-324d-4652-905c-88fc8c564a63 service nova] Acquiring lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:21.671235 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ea9698ef-e58f-4daa-91aa-8d9858a2ae73 req-31596e82-324d-4652-905c-88fc8c564a63 service nova] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:21.671235 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ea9698ef-e58f-4daa-91aa-8d9858a2ae73 req-31596e82-324d-4652-905c-88fc8c564a63 service nova] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:21.671235 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ea9698ef-e58f-4daa-91aa-8d9858a2ae73 req-31596e82-324d-4652-905c-88fc8c564a63 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] No waiting events found dispatching network-vif-unplugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:21.671235 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-ea9698ef-e58f-4daa-91aa-8d9858a2ae73 req-31596e82-324d-4652-905c-88fc8c564a63 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Received unexpected event network-vif-unplugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa for instance with vm_state active and task_state rescuing.
May 28 01:01:21.671235 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/disk.rescue" returned: 0 in 0.066s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:21.671235 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:21.671235 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'migration_context' on Instance uuid bb62eb94-ea3e-47ec-bae7-43acb74061ef {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:01:21.671235 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:01:21.685348 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:21.698733 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:21.716839 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:21.721961 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:21.754589 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:21.939323 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d0055c1b-518f-40ca-ac46-a6e481a7d91c req-d28d11a3-7622-42de-8fe1-b44a5feead55 service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Received event network-vif-unplugged-0d344ede-14be-4d59-b796-097c682389f9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:21.942177 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d0055c1b-518f-40ca-ac46-a6e481a7d91c req-d28d11a3-7622-42de-8fe1-b44a5feead55 service nova] Acquiring lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:21.942177 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d0055c1b-518f-40ca-ac46-a6e481a7d91c req-d28d11a3-7622-42de-8fe1-b44a5feead55 service nova] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:21.942177 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d0055c1b-518f-40ca-ac46-a6e481a7d91c req-d28d11a3-7622-42de-8fe1-b44a5feead55 service nova] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:21.942177 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d0055c1b-518f-40ca-ac46-a6e481a7d91c req-d28d11a3-7622-42de-8fe1-b44a5feead55 service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] No waiting events found dispatching network-vif-unplugged-0d344ede-14be-4d59-b796-097c682389f9 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:21.942177 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d0055c1b-518f-40ca-ac46-a6e481a7d91c req-d28d11a3-7622-42de-8fe1-b44a5feead55 service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Received event network-vif-unplugged-0d344ede-14be-4d59-b796-097c682389f9 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:01:22.001375 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Instance destroyed successfully.
May 28 01:01:22.003098 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lazy-loading 'resources' on Instance uuid 2d2183ad-dbdb-4525-b678-39b72c7ab85d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:01:22.017473 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:22.020991 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:01:22.038689 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bbf1600c-29b1-4d6f-aa6e-28aa9f042158 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "03f1821a-592e-4e02-b609-74f3d7e69b53" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.853s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:22.122963 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:22.143269 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Object Instance<bb62eb94-ea3e-47ec-bae7-43acb74061ef> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:01:22.143269 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:01:22.146223 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Start _get_guest_xml network_info=[{"id": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "address": "fa:16:3e:df:9f:b0", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "vif_mac": "fa:16:3e:df:9f:b0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab3e003-1c", "ovs_interfaceid": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:01:22.146406 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'resources' on Instance uuid bb62eb94-ea3e-47ec-bae7-43acb74061ef {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:01:22.235240 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "refresh_cache-d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:01:22.235372 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquired lock "refresh_cache-d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:01:22.235932 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:01:22.252327 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.768s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:01:22.252327 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31108657-63be-401c-a00e-137d133f11d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:01:22.273611 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:01:22.273611 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:01:22.273611 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:01:22.273611 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:01:22.273611 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:01:22.274140 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:01:22.290067 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:01:22.290067 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:22.290749 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:01:22.290749 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:22.310909 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8] added
May 28 01:01:22.310909 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:01:22.310909 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:01:22.310909 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:01:22.310909 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:01:22.310909 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:01:22.310909 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:22.310909 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:01:22.310909 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0369(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:01:22.310909 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:01:22.319298 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8] added
May 28 01:01:22.319298 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:01:22.319298 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:01:22.319298 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:01:22.319298 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:01:22.319298 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:01:22.319298 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:22.319500 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:01:22.320537 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0466(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:01:22.320537 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:01:22.507837 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-126815204',display_name='tempest-ServerActionsTestOtherB-server-126815204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serveractionstestotherb-server-126815204',id=17,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHowHxSKo/GbZ3/T/DuqsFzaBQyor5k7f+0IXzkeGeXUAEkx6L+ijA0U/nuHnUHla5vZzHw/uAJ60OyJL0qlD41uqiYRDGnW+sKtXyVuDHBRaZp3vxryet5baLwLYdDdtg==',key_name='tempest-keypair-1717835047',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:01:18Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='78d410e4c6ea40ef87f92e84f362fa43',ramdisk_id='',reservation_id='r-6x23ytl1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-243435399',owner_user_name='tempest-ServerActionsTestOtherB-243435399-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:01:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c45fdc9fb964707b5e02c1b5c0ff1d8',uuid=2d2183ad-dbdb-4525-b678-39b72c7ab85d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d344ede-14be-4d59-b796-097c682389f9", "address": "fa:16:3e:bd:1f:a1", "network": {"id": "8dc9ea08-c48e-4321-b325-d1191e9557b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1143389599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78d410e4c6ea40ef87f92e84f362fa43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d344ede-14", "ovs_interfaceid": "0d344ede-14be-4d59-b796-097c682389f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:01:22.508110 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Converting VIF {"id": "0d344ede-14be-4d59-b796-097c682389f9", "address": "fa:16:3e:bd:1f:a1", "network": {"id": "8dc9ea08-c48e-4321-b325-d1191e9557b5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1143389599-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78d410e4c6ea40ef87f92e84f362fa43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d344ede-14", "ovs_interfaceid": "0d344ede-14be-4d59-b796-097c682389f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:01:22.508989 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:1f:a1,bridge_name='br-int',has_traffic_filtering=True,id=0d344ede-14be-4d59-b796-097c682389f9,network=Network(8dc9ea08-c48e-4321-b325-d1191e9557b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d344ede-14') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:01:22.509385 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:1f:a1,bridge_name='br-int',has_traffic_filtering=True,id=0d344ede-14be-4d59-b796-097c682389f9,network=Network(8dc9ea08-c48e-4321-b325-d1191e9557b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d344ede-14') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:01:22.511148 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:22.511490 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d344ede-14, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:22.514703 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:22.520296 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:22.522484 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:22.522806 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4645fac3-43ef-45dd-999d-6c58e8b88ba1) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:22.524842 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:22.528623 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999664485999801 future=<Future at 0x7c988415d5b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:22.530579 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999784789999921 future=<Future at 0x7c988415f770 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:22.530866 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:22.536595 np0000001577 nova-compute[98319]: INFO os_vif [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:1f:a1,bridge_name='br-int',has_traffic_filtering=True,id=0d344ede-14be-4d59-b796-097c682389f9,network=Network(8dc9ea08-c48e-4321-b325-d1191e9557b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d344ede-14')
May 28 01:01:22.536595 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:01:22.536853 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a390b885-c2b5-4116-b7ea-4ad467d6145f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:01:22.537000 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:01:22.651413 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Object Instance<bb62eb94-ea3e-47ec-bae7-43acb74061ef> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:01:22.657559 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:01:22.658902 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-240361421', uuid='bb62eb94-ea3e-47ec-bae7-43acb74061ef'), owner=OwnerMeta(userid='e2684c1dc140407b91687ee5abadef9d', username='tempest-ServerRescueNegativeTestJSON-509890320-project-member', projectid='a3c5a1da6bb242e9a58cb82855897726', projectname='tempest-ServerRescueNegativeTestJSON-509890320'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "address": "fa:16:3e:df:9f:b0", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "vif_mac": "fa:16:3e:df:9f:b0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab3e003-1c", "ovs_interfaceid": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930082.6584914) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:01:22.662817 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:01:22.663161 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:01:22.664142 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:01:22.664331 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:01:22.665826 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:01:22.667146 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:01:22.667146 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:01:22.667146 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:01:22.667146 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:01:22.667146 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:01:22.667146 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:01:22.667146 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:01:22.667146 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:01:22.667427 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:01:22.667427 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:01:22.667711 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:01:22.667913 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'vcpu_model' on Instance uuid bb62eb94-ea3e-47ec-bae7-43acb74061ef {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:01:22.739213 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:22.999761 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c76b9a53-a02a-454f-929d-ad7bca480f66 req-a7ad1a88-fd10-43dc-81c4-b6581edd72dc service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-deleted-02325a90-5e85-4e9f-a65e-c1bd91c39e80 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:23.000222 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-c76b9a53-a02a-454f-929d-ad7bca480f66 req-a7ad1a88-fd10-43dc-81c4-b6581edd72dc service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Neutron deleted interface 02325a90-5e85-4e9f-a65e-c1bd91c39e80; detaching it from the instance and deleting it from the info cache
May 28 01:01:23.001901 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c76b9a53-a02a-454f-929d-ad7bca480f66 req-a7ad1a88-fd10-43dc-81c4-b6581edd72dc service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Detach interface failed, port_id=02325a90-5e85-4e9f-a65e-c1bd91c39e80, reason: Instance 2dbd7449-2081-4377-a31d-e4d202679da1 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:01:23.170799 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Object Instance<bb62eb94-ea3e-47ec-bae7-43acb74061ef> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:01:23.188760 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:00:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-240361421',display_name='tempest-ServerRescueNegativeTestJSON-server-240361421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serverrescuenegativetestjson-server-240361421',id=23,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKn7tTGLKk5GWx/qXsTtMMPyTqpWzMQ3+xGcXKydQCCNbo47i9cV9uNt/ZMr4p7wotQSWkHq9iYZow9PLIPuvBzizYu/67KPau/RyQOJogkvkzBvtRSy37knH43xmdD1+w==',key_name='tempest-keypair-172442327',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:00:28Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3c5a1da6bb242e9a58cb82855897726',ramdisk_id='',reservation_id='r-dygf7jik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-509890320',owner_user_name='tempest-ServerRescueNegativeTestJSON-509890320-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:00:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e2684c1dc140407b91687ee5abadef9d',uuid=bb62eb94-ea3e-47ec-bae7-43acb74061ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "address": "fa:16:3e:df:9f:b0", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "vif_mac": "fa:16:3e:df:9f:b0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab3e003-1c", "ovs_interfaceid": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:01:23.189025 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Converting VIF {"id": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "address": "fa:16:3e:df:9f:b0", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "vif_mac": "fa:16:3e:df:9f:b0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab3e003-1c", "ovs_interfaceid": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:01:23.189706 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:9f:b0,bridge_name='br-int',has_traffic_filtering=True,id=9ab3e003-1c3a-467a-ad12-abbd852f7eaa,network=Network(1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ab3e003-1c') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:01:23.191424 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'pci_devices' on Instance uuid bb62eb94-ea3e-47ec-bae7-43acb74061ef {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:01:23.247002 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:23.314983 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:01:23.320492 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:01:23.338875 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:01:23.338875 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:01:23.355644 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:01:23.355644 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:23.358983 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:23.375879 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:23.384204 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:23.384204 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:23.384204 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:23.384204 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:23.384204 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:23.384204 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:23.384204 np0000001577 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:23.384204 np0000001577 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:23.384204 np0000001577 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:23.384204 np0000001577 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:23.384204 np0000001577 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f180c1e4-7c63-42cb-b572-ee2703f49334 (non-flash)
May 28 01:01:23.384204 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:01:23.384628 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:23.384628 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:23.384628 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:23.384628 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:23.384628 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:23.384628 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:23.384628 np0000001577 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:23.384628 np0000001577 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:23.384628 np0000001577 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:23.384628 np0000001577 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:23.384628 np0000001577 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f180c1e4-7c63-42cb-b572-ee2703f49334 (non-flash)
May 28 01:01:23.384628 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:01:23.405292 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:23.405292 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:23.405292 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:23.405292 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:23.405292 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:23.405292 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:23.405292 np0000001577 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:23.405292 np0000001577 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:23.405292 np0000001577 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:23.405292 np0000001577 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:23.405292 np0000001577 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f180c1e4-7c63-42cb-b572-ee2703f49334 (non-flash)
May 28 01:01:23.405292 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:01:23.405539 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:23.405539 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:23.405539 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:23.405539 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:23.405539 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:23.405539 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:23.405539 np0000001577 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:23.405539 np0000001577 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:23.405539 np0000001577 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:23.405539 np0000001577 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:23.405539 np0000001577 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f180c1e4-7c63-42cb-b572-ee2703f49334 (non-flash)
May 28 01:01:23.405539 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:01:23.458517 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Updating instance_info_cache with network_info: [{"id": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "address": "fa:16:3e:28:56:65", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3d348-6b", "ovs_interfaceid": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:01:23.465145 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8, portal: 192.168.50.100,3260]
May 28 01:01:23.465145 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8, portal: 192.168.50.100,3260] successful.
May 28 01:01:23.465145 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:23.466157 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8, portal: 192.168.40.100,3260]
May 28 01:01:23.466157 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8, portal: 192.168.40.100,3260] successful.
May 28 01:01:23.466157 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:23.481223 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:23.490582 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:23.512955 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:23.512955 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:23.512955 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:23.512955 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:23.512955 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:23.512955 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:23.512955 np0000001577 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:23.512955 np0000001577 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:23.512955 np0000001577 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:23.512955 np0000001577 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:23.512955 np0000001577 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f180c1e4-7c63-42cb-b572-ee2703f49334 (non-flash)
May 28 01:01:23.512955 np0000001577 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:01:23.512955 np0000001577 nova-compute[98319]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:01:23.512955 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:01:23.515007 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:23.515007 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:23.515007 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:23.515007 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:23.515007 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:23.515007 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:23.515007 np0000001577 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:23.515007 np0000001577 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:23.515007 np0000001577 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:23.515007 np0000001577 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:23.515007 np0000001577 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f180c1e4-7c63-42cb-b572-ee2703f49334 (non-flash)
May 28 01:01:23.515007 np0000001577 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:01:23.515007 np0000001577 nova-compute[98319]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:01:23.515007 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:01:23.515007 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.241s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:01:23.515007 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:01:23.516217 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] HCTL ('11', '-', '-', 0) found on session 56 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:01:23.517393 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:01:23.533918 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:23.533918 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:23.533918 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:23.533918 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:23.533918 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:23.533918 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:23.533918 np0000001577 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:23.533918 np0000001577 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:23.533918 np0000001577 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:23.533918 np0000001577 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:23.533918 np0000001577 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f180c1e4-7c63-42cb-b572-ee2703f49334 (non-flash)
May 28 01:01:23.533918 np0000001577 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:01:23.533918 np0000001577 nova-compute[98319]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:01:23.533918 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:01:23.533918 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:23.533918 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:23.533918 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:23.533918 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:23.533918 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:23.533918 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:23.533918 np0000001577 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:23.533918 np0000001577 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:23.533918 np0000001577 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:23.533918 np0000001577 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:23.533918 np0000001577 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f180c1e4-7c63-42cb-b572-ee2703f49334 (non-flash)
May 28 01:01:23.533918 np0000001577 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:01:23.533918 np0000001577 nova-compute[98319]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:01:23.533918 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:01:23.533918 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.254s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:01:23.533918 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:01:23.533918 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] HCTL ('8', '-', '-', 0) found on session 55 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:01:23.533918 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:01:23.544265 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Searching for a device in session 56 and hctl ['11', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:01:23.544265 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31108657-63be-401c-a00e-137d133f11d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:01:23.565269 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Searching for a device in session 55 and hctl ['8', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:01:23.565269 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '31108657-63be-401c-a00e-137d133f11d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:01:23.698105 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Object Instance<bb62eb94-ea3e-47ec-bae7-43acb74061ef> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:01:23.698105 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] End _get_guest_xml xml=<domain type="qemu">
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:   <uuid>bb62eb94-ea3e-47ec-bae7-43acb74061ef</uuid>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:   <name>instance-00000017</name>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-240361421</nova:name>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:01:22</nova:creationTime>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:         <nova:user uuid="e2684c1dc140407b91687ee5abadef9d">tempest-ServerRescueNegativeTestJSON-509890320-project-member</nova:user>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:         <nova:project uuid="a3c5a1da6bb242e9a58cb82855897726">tempest-ServerRescueNegativeTestJSON-509890320</nova:project>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:         <nova:port uuid="9ab3e003-1c3a-467a-ad12-abbd852f7eaa">
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:     <system>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       <entry name="serial">bb62eb94-ea3e-47ec-bae7-43acb74061ef</entry>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       <entry name="uuid">bb62eb94-ea3e-47ec-bae7-43acb74061ef</entry>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:     </system>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:   <os>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:   </os>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:   <features>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:   </features>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:   <devices>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/disk.rescue"/>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:     </disk>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/disk"/>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:     </disk>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/disk.config.rescue"/>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:     </disk>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:df:9f:b0"/>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       <target dev="tap9ab3e003-1c"/>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:     </interface>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/console.log" append="off"/>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:     </serial>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:     <video>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:     </video>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:     </rng>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:   </devices>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]: </domain>
May 28 01:01:23.698105 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:01:23.711830 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Instance destroyed successfully.
May 28 01:01:23.737189 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-bfe70eaa-d8a5-42fb-968d-0b06bf76fefb req-cd5927c5-8165-4007-95ac-1b805a79c722 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-deleted-8a85618a-56c3-4690-af32-885b836a2c19 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:23.741473 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-bfe70eaa-d8a5-42fb-968d-0b06bf76fefb req-cd5927c5-8165-4007-95ac-1b805a79c722 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Neutron deleted interface 8a85618a-56c3-4690-af32-885b836a2c19; detaching it from the instance and deleting it from the info cache
May 28 01:01:23.747454 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-bfe70eaa-d8a5-42fb-968d-0b06bf76fefb req-cd5927c5-8165-4007-95ac-1b805a79c722 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Detach interface failed, port_id=8a85618a-56c3-4690-af32-885b836a2c19, reason: Instance 2dbd7449-2081-4377-a31d-e4d202679da1 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:01:23.973758 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Releasing lock "refresh_cache-d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:01:24.061191 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-170843de-9d88-4ae0-9534-e3d351237e61 req-9f3b212e-7362-49ac-9588-b89a38ac2563 service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Received event network-vif-unplugged-0d344ede-14be-4d59-b796-097c682389f9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:24.061658 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-170843de-9d88-4ae0-9534-e3d351237e61 req-9f3b212e-7362-49ac-9588-b89a38ac2563 service nova] Acquiring lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:24.062377 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-170843de-9d88-4ae0-9534-e3d351237e61 req-9f3b212e-7362-49ac-9588-b89a38ac2563 service nova] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:24.062621 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-170843de-9d88-4ae0-9534-e3d351237e61 req-9f3b212e-7362-49ac-9588-b89a38ac2563 service nova] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:24.062730 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-170843de-9d88-4ae0-9534-e3d351237e61 req-9f3b212e-7362-49ac-9588-b89a38ac2563 service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] No waiting events found dispatching network-vif-unplugged-0d344ede-14be-4d59-b796-097c682389f9 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:24.062887 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-170843de-9d88-4ae0-9534-e3d351237e61 req-9f3b212e-7362-49ac-9588-b89a38ac2563 service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Received event network-vif-unplugged-0d344ede-14be-4d59-b796-097c682389f9 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:01:24.063022 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-170843de-9d88-4ae0-9534-e3d351237e61 req-9f3b212e-7362-49ac-9588-b89a38ac2563 service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Received event network-changed-95f81148-2a4e-4ca8-ad05-cb73d6f2951f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:24.063136 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-170843de-9d88-4ae0-9534-e3d351237e61 req-9f3b212e-7362-49ac-9588-b89a38ac2563 service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Refreshing instance network info cache due to event network-changed-95f81148-2a4e-4ca8-ad05-cb73d6f2951f. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:01:24.064486 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-170843de-9d88-4ae0-9534-e3d351237e61 req-9f3b212e-7362-49ac-9588-b89a38ac2563 service nova] Acquiring lock "refresh_cache-03f1821a-592e-4e02-b609-74f3d7e69b53" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:01:24.064939 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-170843de-9d88-4ae0-9534-e3d351237e61 req-9f3b212e-7362-49ac-9588-b89a38ac2563 service nova] Acquired lock "refresh_cache-03f1821a-592e-4e02-b609-74f3d7e69b53" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:01:24.065097 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-170843de-9d88-4ae0-9534-e3d351237e61 req-9f3b212e-7362-49ac-9588-b89a38ac2563 service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Refreshing network info cache for port 95f81148-2a4e-4ca8-ad05-cb73d6f2951f {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:01:24.274802 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:01:24.476885 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:01:24.491992 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:01:24.503826 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:01:24.527817 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:24.570062 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-170843de-9d88-4ae0-9534-e3d351237e61 req-9f3b212e-7362-49ac-9588-b89a38ac2563 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:24.575710 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:01:24.576018 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:01:24.587497 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:01:24.589673 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe75:1c46', 'fe80::8c3:73ff:fe68:9ea1', 'fe80::fc16:3eff:fef0:246e', 'fe80::fc16:3eff:feca:a831', 'fe80::e8d7:d3ff:fe11:4890', 'fe80::fc16:3eff:fe12:3f51', 'fe80::64e0:a4ff:fe34:ffd6', 'fe80::fc16:3eff:fe72:df47', 'fe80::fc16:3eff:fe3e:2329', 'fe80::fc16:3eff:fe9d:9858', 'fe80::fc16:3eff:fee7:febd', 'fe80::fc16:3eff:fe5e:ef9c', 'fe80::6cd5:f5ff:fe52:2a3e'] 
May 28 01:01:24.589803 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:01:24.589977 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:01:24.590348 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:01:24.975365 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-170843de-9d88-4ae0-9534-e3d351237e61 req-9f3b212e-7362-49ac-9588-b89a38ac2563 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:24.979490 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Took 4.58 seconds to deallocate network for instance.
May 28 01:01:25.099613 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-65288d7b-768b-48f2-8d28-702eba1b6450 req-710e156c-a4ec-46c1-9a92-3a69b1547276 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-deleted-3de085f7-074a-44c7-99ab-7093e0ddc084 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:25.151474 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-170843de-9d88-4ae0-9534-e3d351237e61 req-9f3b212e-7362-49ac-9588-b89a38ac2563 service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Updated VIF entry in instance network info cache for port 95f81148-2a4e-4ca8-ad05-cb73d6f2951f. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:01:25.152046 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-170843de-9d88-4ae0-9534-e3d351237e61 req-9f3b212e-7362-49ac-9588-b89a38ac2563 service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Updating instance_info_cache with network_info: [{"id": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "address": "fa:16:3e:5e:ef:9c", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f81148-2a", "ovs_interfaceid": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:01:25.240900 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:01:25.241416 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:01:25.241674 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:01:25.243585 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] No VIF found with MAC fa:16:3e:df:9f:b0, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:01:25.243585 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Using config drive
May 28 01:01:25.294928 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Found WWN 330000000c92c0359 for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:01:25.294928 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:01:25.294928 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] <== connect_volume: return (3808ms) {'type': 'block', 'scsi_wwn': '330000000c92c0359', 'path': '/dev/dm-0', 'multipath_id': '330000000c92c0359'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:01:25.294928 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c92c0359', 'path': '/dev/dm-0', 'multipath_id': '330000000c92c0359'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:01:25.295581 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.758s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:01:25.297189 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a390b885-c2b5-4116-b7ea-4ad467d6145f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:01:25.297440 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:01:25.299635 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lazy-loading 'flavor' on Instance uuid e2cc3304-bf2b-4196-b6c8-8ad56da19af4 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:01:25.336468 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:25.336468 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:25.336468 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:25.336468 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:25.336468 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:25.336468 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:25.336468 np0000001577 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:25.336468 np0000001577 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:25.336468 np0000001577 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:25.336468 np0000001577 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:25.336468 np0000001577 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f180c1e4-7c63-42cb-b572-ee2703f49334 (non-flash)
May 28 01:01:25.336468 np0000001577 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:01:25.336468 np0000001577 nova-compute[98319]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:01:25.336468 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:01:25.338840 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:25.338840 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:25.338840 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:25.338840 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:25.338840 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:25.338840 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:25.338840 np0000001577 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:25.338840 np0000001577 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f (non-flash)
May 28 01:01:25.338840 np0000001577 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:25.338840 np0000001577 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:25.338840 np0000001577 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f180c1e4-7c63-42cb-b572-ee2703f49334 (non-flash)
May 28 01:01:25.338840 np0000001577 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:01:25.338840 np0000001577 nova-compute[98319]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:01:25.338840 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:01:25.338840 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56', '48'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56', '49'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f180c1e4-7c63-42cb-b572-ee2703f49334', '54'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', '55'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', '56')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:01:25.338840 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', '50')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:01:25.341163 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f', '51')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:01:25.343742 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c98705271a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f'): ({'sdm'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:01:25.343742 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Removing multipathed devices sdm, sdl {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:01:25.343742 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Flush multipath device 33000000018e747c1 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:01:25.384246 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:01:25.454262 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:01:25.503042 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:01:25.503316 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:01:25.504595 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:01:25.523265 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:01:25.523571 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:01:25.541896 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:25.588959 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f, portal: 192.168.40.100,3260]
May 28 01:01:25.588959 np0000001577 nova-compute[98319]: Logout of [sid: 50, target: iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f, portal: 192.168.40.100,3260] successful.
May 28 01:01:25.588959 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:25.611651 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:25.624696 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:25.656567 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-170843de-9d88-4ae0-9534-e3d351237e61 req-9f3b212e-7362-49ac-9588-b89a38ac2563 service nova] Releasing lock "refresh_cache-03f1821a-592e-4e02-b609-74f3d7e69b53" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:01:25.656567 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-170843de-9d88-4ae0-9534-e3d351237e61 req-9f3b212e-7362-49ac-9588-b89a38ac2563 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-deleted-59a7e22c-8c09-4a33-9b95-58ee955f6895 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:25.656567 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-170843de-9d88-4ae0-9534-e3d351237e61 req-9f3b212e-7362-49ac-9588-b89a38ac2563 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Neutron deleted interface 59a7e22c-8c09-4a33-9b95-58ee955f6895; detaching it from the instance and deleting it from the info cache
May 28 01:01:25.656763 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-170843de-9d88-4ae0-9534-e3d351237e61 req-9f3b212e-7362-49ac-9588-b89a38ac2563 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Detach interface failed, port_id=59a7e22c-8c09-4a33-9b95-58ee955f6895, reason: Instance 2dbd7449-2081-4377-a31d-e4d202679da1 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:01:25.671727 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f, portal: 192.168.50.100,3260]
May 28 01:01:25.671727 np0000001577 nova-compute[98319]: Logout of [sid: 51, target: iqn.2023-03.storpool.com:os--volume-a390b885-c2b5-4116-b7ea-4ad467d6145f, portal: 192.168.50.100,3260] successful.
May 28 01:01:25.671727 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:25.695580 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:25.695986 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:01:25.696163 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] <== disconnect_volume: return (3159ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:01:25.696330 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:01:25.696673 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Deleting instance files /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d_del
May 28 01:01:25.704512 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Deletion of /opt/stack/data/nova/instances/2d2183ad-dbdb-4525-b678-39b72c7ab85d_del complete
May 28 01:01:25.748569 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'ec2_ids' on Instance uuid bb62eb94-ea3e-47ec-bae7-43acb74061ef {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:01:25.754766 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Starting finish_migration {{(pid=98319) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 28 01:01:25.757344 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Instance directory exists: not creating {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 01:01:25.757816 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Creating image(s)
May 28 01:01:25.760117 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:25.807683 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Attempting to attach volume 31108657-63be-401c-a00e-137d133f11d8 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:01:25.812725 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:01:25.812725 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:01:25.812725 np0000001577 nova-compute[98319]:   <alias name="ua-31108657-63be-401c-a00e-137d133f11d8"/>
May 28 01:01:25.812725 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 28 01:01:25.812725 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:01:25.812725 np0000001577 nova-compute[98319]:   <serial>31108657-63be-401c-a00e-137d133f11d8</serial>
May 28 01:01:25.812725 np0000001577 nova-compute[98319]: </disk>
May 28 01:01:25.812725 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:01:25.841180 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ac721510-8309-4b6e-9fd1-08c11d203343 req-159afce7-ea93-4b5b-a969-7a983a920020 service nova] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Received event network-vif-deleted-d1b61752-f189-4f02-b9eb-92326fb29830 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:25.842143 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.083s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:25.845565 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:01:25.845565 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:25.982725 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:25.982971 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Cannot resize image /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:01:26.072573 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:26.209702 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Took 4.57 seconds to destroy the instance on the hypervisor.
May 28 01:01:26.210691 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:01:26.210988 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:01:26.211141 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:01:26.211511 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:26.257052 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Object Instance<bb62eb94-ea3e-47ec-bae7-43acb74061ef> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:01:26.257052 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'keypairs' on Instance uuid bb62eb94-ea3e-47ec-bae7-43acb74061ef {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:01:26.281519 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:26.316571 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors.luks [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] opening encrypted volume /dev/dm-8 {{(pid=98319) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 28 01:01:26.492569 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:01:26.492569 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Ensure instance console log exists: /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:01:26.492569 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:26.492569 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:26.492569 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:26.502904 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Start _get_guest_xml network_info=[{"id": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "address": "fa:16:3e:28:56:65", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "vif_mac": "fa:16:3e:28:56:65"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3d348-6b", "ovs_interfaceid": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd15f465c-138e-4c23-9b17-0b08887300f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'd87bb95b-a1e9-4786-8bee-16f2cfaabf2d', 'attached_at': '2026-05-28T01:01:25.000000', 'detached_at': '', 'volume_id': 'd15f465c-138e-4c23-9b17-0b08887300f1', 'multiattach': True, 'serial': 'd15f465c-138e-4c23-9b17-0b08887300f1'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'c89f7280-e814-471c-9bc6-d342e6885c24', 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:01:26.507406 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:01:26.509072 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='d87bb95b-a1e9-4786-8bee-16f2cfaabf2d'), owner=OwnerMeta(userid='f8586a18edcf42cab0a60028135ae401', username='tempest-AttachVolumeMultiAttachTest-89204095-project-member', projectid='938c2829112843edb2054984e80ce7ad', projectname='tempest-AttachVolumeMultiAttachTest-89204095'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "address": "fa:16:3e:28:56:65", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "vif_mac": "fa:16:3e:28:56:65"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3d348-6b", "ovs_interfaceid": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930086.508595) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:01:26.512341 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:01:26.512857 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:01:26.514381 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:01:26.514633 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:01:26.516217 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:01:26.516304 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:01:26.516464 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:01:26.516615 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:01:26.516823 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:01:26.516950 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:01:26.517097 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:01:26.517351 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:01:26.517864 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:01:26.518055 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:01:26.518926 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:01:26.518926 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:01:26.536418 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk.config --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:26.649152 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk.config --force-share --output=json" returned: 0 in 0.113s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:26.649820 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "/opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:26.650125 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "/opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:26.650915 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "/opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:26.651356 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:01:26.651808 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd15f465c-138e-4c23-9b17-0b08887300f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:01:26.652011 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:01:26.652391 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:01:26.652866 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd15f465c-138e-4c23-9b17-0b08887300f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:01:26.678559 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:01:26.679068 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:01:26.679445 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:01:26.679801 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:01:26.680057 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:01:26.680224 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.startup = automatic
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.session.scan = manual
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:01:26.698500 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:01:26.698500 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.startup = automatic
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.session.scan = manual
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:01:26.711696 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:01:26.711696 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:26.716568 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:26.732335 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:26.745073 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:26.745073 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:26.745073 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:26.745073 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:26.745073 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:26.745073 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:26.745073 np0000001577 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:26.745073 np0000001577 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:26.745073 np0000001577 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f180c1e4-7c63-42cb-b572-ee2703f49334 (non-flash)
May 28 01:01:26.745073 np0000001577 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:01:26.745073 np0000001577 nova-compute[98319]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:01:26.745073 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:01:26.748558 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:26.748558 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:26.748558 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:26.748558 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:26.748558 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:26.748558 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:26.748558 np0000001577 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:26.748558 np0000001577 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:26.748558 np0000001577 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f180c1e4-7c63-42cb-b572-ee2703f49334 (non-flash)
May 28 01:01:26.748558 np0000001577 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:01:26.748558 np0000001577 nova-compute[98319]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:01:26.748558 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:01:26.748558 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.067s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:01:26.748558 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Took 1.77 seconds to detach 3 volumes for instance.
May 28 01:01:26.749338 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:01:26.753511 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] HCTL ('15', '0', '0', 0) found on session 45 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:01:26.754494 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Scanning host 15 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:01:26.758676 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:26.758676 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:26.758676 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:26.758676 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:26.758676 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:26.758676 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:26.758676 np0000001577 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:26.758676 np0000001577 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:26.758676 np0000001577 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f180c1e4-7c63-42cb-b572-ee2703f49334 (non-flash)
May 28 01:01:26.758676 np0000001577 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:01:26.758676 np0000001577 nova-compute[98319]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:01:26.758676 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:01:26.758923 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:26.758923 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:26.758923 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:26.758923 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:26.758923 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:26.758923 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:26.758923 np0000001577 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:26.758923 np0000001577 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:26.758923 np0000001577 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f180c1e4-7c63-42cb-b572-ee2703f49334 (non-flash)
May 28 01:01:26.758923 np0000001577 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:01:26.758923 np0000001577 nova-compute[98319]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:01:26.758923 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:01:26.759260 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.079s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:01:26.759433 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:01:26.763233 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Object Instance<bb62eb94-ea3e-47ec-bae7-43acb74061ef> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:01:26.768862 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:26.775124 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Searching for a device in session 45 and hctl ('15', '0', '0', 0) yield: sdj {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:01:26.775408 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd15f465c-138e-4c23-9b17-0b08887300f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:01:26.776533 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] HCTL ('16', '0', '0', 0) found on session 46 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:01:26.776907 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Scanning host 16 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:01:26.789137 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Searching for a device in session 46 and hctl ('16', '0', '0', 0) yield: sdk {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:01:26.789289 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd15f465c-138e-4c23-9b17-0b08887300f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:01:26.853096 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d97f8aa5-d92e-4c6a-bbc1-e3a110cf3fad req-7aa96684-9813-4016-9224-ce36f9a04381 service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Received event network-vif-deleted-0d344ede-14be-4d59-b796-097c682389f9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:26.853289 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-d97f8aa5-d92e-4c6a-bbc1-e3a110cf3fad req-7aa96684-9813-4016-9224-ce36f9a04381 service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Neutron deleted interface 0d344ede-14be-4d59-b796-097c682389f9; detaching it from the instance and deleting it from the info cache
May 28 01:01:26.859588 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d97f8aa5-d92e-4c6a-bbc1-e3a110cf3fad req-7aa96684-9813-4016-9224-ce36f9a04381 service nova] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Detach interface failed, port_id=0d344ede-14be-4d59-b796-097c682389f9, reason: Instance 2d2183ad-dbdb-4525-b678-39b72c7ab85d could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:01:26.931595 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Creating config drive at /opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/disk.config.rescue
May 28 01:01:26.935860 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp95ynl9to {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:26.982867 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp95ynl9to" returned: 0 in 0.047s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:27.267099 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:27.268096 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.005s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:27.297002 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:01:27.524450 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:27.528897 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:27.536665 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:01:27.536879 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:01:27.537034 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:01:27.537175 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] No VIF found with MAC fa:16:3e:9d:98:58, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:01:27.565139 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:27.649359 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:27.681009 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:01:27.753847 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:27.755016 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:27.806294 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Took 1.59 seconds to deallocate network for instance.
May 28 01:01:27.943678 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-49acda54-98b5-4442-931b-34989b8bd7ca req-f9a855d1-2098-4903-8d67-2f3709407671 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Received event network-vif-plugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:27.943888 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-49acda54-98b5-4442-931b-34989b8bd7ca req-f9a855d1-2098-4903-8d67-2f3709407671 service nova] Acquiring lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:27.944029 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-49acda54-98b5-4442-931b-34989b8bd7ca req-f9a855d1-2098-4903-8d67-2f3709407671 service nova] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:27.944149 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-49acda54-98b5-4442-931b-34989b8bd7ca req-f9a855d1-2098-4903-8d67-2f3709407671 service nova] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:27.944276 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-49acda54-98b5-4442-931b-34989b8bd7ca req-f9a855d1-2098-4903-8d67-2f3709407671 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] No waiting events found dispatching network-vif-plugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:27.944419 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-49acda54-98b5-4442-931b-34989b8bd7ca req-f9a855d1-2098-4903-8d67-2f3709407671 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Received unexpected event network-vif-plugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa for instance with vm_state active and task_state rescuing.
May 28 01:01:28.132086 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:01:28.132345 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:01:28.363469 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Removed pending STOPPED event for bb62eb94-ea3e-47ec-bae7-43acb74061ef due to new event <LifecycleEvent: 1779930088.3625062, bb62eb94-ea3e-47ec-bae7-43acb74061ef => Resumed> {{(pid=98319) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 01:01:28.363469 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930088.3625062, bb62eb94-ea3e-47ec-bae7-43acb74061ef => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:01:28.363469 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] VM Resumed (Lifecycle Event)
May 28 01:01:28.366889 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-5a29e849-0176-40da-b6f7-b2d35ba316dc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:28.379613 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Took 0.57 seconds to detach 1 volumes for instance.
May 28 01:01:28.635600 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:01:28.866614 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:28.867878 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:01:28.884666 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:28.900535 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:01:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-775064717',display_name='tempest-TestVolumeBootPattern-server-775064717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpattern-server-775064717',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='050f928f1ce449d6a447cd343dc4ff80',ramdisk_id='',reservation_id='r-ev9dxfpk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1449742411',owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:01:10Z,user_data=None,user_id='0c803ddeaf4f4b3db07587419087b3b2',uuid=dc47e3bc-028d-4166-b702-91cbbd62f80e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f28aa177-6927-4987-8127-d3f565bd347e", "address": "fa:16:3e:0b:7f:79", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf28aa177-69", "ovs_interfaceid": "f28aa177-6927-4987-8127-d3f565bd347e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:01:28.900722 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converting VIF {"id": "f28aa177-6927-4987-8127-d3f565bd347e", "address": "fa:16:3e:0b:7f:79", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf28aa177-69", "ovs_interfaceid": "f28aa177-6927-4987-8127-d3f565bd347e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:01:28.901221 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:7f:79,bridge_name='br-int',has_traffic_filtering=True,id=f28aa177-6927-4987-8127-d3f565bd347e,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf28aa177-69') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:01:28.902135 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lazy-loading 'pci_devices' on Instance uuid dc47e3bc-028d-4166-b702-91cbbd62f80e {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:01:29.053160 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00042108699994969356 future=<Future at 0x7c984c54f860 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:29.053236 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:29.053478 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=5.866425427999957 future=<Future at 0x7c9870574fe0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:29.053478 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=5.866347872999995 future=<Future at 0x7c9870574fe0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:29.054016 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Emitting event <LifecycleEvent: 1779930074.052592, 2dbd7449-2081-4377-a31d-e4d202679da1 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:01:29.054235 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] VM Stopped (Lifecycle Event)
May 28 01:01:29.106061 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3ba210d8-c92f-45ae-88db-f9fbcc700a38 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.453s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:29.144653 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.877s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:29.147979 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.263s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:29.149094 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:29.204350 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Deleted allocations for instance 2dbd7449-2081-4377-a31d-e4d202679da1
May 28 01:01:29.221802 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Deleted allocations for instance 2d2183ad-dbdb-4525-b678-39b72c7ab85d
May 28 01:01:29.371968 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930089.371642, bb62eb94-ea3e-47ec-bae7-43acb74061ef => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:01:29.372375 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] VM Started (Lifecycle Event)
May 28 01:01:29.405808 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] End _get_guest_xml xml=<domain type="qemu">
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:   <uuid>dc47e3bc-028d-4166-b702-91cbbd62f80e</uuid>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:   <name>instance-0000001b</name>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestVolumeBootPattern-server-775064717</nova:name>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:01:12</nova:creationTime>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       <nova:image uuid="">
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:         <nova:properties/>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:         <nova:user uuid="0c803ddeaf4f4b3db07587419087b3b2">tempest-TestVolumeBootPattern-1449742411-project-member</nova:user>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:         <nova:project uuid="050f928f1ce449d6a447cd343dc4ff80">tempest-TestVolumeBootPattern-1449742411</nova:project>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:         <nova:port uuid="f28aa177-6927-4987-8127-d3f565bd347e">
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:     <system>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       <entry name="serial">dc47e3bc-028d-4166-b702-91cbbd62f80e</entry>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       <entry name="uuid">dc47e3bc-028d-4166-b702-91cbbd62f80e</entry>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:     </system>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:   <os>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:   </os>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:   <features>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:   </features>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:   <devices>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/dc47e3bc-028d-4166-b702-91cbbd62f80e/disk.config"/>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:     </disk>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       <alias name="ua-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7"/>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-8"/>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       <serial>3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7</serial>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:     </disk>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:0b:7f:79"/>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       <target dev="tapf28aa177-69"/>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:     </interface>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/dc47e3bc-028d-4166-b702-91cbbd62f80e/console.log" append="off"/>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:     </serial>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:     <video>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:     </video>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:     </rng>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:   </devices>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]: </domain>
May 28 01:01:29.405808 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:01:29.407889 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Preparing to wait for external event network-vif-plugged-f28aa177-6927-4987-8127-d3f565bd347e {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:01:29.407889 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "dc47e3bc-028d-4166-b702-91cbbd62f80e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:29.407889 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "dc47e3bc-028d-4166-b702-91cbbd62f80e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:29.407889 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "dc47e3bc-028d-4166-b702-91cbbd62f80e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:29.408001 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:01:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-775064717',display_name='tempest-TestVolumeBootPattern-server-775064717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpattern-server-775064717',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='050f928f1ce449d6a447cd343dc4ff80',ramdisk_id='',reservation_id='r-ev9dxfpk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1449742411',owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:01:10Z,user_data=None,user_id='0c803ddeaf4f4b3db07587419087b3b2',uuid=dc47e3bc-028d-4166-b702-91cbbd62f80e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f28aa177-6927-4987-8127-d3f565bd347e", "address": "fa:16:3e:0b:7f:79", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf28aa177-69", "ovs_interfaceid": "f28aa177-6927-4987-8127-d3f565bd347e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:01:29.408290 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converting VIF {"id": "f28aa177-6927-4987-8127-d3f565bd347e", "address": "fa:16:3e:0b:7f:79", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf28aa177-69", "ovs_interfaceid": "f28aa177-6927-4987-8127-d3f565bd347e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:01:29.408740 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:7f:79,bridge_name='br-int',has_traffic_filtering=True,id=f28aa177-6927-4987-8127-d3f565bd347e,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf28aa177-69') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:01:29.409034 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:7f:79,bridge_name='br-int',has_traffic_filtering=True,id=f28aa177-6927-4987-8127-d3f565bd347e,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf28aa177-69') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:01:29.409502 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:29.412590 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:29.412590 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:01:29.412590 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:29.412590 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '511804fb-39ef-51b1-9cb2-772401444dd3', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:29.413050 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:29.413748 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:29.414198 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:29.416657 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:29.416657 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf28aa177-69, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:29.417007 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf28aa177-69, col_values=(('qos', UUID('a9388b8e-09c9-457d-8bbf-a7c18cd9d3e5')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:29.417216 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf28aa177-69, col_values=(('external_ids', {'iface-id': 'f28aa177-6927-4987-8127-d3f565bd347e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:7f:79', 'vm-uuid': 'dc47e3bc-028d-4166-b702-91cbbd62f80e'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:29.417982 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:29.419132 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:29.423595 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:29.425666 np0000001577 nova-compute[98319]: INFO os_vif [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:7f:79,bridge_name='br-int',has_traffic_filtering=True,id=f28aa177-6927-4987-8127-d3f565bd347e,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf28aa177-69')
May 28 01:01:29.561980 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 2dbd7449-2081-4377-a31d-e4d202679da1] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:29.874186 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:29.875942 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:01:30.005078 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ba8edca5-615c-4055-8a94-e6de3ff0123c req-7e1aa12c-b4cd-43dd-9875-c2b3130444a1 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Received event network-vif-plugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:30.005855 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ba8edca5-615c-4055-8a94-e6de3ff0123c req-7e1aa12c-b4cd-43dd-9875-c2b3130444a1 service nova] Acquiring lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:30.006088 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ba8edca5-615c-4055-8a94-e6de3ff0123c req-7e1aa12c-b4cd-43dd-9875-c2b3130444a1 service nova] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:30.006237 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ba8edca5-615c-4055-8a94-e6de3ff0123c req-7e1aa12c-b4cd-43dd-9875-c2b3130444a1 service nova] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:30.008043 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ba8edca5-615c-4055-8a94-e6de3ff0123c req-7e1aa12c-b4cd-43dd-9875-c2b3130444a1 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] No waiting events found dispatching network-vif-plugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:30.008218 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-ba8edca5-615c-4055-8a94-e6de3ff0123c req-7e1aa12c-b4cd-43dd-9875-c2b3130444a1 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Received unexpected event network-vif-plugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa for instance with vm_state rescued and task_state unrescuing.
May 28 01:01:30.038763 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-c31c8fad-27dc-4b16-a8fa-1138c63ccac8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Unrescuing
May 28 01:01:30.038953 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c31c8fad-27dc-4b16-a8fa-1138c63ccac8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "refresh_cache-bb62eb94-ea3e-47ec-bae7-43acb74061ef" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:01:30.039070 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c31c8fad-27dc-4b16-a8fa-1138c63ccac8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquired lock "refresh_cache-bb62eb94-ea3e-47ec-bae7-43acb74061ef" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:01:30.039197 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-c31c8fad-27dc-4b16-a8fa-1138c63ccac8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:01:30.216026 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-995d8255-444b-4092-a514-e444c295b100 tempest-TaggedBootDevicesTest_v242-1752653874 tempest-TaggedBootDevicesTest_v242-1752653874-project-member] Lock "2dbd7449-2081-4377-a31d-e4d202679da1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 17.394s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:30.230517 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e42dd478-5568-4e31-900b-9ab82ef50015 tempest-ServerActionsTestOtherB-243435399 tempest-ServerActionsTestOtherB-243435399-project-member] Lock "2d2183ad-dbdb-4525-b678-39b72c7ab85d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.118s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:30.381978 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 28 01:01:30.541308 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c31c8fad-27dc-4b16-a8fa-1138c63ccac8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:30.902626 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c31c8fad-27dc-4b16-a8fa-1138c63ccac8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:30.925216 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Rebuilding instance
May 28 01:01:30.946351 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:01:30.947219 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:01:30.947219 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] No VIF found with MAC fa:16:3e:0b:7f:79, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:01:30.947219 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Using config drive
May 28 01:01:31.069949 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:31.097082 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-c31c8fad-27dc-4b16-a8fa-1138c63ccac8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Updating instance_info_cache with network_info: [{"id": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "address": "fa:16:3e:df:9f:b0", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab3e003-1c", "ovs_interfaceid": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:01:31.099374 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:31.456147 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:31.600837 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c31c8fad-27dc-4b16-a8fa-1138c63ccac8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Releasing lock "refresh_cache-bb62eb94-ea3e-47ec-bae7-43acb74061ef" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:01:31.600837 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-c31c8fad-27dc-4b16-a8fa-1138c63ccac8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'flavor' on Instance uuid bb62eb94-ea3e-47ec-bae7-43acb74061ef {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:01:31.612698 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Creating config drive at /opt/stack/data/nova/instances/dc47e3bc-028d-4166-b702-91cbbd62f80e/disk.config
May 28 01:01:31.617087 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/dc47e3bc-028d-4166-b702-91cbbd62f80e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpoog887ob {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:31.673515 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/dc47e3bc-028d-4166-b702-91cbbd62f80e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpoog887ob" returned: 0 in 0.056s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:31.979347 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:01:31.980776 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:01:32.152487 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:32.210127 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:32.243347 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:32.248648 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:32.318089 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:32.340710 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:32.353093 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:32.367948 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ab44e2fa-83a6-4d0e-b093-e5948f1a9fd8 req-575ba53b-91f1-461f-9189-3d79bd5466b9 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Received event network-vif-unplugged-b1c5ca58-a892-4f67-840e-810089b1fe6a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:32.368475 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ab44e2fa-83a6-4d0e-b093-e5948f1a9fd8 req-575ba53b-91f1-461f-9189-3d79bd5466b9 service nova] Acquiring lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:32.368475 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ab44e2fa-83a6-4d0e-b093-e5948f1a9fd8 req-575ba53b-91f1-461f-9189-3d79bd5466b9 service nova] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:32.368475 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ab44e2fa-83a6-4d0e-b093-e5948f1a9fd8 req-575ba53b-91f1-461f-9189-3d79bd5466b9 service nova] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:32.368670 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ab44e2fa-83a6-4d0e-b093-e5948f1a9fd8 req-575ba53b-91f1-461f-9189-3d79bd5466b9 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] No waiting events found dispatching network-vif-unplugged-b1c5ca58-a892-4f67-840e-810089b1fe6a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:32.369763 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-ab44e2fa-83a6-4d0e-b093-e5948f1a9fd8 req-575ba53b-91f1-461f-9189-3d79bd5466b9 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Received unexpected event network-vif-unplugged-b1c5ca58-a892-4f67-840e-810089b1fe6a for instance with vm_state active and task_state rebuilding.
May 28 01:01:32.449459 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:32.492965 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:32.502665 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:32.512031 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999599637000074 future=<Future at 0x7c988416b4a0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:32.517692 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Instance destroyed successfully.
May 28 01:01:32.525138 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:32.591000 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:32.607672 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:32.618293 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-02f35e4e-85df-453b-8e6a-bd1bd9dab2b2 req-d27f67db-9e46-4f07-94e9-017e8289c795 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Received event network-vif-unplugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:32.618293 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-02f35e4e-85df-453b-8e6a-bd1bd9dab2b2 req-d27f67db-9e46-4f07-94e9-017e8289c795 service nova] Acquiring lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:32.618666 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-02f35e4e-85df-453b-8e6a-bd1bd9dab2b2 req-d27f67db-9e46-4f07-94e9-017e8289c795 service nova] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:32.618666 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-02f35e4e-85df-453b-8e6a-bd1bd9dab2b2 req-d27f67db-9e46-4f07-94e9-017e8289c795 service nova] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:32.618757 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-02f35e4e-85df-453b-8e6a-bd1bd9dab2b2 req-d27f67db-9e46-4f07-94e9-017e8289c795 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] No waiting events found dispatching network-vif-unplugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:32.620455 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-02f35e4e-85df-453b-8e6a-bd1bd9dab2b2 req-d27f67db-9e46-4f07-94e9-017e8289c795 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Received unexpected event network-vif-unplugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa for instance with vm_state rescued and task_state unrescuing.
May 28 01:01:32.632989 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Detaching volume 31108657-63be-401c-a00e-137d133f11d8
May 28 01:01:32.693321 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Attempting to driver detach volume 31108657-63be-401c-a00e-137d133f11d8 from mountpoint /dev/vdb
May 28 01:01:32.720945 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Found disk vdb by alias ua-31108657-63be-401c-a00e-137d133f11d8 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:01:32.721762 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999289661000148 future=<Future at 0x7c98704d0530 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:32.723438 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Attempting to detach device vdb from instance e2cc3304-bf2b-4196-b6c8-8ad56da19af4 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:01:32.724136 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:01:32.724136 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:01:32.724136 np0000001577 nova-compute[98319]:   <alias name="ua-31108657-63be-401c-a00e-137d133f11d8"/>
May 28 01:01:32.724136 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 28 01:01:32.724136 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:01:32.724136 np0000001577 nova-compute[98319]:   <serial>31108657-63be-401c-a00e-137d133f11d8</serial>
May 28 01:01:32.724136 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:01:32.724136 np0000001577 nova-compute[98319]: </disk>
May 28 01:01:32.724136 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:01:32.724136 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Instance destroyed successfully.
May 28 01:01:32.725449 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-c31c8fad-27dc-4b16-a8fa-1138c63ccac8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'numa_topology' on Instance uuid bb62eb94-ea3e-47ec-bae7-43acb74061ef {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:01:32.743301 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Successfully detached device vdb from instance e2cc3304-bf2b-4196-b6c8-8ad56da19af4 from the persistent domain config.
May 28 01:01:32.744890 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:01:32.746769 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31108657-63be-401c-a00e-137d133f11d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:01:32.746769 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:01:32.904301 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:32.978332 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:01:32.978882 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 01:01:32.978882 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:01:33.037448 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:33.049426 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:33.053251 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:33.086153 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:33.099741 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:33.233203 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-c31c8fad-27dc-4b16-a8fa-1138c63ccac8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Object Instance<bb62eb94-ea3e-47ec-bae7-43acb74061ef> lazy-loaded attributes: flavor,numa_topology {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:01:33.431897 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:33.448128 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:33.454996 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930093.4546056, dc47e3bc-028d-4166-b702-91cbbd62f80e => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:01:33.455153 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] VM Started (Lifecycle Event)
May 28 01:01:33.611635 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:33.622419 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:33.724646 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:33.762335 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:33.765873 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:33.862453 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:33.911651 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:33.917534 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:33.957823 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:33.963093 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930093.9627872, dc47e3bc-028d-4166-b702-91cbbd62f80e => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:01:33.963272 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] VM Paused (Lifecycle Event)
May 28 01:01:33.977925 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:01:33.978167 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:01:34.428562 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:34.455597 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Received event network-vif-unplugged-b1c5ca58-a892-4f67-840e-810089b1fe6a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:34.455597 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] Acquiring lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:34.455597 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:34.455597 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:34.455597 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] No waiting events found dispatching network-vif-unplugged-b1c5ca58-a892-4f67-840e-810089b1fe6a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:34.455597 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Received unexpected event network-vif-unplugged-b1c5ca58-a892-4f67-840e-810089b1fe6a for instance with vm_state active and task_state rebuilding.
May 28 01:01:34.455597 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Received event network-vif-plugged-f28aa177-6927-4987-8127-d3f565bd347e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:34.456604 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] Acquiring lock "dc47e3bc-028d-4166-b702-91cbbd62f80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:34.457227 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] Lock "dc47e3bc-028d-4166-b702-91cbbd62f80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:34.457507 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] Lock "dc47e3bc-028d-4166-b702-91cbbd62f80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:34.457846 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Processing event network-vif-plugged-f28aa177-6927-4987-8127-d3f565bd347e {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:01:34.458058 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Received event network-vif-plugged-f28aa177-6927-4987-8127-d3f565bd347e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:34.458290 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] Acquiring lock "dc47e3bc-028d-4166-b702-91cbbd62f80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:34.458934 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:01:34.459371 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] Lock "dc47e3bc-028d-4166-b702-91cbbd62f80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:34.459439 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] Lock "dc47e3bc-028d-4166-b702-91cbbd62f80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:34.459696 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] No waiting events found dispatching network-vif-plugged-f28aa177-6927-4987-8127-d3f565bd347e {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:34.460674 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Received unexpected event network-vif-plugged-f28aa177-6927-4987-8127-d3f565bd347e for instance with vm_state building and task_state spawning.
May 28 01:01:34.460674 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Received event network-vif-plugged-b1c5ca58-a892-4f67-840e-810089b1fe6a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:34.460674 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] Acquiring lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:34.460674 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:34.460674 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:34.460674 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] No waiting events found dispatching network-vif-plugged-b1c5ca58-a892-4f67-840e-810089b1fe6a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:34.460674 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Received unexpected event network-vif-plugged-b1c5ca58-a892-4f67-840e-810089b1fe6a for instance with vm_state active and task_state rebuilding.
May 28 01:01:34.461072 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Received event network-vif-plugged-b1c5ca58-a892-4f67-840e-810089b1fe6a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:34.461318 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] Acquiring lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:34.461526 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:34.461720 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:34.461930 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] No waiting events found dispatching network-vif-plugged-b1c5ca58-a892-4f67-840e-810089b1fe6a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:34.464678 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Received unexpected event network-vif-plugged-b1c5ca58-a892-4f67-840e-810089b1fe6a for instance with vm_state active and task_state rebuilding.
May 28 01:01:34.465430 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Received event network-vif-unplugged-b1c5ca58-a892-4f67-840e-810089b1fe6a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:34.465912 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] Acquiring lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:34.468740 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:34.470896 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:34.470896 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:34.470896 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] No waiting events found dispatching network-vif-unplugged-b1c5ca58-a892-4f67-840e-810089b1fe6a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:34.470896 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Received unexpected event network-vif-unplugged-b1c5ca58-a892-4f67-840e-810089b1fe6a for instance with vm_state active and task_state rebuilding.
May 28 01:01:34.470896 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Received event network-vif-unplugged-b1c5ca58-a892-4f67-840e-810089b1fe6a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:34.470896 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] Acquiring lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:34.470896 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:34.470896 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:34.470896 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] No waiting events found dispatching network-vif-unplugged-b1c5ca58-a892-4f67-840e-810089b1fe6a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:34.470896 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-d3026a1c-40cb-44f2-9660-1a885a50aca0 req-249c8cc2-705f-4b48-8ceb-cd415f7f46f0 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Received unexpected event network-vif-unplugged-b1c5ca58-a892-4f67-840e-810089b1fe6a for instance with vm_state active and task_state rebuilding.
May 28 01:01:34.472214 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930094.4718995, dc47e3bc-028d-4166-b702-91cbbd62f80e => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:01:34.472377 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] VM Resumed (Lifecycle Event)
May 28 01:01:34.473461 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:01:34.478876 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Instance spawned successfully.
May 28 01:01:34.480417 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:01:34.485010 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:34.485199 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:34.485331 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:34.485439 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Auditing locally available compute resources for np0000001577 (node: np0000001577) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 01:01:34.667604 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-c31c8fad-27dc-4b16-a8fa-1138c63ccac8 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:34.712663 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f7c0fe5e-fe36-421d-b2d6-096d388523e6 req-237124ec-7ce0-4ea7-91ad-cd8b38d09e4e service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Received event network-vif-unplugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:34.712663 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f7c0fe5e-fe36-421d-b2d6-096d388523e6 req-237124ec-7ce0-4ea7-91ad-cd8b38d09e4e service nova] Acquiring lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:34.716398 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f7c0fe5e-fe36-421d-b2d6-096d388523e6 req-237124ec-7ce0-4ea7-91ad-cd8b38d09e4e service nova] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:34.717132 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f7c0fe5e-fe36-421d-b2d6-096d388523e6 req-237124ec-7ce0-4ea7-91ad-cd8b38d09e4e service nova] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:34.717346 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f7c0fe5e-fe36-421d-b2d6-096d388523e6 req-237124ec-7ce0-4ea7-91ad-cd8b38d09e4e service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] No waiting events found dispatching network-vif-unplugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:34.717483 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-f7c0fe5e-fe36-421d-b2d6-096d388523e6 req-237124ec-7ce0-4ea7-91ad-cd8b38d09e4e service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Received unexpected event network-vif-unplugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa for instance with vm_state rescued and task_state unrescuing.
May 28 01:01:34.717607 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f7c0fe5e-fe36-421d-b2d6-096d388523e6 req-237124ec-7ce0-4ea7-91ad-cd8b38d09e4e service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Received event network-vif-plugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:34.717748 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f7c0fe5e-fe36-421d-b2d6-096d388523e6 req-237124ec-7ce0-4ea7-91ad-cd8b38d09e4e service nova] Acquiring lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:34.717909 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f7c0fe5e-fe36-421d-b2d6-096d388523e6 req-237124ec-7ce0-4ea7-91ad-cd8b38d09e4e service nova] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:34.718054 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f7c0fe5e-fe36-421d-b2d6-096d388523e6 req-237124ec-7ce0-4ea7-91ad-cd8b38d09e4e service nova] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:34.719140 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f7c0fe5e-fe36-421d-b2d6-096d388523e6 req-237124ec-7ce0-4ea7-91ad-cd8b38d09e4e service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] No waiting events found dispatching network-vif-plugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:34.719238 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-f7c0fe5e-fe36-421d-b2d6-096d388523e6 req-237124ec-7ce0-4ea7-91ad-cd8b38d09e4e service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Received unexpected event network-vif-plugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa for instance with vm_state rescued and task_state unrescuing.
May 28 01:01:34.719780 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f7c0fe5e-fe36-421d-b2d6-096d388523e6 req-237124ec-7ce0-4ea7-91ad-cd8b38d09e4e service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Received event network-vif-plugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:34.719949 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f7c0fe5e-fe36-421d-b2d6-096d388523e6 req-237124ec-7ce0-4ea7-91ad-cd8b38d09e4e service nova] Acquiring lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:34.720070 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f7c0fe5e-fe36-421d-b2d6-096d388523e6 req-237124ec-7ce0-4ea7-91ad-cd8b38d09e4e service nova] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:34.720859 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f7c0fe5e-fe36-421d-b2d6-096d388523e6 req-237124ec-7ce0-4ea7-91ad-cd8b38d09e4e service nova] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:34.721503 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Found WWN 330000000d00ec62f for multipath device dm-6 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:01:34.721892 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f7c0fe5e-fe36-421d-b2d6-096d388523e6 req-237124ec-7ce0-4ea7-91ad-cd8b38d09e4e service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] No waiting events found dispatching network-vif-plugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:34.722117 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-f7c0fe5e-fe36-421d-b2d6-096d388523e6 req-237124ec-7ce0-4ea7-91ad-cd8b38d09e4e service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Received unexpected event network-vif-plugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa for instance with vm_state rescued and task_state unrescuing.
May 28 01:01:34.722862 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 8.070s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:01:34.723305 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.977s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:01:34.723868 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31108657-63be-401c-a00e-137d133f11d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:01:34.723994 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:01:34.724318 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] <== connect_volume: return (8071ms) {'type': 'block', 'scsi_wwn': '330000000d00ec62f', 'path': '/dev/dm-6', 'multipath_id': '330000000d00ec62f'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:01:34.724482 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d00ec62f', 'path': '/dev/dm-6', 'multipath_id': '330000000d00ec62f'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:01:34.757966 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:34.757966 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:34.757966 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:34.757966 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:34.757966 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:34.757966 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:34.757966 np0000001577 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:34.757966 np0000001577 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:34.757966 np0000001577 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f180c1e4-7c63-42cb-b572-ee2703f49334 (non-flash)
May 28 01:01:34.757966 np0000001577 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:01:34.757966 np0000001577 nova-compute[98319]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:01:34.757966 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:01:34.757966 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:34.757966 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:34.757966 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:34.757966 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:34.757966 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:34.757966 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:34.757966 np0000001577 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:34.757966 np0000001577 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:34.757966 np0000001577 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f180c1e4-7c63-42cb-b572-ee2703f49334 (non-flash)
May 28 01:01:34.757966 np0000001577 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:01:34.757966 np0000001577 nova-compute[98319]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:01:34.757966 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:01:34.757966 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56', '48'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56', '49'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f180c1e4-7c63-42cb-b572-ee2703f49334', '54'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', '55'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', '56')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:01:34.757966 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', '56')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:01:34.757966 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', '55')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:01:34.759037 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c987044c860>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8'): ({'sdf'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:01:34.759037 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Removing multipathed devices sdf, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:01:34.759155 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Flush multipath device 330000000c92c0359 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:01:34.792517 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:01:34.867059 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:01:34.922434 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:34.922434 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0025542170001244813 future=<Future at 0x7c9870574fe0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:34.922434 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:34.922889 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=2.6053562059998967 future=<Future at 0x7c988415d5b0 state=cancelled>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:34.923556 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=2.604708110999809 future=<Future at 0x7c988415d5b0 state=cancelled>) was cancelled while queued, skipping {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:34.923642 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:34.923767 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=2.6049998629998754 future=<Future at 0x7c988415f770 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:34.923884 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=2.604879498999935 future=<Future at 0x7c988415f770 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:34.924422 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Emitting event <LifecycleEvent: 1779930079.919652, d87bb95b-a1e9-4786-8bee-16f2cfaabf2d => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:01:34.924588 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] VM Stopped (Lifecycle Event)
May 28 01:01:34.938516 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Checking to see if SCSI volumes sdf, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:01:34.938516 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] SCSI volumes sdf, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:01:34.939361 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Checking to see if device paths {'sdf', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:01:34.956374 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Device paths {'sdf', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:01:34.956528 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:01:34.966437 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:34.977289 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:34.982937 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:01:34.998523 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:01:34.998722 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:01:34.999089 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:01:34.999357 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:01:34.999656 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:01:34.999924 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:01:35.013121 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8, portal: 192.168.40.100,3260]
May 28 01:01:35.013121 np0000001577 nova-compute[98319]: Logout of [sid: 56, target: iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8, portal: 192.168.40.100,3260] successful.
May 28 01:01:35.013121 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:35.071010 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:35.082435 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:35.123656 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8, portal: 192.168.50.100,3260]
May 28 01:01:35.123656 np0000001577 nova-compute[98319]: Logout of [sid: 55, target: iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8, portal: 192.168.50.100,3260] successful.
May 28 01:01:35.123656 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:35.149332 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:35.149332 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.424s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:01:35.149332 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] <== disconnect_volume: return (2401ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:01:35.149332 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:01:35.234659 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001577',hostname='multiattach-server-0',id=21,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7fHo3fyBWUybZxdNVpYEXXxMYY3ACB7D4odfvDXtuf5uMmk/o2XggiQakoJbwdRCXKjpHaMcmXgSyAS8x+3bDHMUWn1qlznnyXp/nDVRmoqTgLFpV2Do6YlUuA3zZ+mw==',key_name='tempest-keypair-627531643',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:00:20Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001577',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='938c2829112843edb2054984e80ce7ad',ramdisk_id='',reservation_id='r-vg7s0e6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-89204095',owner_user_name='tempest-AttachVolumeMultiAttachTest-89204095-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:01:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8586a18edcf42cab0a60028135ae401',uuid=d87bb95b-a1e9-4786-8bee-16f2cfaabf2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "address": "fa:16:3e:28:56:65", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "vif_mac": "fa:16:3e:28:56:65"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3d348-6b", "ovs_interfaceid": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:01:35.235353 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converting VIF {"id": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "address": "fa:16:3e:28:56:65", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "vif_mac": "fa:16:3e:28:56:65"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3d348-6b", "ovs_interfaceid": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:01:35.236074 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:56:65,bridge_name='br-int',has_traffic_filtering=True,id=3ed3d348-6b93-4492-9c18-7b0eecc6454a,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed3d348-6b') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:01:35.237562 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] End _get_guest_xml xml=<domain type="qemu">
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:   <uuid>d87bb95b-a1e9-4786-8bee-16f2cfaabf2d</uuid>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:   <name>instance-00000015</name>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:   <memory>262144</memory>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <nova:name>multiattach-server-0</nova:name>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:01:26</nova:creationTime>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.micro" id="84">
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:         <nova:memory>256</nova:memory>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:         <nova:user uuid="f8586a18edcf42cab0a60028135ae401">tempest-AttachVolumeMultiAttachTest-89204095-project-member</nova:user>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:         <nova:project uuid="938c2829112843edb2054984e80ce7ad">tempest-AttachVolumeMultiAttachTest-89204095</nova:project>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:         <nova:port uuid="3ed3d348-6b93-4492-9c18-7b0eecc6454a">
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:     <system>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <entry name="serial">d87bb95b-a1e9-4786-8bee-16f2cfaabf2d</entry>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <entry name="uuid">d87bb95b-a1e9-4786-8bee-16f2cfaabf2d</entry>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:     </system>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:   <os>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:   </os>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:   <features>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:   </features>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:   <devices>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk"/>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:     </disk>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk.config"/>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:     </disk>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <alias name="ua-d15f465c-138e-4c23-9b17-0b08887300f1"/>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-6"/>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <serial>d15f465c-138e-4c23-9b17-0b08887300f1</serial>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <shareable/>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:     </disk>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:28:56:65"/>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <target dev="tap3ed3d348-6b"/>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:     </interface>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/console.log" append="off"/>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:     </serial>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:     <video>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:     </video>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:     </rng>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:   </devices>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]: </domain>
May 28 01:01:35.237562 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:01:35.240121 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001577',hostname='multiattach-server-0',id=21,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7fHo3fyBWUybZxdNVpYEXXxMYY3ACB7D4odfvDXtuf5uMmk/o2XggiQakoJbwdRCXKjpHaMcmXgSyAS8x+3bDHMUWn1qlznnyXp/nDVRmoqTgLFpV2Do6YlUuA3zZ+mw==',key_name='tempest-keypair-627531643',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:00:20Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001577',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='938c2829112843edb2054984e80ce7ad',ramdisk_id='',reservation_id='r-vg7s0e6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-89204095',owner_user_name='tempest-AttachVolumeMultiAttachTest-89204095-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:01:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8586a18edcf42cab0a60028135ae401',uuid=d87bb95b-a1e9-4786-8bee-16f2cfaabf2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "address": "fa:16:3e:28:56:65", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "vif_mac": "fa:16:3e:28:56:65"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3d348-6b", "ovs_interfaceid": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:01:35.240121 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converting VIF {"id": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "address": "fa:16:3e:28:56:65", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "vif_mac": "fa:16:3e:28:56:65"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3d348-6b", "ovs_interfaceid": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:01:35.240121 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:56:65,bridge_name='br-int',has_traffic_filtering=True,id=3ed3d348-6b93-4492-9c18-7b0eecc6454a,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed3d348-6b') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:01:35.240121 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:56:65,bridge_name='br-int',has_traffic_filtering=True,id=3ed3d348-6b93-4492-9c18-7b0eecc6454a,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed3d348-6b') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:01:35.240121 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:35.240121 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:35.240121 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:01:35.242924 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:35.242924 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68204bd2-1745-5314-9959-da8903b9b9ec', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:35.242924 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:35.242924 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:35.248517 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:35.251366 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:35.251511 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ed3d348-6b, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:35.251831 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ed3d348-6b, col_values=(('qos', UUID('83e0dc28-f972-4282-bea3-eee73cf0f65b')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:35.252005 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ed3d348-6b, col_values=(('external_ids', {'iface-id': '3ed3d348-6b93-4492-9c18-7b0eecc6454a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:56:65', 'vm-uuid': 'd87bb95b-a1e9-4786-8bee-16f2cfaabf2d'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:35.252848 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:35.254197 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:35.264848 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:35.265691 np0000001577 nova-compute[98319]: INFO os_vif [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:56:65,bridge_name='br-int',has_traffic_filtering=True,id=3ed3d348-6b93-4492-9c18-7b0eecc6454a,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed3d348-6b')
May 28 01:01:35.429138 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:35.434325 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:01:35.485735 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:01:35.486110 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Removed pending STOPPED event for bb62eb94-ea3e-47ec-bae7-43acb74061ef due to new event <LifecycleEvent: 1779930095.4858851, bb62eb94-ea3e-47ec-bae7-43acb74061ef => Resumed> {{(pid=98319) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 01:01:35.486269 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930095.4858851, bb62eb94-ea3e-47ec-bae7-43acb74061ef => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:01:35.486431 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] VM Resumed (Lifecycle Event)
May 28 01:01:35.504833 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Took 22.96 seconds to spawn the instance on the hypervisor.
May 28 01:01:35.505229 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:35.578301 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:35.678889 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:35.679699 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:35.790988 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:35.792315 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:01:35.795105 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:35.903131 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:35.905567 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:35.939221 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 28 01:01:35.989220 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:35.990906 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:35.991835 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:01:35.993221 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:01:35.998628 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:36.025779 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Took 33.03 seconds to build instance.
May 28 01:01:36.073344 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:36.093952 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:36.095577 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:36.199503 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:36.214613 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:36.239578 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Instance destroyed successfully.
May 28 01:01:36.239771 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-778733213',display_name='tempest-ServerActionsTestOtherA-server-1104107866',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-tempest-common-compute-instance-778733213',id=25,image_ref='5574e7a7-cbb4-4ae2-8b7f-aa34fd051b87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkiPLdYbCo1S3Q8zHTI1NipWScu+iP6NIHT7weBqNR/4DW9uVU8JGbzlGA44pLzm48mu9WdSdzEcSZJe6dOWPJFIyxn7tMsGB3fbMiFLIYEXAldqT3xnfulQjdD578NKQ==',key_name='tempest-keypair-1759049740',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:00:39Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='73ee6b376bb14dffb5664085cca58288',ramdisk_id='',reservation_id='r-0r9cnnkw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5574e7a7-cbb4-4ae2-8b7f-aa34fd051b87',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1279266727',owner_user_name='tempest-ServerActionsTestOtherA-1279266727-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:01:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84e218b589ef4968828db0c740eaa72b',uuid=e2cc3304-bf2b-4196-b6c8-8ad56da19af4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "address": "fa:16:3e:9d:98:58", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c5ca58-a8", "ovs_interfaceid": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:01:36.240038 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Converting VIF {"id": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "address": "fa:16:3e:9d:98:58", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c5ca58-a8", "ovs_interfaceid": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:01:36.241366 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:98:58,bridge_name='br-int',has_traffic_filtering=True,id=b1c5ca58-a892-4f67-840e-810089b1fe6a,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c5ca58-a8') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:01:36.241737 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:98:58,bridge_name='br-int',has_traffic_filtering=True,id=b1c5ca58-a892-4f67-840e-810089b1fe6a,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c5ca58-a8') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:01:36.248125 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:36.248125 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1c5ca58-a8, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:36.251138 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:36.257066 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:36.259044 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:36.259309 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d0a2d299-0b34-41ca-a98a-d1c908602e80) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:36.260615 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:36.262095 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:36.268853 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:36.271436 np0000001577 nova-compute[98319]: INFO os_vif [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:98:58,bridge_name='br-int',has_traffic_filtering=True,id=b1c5ca58-a892-4f67-840e-810089b1fe6a,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c5ca58-a8')
May 28 01:01:36.272765 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:01:36.273171 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31108657-63be-401c-a00e-137d133f11d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:01:36.273310 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:01:36.273749 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:01:36.274111 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31108657-63be-401c-a00e-137d133f11d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:01:36.274273 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:01:36.303586 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:36.303586 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:36.303586 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:36.303586 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:36.303586 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:36.303586 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:36.303586 np0000001577 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:36.303586 np0000001577 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:36.303586 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:01:36.303869 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:36.303869 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:36.303869 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:36.303869 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:36.303869 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:36.303869 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:36.303869 np0000001577 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:36.303869 np0000001577 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:36.303869 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:01:36.303869 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56', '48'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56', '49'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', '53')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:01:36.304063 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8, 0): [] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:01:36.304659 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8') {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 01:01:36.307567 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8, 0): [] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:01:36.307567 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8') {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 01:01:36.307567 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c984c508360>, {}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:01:36.307567 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Disconnecting from: [] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:01:36.307567 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.032s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:01:36.307567 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] <== disconnect_volume: return (31ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:01:36.307567 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:01:36.307567 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Deleting instance files /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4_del
May 28 01:01:36.307567 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Deletion of /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4_del complete
May 28 01:01:36.311634 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:36.312245 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000019, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk
May 28 01:01:36.318780 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:36.425352 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:36.425810 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:36.497256 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930096.4965107, bb62eb94-ea3e-47ec-bae7-43acb74061ef => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:01:36.497474 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] VM Started (Lifecycle Event)
May 28 01:01:36.513505 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:36.513864 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:01:36.518029 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:36.533039 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-39d60fa9-5435-4a25-9f60-5553154dde85 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "dc47e3bc-028d-4166-b702-91cbbd62f80e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.542s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:36.597204 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:36.597713 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:36.693927 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:36.703758 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:36.790758 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:01:36.790924 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:01:36.791073 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:01:36.791240 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No VIF found with MAC fa:16:3e:28:56:65, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:01:36.792168 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Using config drive
May 28 01:01:36.814777 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:36.816049 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:36.893717 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ac0c6270-2c1f-401d-80da-bc438e41bac2 req-4fe6b4aa-1204-4693-ba9c-f34fe5182286 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Received event network-changed-9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:36.894343 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ac0c6270-2c1f-401d-80da-bc438e41bac2 req-4fe6b4aa-1204-4693-ba9c-f34fe5182286 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Refreshing instance network info cache due to event network-changed-9ab3e003-1c3a-467a-ad12-abbd852f7eaa. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:01:36.894580 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ac0c6270-2c1f-401d-80da-bc438e41bac2 req-4fe6b4aa-1204-4693-ba9c-f34fe5182286 service nova] Acquiring lock "refresh_cache-bb62eb94-ea3e-47ec-bae7-43acb74061ef" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:01:36.894684 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ac0c6270-2c1f-401d-80da-bc438e41bac2 req-4fe6b4aa-1204-4693-ba9c-f34fe5182286 service nova] Acquired lock "refresh_cache-bb62eb94-ea3e-47ec-bae7-43acb74061ef" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:01:36.894819 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-ac0c6270-2c1f-401d-80da-bc438e41bac2 req-4fe6b4aa-1204-4693-ba9c-f34fe5182286 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Refreshing network info cache for port 9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:01:36.932380 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:36.935974 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:37.003096 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:37.008960 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:01:37.054765 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:37.055303 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:37.143302 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:37.152003 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-9 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:01:37.153927 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:37.253998 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:37.255316 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:37.277304 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:37.315771 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:37.347139 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Booting with volume 31108657-63be-401c-a00e-137d133f11d8 at /dev/vdb
May 28 01:01:37.364167 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:37.368414 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk.rescue --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:37.399923 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-ac0c6270-2c1f-401d-80da-bc438e41bac2 req-4fe6b4aa-1204-4693-ba9c-f34fe5182286 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:37.407094 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:01:37.414804 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:37.426826 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:01:37.454384 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:37.500263 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:37.500527 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:37.503432 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:37.505248 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk.rescue --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:37.537598 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:01:37.538475 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:01:37.548354 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.019512759000008373 future=<Future at 0x7c988415f770 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:37.548507 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:37.548637 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=9.958294088000002 future=<Future at 0x7c988416b4a0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:37.548792 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=9.958136355000079 future=<Future at 0x7c988416b4a0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:37.549410 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Emitting event <LifecycleEvent: 1779930082.5287173, 2d2183ad-dbdb-4525-b678-39b72c7ab85d => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:01:37.549830 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] VM Stopped (Lifecycle Event)
May 28 01:01:37.562571 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:01:37.562571 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe75:1c46', 'fe80::8c3:73ff:fe68:9ea1', 'fe80::fc16:3eff:fef0:246e', 'fe80::fc16:3eff:feca:a831', 'fe80::e8d7:d3ff:fe11:4890', 'fe80::fc16:3eff:fe12:3f51', 'fe80::64e0:a4ff:fe34:ffd6', 'fe80::fc16:3eff:fe72:df47', 'fe80::fc16:3eff:fe3e:2329', 'fe80::fc16:3eff:fee7:febd', 'fe80::fc16:3eff:fe5e:ef9c', 'fe80::6cd5:f5ff:fe52:2a3e', 'fe80::fc16:3eff:fe0b:7f79', 'fe80::e873:f8ff:fed0:1522', 'fe80::fc16:3eff:fedf:9fb0', 'fe80::fc16:3eff:fe28:5665'] 
May 28 01:01:37.562571 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:01:37.562571 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:01:37.562980 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:01:37.563959 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Updating existing volume attachment record: 9d45ac23-3238-4aa5-9f5e-9802b9b93641 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:01:37.632250 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk.rescue --force-share --output=json" returned: 0 in 0.127s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:37.634202 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:37.768466 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:37.768969 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:37.863801 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:37.875044 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-8 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:01:37.882665 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:01:37.885574 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:37.935189 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "env LANG=C uptime" returned: 0 in 0.050s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:37.935637 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Hypervisor/Node resource view: name=np0000001577 free_ram=11009MB free_disk=74.1998291015625GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 01:01:37.937423 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:37.937423 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:37.968723 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-ac0c6270-2c1f-401d-80da-bc438e41bac2 req-4fe6b4aa-1204-4693-ba9c-f34fe5182286 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:37.998403 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:38.056483 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-20d4730d-d967-4c20-8de1-ac2dc22333fa tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 2d2183ad-dbdb-4525-b678-39b72c7ab85d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:38.102403 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "dc47e3bc-028d-4166-b702-91cbbd62f80e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:38.102884 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "dc47e3bc-028d-4166-b702-91cbbd62f80e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:38.102884 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "dc47e3bc-028d-4166-b702-91cbbd62f80e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:38.103020 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "dc47e3bc-028d-4166-b702-91cbbd62f80e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:38.103178 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "dc47e3bc-028d-4166-b702-91cbbd62f80e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:38.106508 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Terminating instance
May 28 01:01:38.148490 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-ac0c6270-2c1f-401d-80da-bc438e41bac2 req-4fe6b4aa-1204-4693-ba9c-f34fe5182286 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Updated VIF entry in instance network info cache for port 9ab3e003-1c3a-467a-ad12-abbd852f7eaa. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:01:38.148490 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-ac0c6270-2c1f-401d-80da-bc438e41bac2 req-4fe6b4aa-1204-4693-ba9c-f34fe5182286 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Updating instance_info_cache with network_info: [{"id": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "address": "fa:16:3e:df:9f:b0", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab3e003-1c", "ovs_interfaceid": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:01:38.317609 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930098.317235, d87bb95b-a1e9-4786-8bee-16f2cfaabf2d => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:01:38.318257 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Instance event wait completed in 0 seconds for  {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:01:38.319233 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] VM Resumed (Lifecycle Event)
May 28 01:01:38.322158 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Instance running successfully.
May 28 01:01:38.323033 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Failed to set time: agent not configured {{(pid=98319) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 28 01:01:38.323257 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0d5f3134-387c-4bcf-a1a3-1adb455f7d0a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] finish_migration finished successfully. {{(pid=98319) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 28 01:01:38.611472 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:01:38.650235 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ac0c6270-2c1f-401d-80da-bc438e41bac2 req-4fe6b4aa-1204-4693-ba9c-f34fe5182286 service nova] Releasing lock "refresh_cache-bb62eb94-ea3e-47ec-bae7-43acb74061ef" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:01:38.744137 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:38.748181 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:38.753463 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:38.772476 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:38.780370 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:38.809522 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:38.822070 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:38.824485 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:01:38.939839 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:38.957345 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Applying migration context for instance d87bb95b-a1e9-4786-8bee-16f2cfaabf2d as it has an incoming, in-progress migration ec834ead-e707-4577-add9-25a13637a2e8. Migration status is finished {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 28 01:01:38.959284 np0000001577 nova-compute[98319]: INFO nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Updating resource usage from migration ec834ead-e707-4577-add9-25a13637a2e8
May 28 01:01:38.989399 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Instance destroyed successfully.
May 28 01:01:38.990165 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lazy-loading 'resources' on Instance uuid dc47e3bc-028d-4166-b702-91cbbd62f80e {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:01:39.010929 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 8bca25d8-071e-4b2d-960c-50582381cc75 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:01:39.011107 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance d09e5674-c5ab-4ace-9952-554361002541 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:01:39.011219 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance d988b526-836d-48b8-a381-1f7679caf41d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:01:39.011310 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance dccaa2b7-3c00-45f9-bf40-1a8a15030825 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:01:39.011829 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance b73b73f0-79a5-448c-a374-bbb182da41a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:01:39.011966 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance f2b64af8-9a7b-4726-b298-cf9d2cb24498 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:01:39.012080 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance bb62eb94-ea3e-47ec-bae7-43acb74061ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:01:39.012227 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance e2cc3304-bf2b-4196-b6c8-8ad56da19af4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:01:39.012379 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 04880ef4-5eee-4221-ad42-29788eb26358 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:01:39.012472 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance dc47e3bc-028d-4166-b702-91cbbd62f80e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:01:39.012574 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 03f1821a-592e-4e02-b609-74f3d7e69b53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:01:39.012675 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Migration ec834ead-e707-4577-add9-25a13637a2e8 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 28 01:01:39.012794 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance d87bb95b-a1e9-4786-8bee-16f2cfaabf2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:01:39.012964 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 01:01:39.013100 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Final resource view: name=np0000001577 phys_ram=24030MB used_ram=3072MB phys_disk=95GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:01:37 up 33 min,  2 users,  load average: 8.95, 6.40, 3.16\n', 'num_instances': '12', 'num_vm_active': '11', 'num_task_None': '9', 'num_os_type_None': '12', 'num_proj_938c2829112843edb2054984e80ce7ad': '5', 'io_workload': '0', 'num_proj_a3c5a1da6bb242e9a58cb82855897726': '3', 'num_vm_rescued': '1', 'num_proj_73ee6b376bb14dffb5664085cca58288': '2', 'num_task_resize_finish': '1', 'num_task_rebuild_block_device_mapping': '1', 'num_task_deleting': '1', 'num_proj_050f928f1ce449d6a447cd343dc4ff80': '1', 'num_proj_f6a7090a79f448f3abe4737bf127df53': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 01:01:39.048227 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9cc8ec7b-b002-43d1-b4dd-e3b7270cec6f req-35f7b496-77f8-4f8e-904d-679754e4e76d service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Received event network-changed-9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:39.051284 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9cc8ec7b-b002-43d1-b4dd-e3b7270cec6f req-35f7b496-77f8-4f8e-904d-679754e4e76d service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Refreshing instance network info cache due to event network-changed-9ab3e003-1c3a-467a-ad12-abbd852f7eaa. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:01:39.051971 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9cc8ec7b-b002-43d1-b4dd-e3b7270cec6f req-35f7b496-77f8-4f8e-904d-679754e4e76d service nova] Acquiring lock "refresh_cache-bb62eb94-ea3e-47ec-bae7-43acb74061ef" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:01:39.052103 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9cc8ec7b-b002-43d1-b4dd-e3b7270cec6f req-35f7b496-77f8-4f8e-904d-679754e4e76d service nova] Acquired lock "refresh_cache-bb62eb94-ea3e-47ec-bae7-43acb74061ef" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:01:39.052314 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-9cc8ec7b-b002-43d1-b4dd-e3b7270cec6f req-35f7b496-77f8-4f8e-904d-679754e4e76d service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Refreshing network info cache for port 9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:01:39.328114 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 28 01:01:39.328114 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930099.3268394, d87bb95b-a1e9-4786-8bee-16f2cfaabf2d => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:01:39.328114 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] VM Started (Lifecycle Event)
May 28 01:01:39.495507 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:01:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-775064717',display_name='tempest-TestVolumeBootPattern-server-775064717',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpattern-server-775064717',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:01:35Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='050f928f1ce449d6a447cd343dc4ff80',ramdisk_id='',reservation_id='r-ev9dxfpk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestVolumeBootPattern-1449742411',owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:01:36Z,user_data=None,user_id='0c803ddeaf4f4b3db07587419087b3b2',uuid=dc47e3bc-028d-4166-b702-91cbbd62f80e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f28aa177-6927-4987-8127-d3f565bd347e", "address": "fa:16:3e:0b:7f:79", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf28aa177-69", "ovs_interfaceid": "f28aa177-6927-4987-8127-d3f565bd347e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:01:39.495684 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converting VIF {"id": "f28aa177-6927-4987-8127-d3f565bd347e", "address": "fa:16:3e:0b:7f:79", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf28aa177-69", "ovs_interfaceid": "f28aa177-6927-4987-8127-d3f565bd347e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:01:39.496284 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:7f:79,bridge_name='br-int',has_traffic_filtering=True,id=f28aa177-6927-4987-8127-d3f565bd347e,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf28aa177-69') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:01:39.496511 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:7f:79,bridge_name='br-int',has_traffic_filtering=True,id=f28aa177-6927-4987-8127-d3f565bd347e,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf28aa177-69') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:01:39.500698 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:39.500942 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf28aa177-69, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:39.501881 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:39.502480 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:39.503354 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:39.505152 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:39.505280 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9388b8e-09c9-457d-8bbf-a7c18cd9d3e5) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:39.505872 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:39.506682 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:39.506682 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:39.508992 np0000001577 nova-compute[98319]: INFO os_vif [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:7f:79,bridge_name='br-int',has_traffic_filtering=True,id=f28aa177-6927-4987-8127-d3f565bd347e,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf28aa177-69')
May 28 01:01:39.555255 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-9cc8ec7b-b002-43d1-b4dd-e3b7270cec6f req-35f7b496-77f8-4f8e-904d-679754e4e76d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:39.562393 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-8'}, 'status': 'reserved', 'instance': 'dc47e3bc-028d-4166-b702-91cbbd62f80e', 'attached_at': '', 'detached_at': '', 'volume_id': '3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'serial': '3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 01:01:39.565765 np0000001577 nova-compute[98319]: WARNING stevedore.named [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 01:01:39.565765 np0000001577 nova-compute[98319]: WARNING castellan.key_manager [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:01:39.565765 np0000001577 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:01:39.565765 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x7c984c511fd0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-8'}, 'status': 'reserved', 'instance': 'dc47e3bc-028d-4166-b702-91cbbd62f80e', 'attached_at': '', 'detached_at': '', 'volume_id': '3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'serial': '3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7'} {{(pid=98319) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 01:01:39.565765 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors.luks [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] closing encrypted volume /dev/dm-2 {{(pid=98319) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:207}}
May 28 01:01:39.597456 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:01:39.597456 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-8'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:01:39.598875 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:01:39.598875 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:01:39.598875 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:01:39.598875 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:01:39.631758 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:39.639043 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:39.639043 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:39.639043 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:39.639043 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:39.639043 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:39.639043 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:39.639043 np0000001577 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:39.639043 np0000001577 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:39.639043 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:01:39.639470 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:39.639470 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:39.639470 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:39.639470 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:39.639470 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:39.639470 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:39.639470 np0000001577 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:39.639470 np0000001577 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7 (non-flash)
May 28 01:01:39.639470 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:01:39.639470 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56', '48'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56', '49'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', '53')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:01:39.639470 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', '52')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:01:39.640271 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7', '53')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:01:39.642365 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c987044d940>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7'): ({'sdo'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:01:39.642365 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Removing multipathed devices sdo, sdn {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:01:39.642365 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Flush multipath device 33000000086c4030c {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:01:39.676308 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:01:39.711079 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:01:39.716082 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Creating image(s)
May 28 01:01:39.717213 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:39.717388 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "/opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:39.717814 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "/opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:39.718103 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "07a94fed33c407a0383d5665ff563e57a401d75b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:39.718336 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "07a94fed33c407a0383d5665ff563e57a401d75b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:39.727469 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:01:39.773944 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Checking to see if SCSI volumes sdo, sdn have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:01:39.773944 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] SCSI volumes sdo, sdn have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:01:39.773944 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Checking to see if device paths {'sdo', 'sdn'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:01:39.788038 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Device paths {'sdo', 'sdn'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:01:39.788529 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:01:39.803646 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:39.826825 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:01:39.827106 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:01:39.829649 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:39.835322 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:01:39.849766 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7, portal: 192.168.40.100,3260]
May 28 01:01:39.849766 np0000001577 nova-compute[98319]: Logout of [sid: 52, target: iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7, portal: 192.168.40.100,3260] successful.
May 28 01:01:39.849766 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:39.870361 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:39.885105 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:39.911414 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7, portal: 192.168.50.100,3260]
May 28 01:01:39.911414 np0000001577 nova-compute[98319]: Logout of [sid: 53, target: iqn.2023-03.storpool.com:os--volume-3b41dbbe-5b7a-44ee-80c6-0588d12fb8d7, portal: 192.168.50.100,3260] successful.
May 28 01:01:39.911414 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:39.930888 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:39.936232 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:01:39.936232 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] <== disconnect_volume: return (336ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:01:39.936232 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:01:39.936232 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Deleting instance files /opt/stack/data/nova/instances/dc47e3bc-028d-4166-b702-91cbbd62f80e_del
May 28 01:01:39.936232 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Deletion of /opt/stack/data/nova/instances/dc47e3bc-028d-4166-b702-91cbbd62f80e_del complete
May 28 01:01:40.154213 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a4608dda-01c7-4cdd-90fa-9b8a836e35f9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:40.154406 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a4608dda-01c7-4cdd-90fa-9b8a836e35f9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:40.154661 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-a4608dda-01c7-4cdd-90fa-9b8a836e35f9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Going to confirm migration 2 {{(pid=98319) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 28 01:01:40.209382 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-9cc8ec7b-b002-43d1-b4dd-e3b7270cec6f req-35f7b496-77f8-4f8e-904d-679754e4e76d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:40.331274 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:01:40.339983 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999694393000027 future=<Future at 0x7c989659c7d0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:40.443468 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-9cc8ec7b-b002-43d1-b4dd-e3b7270cec6f req-35f7b496-77f8-4f8e-904d-679754e4e76d service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Updated VIF entry in instance network info cache for port 9ab3e003-1c3a-467a-ad12-abbd852f7eaa. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:01:40.443468 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-9cc8ec7b-b002-43d1-b4dd-e3b7270cec6f req-35f7b496-77f8-4f8e-904d-679754e4e76d service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Updating instance_info_cache with network_info: [{"id": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "address": "fa:16:3e:df:9f:b0", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab3e003-1c", "ovs_interfaceid": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:01:40.450578 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Took 1.84 seconds to destroy the instance on the hypervisor.
May 28 01:01:40.453223 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:01:40.453629 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:01:40.453709 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:01:40.453967 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:40.510498 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:01:40.514658 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:01:40.515129 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07a94fed33c407a0383d5665ff563e57a401d75b.part --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:40.592785 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:40.621897 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07a94fed33c407a0383d5665ff563e57a401d75b.part --force-share --output=json" returned: 0 in 0.106s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:40.623655 np0000001577 nova-compute[98319]: DEBUG nova.virt.images [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] 5574e7a7-cbb4-4ae2-8b7f-aa34fd051b87 was qcow2, converting to raw {{(pid=98319) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 01:01:40.623655 np0000001577 nova-compute[98319]: DEBUG nova.privsep.utils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 01:01:40.623655 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/07a94fed33c407a0383d5665ff563e57a401d75b.part /opt/stack/data/nova/instances/_base/07a94fed33c407a0383d5665ff563e57a401d75b.converted {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:40.669907 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-a4608dda-01c7-4cdd-90fa-9b8a836e35f9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:40.769827 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/07a94fed33c407a0383d5665ff563e57a401d75b.part /opt/stack/data/nova/instances/_base/07a94fed33c407a0383d5665ff563e57a401d75b.converted" returned: 0 in 0.146s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:40.775872 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07a94fed33c407a0383d5665ff563e57a401d75b.converted --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:40.843239 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Compute_service record updated for np0000001577:np0000001577 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 01:01:40.843478 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.907s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:40.844573 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:01:40.867172 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07a94fed33c407a0383d5665ff563e57a401d75b.converted --force-share --output=json" returned: 0 in 0.091s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:40.867812 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "07a94fed33c407a0383d5665ff563e57a401d75b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.149s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:40.868280 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:01:40.876023 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:01:40.877683 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07a94fed33c407a0383d5665ff563e57a401d75b --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:40.919257 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-71049ef2-7ba6-4d18-b9a0-5bfbd2005d51 req-7e10d9fa-64c4-481b-9e59-4bc6aaa9efc2 service nova] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Received event network-vif-deleted-f28aa177-6927-4987-8127-d3f565bd347e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:40.919931 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-71049ef2-7ba6-4d18-b9a0-5bfbd2005d51 req-7e10d9fa-64c4-481b-9e59-4bc6aaa9efc2 service nova] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Neutron deleted interface f28aa177-6927-4987-8127-d3f565bd347e; detaching it from the instance and deleting it from the info cache
May 28 01:01:40.924062 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-71049ef2-7ba6-4d18-b9a0-5bfbd2005d51 req-7e10d9fa-64c4-481b-9e59-4bc6aaa9efc2 service nova] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Detach interface failed, port_id=f28aa177-6927-4987-8127-d3f565bd347e, reason: Instance dc47e3bc-028d-4166-b702-91cbbd62f80e could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:01:40.947161 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9cc8ec7b-b002-43d1-b4dd-e3b7270cec6f req-35f7b496-77f8-4f8e-904d-679754e4e76d service nova] Releasing lock "refresh_cache-bb62eb94-ea3e-47ec-bae7-43acb74061ef" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:01:40.947417 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9cc8ec7b-b002-43d1-b4dd-e3b7270cec6f req-35f7b496-77f8-4f8e-904d-679754e4e76d service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Received event network-vif-plugged-3ed3d348-6b93-4492-9c18-7b0eecc6454a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:40.947727 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9cc8ec7b-b002-43d1-b4dd-e3b7270cec6f req-35f7b496-77f8-4f8e-904d-679754e4e76d service nova] Acquiring lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:40.947956 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9cc8ec7b-b002-43d1-b4dd-e3b7270cec6f req-35f7b496-77f8-4f8e-904d-679754e4e76d service nova] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:40.948108 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9cc8ec7b-b002-43d1-b4dd-e3b7270cec6f req-35f7b496-77f8-4f8e-904d-679754e4e76d service nova] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:40.948266 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9cc8ec7b-b002-43d1-b4dd-e3b7270cec6f req-35f7b496-77f8-4f8e-904d-679754e4e76d service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] No waiting events found dispatching network-vif-plugged-3ed3d348-6b93-4492-9c18-7b0eecc6454a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:40.948428 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-9cc8ec7b-b002-43d1-b4dd-e3b7270cec6f req-35f7b496-77f8-4f8e-904d-679754e4e76d service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Received unexpected event network-vif-plugged-3ed3d348-6b93-4492-9c18-7b0eecc6454a for instance with vm_state resized and task_state None.
May 28 01:01:40.948585 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9cc8ec7b-b002-43d1-b4dd-e3b7270cec6f req-35f7b496-77f8-4f8e-904d-679754e4e76d service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Received event network-vif-plugged-3ed3d348-6b93-4492-9c18-7b0eecc6454a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:40.948743 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9cc8ec7b-b002-43d1-b4dd-e3b7270cec6f req-35f7b496-77f8-4f8e-904d-679754e4e76d service nova] Acquiring lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:40.948915 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9cc8ec7b-b002-43d1-b4dd-e3b7270cec6f req-35f7b496-77f8-4f8e-904d-679754e4e76d service nova] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:40.949054 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9cc8ec7b-b002-43d1-b4dd-e3b7270cec6f req-35f7b496-77f8-4f8e-904d-679754e4e76d service nova] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:40.949189 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9cc8ec7b-b002-43d1-b4dd-e3b7270cec6f req-35f7b496-77f8-4f8e-904d-679754e4e76d service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] No waiting events found dispatching network-vif-plugged-3ed3d348-6b93-4492-9c18-7b0eecc6454a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:40.949324 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-9cc8ec7b-b002-43d1-b4dd-e3b7270cec6f req-35f7b496-77f8-4f8e-904d-679754e4e76d service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Received unexpected event network-vif-plugged-3ed3d348-6b93-4492-9c18-7b0eecc6454a for instance with vm_state resized and task_state None.
May 28 01:01:40.967312 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-a4608dda-01c7-4cdd-90fa-9b8a836e35f9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:40.968643 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a4608dda-01c7-4cdd-90fa-9b8a836e35f9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "refresh_cache-d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:01:40.968643 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a4608dda-01c7-4cdd-90fa-9b8a836e35f9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquired lock "refresh_cache-d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:01:40.968643 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-a4608dda-01c7-4cdd-90fa-9b8a836e35f9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:01:40.968643 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-a4608dda-01c7-4cdd-90fa-9b8a836e35f9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lazy-loading 'info_cache' on Instance uuid d87bb95b-a1e9-4786-8bee-16f2cfaabf2d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:01:40.971409 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07a94fed33c407a0383d5665ff563e57a401d75b --force-share --output=json" returned: 0 in 0.094s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:40.972020 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "07a94fed33c407a0383d5665ff563e57a401d75b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:40.972349 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "07a94fed33c407a0383d5665ff563e57a401d75b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:40.972844 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:01:40.977017 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:01:40.977454 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07a94fed33c407a0383d5665ff563e57a401d75b --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:41.069989 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07a94fed33c407a0383d5665ff563e57a401d75b --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:41.070534 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07a94fed33c407a0383d5665ff563e57a401d75b,backing_fmt=raw /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:41.083827 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:41.138385 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07a94fed33c407a0383d5665ff563e57a401d75b,backing_fmt=raw /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk 1073741824" returned: 0 in 0.068s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:41.138980 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "07a94fed33c407a0383d5665ff563e57a401d75b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.166s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:41.139213 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07a94fed33c407a0383d5665ff563e57a401d75b --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:41.162384 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-063dfdf3-bc66-4ae8-9f03-b27669735372 req-328939d6-a136-42c7-92fe-21c2ea280b44 service nova] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Received event network-vif-unplugged-f28aa177-6927-4987-8127-d3f565bd347e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:41.162923 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-063dfdf3-bc66-4ae8-9f03-b27669735372 req-328939d6-a136-42c7-92fe-21c2ea280b44 service nova] Acquiring lock "dc47e3bc-028d-4166-b702-91cbbd62f80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:41.164821 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-063dfdf3-bc66-4ae8-9f03-b27669735372 req-328939d6-a136-42c7-92fe-21c2ea280b44 service nova] Lock "dc47e3bc-028d-4166-b702-91cbbd62f80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:41.165444 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-063dfdf3-bc66-4ae8-9f03-b27669735372 req-328939d6-a136-42c7-92fe-21c2ea280b44 service nova] Lock "dc47e3bc-028d-4166-b702-91cbbd62f80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:41.165674 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-063dfdf3-bc66-4ae8-9f03-b27669735372 req-328939d6-a136-42c7-92fe-21c2ea280b44 service nova] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] No waiting events found dispatching network-vif-unplugged-f28aa177-6927-4987-8127-d3f565bd347e {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:41.165908 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-063dfdf3-bc66-4ae8-9f03-b27669735372 req-328939d6-a136-42c7-92fe-21c2ea280b44 service nova] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Received event network-vif-unplugged-f28aa177-6927-4987-8127-d3f565bd347e for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:01:41.166104 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-063dfdf3-bc66-4ae8-9f03-b27669735372 req-328939d6-a136-42c7-92fe-21c2ea280b44 service nova] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Received event network-vif-unplugged-f28aa177-6927-4987-8127-d3f565bd347e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:41.166296 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-063dfdf3-bc66-4ae8-9f03-b27669735372 req-328939d6-a136-42c7-92fe-21c2ea280b44 service nova] Acquiring lock "dc47e3bc-028d-4166-b702-91cbbd62f80e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:41.166503 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-063dfdf3-bc66-4ae8-9f03-b27669735372 req-328939d6-a136-42c7-92fe-21c2ea280b44 service nova] Lock "dc47e3bc-028d-4166-b702-91cbbd62f80e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:41.166671 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-063dfdf3-bc66-4ae8-9f03-b27669735372 req-328939d6-a136-42c7-92fe-21c2ea280b44 service nova] Lock "dc47e3bc-028d-4166-b702-91cbbd62f80e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:41.166895 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-063dfdf3-bc66-4ae8-9f03-b27669735372 req-328939d6-a136-42c7-92fe-21c2ea280b44 service nova] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] No waiting events found dispatching network-vif-unplugged-f28aa177-6927-4987-8127-d3f565bd347e {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:41.167080 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-063dfdf3-bc66-4ae8-9f03-b27669735372 req-328939d6-a136-42c7-92fe-21c2ea280b44 service nova] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Received event network-vif-unplugged-f28aa177-6927-4987-8127-d3f565bd347e for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:01:41.224678 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07a94fed33c407a0383d5665ff563e57a401d75b --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:41.225032 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:01:41.225288 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:41.321303 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:41.321986 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Cannot resize image /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:01:41.323155 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:01:41.323529 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Ensure instance console log exists: /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:01:41.324185 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:41.324397 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:41.324604 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:41.327665 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Start _get_guest_xml network_info=[{"id": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "address": "fa:16:3e:9d:98:58", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c5ca58-a8", "ovs_interfaceid": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-28T00:54:52Z,direct_url=<?>,disk_format='qcow2',id=5574e7a7-cbb4-4ae2-8b7f-aa34fd051b87,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-28T00:54:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31108657-63be-401c-a00e-137d133f11d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'e2cc3304-bf2b-4196-b6c8-8ad56da19af4', 'attached_at': '', 'detached_at': '', 'volume_id': '31108657-63be-401c-a00e-137d133f11d8', 'serial': '31108657-63be-401c-a00e-137d133f11d8'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '9d45ac23-3238-4aa5-9f5e-9802b9b93641', 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:01:41.332667 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
May 28 01:01:41.334307 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='5574e7a7-cbb4-4ae2-8b7f-aa34fd051b87', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-1104107866', uuid='e2cc3304-bf2b-4196-b6c8-8ad56da19af4'), owner=OwnerMeta(userid='84e218b589ef4968828db0c740eaa72b', username='tempest-ServerActionsTestOtherA-1279266727-project-member', projectid='73ee6b376bb14dffb5664085cca58288', projectname='tempest-ServerActionsTestOtherA-1279266727'), image=ImageMeta(id='5574e7a7-cbb4-4ae2-8b7f-aa34fd051b87', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "address": "fa:16:3e:9d:98:58", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c5ca58-a8", "ovs_interfaceid": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930101.3337984) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:01:41.336112 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:01:41.336722 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:01:41.337837 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:01:41.338043 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:01:41.340572 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:01:41.341960 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-28T00:54:52Z,direct_url=<?>,disk_format='qcow2',id=5574e7a7-cbb4-4ae2-8b7f-aa34fd051b87,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-28T00:54:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:01:41.341960 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:01:41.341960 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:01:41.341960 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:01:41.342435 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:01:41.342435 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:01:41.342478 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:01:41.342614 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:01:41.342815 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:01:41.342872 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:01:41.343018 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:01:41.343557 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lazy-loading 'vcpu_model' on Instance uuid e2cc3304-bf2b-4196-b6c8-8ad56da19af4 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:01:41.345377 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:01:41.421369 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:41.840659 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:01:41.848424 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:01:41.848424 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:01:41.848424 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:01:41.848424 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 52.13 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:01:41.854855 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Took 1.40 seconds to deallocate network for instance.
May 28 01:01:41.879370 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:01:41.879962 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31108657-63be-401c-a00e-137d133f11d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:01:41.880203 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:01:41.928183 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:41.975361 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-a4608dda-01c7-4cdd-90fa-9b8a836e35f9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:42.288134 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-a4608dda-01c7-4cdd-90fa-9b8a836e35f9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:42.454901 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-a4608dda-01c7-4cdd-90fa-9b8a836e35f9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Updating instance_info_cache with network_info: [{"id": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "address": "fa:16:3e:28:56:65", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3d348-6b", "ovs_interfaceid": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:01:42.463248 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Took 0.60 seconds to detach 1 volumes for instance.
May 28 01:01:42.533468 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.653s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:01:42.533468 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31108657-63be-401c-a00e-137d133f11d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:01:42.544749 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:01:42.545585 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:01:42.546087 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:01:42.546252 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:01:42.546686 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:01:42.546925 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:01:42.560948 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:01:42.560948 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:42.571915 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:01:42.571915 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:42.577557 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8] added
May 28 01:01:42.577557 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:01:42.577557 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:01:42.577557 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:01:42.577557 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:01:42.577557 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:01:42.577557 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:42.577873 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:01:42.578073 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.031(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:01:42.578169 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:01:42.585115 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8] added
May 28 01:01:42.585115 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:01:42.585115 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:01:42.585115 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:01:42.585115 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:01:42.585115 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:01:42.585115 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:42.585515 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:01:42.585515 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0391(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:01:42.585515 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:01:42.957275 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a4608dda-01c7-4cdd-90fa-9b8a836e35f9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Releasing lock "refresh_cache-d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:01:42.958468 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-a4608dda-01c7-4cdd-90fa-9b8a836e35f9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lazy-loading 'migration_context' on Instance uuid d87bb95b-a1e9-4786-8bee-16f2cfaabf2d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:01:42.968457 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:42.970287 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:43.464202 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-a4608dda-01c7-4cdd-90fa-9b8a836e35f9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Object Instance<d87bb95b-a1e9-4786-8bee-16f2cfaabf2d> lazy-loaded attributes: info_cache,migration_context {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:01:43.471151 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a4608dda-01c7-4cdd-90fa-9b8a836e35f9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:43.578775 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:01:43.586586 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:01:43.595987 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:01:43.595987 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:01:43.605356 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:01:43.605356 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:43.609119 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:43.624314 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:43.636093 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:43.636093 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:43.636093 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:43.636093 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:43.636093 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:43.636093 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:43.636093 np0000001577 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1000409-73f0-4c9c-a75c-ddd180239056 (non-flash)
May 28 01:01:43.636093 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:01:43.636357 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:43.636357 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:43.636357 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:43.636357 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:43.636357 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:43.636357 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:43.636357 np0000001577 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1000409-73f0-4c9c-a75c-ddd180239056 (non-flash)
May 28 01:01:43.636357 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:01:43.643391 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:43.643391 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:43.643391 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:43.643391 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:43.643391 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:43.643391 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:43.643391 np0000001577 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1000409-73f0-4c9c-a75c-ddd180239056 (non-flash)
May 28 01:01:43.643391 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:01:43.643391 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:43.643391 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:43.643391 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:43.643391 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:43.643391 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:43.643391 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:43.643391 np0000001577 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1000409-73f0-4c9c-a75c-ddd180239056 (non-flash)
May 28 01:01:43.643391 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:01:43.682284 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8, portal: 192.168.50.100,3260]
May 28 01:01:43.682284 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8, portal: 192.168.50.100,3260] successful.
May 28 01:01:43.682284 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:43.691946 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8, portal: 192.168.40.100,3260]
May 28 01:01:43.691946 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8, portal: 192.168.40.100,3260] successful.
May 28 01:01:43.691946 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:43.700892 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:43.709003 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:01:43.723018 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:43.723018 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:43.723018 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:43.723018 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:43.723018 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:43.723018 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:43.723018 np0000001577 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1000409-73f0-4c9c-a75c-ddd180239056 (non-flash)
May 28 01:01:43.723018 np0000001577 nova-compute[98319]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:01:43.723018 np0000001577 nova-compute[98319]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:01:43.723018 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:01:43.723525 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:43.723525 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:43.723525 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:43.723525 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:43.723525 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:43.723525 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:43.723525 np0000001577 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1000409-73f0-4c9c-a75c-ddd180239056 (non-flash)
May 28 01:01:43.723525 np0000001577 nova-compute[98319]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:01:43.723525 np0000001577 nova-compute[98319]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:01:43.723525 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:01:43.724073 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:01:43.724073 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:01:43.725165 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:43.725165 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:43.725165 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:43.725165 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:43.725165 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:43.725165 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:43.725165 np0000001577 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1000409-73f0-4c9c-a75c-ddd180239056 (non-flash)
May 28 01:01:43.725165 np0000001577 nova-compute[98319]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:01:43.725165 np0000001577 nova-compute[98319]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:01:43.725165 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:01:43.725429 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:43.725429 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:01:43.725429 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:43.725429 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:01:43.725429 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:43.725429 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:01:43.725429 np0000001577 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b1000409-73f0-4c9c-a75c-ddd180239056 (non-flash)
May 28 01:01:43.725429 np0000001577 nova-compute[98319]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:01:43.725429 np0000001577 nova-compute[98319]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:01:43.725429 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:01:43.725780 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.180s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:01:43.725780 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:01:43.726361 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] HCTL ('8', '-', '-', 0) found on session 58 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:01:43.727056 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:01:43.727472 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] HCTL ('11', '-', '-', 0) found on session 59 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:01:43.730187 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:01:43.743682 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Searching for a device in session 58 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:01:43.743901 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '31108657-63be-401c-a00e-137d133f11d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:01:43.757711 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Searching for a device in session 59 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:01:43.757711 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31108657-63be-401c-a00e-137d133f11d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:01:43.792823 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:01:43.793143 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:01:44.296442 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:01:44.509300 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:44.546767 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:01:44.805685 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.835s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:44.807317 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a4608dda-01c7-4cdd-90fa-9b8a836e35f9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 1.335s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:44.864642 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Deleted allocations for instance dc47e3bc-028d-4166-b702-91cbbd62f80e
May 28 01:01:45.379649 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Acquiring lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:45.381506 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:45.563901 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Found WWN 330000000c92c0359 for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:01:45.566560 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:01:45.566560 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] <== connect_volume: return (3684ms) {'type': 'block', 'scsi_wwn': '330000000c92c0359', 'path': '/dev/dm-0', 'multipath_id': '330000000c92c0359'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:01:45.566560 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c92c0359', 'path': '/dev/dm-0', 'multipath_id': '330000000c92c0359'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:01:45.760910 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:45.880620 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e01b591c-0967-4c3b-8dfb-5a56a665a3c4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "dc47e3bc-028d-4166-b702-91cbbd62f80e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.778s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:45.882581 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:01:45.977333 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a4608dda-01c7-4cdd-90fa-9b8a836e35f9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:01:45.977837 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a4608dda-01c7-4cdd-90fa-9b8a836e35f9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:01:46.071812 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T01:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-778733213',display_name='tempest-ServerActionsTestOtherA-server-1104107866',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-tempest-common-compute-instance-778733213',id=25,image_ref='5574e7a7-cbb4-4ae2-8b7f-aa34fd051b87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkiPLdYbCo1S3Q8zHTI1NipWScu+iP6NIHT7weBqNR/4DW9uVU8JGbzlGA44pLzm48mu9WdSdzEcSZJe6dOWPJFIyxn7tMsGB3fbMiFLIYEXAldqT3xnfulQjdD578NKQ==',key_name='tempest-keypair-1759049740',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:00:39Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='73ee6b376bb14dffb5664085cca58288',ramdisk_id='',reservation_id='r-0r9cnnkw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5574e7a7-cbb4-4ae2-8b7f-aa34fd051b87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1279266727',owner_user_name='tempest-ServerActionsTestOtherA-1279266727-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:01:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84e218b589ef4968828db0c740eaa72b',uuid=e2cc3304-bf2b-4196-b6c8-8ad56da19af4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "address": "fa:16:3e:9d:98:58", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c5ca58-a8", "ovs_interfaceid": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:01:46.072485 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Converting VIF {"id": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "address": "fa:16:3e:9d:98:58", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c5ca58-a8", "ovs_interfaceid": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:01:46.073157 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:98:58,bridge_name='br-int',has_traffic_filtering=True,id=b1c5ca58-a892-4f67-840e-810089b1fe6a,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c5ca58-a8') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:01:46.077706 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:46.079940 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] End _get_guest_xml xml=<domain type="qemu">
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:   <uuid>e2cc3304-bf2b-4196-b6c8-8ad56da19af4</uuid>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:   <name>instance-00000019</name>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <nova:name>tempest-ServerActionsTestOtherA-server-1104107866</nova:name>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:01:41</nova:creationTime>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <nova:image uuid="5574e7a7-cbb4-4ae2-8b7f-aa34fd051b87">
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:         <nova:user uuid="84e218b589ef4968828db0c740eaa72b">tempest-ServerActionsTestOtherA-1279266727-project-member</nova:user>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:         <nova:project uuid="73ee6b376bb14dffb5664085cca58288">tempest-ServerActionsTestOtherA-1279266727</nova:project>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="5574e7a7-cbb4-4ae2-8b7f-aa34fd051b87"/>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:         <nova:port uuid="b1c5ca58-a892-4f67-840e-810089b1fe6a">
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:     <system>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <entry name="serial">e2cc3304-bf2b-4196-b6c8-8ad56da19af4</entry>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <entry name="uuid">e2cc3304-bf2b-4196-b6c8-8ad56da19af4</entry>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:     </system>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:   <os>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:   </os>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:   <features>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:   </features>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:   <devices>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk"/>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:     </disk>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk.config"/>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:     </disk>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <alias name="ua-31108657-63be-401c-a00e-137d133f11d8"/>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-0"/>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <serial>31108657-63be-401c-a00e-137d133f11d8</serial>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:     </disk>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:9d:98:58"/>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <target dev="tapb1c5ca58-a8"/>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:     </interface>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/console.log" append="off"/>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:     </serial>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:     <video>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:     </video>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:     </rng>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:   </devices>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]: </domain>
May 28 01:01:46.079940 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:01:46.081796 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T01:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-778733213',display_name='tempest-ServerActionsTestOtherA-server-1104107866',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-tempest-common-compute-instance-778733213',id=25,image_ref='5574e7a7-cbb4-4ae2-8b7f-aa34fd051b87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkiPLdYbCo1S3Q8zHTI1NipWScu+iP6NIHT7weBqNR/4DW9uVU8JGbzlGA44pLzm48mu9WdSdzEcSZJe6dOWPJFIyxn7tMsGB3fbMiFLIYEXAldqT3xnfulQjdD578NKQ==',key_name='tempest-keypair-1759049740',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:00:39Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='73ee6b376bb14dffb5664085cca58288',ramdisk_id='',reservation_id='r-0r9cnnkw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5574e7a7-cbb4-4ae2-8b7f-aa34fd051b87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1279266727',owner_user_name='tempest-ServerActionsTestOtherA-1279266727-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:01:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84e218b589ef4968828db0c740eaa72b',uuid=e2cc3304-bf2b-4196-b6c8-8ad56da19af4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "address": "fa:16:3e:9d:98:58", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c5ca58-a8", "ovs_interfaceid": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:01:46.081796 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Converting VIF {"id": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "address": "fa:16:3e:9d:98:58", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c5ca58-a8", "ovs_interfaceid": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:01:46.081796 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:98:58,bridge_name='br-int',has_traffic_filtering=True,id=b1c5ca58-a892-4f67-840e-810089b1fe6a,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c5ca58-a8') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:01:46.081796 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:98:58,bridge_name='br-int',has_traffic_filtering=True,id=b1c5ca58-a892-4f67-840e-810089b1fe6a,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c5ca58-a8') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:01:46.081796 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:46.082013 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:46.082108 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:01:46.084733 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:46.084886 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8478021a-7644-5894-9110-90f81d9c7d6d', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:46.085515 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:46.086307 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:46.086723 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:46.088963 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:46.089145 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1c5ca58-a8, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:46.089495 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb1c5ca58-a8, col_values=(('qos', UUID('9cf365d3-3656-46ec-878e-819b9bec9704')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:46.089700 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb1c5ca58-a8, col_values=(('external_ids', {'iface-id': 'b1c5ca58-a892-4f67-840e-810089b1fe6a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:98:58', 'vm-uuid': 'e2cc3304-bf2b-4196-b6c8-8ad56da19af4'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:46.090539 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:46.092109 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:46.098266 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:46.098810 np0000001577 nova-compute[98319]: INFO os_vif [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:98:58,bridge_name='br-int',has_traffic_filtering=True,id=b1c5ca58-a892-4f67-840e-810089b1fe6a,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c5ca58-a8')
May 28 01:01:46.440443 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:46.480200 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a4608dda-01c7-4cdd-90fa-9b8a836e35f9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:01:47.491844 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a4608dda-01c7-4cdd-90fa-9b8a836e35f9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.685s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:47.496221 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.056s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:47.499367 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:01:47.499527 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Claim successful on node np0000001577
May 28 01:01:47.507863 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00040653699988979497 future=<Future at 0x7c988416b4a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:47.507863 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:47.507863 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=0.2134825370001181 future=<Future at 0x7c98704d0530 state=cancelled>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:47.507863 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=0.21338475500010645 future=<Future at 0x7c98704d0530 state=cancelled>) was cancelled while queued, skipping {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:47.507863 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:47.507863 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=7.831848258000036 future=<Future at 0x7c989659c7d0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:47.507863 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=7.831775903000107 future=<Future at 0x7c989659c7d0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:47.508631 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Emitting event <LifecycleEvent: 1779930092.506834, e2cc3304-bf2b-4196-b6c8-8ad56da19af4 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:01:47.508779 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] VM Stopped (Lifecycle Event)
May 28 01:01:47.622176 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:01:47.622352 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:01:47.622481 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:01:47.622630 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] No VIF found with MAC fa:16:3e:9d:98:58, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:01:47.623174 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Using config drive
May 28 01:01:48.012026 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:48.016869 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 4 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:01:48.131152 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lazy-loading 'ec2_ids' on Instance uuid e2cc3304-bf2b-4196-b6c8-8ad56da19af4 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:01:48.186632 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-a4608dda-01c7-4cdd-90fa-9b8a836e35f9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Deleted allocation for migration ec834ead-e707-4577-add9-25a13637a2e8
May 28 01:01:48.520048 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
May 28 01:01:48.582668 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:48.634765 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Object Instance<e2cc3304-bf2b-4196-b6c8-8ad56da19af4> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:01:48.634953 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lazy-loading 'keypairs' on Instance uuid e2cc3304-bf2b-4196-b6c8-8ad56da19af4 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:01:48.693817 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a4608dda-01c7-4cdd-90fa-9b8a836e35f9 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 8.539s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:49.140542 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Object Instance<e2cc3304-bf2b-4196-b6c8-8ad56da19af4> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:01:49.143228 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
May 28 01:01:49.195071 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:01:49.195071 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:01:49.319522 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Creating config drive at /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk.config
May 28 01:01:49.323866 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp68s23vlw {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:49.382242 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp68s23vlw" returned: 0 in 0.058s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:49.697632 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:01:49.864005 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:49.897959 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:49.901436 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:49.916640 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-79ec2580-9c8a-4b3c-879e-387e5bf4e0ca req-061a430d-3f04-43b6-9b6b-81f16d5c71ef service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Received event network-changed-d80f49b7-bd41-46df-9743-8ad514696557 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:49.917282 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-79ec2580-9c8a-4b3c-879e-387e5bf4e0ca req-061a430d-3f04-43b6-9b6b-81f16d5c71ef service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Refreshing instance network info cache due to event network-changed-d80f49b7-bd41-46df-9743-8ad514696557. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:01:49.917282 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-79ec2580-9c8a-4b3c-879e-387e5bf4e0ca req-061a430d-3f04-43b6-9b6b-81f16d5c71ef service nova] Acquiring lock "refresh_cache-04880ef4-5eee-4221-ad42-29788eb26358" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:01:49.917282 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-79ec2580-9c8a-4b3c-879e-387e5bf4e0ca req-061a430d-3f04-43b6-9b6b-81f16d5c71ef service nova] Acquired lock "refresh_cache-04880ef4-5eee-4221-ad42-29788eb26358" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:01:49.917282 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-79ec2580-9c8a-4b3c-879e-387e5bf4e0ca req-061a430d-3f04-43b6-9b6b-81f16d5c71ef service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Refreshing network info cache for port d80f49b7-bd41-46df-9743-8ad514696557 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:01:50.022752 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:50.033446 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:50.034509 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:50.211520 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.715s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:50.212192 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:01:50.420486 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-79ec2580-9c8a-4b3c-879e-387e5bf4e0ca req-061a430d-3f04-43b6-9b6b-81f16d5c71ef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:50.687449 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "63eb5e59-29a0-4b0c-b731-6d7265f7d91f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:50.687449 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "63eb5e59-29a0-4b0c-b731-6d7265f7d91f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:50.726080 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:01:50.726756 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:01:50.726756 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:50.726884 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:50.778248 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930110.7773607, e2cc3304-bf2b-4196-b6c8-8ad56da19af4 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:01:50.778248 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] VM Resumed (Lifecycle Event)
May 28 01:01:50.779960 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Instance event wait completed in 0 seconds for  {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:01:50.780334 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:01:50.783340 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-79ec2580-9c8a-4b3c-879e-387e5bf4e0ca req-061a430d-3f04-43b6-9b6b-81f16d5c71ef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:50.786216 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Instance spawned successfully.
May 28 01:01:50.788059 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:01:50.823237 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00466e4787894abe9c5b57f909d4bd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efd8caac5eb46ae9af16a2452ee0353', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:01:50.931675 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-79ec2580-9c8a-4b3c-879e-387e5bf4e0ca req-061a430d-3f04-43b6-9b6b-81f16d5c71ef service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Updated VIF entry in instance network info cache for port d80f49b7-bd41-46df-9743-8ad514696557. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:01:50.932042 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-79ec2580-9c8a-4b3c-879e-387e5bf4e0ca req-061a430d-3f04-43b6-9b6b-81f16d5c71ef service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Updating instance_info_cache with network_info: [{"id": "d80f49b7-bd41-46df-9743-8ad514696557", "address": "fa:16:3e:e7:fe:bd", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80f49b7-bd", "ovs_interfaceid": "d80f49b7-bd41-46df-9743-8ad514696557", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:01:51.079694 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:51.091411 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:51.191068 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:01:51.230095 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:01:51.282386 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:51.288037 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:01:51.293907 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:01:51.294025 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:01:51.294293 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:01:51.294868 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:01:51.294868 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:01:51.294992 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:01:51.434774 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-79ec2580-9c8a-4b3c-879e-387e5bf4e0ca req-061a430d-3f04-43b6-9b6b-81f16d5c71ef service nova] Releasing lock "refresh_cache-04880ef4-5eee-4221-ad42-29788eb26358" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:01:51.439582 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Successfully created port: 56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:01:51.733343 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:01:51.748007 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:51.748007 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:51.752816 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "090f8701-682e-4da8-bd51-e80aa1633d36" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:51.752816 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "090f8701-682e-4da8-bd51-e80aa1633d36" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:51.753664 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:01:51.753797 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Claim successful on node np0000001577
May 28 01:01:51.788935 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
May 28 01:01:51.789201 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930111.7890139, e2cc3304-bf2b-4196-b6c8-8ad56da19af4 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:01:51.789296 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] VM Started (Lifecycle Event)
May 28 01:01:51.804740 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:51.966863 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Successfully updated port: 56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:01:51.989659 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-abc0a388-bc65-4a08-bc1a-efac1598e857 req-b3363531-7c7e-402c-bfd8-e22114b47311 service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Received event network-changed-3ed3d348-6b93-4492-9c18-7b0eecc6454a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:51.989780 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-abc0a388-bc65-4a08-bc1a-efac1598e857 req-b3363531-7c7e-402c-bfd8-e22114b47311 service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Refreshing instance network info cache due to event network-changed-3ed3d348-6b93-4492-9c18-7b0eecc6454a. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:01:51.989880 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-abc0a388-bc65-4a08-bc1a-efac1598e857 req-b3363531-7c7e-402c-bfd8-e22114b47311 service nova] Acquiring lock "refresh_cache-d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:01:51.989967 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-abc0a388-bc65-4a08-bc1a-efac1598e857 req-b3363531-7c7e-402c-bfd8-e22114b47311 service nova] Acquired lock "refresh_cache-d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:01:51.990073 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-abc0a388-bc65-4a08-bc1a-efac1598e857 req-b3363531-7c7e-402c-bfd8-e22114b47311 service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Refreshing network info cache for port 3ed3d348-6b93-4492-9c18-7b0eecc6454a {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:01:52.262339 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:01:52.291775 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:52.293306 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:01:52.317569 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:52.469954 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Acquiring lock "refresh_cache-5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:01:52.469954 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Acquired lock "refresh_cache-5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:01:52.469954 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:01:52.492936 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-abc0a388-bc65-4a08-bc1a-efac1598e857 req-b3363531-7c7e-402c-bfd8-e22114b47311 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:52.741672 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:01:52.742538 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:01:52.742773 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Creating image(s)
May 28 01:01:52.743896 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Acquiring lock "/opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:52.744061 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "/opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:52.744481 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "/opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:52.745285 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:01:52.748006 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:01:52.749046 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:52.847758 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.098s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:52.848330 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:52.848798 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:52.849222 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:01:52.853506 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:01:52.853929 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:52.910287 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:52.924438 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-abc0a388-bc65-4a08-bc1a-efac1598e857 req-b3363531-7c7e-402c-bfd8-e22114b47311 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:52.950755 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.097s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:52.951299 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:52.996493 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk 1073741824" returned: 0 in 0.045s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:52.997016 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.148s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:52.997453 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:53.086134 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:01:53.088485 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.091s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:53.089850 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:01:53.089850 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:53.124019 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-abc0a388-bc65-4a08-bc1a-efac1598e857 req-b3363531-7c7e-402c-bfd8-e22114b47311 service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Updated VIF entry in instance network info cache for port 3ed3d348-6b93-4492-9c18-7b0eecc6454a. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:01:53.124817 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-abc0a388-bc65-4a08-bc1a-efac1598e857 req-b3363531-7c7e-402c-bfd8-e22114b47311 service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Updating instance_info_cache with network_info: [{"id": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "address": "fa:16:3e:28:56:65", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3d348-6b", "ovs_interfaceid": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:01:53.170826 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:53.171163 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Cannot resize image /opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:01:53.171464 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:01:53.171651 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Ensure instance console log exists: /opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:01:53.171923 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:53.172296 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:53.172436 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:53.286263 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:53.446472 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Updating instance_info_cache with network_info: [{"id": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "address": "fa:16:3e:6e:a8:24", "network": {"id": "6403eebe-dcdf-49f8-8196-07e14e099cf4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-219519001-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8efd8caac5eb46ae9af16a2452ee0353", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d66a5a-b3", "ovs_interfaceid": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:01:53.596963 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:01:53.597179 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:01:53.635780 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-abc0a388-bc65-4a08-bc1a-efac1598e857 req-b3363531-7c7e-402c-bfd8-e22114b47311 service nova] Releasing lock "refresh_cache-d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:01:53.951334 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Releasing lock "refresh_cache-5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:01:53.951820 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Instance network_info: |[{"id": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "address": "fa:16:3e:6e:a8:24", "network": {"id": "6403eebe-dcdf-49f8-8196-07e14e099cf4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-219519001-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8efd8caac5eb46ae9af16a2452ee0353", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d66a5a-b3", "ovs_interfaceid": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:01:53.953060 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Start _get_guest_xml network_info=[{"id": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "address": "fa:16:3e:6e:a8:24", "network": {"id": "6403eebe-dcdf-49f8-8196-07e14e099cf4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-219519001-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8efd8caac5eb46ae9af16a2452ee0353", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d66a5a-b3", "ovs_interfaceid": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:01:53.954969 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:01:53.956104 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-1176978347', uuid='5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b'), owner=OwnerMeta(userid='00466e4787894abe9c5b57f909d4bd80', username='tempest-ServerStableDeviceRescueTest-1831534173-project-member', projectid='8efd8caac5eb46ae9af16a2452ee0353', projectname='tempest-ServerStableDeviceRescueTest-1831534173'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "address": "fa:16:3e:6e:a8:24", "network": {"id": "6403eebe-dcdf-49f8-8196-07e14e099cf4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-219519001-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8efd8caac5eb46ae9af16a2452ee0353", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d66a5a-b3", "ovs_interfaceid": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930113.9558084) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:01:53.956937 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:01:53.957260 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:01:53.957958 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:01:53.958126 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:01:53.958951 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:01:53.959249 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:01:53.959405 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:01:53.959526 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:01:53.959714 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:01:53.959836 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:01:53.959927 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:01:53.960068 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:01:53.960162 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:01:53.960267 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:01:53.960360 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:01:53.960482 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:01:53.971867 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:01:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1176978347',display_name='tempest-ServerStableDeviceRescueTest-server-1176978347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serverstabledevicerescuetest-server-1176978347',id=29,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPboZm7ws4t1wEvtZdWzsFVGfNAtB4ijiaRXP0ILEOIyDMla/IV8XOeOh4GaCFErFIkUt97cERef0s2ccqsfOs3RN6JctfpcwjL4XjJhAm1ABrtlDHL+kEgJV1JBwPSzbg==',key_name='tempest-keypair-97535522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8efd8caac5eb46ae9af16a2452ee0353',ramdisk_id='',reservation_id='r-t01ghn10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1831534173',owner_user_name='tempest-ServerStableDeviceRescueTest-1831534173-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:01:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00466e4787894abe9c5b57f909d4bd80',uuid=5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "address": "fa:16:3e:6e:a8:24", "network": {"id": "6403eebe-dcdf-49f8-8196-07e14e099cf4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-219519001-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8efd8caac5eb46ae9af16a2452ee0353", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d66a5a-b3", "ovs_interfaceid": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:01:53.972085 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Converting VIF {"id": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "address": "fa:16:3e:6e:a8:24", "network": {"id": "6403eebe-dcdf-49f8-8196-07e14e099cf4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-219519001-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8efd8caac5eb46ae9af16a2452ee0353", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d66a5a-b3", "ovs_interfaceid": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:01:53.972671 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:a8:24,bridge_name='br-int',has_traffic_filtering=True,id=56d66a5a-b38c-4f84-9a46-d0acab5cea53,network=Network(6403eebe-dcdf-49f8-8196-07e14e099cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d66a5a-b3') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:01:53.973240 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lazy-loading 'pci_devices' on Instance uuid 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:01:54.063027 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-80c33608-7c70-4b37-8608-4397cd7e8cfb req-9f8513bc-dc20-4940-9191-32cc5f9e07f1 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Received event network-changed-56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:54.063027 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-80c33608-7c70-4b37-8608-4397cd7e8cfb req-9f8513bc-dc20-4940-9191-32cc5f9e07f1 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Refreshing instance network info cache due to event network-changed-56d66a5a-b38c-4f84-9a46-d0acab5cea53. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:01:54.063027 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-80c33608-7c70-4b37-8608-4397cd7e8cfb req-9f8513bc-dc20-4940-9191-32cc5f9e07f1 service nova] Acquiring lock "refresh_cache-5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:01:54.063027 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-80c33608-7c70-4b37-8608-4397cd7e8cfb req-9f8513bc-dc20-4940-9191-32cc5f9e07f1 service nova] Acquired lock "refresh_cache-5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:01:54.063027 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-80c33608-7c70-4b37-8608-4397cd7e8cfb req-9f8513bc-dc20-4940-9191-32cc5f9e07f1 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Refreshing network info cache for port 56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:01:54.101441 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:01:54.348002 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6077e208-1674-43b6-959f-3af84fb66d60 req-5e615143-5296-4537-b3e2-5a9d146ddd26 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Received event network-vif-plugged-b1c5ca58-a892-4f67-840e-810089b1fe6a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:54.348165 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6077e208-1674-43b6-959f-3af84fb66d60 req-5e615143-5296-4537-b3e2-5a9d146ddd26 service nova] Acquiring lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:54.348326 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6077e208-1674-43b6-959f-3af84fb66d60 req-5e615143-5296-4537-b3e2-5a9d146ddd26 service nova] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:54.348485 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6077e208-1674-43b6-959f-3af84fb66d60 req-5e615143-5296-4537-b3e2-5a9d146ddd26 service nova] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:54.348630 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6077e208-1674-43b6-959f-3af84fb66d60 req-5e615143-5296-4537-b3e2-5a9d146ddd26 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] No waiting events found dispatching network-vif-plugged-b1c5ca58-a892-4f67-840e-810089b1fe6a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:54.348752 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-6077e208-1674-43b6-959f-3af84fb66d60 req-5e615143-5296-4537-b3e2-5a9d146ddd26 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Received unexpected event network-vif-plugged-b1c5ca58-a892-4f67-840e-810089b1fe6a for instance with vm_state active and task_state None.
May 28 01:01:54.476329 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] End _get_guest_xml xml=<domain type="qemu">
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:   <uuid>5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b</uuid>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:   <name>instance-0000001d</name>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1176978347</nova:name>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:01:53</nova:creationTime>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:         <nova:user uuid="00466e4787894abe9c5b57f909d4bd80">tempest-ServerStableDeviceRescueTest-1831534173-project-member</nova:user>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:         <nova:project uuid="8efd8caac5eb46ae9af16a2452ee0353">tempest-ServerStableDeviceRescueTest-1831534173</nova:project>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:         <nova:port uuid="56d66a5a-b38c-4f84-9a46-d0acab5cea53">
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:     <system>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       <entry name="serial">5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b</entry>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       <entry name="uuid">5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b</entry>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:     </system>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:   <os>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:   </os>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:   <features>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:   </features>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:   <devices>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk"/>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:     </disk>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk.config"/>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:     </disk>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:6e:a8:24"/>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       <target dev="tap56d66a5a-b3"/>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:     </interface>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/console.log" append="off"/>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:     </serial>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:     <video>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:     </video>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:     </rng>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:   </devices>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]: </domain>
May 28 01:01:54.476329 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:01:54.478228 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Preparing to wait for external event network-vif-plugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:01:54.478228 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Acquiring lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:54.478228 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:54.478228 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:54.478402 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:01:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1176978347',display_name='tempest-ServerStableDeviceRescueTest-server-1176978347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serverstabledevicerescuetest-server-1176978347',id=29,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPboZm7ws4t1wEvtZdWzsFVGfNAtB4ijiaRXP0ILEOIyDMla/IV8XOeOh4GaCFErFIkUt97cERef0s2ccqsfOs3RN6JctfpcwjL4XjJhAm1ABrtlDHL+kEgJV1JBwPSzbg==',key_name='tempest-keypair-97535522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8efd8caac5eb46ae9af16a2452ee0353',ramdisk_id='',reservation_id='r-t01ghn10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1831534173',owner_user_name='tempest-ServerStableDeviceRescueTest-1831534173-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:01:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00466e4787894abe9c5b57f909d4bd80',uuid=5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "address": "fa:16:3e:6e:a8:24", "network": {"id": "6403eebe-dcdf-49f8-8196-07e14e099cf4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-219519001-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8efd8caac5eb46ae9af16a2452ee0353", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d66a5a-b3", "ovs_interfaceid": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:01:54.478532 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Converting VIF {"id": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "address": "fa:16:3e:6e:a8:24", "network": {"id": "6403eebe-dcdf-49f8-8196-07e14e099cf4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-219519001-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8efd8caac5eb46ae9af16a2452ee0353", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d66a5a-b3", "ovs_interfaceid": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:01:54.479371 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:a8:24,bridge_name='br-int',has_traffic_filtering=True,id=56d66a5a-b38c-4f84-9a46-d0acab5cea53,network=Network(6403eebe-dcdf-49f8-8196-07e14e099cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d66a5a-b3') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:01:54.479710 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:a8:24,bridge_name='br-int',has_traffic_filtering=True,id=56d66a5a-b38c-4f84-9a46-d0acab5cea53,network=Network(6403eebe-dcdf-49f8-8196-07e14e099cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d66a5a-b3') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:01:54.480367 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:54.480653 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:54.480927 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:01:54.481773 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:54.481967 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a552b151-e0e2-5a06-93a3-a06844fb2c58', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:54.482976 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:54.485196 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:54.487675 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:54.487958 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56d66a5a-b3, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:54.488436 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56d66a5a-b3, col_values=(('qos', UUID('a99a4148-ec53-4d6c-b6ba-e867426f3c88')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:54.490559 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56d66a5a-b3, col_values=(('external_ids', {'iface-id': '56d66a5a-b38c-4f84-9a46-d0acab5cea53', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:a8:24', 'vm-uuid': '5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:54.492380 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:54.494055 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:54.497911 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:54.499203 np0000001577 nova-compute[98319]: INFO os_vif [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:a8:24,bridge_name='br-int',has_traffic_filtering=True,id=56d66a5a-b38c-4f84-9a46-d0acab5cea53,network=Network(6403eebe-dcdf-49f8-8196-07e14e099cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d66a5a-b3')
May 28 01:01:54.568887 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-80c33608-7c70-4b37-8608-4397cd7e8cfb req-9f8513bc-dc20-4940-9191-32cc5f9e07f1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:54.609666 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.862s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:54.610526 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 2.295s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:54.610909 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:01:54.612386 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Trying to apply a migration context that does not seem to be set for this instance {{(pid=98319) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
May 28 01:01:54.887247 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-80c33608-7c70-4b37-8608-4397cd7e8cfb req-9f8513bc-dc20-4940-9191-32cc5f9e07f1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:55.014368 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-80c33608-7c70-4b37-8608-4397cd7e8cfb req-9f8513bc-dc20-4940-9191-32cc5f9e07f1 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Updated VIF entry in instance network info cache for port 56d66a5a-b38c-4f84-9a46-d0acab5cea53. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:01:55.014368 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-80c33608-7c70-4b37-8608-4397cd7e8cfb req-9f8513bc-dc20-4940-9191-32cc5f9e07f1 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Updating instance_info_cache with network_info: [{"id": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "address": "fa:16:3e:6e:a8:24", "network": {"id": "6403eebe-dcdf-49f8-8196-07e14e099cf4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-219519001-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8efd8caac5eb46ae9af16a2452ee0353", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d66a5a-b3", "ovs_interfaceid": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:01:55.127000 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:01:55.127480 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:01:55.127850 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:55.129421 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:55.221075 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb6c20970bf0401190583f6348e00e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e28acf25c4445ea969bd7bca3eac146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:01:55.340029 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00035626999988380703 future=<Future at 0x7c989659c7d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:55.340121 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:01:55.341252 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Emitting event <LifecycleEvent: 1779930100.3395767, dc47e3bc-028d-4166-b702-91cbbd62f80e => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:01:55.341383 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] VM Stopped (Lifecycle Event)
May 28 01:01:55.517082 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-80c33608-7c70-4b37-8608-4397cd7e8cfb req-9f8513bc-dc20-4940-9191-32cc5f9e07f1 service nova] Releasing lock "refresh_cache-5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:01:55.604361 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Successfully created port: 3fc659a4-8cd1-453e-96ac-75c50cf7a85a {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:01:55.628963 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ae85d03a-744c-4572-89d6-f44af2445444 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.019s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:55.630838 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.719s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:55.630838 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:01:55.637714 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:01:55.638322 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Claim successful on node np0000001577
May 28 01:01:55.847333 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: dc47e3bc-028d-4166-b702-91cbbd62f80e] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:56.026329 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:01:56.026329 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:01:56.026786 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] No VIF found with MAC fa:16:3e:6e:a8:24, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:01:56.026835 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Using config drive
May 28 01:01:56.080643 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:56.106294 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Successfully updated port: 3fc659a4-8cd1-453e-96ac-75c50cf7a85a {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:01:56.134718 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:01:56.408814 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7fcd11ca-1496-4565-a55b-e591566f348f req-cb63fec2-5970-40d8-a67e-4d0360ffb993 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Received event network-vif-plugged-b1c5ca58-a892-4f67-840e-810089b1fe6a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:56.408999 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7fcd11ca-1496-4565-a55b-e591566f348f req-cb63fec2-5970-40d8-a67e-4d0360ffb993 service nova] Acquiring lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:56.409155 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7fcd11ca-1496-4565-a55b-e591566f348f req-cb63fec2-5970-40d8-a67e-4d0360ffb993 service nova] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:56.409265 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7fcd11ca-1496-4565-a55b-e591566f348f req-cb63fec2-5970-40d8-a67e-4d0360ffb993 service nova] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:56.409364 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7fcd11ca-1496-4565-a55b-e591566f348f req-cb63fec2-5970-40d8-a67e-4d0360ffb993 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] No waiting events found dispatching network-vif-plugged-b1c5ca58-a892-4f67-840e-810089b1fe6a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:56.409470 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-7fcd11ca-1496-4565-a55b-e591566f348f req-cb63fec2-5970-40d8-a67e-4d0360ffb993 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Received unexpected event network-vif-plugged-b1c5ca58-a892-4f67-840e-810089b1fe6a for instance with vm_state active and task_state None.
May 28 01:01:56.409577 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7fcd11ca-1496-4565-a55b-e591566f348f req-cb63fec2-5970-40d8-a67e-4d0360ffb993 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Received event network-vif-unplugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:56.409717 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7fcd11ca-1496-4565-a55b-e591566f348f req-cb63fec2-5970-40d8-a67e-4d0360ffb993 service nova] Acquiring lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:56.409832 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7fcd11ca-1496-4565-a55b-e591566f348f req-cb63fec2-5970-40d8-a67e-4d0360ffb993 service nova] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:56.410226 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7fcd11ca-1496-4565-a55b-e591566f348f req-cb63fec2-5970-40d8-a67e-4d0360ffb993 service nova] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:56.410438 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7fcd11ca-1496-4565-a55b-e591566f348f req-cb63fec2-5970-40d8-a67e-4d0360ffb993 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] No event matching network-vif-unplugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 in dict_keys([('network-vif-plugged', '56d66a5a-b38c-4f84-9a46-d0acab5cea53')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 01:01:56.410495 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-7fcd11ca-1496-4565-a55b-e591566f348f req-cb63fec2-5970-40d8-a67e-4d0360ffb993 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Received unexpected event network-vif-unplugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 for instance with vm_state building and task_state spawning.
May 28 01:01:56.410603 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7fcd11ca-1496-4565-a55b-e591566f348f req-cb63fec2-5970-40d8-a67e-4d0360ffb993 service nova] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Received event network-changed-3fc659a4-8cd1-453e-96ac-75c50cf7a85a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:56.410696 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7fcd11ca-1496-4565-a55b-e591566f348f req-cb63fec2-5970-40d8-a67e-4d0360ffb993 service nova] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Refreshing instance network info cache due to event network-changed-3fc659a4-8cd1-453e-96ac-75c50cf7a85a. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:01:56.410836 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7fcd11ca-1496-4565-a55b-e591566f348f req-cb63fec2-5970-40d8-a67e-4d0360ffb993 service nova] Acquiring lock "refresh_cache-63eb5e59-29a0-4b0c-b731-6d7265f7d91f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:01:56.410918 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7fcd11ca-1496-4565-a55b-e591566f348f req-cb63fec2-5970-40d8-a67e-4d0360ffb993 service nova] Acquired lock "refresh_cache-63eb5e59-29a0-4b0c-b731-6d7265f7d91f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:01:56.411026 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-7fcd11ca-1496-4565-a55b-e591566f348f req-cb63fec2-5970-40d8-a67e-4d0360ffb993 service nova] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Refreshing network info cache for port 3fc659a4-8cd1-453e-96ac-75c50cf7a85a {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:01:56.531322 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:56.610177 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "refresh_cache-63eb5e59-29a0-4b0c-b731-6d7265f7d91f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:01:56.691839 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Creating config drive at /opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk.config
May 28 01:01:56.696913 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdk04xiaa {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:56.747906 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdk04xiaa" returned: 0 in 0.051s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:56.913495 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-7fcd11ca-1496-4565-a55b-e591566f348f req-cb63fec2-5970-40d8-a67e-4d0360ffb993 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:56.988437 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-7fcd11ca-1496-4565-a55b-e591566f348f req-cb63fec2-5970-40d8-a67e-4d0360ffb993 service nova] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:01:57.143336 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:01:57.146968 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:01:57.146968 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Creating image(s)
May 28 01:01:57.146968 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "/opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:57.146968 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "/opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:57.146968 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "/opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:57.147289 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:01:57.150795 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:01:57.152076 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:57.177974 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-7fcd11ca-1496-4565-a55b-e591566f348f req-cb63fec2-5970-40d8-a67e-4d0360ffb993 service nova] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:01:57.184135 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:57.213540 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:57.247162 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.095s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:57.247969 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:57.248342 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:57.248758 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:01:57.253963 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:01:57.254279 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:57.296235 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:57.352574 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.097s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:57.352574 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:57.407515 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f/disk 1073741824" returned: 0 in 0.055s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:57.407965 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.160s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:57.408338 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:57.493589 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:01:57.493793 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:01:57.496182 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.088s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:57.496747 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Checking if we can resize image /opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:01:57.496987 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:01:57.540848 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:57.544288 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:57.566369 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:57.580800 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:01:57.581193 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Cannot resize image /opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:01:57.581528 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:01:57.581702 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Ensure instance console log exists: /opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:01:57.581939 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:57.582205 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:57.583586 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:57.683735 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7fcd11ca-1496-4565-a55b-e591566f348f req-cb63fec2-5970-40d8-a67e-4d0360ffb993 service nova] Releasing lock "refresh_cache-63eb5e59-29a0-4b0c-b731-6d7265f7d91f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:01:57.684303 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquired lock "refresh_cache-63eb5e59-29a0-4b0c-b731-6d7265f7d91f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:01:57.684459 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:01:57.914305 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930117.9139416, 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:01:57.914591 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] VM Started (Lifecycle Event)
May 28 01:01:57.997508 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:01:58.243990 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:01:58.383111 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:58.416937 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:58.419218 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930118.4189825, 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:01:58.419407 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] VM Paused (Lifecycle Event)
May 28 01:01:58.487132 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-73913732-2249-4929-8f14-0e1f80dab347 req-41a87446-57ea-44d5-9ce5-9b79bf363371 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Received event network-vif-plugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:58.487577 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-73913732-2249-4929-8f14-0e1f80dab347 req-41a87446-57ea-44d5-9ce5-9b79bf363371 service nova] Acquiring lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:58.487822 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-73913732-2249-4929-8f14-0e1f80dab347 req-41a87446-57ea-44d5-9ce5-9b79bf363371 service nova] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:58.487993 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-73913732-2249-4929-8f14-0e1f80dab347 req-41a87446-57ea-44d5-9ce5-9b79bf363371 service nova] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:58.488162 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-73913732-2249-4929-8f14-0e1f80dab347 req-41a87446-57ea-44d5-9ce5-9b79bf363371 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Processing event network-vif-plugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:01:58.488323 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-73913732-2249-4929-8f14-0e1f80dab347 req-41a87446-57ea-44d5-9ce5-9b79bf363371 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Received event network-vif-plugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:01:58.488494 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-73913732-2249-4929-8f14-0e1f80dab347 req-41a87446-57ea-44d5-9ce5-9b79bf363371 service nova] Acquiring lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:58.488890 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-73913732-2249-4929-8f14-0e1f80dab347 req-41a87446-57ea-44d5-9ce5-9b79bf363371 service nova] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:58.488890 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-73913732-2249-4929-8f14-0e1f80dab347 req-41a87446-57ea-44d5-9ce5-9b79bf363371 service nova] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:58.489022 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-73913732-2249-4929-8f14-0e1f80dab347 req-41a87446-57ea-44d5-9ce5-9b79bf363371 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] No waiting events found dispatching network-vif-plugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:01:58.489128 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-73913732-2249-4929-8f14-0e1f80dab347 req-41a87446-57ea-44d5-9ce5-9b79bf363371 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Received unexpected event network-vif-plugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 for instance with vm_state building and task_state spawning.
May 28 01:01:58.489474 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:01:58.497166 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:01:58.499218 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Instance spawned successfully.
May 28 01:01:58.499617 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:01:58.504789 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.876s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:58.505040 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:01:58.553401 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Updating instance_info_cache with network_info: [{"id": "3fc659a4-8cd1-453e-96ac-75c50cf7a85a", "address": "fa:16:3e:11:79:2b", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc659a4-8c", "ovs_interfaceid": "3fc659a4-8cd1-453e-96ac-75c50cf7a85a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:01:58.921670 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:58.924066 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930118.9238162, 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:01:58.924199 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] VM Resumed (Lifecycle Event)
May 28 01:01:59.013075 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:01:59.015353 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:01:59.015353 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:59.015353 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:01:59.016967 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:01:59.017127 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:01:59.017519 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:01:59.017848 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:01:59.018181 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:01:59.018520 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:01:59.055416 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Releasing lock "refresh_cache-63eb5e59-29a0-4b0c-b731-6d7265f7d91f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:01:59.055657 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Instance network_info: |[{"id": "3fc659a4-8cd1-453e-96ac-75c50cf7a85a", "address": "fa:16:3e:11:79:2b", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc659a4-8c", "ovs_interfaceid": "3fc659a4-8cd1-453e-96ac-75c50cf7a85a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:01:59.058642 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Start _get_guest_xml network_info=[{"id": "3fc659a4-8cd1-453e-96ac-75c50cf7a85a", "address": "fa:16:3e:11:79:2b", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc659a4-8c", "ovs_interfaceid": "3fc659a4-8cd1-453e-96ac-75c50cf7a85a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:01:59.063741 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:01:59.064604 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-731729782', uuid='63eb5e59-29a0-4b0c-b731-6d7265f7d91f'), owner=OwnerMeta(userid='fb6c20970bf0401190583f6348e00e4b', username='tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member', projectid='9e28acf25c4445ea969bd7bca3eac146', projectname='tempest-ServerBootFromVolumeStableRescueTest-568223226'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3fc659a4-8cd1-453e-96ac-75c50cf7a85a", "address": "fa:16:3e:11:79:2b", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc659a4-8c", "ovs_interfaceid": "3fc659a4-8cd1-453e-96ac-75c50cf7a85a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930119.0642517) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:01:59.065783 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:01:59.066112 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:01:59.066828 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:01:59.067146 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:01:59.067910 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:01:59.068455 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:01:59.068455 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:01:59.068455 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:01:59.068632 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:01:59.068632 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:01:59.068860 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:01:59.071011 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:01:59.071011 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:01:59.071011 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:01:59.071011 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:01:59.071011 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:01:59.082565 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:01:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-731729782',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serverbootfromvolumestablerescuetest-server-731729782',id=30,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e28acf25c4445ea969bd7bca3eac146',ramdisk_id='',reservation_id='r-s7uatqrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-568223226',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:01:56Z,user_data=None,user_id='fb6c20970bf0401190583f6348e00e4b',uuid=63eb5e59-29a0-4b0c-b731-6d7265f7d91f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fc659a4-8cd1-453e-96ac-75c50cf7a85a", "address": "fa:16:3e:11:79:2b", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc659a4-8c", "ovs_interfaceid": "3fc659a4-8cd1-453e-96ac-75c50cf7a85a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:01:59.082565 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Converting VIF {"id": "3fc659a4-8cd1-453e-96ac-75c50cf7a85a", "address": "fa:16:3e:11:79:2b", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc659a4-8c", "ovs_interfaceid": "3fc659a4-8cd1-453e-96ac-75c50cf7a85a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:01:59.082565 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:79:2b,bridge_name='br-int',has_traffic_filtering=True,id=3fc659a4-8cd1-453e-96ac-75c50cf7a85a,network=Network(c25f8563-bd10-4e42-b4ce-fd2164eca324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fc659a4-8c') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:01:59.082565 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lazy-loading 'pci_devices' on Instance uuid 63eb5e59-29a0-4b0c-b731-6d7265f7d91f {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:01:59.121041 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c803ddeaf4f4b3db07587419087b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050f928f1ce449d6a447cd343dc4ff80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:01:59.427280 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:59.430803 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:01:59.501375 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:59.517652 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:01:59.526244 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Took 6.78 seconds to spawn the instance on the hypervisor.
May 28 01:01:59.526244 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:01:59.584059 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] End _get_guest_xml xml=<domain type="qemu">
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:   <uuid>63eb5e59-29a0-4b0c-b731-6d7265f7d91f</uuid>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:   <name>instance-0000001e</name>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-731729782</nova:name>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:01:59</nova:creationTime>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:         <nova:user uuid="fb6c20970bf0401190583f6348e00e4b">tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member</nova:user>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:         <nova:project uuid="9e28acf25c4445ea969bd7bca3eac146">tempest-ServerBootFromVolumeStableRescueTest-568223226</nova:project>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:         <nova:port uuid="3fc659a4-8cd1-453e-96ac-75c50cf7a85a">
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:     <system>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       <entry name="serial">63eb5e59-29a0-4b0c-b731-6d7265f7d91f</entry>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       <entry name="uuid">63eb5e59-29a0-4b0c-b731-6d7265f7d91f</entry>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:     </system>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:   <os>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:   </os>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:   <features>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:   </features>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:   <devices>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f/disk"/>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:     </disk>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f/disk.config"/>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:     </disk>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:11:79:2b"/>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       <target dev="tap3fc659a4-8c"/>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:     </interface>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f/console.log" append="off"/>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:     </serial>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:     <video>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:     </video>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:     </rng>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:   </devices>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]: </domain>
May 28 01:01:59.584059 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:01:59.586826 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Preparing to wait for external event network-vif-plugged-3fc659a4-8cd1-453e-96ac-75c50cf7a85a {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:01:59.586826 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "63eb5e59-29a0-4b0c-b731-6d7265f7d91f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:01:59.586826 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "63eb5e59-29a0-4b0c-b731-6d7265f7d91f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:01:59.586826 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "63eb5e59-29a0-4b0c-b731-6d7265f7d91f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:01:59.586826 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:01:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-731729782',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serverbootfromvolumestablerescuetest-server-731729782',id=30,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e28acf25c4445ea969bd7bca3eac146',ramdisk_id='',reservation_id='r-s7uatqrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-568223226',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:01:56Z,user_data=None,user_id='fb6c20970bf0401190583f6348e00e4b',uuid=63eb5e59-29a0-4b0c-b731-6d7265f7d91f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fc659a4-8cd1-453e-96ac-75c50cf7a85a", "address": "fa:16:3e:11:79:2b", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc659a4-8c", "ovs_interfaceid": "3fc659a4-8cd1-453e-96ac-75c50cf7a85a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:01:59.586826 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Converting VIF {"id": "3fc659a4-8cd1-453e-96ac-75c50cf7a85a", "address": "fa:16:3e:11:79:2b", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc659a4-8c", "ovs_interfaceid": "3fc659a4-8cd1-453e-96ac-75c50cf7a85a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:01:59.586826 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:79:2b,bridge_name='br-int',has_traffic_filtering=True,id=3fc659a4-8cd1-453e-96ac-75c50cf7a85a,network=Network(c25f8563-bd10-4e42-b4ce-fd2164eca324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fc659a4-8c') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:01:59.586826 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:79:2b,bridge_name='br-int',has_traffic_filtering=True,id=3fc659a4-8cd1-453e-96ac-75c50cf7a85a,network=Network(c25f8563-bd10-4e42-b4ce-fd2164eca324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fc659a4-8c') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:01:59.586826 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:59.587739 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:59.587739 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:01:59.588178 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:59.588343 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b71324d-a2c3-5e7d-813f-50d619f214c8', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:59.589133 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:59.589992 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:59.590873 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:59.595029 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Successfully created port: 22ff5930-d13e-450c-9898-d435893e84ee {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:01:59.599070 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:59.599246 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3fc659a4-8c, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:59.599524 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3fc659a4-8c, col_values=(('qos', UUID('b572aa51-5730-4399-8a03-afd171218f69')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:59.599698 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3fc659a4-8c, col_values=(('external_ids', {'iface-id': '3fc659a4-8cd1-453e-96ac-75c50cf7a85a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:79:2b', 'vm-uuid': '63eb5e59-29a0-4b0c-b731-6d7265f7d91f'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:01:59.602071 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:01:59.608643 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:01:59.609259 np0000001577 nova-compute[98319]: INFO os_vif [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:79:2b,bridge_name='br-int',has_traffic_filtering=True,id=3fc659a4-8cd1-453e-96ac-75c50cf7a85a,network=Network(c25f8563-bd10-4e42-b4ce-fd2164eca324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fc659a4-8c')
May 28 01:01:59.933025 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:02:00.018935 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:02:00.042234 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Took 13.66 seconds to build instance.
May 28 01:02:00.092773 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Successfully updated port: 22ff5930-d13e-450c-9898-d435893e84ee {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:02:00.145058 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e6c84437-a2a6-4749-8ddd-ad9f97a6c0cb req-bbdfbe13-5efd-4f5f-9c15-99f1f09cab45 service nova] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Received event network-changed-22ff5930-d13e-450c-9898-d435893e84ee {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:00.145179 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e6c84437-a2a6-4749-8ddd-ad9f97a6c0cb req-bbdfbe13-5efd-4f5f-9c15-99f1f09cab45 service nova] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Refreshing instance network info cache due to event network-changed-22ff5930-d13e-450c-9898-d435893e84ee. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:02:00.145317 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e6c84437-a2a6-4749-8ddd-ad9f97a6c0cb req-bbdfbe13-5efd-4f5f-9c15-99f1f09cab45 service nova] Acquiring lock "refresh_cache-090f8701-682e-4da8-bd51-e80aa1633d36" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:02:00.145401 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e6c84437-a2a6-4749-8ddd-ad9f97a6c0cb req-bbdfbe13-5efd-4f5f-9c15-99f1f09cab45 service nova] Acquired lock "refresh_cache-090f8701-682e-4da8-bd51-e80aa1633d36" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:02:00.145499 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-e6c84437-a2a6-4749-8ddd-ad9f97a6c0cb req-bbdfbe13-5efd-4f5f-9c15-99f1f09cab45 service nova] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Refreshing network info cache for port 22ff5930-d13e-450c-9898-d435893e84ee {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:02:00.518226 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "a9122d01-9c31-48d3-ae6b-e2d6305fe8d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:00.518640 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "a9122d01-9c31-48d3-ae6b-e2d6305fe8d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:00.524746 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Booting with volume cb4e4708-5c28-498f-ba26-71dd5596e0bd at /dev/vda
May 28 01:02:00.543737 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b94ba0e9-2e12-4994-a0c3-66bce5332dc0 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.163s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:00.562173 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:02:00.575258 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:02:00.595169 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "refresh_cache-090f8701-682e-4da8-bd51-e80aa1633d36" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:02:00.599090 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:00.637618 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:02:00.637618 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:02:00.647871 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-e6c84437-a2a6-4749-8ddd-ad9f97a6c0cb req-bbdfbe13-5efd-4f5f-9c15-99f1f09cab45 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:00.649895 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:02:00.651224 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe75:1c46', 'fe80::8c3:73ff:fe68:9ea1', 'fe80::fc16:3eff:fef0:246e', 'fe80::fc16:3eff:feca:a831', 'fe80::e8d7:d3ff:fe11:4890', 'fe80::fc16:3eff:fe12:3f51', 'fe80::64e0:a4ff:fe34:ffd6', 'fe80::fc16:3eff:fe72:df47', 'fe80::fc16:3eff:fe3e:2329', 'fe80::fc16:3eff:fee7:febd', 'fe80::fc16:3eff:fe5e:ef9c', 'fe80::6cd5:f5ff:fe52:2a3e', 'fe80::fc16:3eff:fedf:9fb0', 'fe80::fc16:3eff:fe28:5665', 'fe80::fc16:3eff:fe9d:9858', 'fe80::fc16:3eff:fe6e:a824', 'fe80::1457:8aff:feb2:8bfb'] 
May 28 01:02:00.651341 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:02:00.652529 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:02:00.652787 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:02:00.653111 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Updating existing volume attachment record: 65263b77-9bd1-4499-9870-cda34b65c698 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:02:00.726008 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-e6c84437-a2a6-4749-8ddd-ad9f97a6c0cb req-bbdfbe13-5efd-4f5f-9c15-99f1f09cab45 service nova] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:02:00.900228 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-e6c84437-a2a6-4749-8ddd-ad9f97a6c0cb req-bbdfbe13-5efd-4f5f-9c15-99f1f09cab45 service nova] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:02:01.023029 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:02:01.084884 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:01.091357 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-77db9125-0029-426d-aa0c-fdb253e3a1fa req-555eaa27-3820-4386-8ce9-a58a1156e7f5 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Received event network-changed-56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:01.091594 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-77db9125-0029-426d-aa0c-fdb253e3a1fa req-555eaa27-3820-4386-8ce9-a58a1156e7f5 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Refreshing instance network info cache due to event network-changed-56d66a5a-b38c-4f84-9a46-d0acab5cea53. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:02:01.091867 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-77db9125-0029-426d-aa0c-fdb253e3a1fa req-555eaa27-3820-4386-8ce9-a58a1156e7f5 service nova] Acquiring lock "refresh_cache-5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:02:01.092859 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-77db9125-0029-426d-aa0c-fdb253e3a1fa req-555eaa27-3820-4386-8ce9-a58a1156e7f5 service nova] Acquired lock "refresh_cache-5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:02:01.092956 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-77db9125-0029-426d-aa0c-fdb253e3a1fa req-555eaa27-3820-4386-8ce9-a58a1156e7f5 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Refreshing network info cache for port 56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:02:01.135821 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:02:01.135975 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:02:01.136036 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] No VIF found with MAC fa:16:3e:11:79:2b, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:02:01.136446 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Using config drive
May 28 01:02:01.402995 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e6c84437-a2a6-4749-8ddd-ad9f97a6c0cb req-bbdfbe13-5efd-4f5f-9c15-99f1f09cab45 service nova] Releasing lock "refresh_cache-090f8701-682e-4da8-bd51-e80aa1633d36" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:02:01.403723 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquired lock "refresh_cache-090f8701-682e-4da8-bd51-e80aa1633d36" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:02:01.403983 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:02:01.584600 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:01.584942 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:01.587281 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:02:01.587403 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Claim successful on node np0000001577
May 28 01:02:01.594916 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-77db9125-0029-426d-aa0c-fdb253e3a1fa req-555eaa27-3820-4386-8ce9-a58a1156e7f5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:01.642884 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:01.781901 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Creating config drive at /opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f/disk.config
May 28 01:02:01.786344 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbq5jclm5 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:01.836711 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbq5jclm5" returned: 0 in 0.050s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:01.989320 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:02:02.026228 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "03f1821a-592e-4e02-b609-74f3d7e69b53" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:02.026228 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "03f1821a-592e-4e02-b609-74f3d7e69b53" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:02.026228 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Shelving
May 28 01:02:02.175997 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:02.290302 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:02.294937 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:02.321139 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:02.333682 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Updating instance_info_cache with network_info: [{"id": "22ff5930-d13e-450c-9898-d435893e84ee", "address": "fa:16:3e:f8:be:e0", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ff5930-d1", "ovs_interfaceid": "22ff5930-d13e-450c-9898-d435893e84ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:02:02.405446 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:02.447321 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-77db9125-0029-426d-aa0c-fdb253e3a1fa req-555eaa27-3820-4386-8ce9-a58a1156e7f5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:02.621407 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-77db9125-0029-426d-aa0c-fdb253e3a1fa req-555eaa27-3820-4386-8ce9-a58a1156e7f5 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Updated VIF entry in instance network info cache for port 56d66a5a-b38c-4f84-9a46-d0acab5cea53. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:02:02.621909 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-77db9125-0029-426d-aa0c-fdb253e3a1fa req-555eaa27-3820-4386-8ce9-a58a1156e7f5 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Updating instance_info_cache with network_info: [{"id": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "address": "fa:16:3e:6e:a8:24", "network": {"id": "6403eebe-dcdf-49f8-8196-07e14e099cf4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-219519001-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8efd8caac5eb46ae9af16a2452ee0353", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d66a5a-b3", "ovs_interfaceid": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:02:02.655314 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:02.657403 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:02.661078 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:02.687749 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:02.780687 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:02:02.781937 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:02:02.782188 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Creating image(s)
May 28 01:02:02.782514 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:02:02.782950 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Ensure instance console log exists: /opt/stack/data/nova/instances/090f8701-682e-4da8-bd51-e80aa1633d36/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:02:02.783196 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:02.784387 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:02.784387 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:02.838146 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Releasing lock "refresh_cache-090f8701-682e-4da8-bd51-e80aa1633d36" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:02:02.838146 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Instance network_info: |[{"id": "22ff5930-d13e-450c-9898-d435893e84ee", "address": "fa:16:3e:f8:be:e0", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ff5930-d1", "ovs_interfaceid": "22ff5930-d13e-450c-9898-d435893e84ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:02:02.838799 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Start _get_guest_xml network_info=[{"id": "22ff5930-d13e-450c-9898-d435893e84ee", "address": "fa:16:3e:f8:be:e0", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ff5930-d1", "ovs_interfaceid": "22ff5930-d13e-450c-9898-d435893e84ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd', 'iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cb4e4708-5c28-498f-ba26-71dd5596e0bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '090f8701-682e-4da8-bd51-e80aa1633d36', 'attached_at': '', 'detached_at': '', 'volume_id': 'cb4e4708-5c28-498f-ba26-71dd5596e0bd', 'serial': 'cb4e4708-5c28-498f-ba26-71dd5596e0bd'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '65263b77-9bd1-4499-9870-cda34b65c698', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:02:02.847476 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:02:02.848719 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-541658760', uuid='090f8701-682e-4da8-bd51-e80aa1633d36'), owner=OwnerMeta(userid='0c803ddeaf4f4b3db07587419087b3b2', username='tempest-TestVolumeBootPattern-1449742411-project-member', projectid='050f928f1ce449d6a447cd343dc4ff80', projectname='tempest-TestVolumeBootPattern-1449742411'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "22ff5930-d13e-450c-9898-d435893e84ee", "address": "fa:16:3e:f8:be:e0", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ff5930-d1", "ovs_interfaceid": "22ff5930-d13e-450c-9898-d435893e84ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930122.848201) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:02:02.849858 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:02:02.850171 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:02:02.851031 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:02:02.851177 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:02:02.851950 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:02:02.852197 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:02:02.852327 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:02:02.852412 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:02:02.852527 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:02:02.852655 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:02:02.852796 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:02:02.853007 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:02:02.853213 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:02:02.853384 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:02:02.853515 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:02:02.853689 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:02:02.864443 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:02:02.864788 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd', 'iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cb4e4708-5c28-498f-ba26-71dd5596e0bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:02:02.864936 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:02:02.865274 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:02:02.865618 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd', 'iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cb4e4708-5c28-498f-ba26-71dd5596e0bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:02:02.877494 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:02:02.878202 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:02:02.879992 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:02:02.879992 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:02:02.879992 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:02:02.879992 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:02:02.892063 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:02:02.892063 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:02.902374 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:02:02.902374 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:02.909696 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd] added
May 28 01:02:02.909696 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:02:02.909696 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:02:02.909696 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:02:02.909696 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:02:02.909696 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:02:02.909696 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:02.910105 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:02:02.910336 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0313(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:02:02.910575 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:02:02.914419 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd] added
May 28 01:02:02.914419 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:02:02.914419 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:02:02.914419 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:02:02.914419 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:02:02.914419 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:02:02.914419 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:02.915593 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:02:02.915794 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0363(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:02:02.915954 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:02:03.060559 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:03.063465 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:03.084020 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:03.095463 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:03.119035 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:03.130249 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-77db9125-0029-426d-aa0c-fdb253e3a1fa req-555eaa27-3820-4386-8ce9-a58a1156e7f5 service nova] Releasing lock "refresh_cache-5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:02:03.144800 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-133f0a57-793e-4b6b-a130-24408266b8f6 req-56ea50a6-ecda-4ff3-9a3a-4f0ea3d4a8f1 service nova] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Received event network-vif-plugged-3fc659a4-8cd1-453e-96ac-75c50cf7a85a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:03.145156 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-133f0a57-793e-4b6b-a130-24408266b8f6 req-56ea50a6-ecda-4ff3-9a3a-4f0ea3d4a8f1 service nova] Acquiring lock "63eb5e59-29a0-4b0c-b731-6d7265f7d91f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:03.145290 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-133f0a57-793e-4b6b-a130-24408266b8f6 req-56ea50a6-ecda-4ff3-9a3a-4f0ea3d4a8f1 service nova] Lock "63eb5e59-29a0-4b0c-b731-6d7265f7d91f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:03.145482 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-133f0a57-793e-4b6b-a130-24408266b8f6 req-56ea50a6-ecda-4ff3-9a3a-4f0ea3d4a8f1 service nova] Lock "63eb5e59-29a0-4b0c-b731-6d7265f7d91f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:03.145582 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-133f0a57-793e-4b6b-a130-24408266b8f6 req-56ea50a6-ecda-4ff3-9a3a-4f0ea3d4a8f1 service nova] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Processing event network-vif-plugged-3fc659a4-8cd1-453e-96ac-75c50cf7a85a {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:02:03.145660 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-133f0a57-793e-4b6b-a130-24408266b8f6 req-56ea50a6-ecda-4ff3-9a3a-4f0ea3d4a8f1 service nova] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Received event network-vif-plugged-3fc659a4-8cd1-453e-96ac-75c50cf7a85a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:03.145790 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-133f0a57-793e-4b6b-a130-24408266b8f6 req-56ea50a6-ecda-4ff3-9a3a-4f0ea3d4a8f1 service nova] Acquiring lock "63eb5e59-29a0-4b0c-b731-6d7265f7d91f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:03.145887 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-133f0a57-793e-4b6b-a130-24408266b8f6 req-56ea50a6-ecda-4ff3-9a3a-4f0ea3d4a8f1 service nova] Lock "63eb5e59-29a0-4b0c-b731-6d7265f7d91f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:03.145992 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-133f0a57-793e-4b6b-a130-24408266b8f6 req-56ea50a6-ecda-4ff3-9a3a-4f0ea3d4a8f1 service nova] Lock "63eb5e59-29a0-4b0c-b731-6d7265f7d91f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:03.146085 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-133f0a57-793e-4b6b-a130-24408266b8f6 req-56ea50a6-ecda-4ff3-9a3a-4f0ea3d4a8f1 service nova] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] No waiting events found dispatching network-vif-plugged-3fc659a4-8cd1-453e-96ac-75c50cf7a85a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:02:03.146192 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-133f0a57-793e-4b6b-a130-24408266b8f6 req-56ea50a6-ecda-4ff3-9a3a-4f0ea3d4a8f1 service nova] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Received unexpected event network-vif-plugged-3fc659a4-8cd1-453e-96ac-75c50cf7a85a for instance with vm_state building and task_state spawning.
May 28 01:02:03.163996 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:02:03.166352 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930123.1656704, 63eb5e59-29a0-4b0c-b731-6d7265f7d91f => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:02:03.166732 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] VM Started (Lifecycle Event)
May 28 01:02:03.167443 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:02:03.170464 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Instance spawned successfully.
May 28 01:02:03.172663 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:02:03.228056 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4a3b448d-2626-47c7-b8b7-919188c582fe req-71281bb4-0d7d-40f6-bb99-160353557ffa service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Received event network-vif-unplugged-95f81148-2a4e-4ca8-ad05-cb73d6f2951f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:03.228413 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4a3b448d-2626-47c7-b8b7-919188c582fe req-71281bb4-0d7d-40f6-bb99-160353557ffa service nova] Acquiring lock "03f1821a-592e-4e02-b609-74f3d7e69b53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:03.228620 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4a3b448d-2626-47c7-b8b7-919188c582fe req-71281bb4-0d7d-40f6-bb99-160353557ffa service nova] Lock "03f1821a-592e-4e02-b609-74f3d7e69b53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:03.228788 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4a3b448d-2626-47c7-b8b7-919188c582fe req-71281bb4-0d7d-40f6-bb99-160353557ffa service nova] Lock "03f1821a-592e-4e02-b609-74f3d7e69b53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:03.229211 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4a3b448d-2626-47c7-b8b7-919188c582fe req-71281bb4-0d7d-40f6-bb99-160353557ffa service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] No waiting events found dispatching network-vif-unplugged-95f81148-2a4e-4ca8-ad05-cb73d6f2951f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:02:03.229395 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-4a3b448d-2626-47c7-b8b7-919188c582fe req-71281bb4-0d7d-40f6-bb99-160353557ffa service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Received unexpected event network-vif-unplugged-95f81148-2a4e-4ca8-ad05-cb73d6f2951f for instance with vm_state active and task_state shelving.
May 28 01:02:03.343934 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:03.360725 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:03.378993 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Instance destroyed successfully.
May 28 01:02:03.379564 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lazy-loading 'numa_topology' on Instance uuid 03f1821a-592e-4e02-b609-74f3d7e69b53 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:03.388135 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:02:03.388692 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:02:03.670535 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:03.672016 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:02:03.678664 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:02:03.678837 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:02:03.679314 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:02:03.679634 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:02:03.680010 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:02:03.680335 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:02:03.891779 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:02:03.911098 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:02:03.916332 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:02:03.925482 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:02:03.925482 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:02:03.935232 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:02:03.935232 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:03.941993 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:03.948886 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:03.958641 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:03.958641 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:03.958641 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:03.958641 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:03.958641 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:02:03.958641 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:02:03.958641 np0000001577 nova-compute[98319]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:03.958641 np0000001577 nova-compute[98319]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:03.958641 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:02:03.958941 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:03.958941 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:03.958941 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:03.958941 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:03.958941 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:02:03.958941 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:02:03.958941 np0000001577 nova-compute[98319]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:03.958941 np0000001577 nova-compute[98319]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:03.958941 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:02:03.967211 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:03.967211 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:03.967211 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:03.967211 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:03.967211 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:02:03.967211 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:02:03.967211 np0000001577 nova-compute[98319]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:03.967211 np0000001577 nova-compute[98319]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:03.967211 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:02:03.970499 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:03.970499 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:03.970499 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:03.970499 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:03.970499 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:02:03.970499 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:02:03.970499 np0000001577 nova-compute[98319]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:03.970499 np0000001577 nova-compute[98319]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:03.970499 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:02:03.980538 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Beginning cold snapshot process
May 28 01:02:04.007949 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd, portal: 192.168.40.100,3260]
May 28 01:02:04.007949 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd, portal: 192.168.40.100,3260] successful.
May 28 01:02:04.007949 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:04.020161 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:04.028245 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd, portal: 192.168.50.100,3260]
May 28 01:02:04.028245 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd, portal: 192.168.50.100,3260] successful.
May 28 01:02:04.028245 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:04.040122 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:04.040122 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:04.040122 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:04.040122 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:04.040122 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:02:04.040122 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:02:04.040122 np0000001577 nova-compute[98319]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:04.040122 np0000001577 nova-compute[98319]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:04.040122 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:04.040122 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:04.040122 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:02:04.040397 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:04.040397 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:04.040397 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:04.040397 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:04.040397 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:02:04.040397 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:02:04.040397 np0000001577 nova-compute[98319]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:04.040397 np0000001577 nova-compute[98319]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:04.040397 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:04.040397 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:04.040397 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:02:04.041757 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.162s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:02:04.041988 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:02:04.044367 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:04.044562 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] HCTL ('7', '-', '-', 0) found on session 60 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:02:04.045030 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:02:04.059199 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching for a device in session 60 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:02:04.059199 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cb4e4708-5c28-498f-ba26-71dd5596e0bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:02:04.070824 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:04.070824 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:04.070824 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:04.070824 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:04.070824 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:02:04.070824 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:02:04.070824 np0000001577 nova-compute[98319]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:04.070824 np0000001577 nova-compute[98319]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:04.070824 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:04.070824 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:04.070824 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:02:04.071096 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:04.071096 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:04.071096 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:04.071096 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:04.071096 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:02:04.071096 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:02:04.071096 np0000001577 nova-compute[98319]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:04.071096 np0000001577 nova-compute[98319]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:04.071096 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:04.071096 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:04.071096 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:02:04.071332 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.192s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:02:04.071416 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:02:04.072964 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] HCTL ('12', '-', '-', 0) found on session 61 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:02:04.073534 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:02:04.088282 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching for a device in session 61 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:02:04.088282 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'cb4e4708-5c28-498f-ba26-71dd5596e0bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:02:04.175135 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:02:04.175260 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930124.1751304, 63eb5e59-29a0-4b0c-b731-6d7265f7d91f => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:02:04.175380 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] VM Paused (Lifecycle Event)
May 28 01:02:04.185540 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Took 7.04 seconds to spawn the instance on the hypervisor.
May 28 01:02:04.185902 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:04.400289 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.815s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:04.400557 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:02:04.613123 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:04.678488 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:04.680107 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930124.679901, 63eb5e59-29a0-4b0c-b731-6d7265f7d91f => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:02:04.680344 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] VM Resumed (Lifecycle Event)
May 28 01:02:04.697499 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Took 13.00 seconds to build instance.
May 28 01:02:04.879384 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:02:04.905953 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:02:04.906144 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:02:04.906381 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:04.906583 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:04.992540 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f43f6f5427ba4a5b896019555a2ef47a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b80759164bf4465b0bd873db74c9c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:02:05.183044 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:05.185837 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:02:05.199127 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd7d8f9f-e7c3-4d72-803e-b4f7e5aee1e6 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "63eb5e59-29a0-4b0c-b731-6d7265f7d91f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.512s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:05.308958 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-135358ea-e81b-4eb2-8b6c-fd9e389a90e0 req-5e915a83-d5aa-4623-9d07-0483cc08e4dc service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Received event network-vif-unplugged-95f81148-2a4e-4ca8-ad05-cb73d6f2951f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:05.309110 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-135358ea-e81b-4eb2-8b6c-fd9e389a90e0 req-5e915a83-d5aa-4623-9d07-0483cc08e4dc service nova] Acquiring lock "03f1821a-592e-4e02-b609-74f3d7e69b53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:05.309226 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-135358ea-e81b-4eb2-8b6c-fd9e389a90e0 req-5e915a83-d5aa-4623-9d07-0483cc08e4dc service nova] Lock "03f1821a-592e-4e02-b609-74f3d7e69b53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:05.309327 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-135358ea-e81b-4eb2-8b6c-fd9e389a90e0 req-5e915a83-d5aa-4623-9d07-0483cc08e4dc service nova] Lock "03f1821a-592e-4e02-b609-74f3d7e69b53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:05.309441 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-135358ea-e81b-4eb2-8b6c-fd9e389a90e0 req-5e915a83-d5aa-4623-9d07-0483cc08e4dc service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] No waiting events found dispatching network-vif-unplugged-95f81148-2a4e-4ca8-ad05-cb73d6f2951f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:02:05.309559 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-135358ea-e81b-4eb2-8b6c-fd9e389a90e0 req-5e915a83-d5aa-4623-9d07-0483cc08e4dc service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Received unexpected event network-vif-unplugged-95f81148-2a4e-4ca8-ad05-cb73d6f2951f for instance with vm_state active and task_state shelving_image_pending_upload.
May 28 01:02:05.409071 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:02:05.483920 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Successfully created port: 78e03974-3a80-43b7-8198-eb4e28fb8e4f {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:02:05.497445 np0000001577 nova-compute[98319]: DEBUG nova.privsep.utils [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 01:02:05.499637 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/disk /opt/stack/data/nova/instances/snapshots/tmps11s1g_j/495ff473700a429aa8c140196e841922 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:05.693176 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.99930084499988 future=<Future at 0x7c987047c7a0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:05.694954 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.99689004600009 future=<Future at 0x7c987047c7a0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:05.695050 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.996765523000022 future=<Future at 0x7c987047c7a0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:05.741678 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/disk /opt/stack/data/nova/instances/snapshots/tmps11s1g_j/495ff473700a429aa8c140196e841922" returned: 0 in 0.242s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:05.743682 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Snapshot extracted, beginning image upload
May 28 01:02:05.900335 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Found WWN 3300000009fad0407 for multipath device dm-2 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:02:05.900850 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:02:05.901233 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '3300000009fad0407', 'path': '/dev/dm-2', 'multipath_id': '3300000009fad0407'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:02:05.901233 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009fad0407', 'path': '/dev/dm-2', 'multipath_id': '3300000009fad0407'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:02:05.915243 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:02:06.039876 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Successfully updated port: 78e03974-3a80-43b7-8198-eb4e28fb8e4f {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:02:06.087082 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:06.103136 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b50575b1-98f8-41a3-9846-40e6df4bf8a0 req-bad15c14-5b30-4326-a405-5ca83b81d35c service nova] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Received event network-changed-78e03974-3a80-43b7-8198-eb4e28fb8e4f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:06.103434 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b50575b1-98f8-41a3-9846-40e6df4bf8a0 req-bad15c14-5b30-4326-a405-5ca83b81d35c service nova] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Refreshing instance network info cache due to event network-changed-78e03974-3a80-43b7-8198-eb4e28fb8e4f. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:02:06.103781 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b50575b1-98f8-41a3-9846-40e6df4bf8a0 req-bad15c14-5b30-4326-a405-5ca83b81d35c service nova] Acquiring lock "refresh_cache-a9122d01-9c31-48d3-ae6b-e2d6305fe8d7" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:02:06.103916 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b50575b1-98f8-41a3-9846-40e6df4bf8a0 req-bad15c14-5b30-4326-a405-5ca83b81d35c service nova] Acquired lock "refresh_cache-a9122d01-9c31-48d3-ae6b-e2d6305fe8d7" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:02:06.104232 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b50575b1-98f8-41a3-9846-40e6df4bf8a0 req-bad15c14-5b30-4326-a405-5ca83b81d35c service nova] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Refreshing network info cache for port 78e03974-3a80-43b7-8198-eb4e28fb8e4f {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:02:06.410346 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:01:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-541658760',display_name='tempest-TestVolumeBootPattern-server-541658760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpattern-server-541658760',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTv25yrQ3s0TbPbCrDSd+GoI2f0UdDwk/W38CiCCv+YARRkBAVGf5UOJO55OoH9kSwt8i0m12+wHnB37bSw+YJd2DsVdqH3urR9C0DDH8CHMRoo1WH/IUKCEjEfwBV1qA==',key_name='tempest-keypair-1524072439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='050f928f1ce449d6a447cd343dc4ff80',ramdisk_id='',reservation_id='r-zfwv86qe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1449742411',owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:02:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c803ddeaf4f4b3db07587419087b3b2',uuid=090f8701-682e-4da8-bd51-e80aa1633d36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22ff5930-d13e-450c-9898-d435893e84ee", "address": "fa:16:3e:f8:be:e0", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ff5930-d1", "ovs_interfaceid": "22ff5930-d13e-450c-9898-d435893e84ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:02:06.410346 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converting VIF {"id": "22ff5930-d13e-450c-9898-d435893e84ee", "address": "fa:16:3e:f8:be:e0", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ff5930-d1", "ovs_interfaceid": "22ff5930-d13e-450c-9898-d435893e84ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:02:06.410346 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:be:e0,bridge_name='br-int',has_traffic_filtering=True,id=22ff5930-d13e-450c-9898-d435893e84ee,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22ff5930-d1') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:02:06.410346 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lazy-loading 'pci_devices' on Instance uuid 090f8701-682e-4da8-bd51-e80aa1633d36 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:06.432206 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ae8051a4-b816-47c5-9cf7-7dbd75f9a566 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:06.541706 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "refresh_cache-a9122d01-9c31-48d3-ae6b-e2d6305fe8d7" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:02:06.606695 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-b50575b1-98f8-41a3-9846-40e6df4bf8a0 req-bad15c14-5b30-4326-a405-5ca83b81d35c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:06.687084 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b50575b1-98f8-41a3-9846-40e6df4bf8a0 req-bad15c14-5b30-4326-a405-5ca83b81d35c service nova] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:02:06.846571 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b50575b1-98f8-41a3-9846-40e6df4bf8a0 req-bad15c14-5b30-4326-a405-5ca83b81d35c service nova] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:02:06.914765 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] End _get_guest_xml xml=<domain type="qemu">
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:   <uuid>090f8701-682e-4da8-bd51-e80aa1633d36</uuid>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:   <name>instance-0000001f</name>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestVolumeBootPattern-server-541658760</nova:name>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:02:02</nova:creationTime>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       <nova:image uuid="">
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:         <nova:user uuid="0c803ddeaf4f4b3db07587419087b3b2">tempest-TestVolumeBootPattern-1449742411-project-member</nova:user>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:         <nova:project uuid="050f928f1ce449d6a447cd343dc4ff80">tempest-TestVolumeBootPattern-1449742411</nova:project>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:         <nova:port uuid="22ff5930-d13e-450c-9898-d435893e84ee">
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:     <system>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       <entry name="serial">090f8701-682e-4da8-bd51-e80aa1633d36</entry>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       <entry name="uuid">090f8701-682e-4da8-bd51-e80aa1633d36</entry>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:     </system>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:   <os>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:   </os>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:   <features>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:   </features>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:   <devices>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/090f8701-682e-4da8-bd51-e80aa1633d36/disk.config"/>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:     </disk>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       <alias name="ua-cb4e4708-5c28-498f-ba26-71dd5596e0bd"/>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-2"/>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       <serial>cb4e4708-5c28-498f-ba26-71dd5596e0bd</serial>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:     </disk>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:f8:be:e0"/>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       <target dev="tap22ff5930-d1"/>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:     </interface>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/090f8701-682e-4da8-bd51-e80aa1633d36/console.log" append="off"/>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:     </serial>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:     <video>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:     </video>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:     </rng>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:   </devices>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]: </domain>
May 28 01:02:06.914765 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:02:06.919566 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Preparing to wait for external event network-vif-plugged-22ff5930-d13e-450c-9898-d435893e84ee {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:02:06.919566 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "090f8701-682e-4da8-bd51-e80aa1633d36-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:06.919566 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "090f8701-682e-4da8-bd51-e80aa1633d36-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:06.919566 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "090f8701-682e-4da8-bd51-e80aa1633d36-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:06.919566 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:01:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-541658760',display_name='tempest-TestVolumeBootPattern-server-541658760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpattern-server-541658760',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTv25yrQ3s0TbPbCrDSd+GoI2f0UdDwk/W38CiCCv+YARRkBAVGf5UOJO55OoH9kSwt8i0m12+wHnB37bSw+YJd2DsVdqH3urR9C0DDH8CHMRoo1WH/IUKCEjEfwBV1qA==',key_name='tempest-keypair-1524072439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='050f928f1ce449d6a447cd343dc4ff80',ramdisk_id='',reservation_id='r-zfwv86qe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1449742411',owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:02:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c803ddeaf4f4b3db07587419087b3b2',uuid=090f8701-682e-4da8-bd51-e80aa1633d36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22ff5930-d13e-450c-9898-d435893e84ee", "address": "fa:16:3e:f8:be:e0", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ff5930-d1", "ovs_interfaceid": "22ff5930-d13e-450c-9898-d435893e84ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:02:06.919566 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converting VIF {"id": "22ff5930-d13e-450c-9898-d435893e84ee", "address": "fa:16:3e:f8:be:e0", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ff5930-d1", "ovs_interfaceid": "22ff5930-d13e-450c-9898-d435893e84ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:02:06.921160 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:be:e0,bridge_name='br-int',has_traffic_filtering=True,id=22ff5930-d13e-450c-9898-d435893e84ee,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22ff5930-d1') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:02:06.921160 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:be:e0,bridge_name='br-int',has_traffic_filtering=True,id=22ff5930-d13e-450c-9898-d435893e84ee,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22ff5930-d1') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:02:06.921160 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:06.921160 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:06.921441 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:02:06.922560 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:06.922744 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a5c8c04-0de2-5e31-9b7c-027c823173e6', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:06.923900 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:02:06.943090 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-ae8051a4-b816-47c5-9cf7-7dbd75f9a566 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] instance snapshotting
May 28 01:02:06.945703 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:02:06.946359 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:02:06.947522 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Creating image(s)
May 28 01:02:06.948842 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "/opt/stack/data/nova/instances/a9122d01-9c31-48d3-ae6b-e2d6305fe8d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:06.948988 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "/opt/stack/data/nova/instances/a9122d01-9c31-48d3-ae6b-e2d6305fe8d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:06.950660 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:06.951664 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "/opt/stack/data/nova/instances/a9122d01-9c31-48d3-ae6b-e2d6305fe8d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:06.951869 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22ff5930-d1, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:06.952448 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22ff5930-d1, col_values=(('qos', UUID('6e503e60-cc32-44e4-80e0-417cb51c5e8c')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:06.952617 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22ff5930-d1, col_values=(('external_ids', {'iface-id': '22ff5930-d13e-450c-9898-d435893e84ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:be:e0', 'vm-uuid': '090f8701-682e-4da8-bd51-e80aa1633d36'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:06.955096 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:02:06.961426 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:02:06.963285 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:02:06.965444 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:06.966334 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:06.984191 np0000001577 nova-compute[98319]: INFO os_vif [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:be:e0,bridge_name='br-int',has_traffic_filtering=True,id=22ff5930-d13e-450c-9898-d435893e84ee,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22ff5930-d1')
May 28 01:02:07.053213 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.087s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:07.054236 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:07.054236 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:07.054236 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:02:07.056756 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:02:07.057529 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:07.081556 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ae8051a4-b816-47c5-9cf7-7dbd75f9a566 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Beginning live snapshot process
May 28 01:02:07.134362 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.077s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:07.134791 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/a9122d01-9c31-48d3-ae6b-e2d6305fe8d7/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:07.195283 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/a9122d01-9c31-48d3-ae6b-e2d6305fe8d7/disk 1073741824" returned: 0 in 0.060s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:07.195863 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.142s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:07.196272 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:07.289500 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.093s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:07.290084 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a9122d01-9c31-48d3-ae6b-e2d6305fe8d7/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:02:07.290385 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9122d01-9c31-48d3-ae6b-e2d6305fe8d7/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:07.349235 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b50575b1-98f8-41a3-9846-40e6df4bf8a0 req-bad15c14-5b30-4326-a405-5ca83b81d35c service nova] Releasing lock "refresh_cache-a9122d01-9c31-48d3-ae6b-e2d6305fe8d7" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:02:07.349870 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquired lock "refresh_cache-a9122d01-9c31-48d3-ae6b-e2d6305fe8d7" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:02:07.350101 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:02:07.371849 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9122d01-9c31-48d3-ae6b-e2d6305fe8d7/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:07.372257 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Cannot resize image /opt/stack/data/nova/instances/a9122d01-9c31-48d3-ae6b-e2d6305fe8d7/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:02:07.372727 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:02:07.372965 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Ensure instance console log exists: /opt/stack/data/nova/instances/a9122d01-9c31-48d3-ae6b-e2d6305fe8d7/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:02:07.373275 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:07.373537 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:07.373828 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:07.909955 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:02:08.075944 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:08.217699 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Updating instance_info_cache with network_info: [{"id": "78e03974-3a80-43b7-8198-eb4e28fb8e4f", "address": "fa:16:3e:2e:7b:c9", "network": {"id": "be63e483-23b8-4753-b2fa-d9fc516b53f9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-518223995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b80759164bf4465b0bd873db74c9c49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78e03974-3a", "ovs_interfaceid": "78e03974-3a80-43b7-8198-eb4e28fb8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:02:08.518376 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:02:08.518376 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:02:08.518376 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] No VIF found with MAC fa:16:3e:f8:be:e0, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:02:08.521209 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Using config drive
May 28 01:02:08.606324 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ae8051a4-b816-47c5-9cf7-7dbd75f9a566 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f/disk --force-share --output=json -f qcow2 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:08.690217 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ae8051a4-b816-47c5-9cf7-7dbd75f9a566 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f/disk --force-share --output=json -f qcow2" returned: 0 in 0.083s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:08.691252 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ae8051a4-b816-47c5-9cf7-7dbd75f9a566 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f/disk --force-share --output=json -f qcow2 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:08.721497 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Releasing lock "refresh_cache-a9122d01-9c31-48d3-ae6b-e2d6305fe8d7" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:02:08.722358 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Instance network_info: |[{"id": "78e03974-3a80-43b7-8198-eb4e28fb8e4f", "address": "fa:16:3e:2e:7b:c9", "network": {"id": "be63e483-23b8-4753-b2fa-d9fc516b53f9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-518223995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b80759164bf4465b0bd873db74c9c49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78e03974-3a", "ovs_interfaceid": "78e03974-3a80-43b7-8198-eb4e28fb8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:02:08.727746 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Start _get_guest_xml network_info=[{"id": "78e03974-3a80-43b7-8198-eb4e28fb8e4f", "address": "fa:16:3e:2e:7b:c9", "network": {"id": "be63e483-23b8-4753-b2fa-d9fc516b53f9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-518223995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b80759164bf4465b0bd873db74c9c49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78e03974-3a", "ovs_interfaceid": "78e03974-3a80-43b7-8198-eb4e28fb8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:02:08.731672 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:02:08.733450 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-1190305643', uuid='a9122d01-9c31-48d3-ae6b-e2d6305fe8d7'), owner=OwnerMeta(userid='f43f6f5427ba4a5b896019555a2ef47a', username='tempest-VolumesBackupsTest-2139172395-project-member', projectid='6b80759164bf4465b0bd873db74c9c49', projectname='tempest-VolumesBackupsTest-2139172395'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "78e03974-3a80-43b7-8198-eb4e28fb8e4f", "address": "fa:16:3e:2e:7b:c9", "network": {"id": "be63e483-23b8-4753-b2fa-d9fc516b53f9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-518223995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b80759164bf4465b0bd873db74c9c49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78e03974-3a", "ovs_interfaceid": "78e03974-3a80-43b7-8198-eb4e28fb8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930128.7329395) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:02:08.734476 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:02:08.734901 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:02:08.735692 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:02:08.735900 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:02:08.736894 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:02:08.737218 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:02:08.737366 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:02:08.737463 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:02:08.737661 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:02:08.737834 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:02:08.737987 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:02:08.738222 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:02:08.738374 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:02:08.738689 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:02:08.738810 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:02:08.738949 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:02:08.749683 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:01:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1190305643',display_name='tempest-VolumesBackupsTest-instance-1190305643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumesbackupstest-instance-1190305643',id=32,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTFZAfivaY4B9zu1d49d7nHqJDWRVudFsrX3cS583l58RBZNWCdmhJiz2THSglo2FISlqSPp8PhnVsYs0YBeFmWNYjEiPxt/urUWjGF6XYLDF7qEG3w8J+RTVXX+Feuag==',key_name='tempest-keypair-681468811',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b80759164bf4465b0bd873db74c9c49',ramdisk_id='',reservation_id='r-2z90whge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-2139172395',owner_user_name='tempest-VolumesBackupsTest-2139172395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:02:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f43f6f5427ba4a5b896019555a2ef47a',uuid=a9122d01-9c31-48d3-ae6b-e2d6305fe8d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78e03974-3a80-43b7-8198-eb4e28fb8e4f", "address": "fa:16:3e:2e:7b:c9", "network": {"id": "be63e483-23b8-4753-b2fa-d9fc516b53f9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-518223995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b80759164bf4465b0bd873db74c9c49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78e03974-3a", "ovs_interfaceid": "78e03974-3a80-43b7-8198-eb4e28fb8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:02:08.749920 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Converting VIF {"id": "78e03974-3a80-43b7-8198-eb4e28fb8e4f", "address": "fa:16:3e:2e:7b:c9", "network": {"id": "be63e483-23b8-4753-b2fa-d9fc516b53f9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-518223995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b80759164bf4465b0bd873db74c9c49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78e03974-3a", "ovs_interfaceid": "78e03974-3a80-43b7-8198-eb4e28fb8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:02:08.750635 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:7b:c9,bridge_name='br-int',has_traffic_filtering=True,id=78e03974-3a80-43b7-8198-eb4e28fb8e4f,network=Network(be63e483-23b8-4753-b2fa-d9fc516b53f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78e03974-3a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:02:08.751203 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lazy-loading 'pci_devices' on Instance uuid a9122d01-9c31-48d3-ae6b-e2d6305fe8d7 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:08.781226 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ae8051a4-b816-47c5-9cf7-7dbd75f9a566 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f/disk --force-share --output=json -f qcow2" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:08.781904 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-ae8051a4-b816-47c5-9cf7-7dbd75f9a566 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:02:08.784929 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-ae8051a4-b816-47c5-9cf7-7dbd75f9a566 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:02:08.785179 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ae8051a4-b816-47c5-9cf7-7dbd75f9a566 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:08.870730 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ae8051a4-b816-47c5-9cf7-7dbd75f9a566 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:08.873631 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ae8051a4-b816-47c5-9cf7-7dbd75f9a566 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxv9ltx38/239235f615434325a6a71727f5c2490f.delta 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:08.924969 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ae8051a4-b816-47c5-9cf7-7dbd75f9a566 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxv9ltx38/239235f615434325a6a71727f5c2490f.delta 1073741824" returned: 0 in 0.053s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:08.926827 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ae8051a4-b816-47c5-9cf7-7dbd75f9a566 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Quiescing instance not available: QEMU guest agent is not enabled.
May 28 01:02:09.030276 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:09.078061 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Snapshot image upload complete
May 28 01:02:09.078225 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:09.169000 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-ae8051a4-b816-47c5-9cf7-7dbd75f9a566 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 28 01:02:09.170816 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ae8051a4-b816-47c5-9cf7-7dbd75f9a566 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Skipping quiescing instance: QEMU guest agent is not enabled.
May 28 01:02:09.175844 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Creating config drive at /opt/stack/data/nova/instances/090f8701-682e-4da8-bd51-e80aa1633d36/disk.config
May 28 01:02:09.180742 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/090f8701-682e-4da8-bd51-e80aa1633d36/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkkboe2m6 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:09.222566 np0000001577 nova-compute[98319]: DEBUG nova.privsep.utils [None req-ae8051a4-b816-47c5-9cf7-7dbd75f9a566 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 01:02:09.222566 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ae8051a4-b816-47c5-9cf7-7dbd75f9a566 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxv9ltx38/239235f615434325a6a71727f5c2490f.delta /opt/stack/data/nova/instances/snapshots/tmpxv9ltx38/239235f615434325a6a71727f5c2490f {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:09.238721 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/090f8701-682e-4da8-bd51-e80aa1633d36/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkkboe2m6" returned: 0 in 0.057s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:09.257559 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] End _get_guest_xml xml=<domain type="qemu">
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:   <uuid>a9122d01-9c31-48d3-ae6b-e2d6305fe8d7</uuid>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:   <name>instance-00000020</name>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       <nova:name>tempest-VolumesBackupsTest-instance-1190305643</nova:name>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:02:08</nova:creationTime>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:         <nova:user uuid="f43f6f5427ba4a5b896019555a2ef47a">tempest-VolumesBackupsTest-2139172395-project-member</nova:user>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:         <nova:project uuid="6b80759164bf4465b0bd873db74c9c49">tempest-VolumesBackupsTest-2139172395</nova:project>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:         <nova:port uuid="78e03974-3a80-43b7-8198-eb4e28fb8e4f">
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:     <system>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       <entry name="serial">a9122d01-9c31-48d3-ae6b-e2d6305fe8d7</entry>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       <entry name="uuid">a9122d01-9c31-48d3-ae6b-e2d6305fe8d7</entry>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:     </system>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:   <os>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:   </os>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:   <features>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:   </features>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:   <devices>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/a9122d01-9c31-48d3-ae6b-e2d6305fe8d7/disk"/>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:     </disk>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/a9122d01-9c31-48d3-ae6b-e2d6305fe8d7/disk.config"/>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:     </disk>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:2e:7b:c9"/>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       <target dev="tap78e03974-3a"/>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:     </interface>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/a9122d01-9c31-48d3-ae6b-e2d6305fe8d7/console.log" append="off"/>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:     </serial>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:     <video>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:     </video>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:     </rng>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:   </devices>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]: </domain>
May 28 01:02:09.257559 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:02:09.259535 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Preparing to wait for external event network-vif-plugged-78e03974-3a80-43b7-8198-eb4e28fb8e4f {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:02:09.259535 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "a9122d01-9c31-48d3-ae6b-e2d6305fe8d7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:09.259535 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "a9122d01-9c31-48d3-ae6b-e2d6305fe8d7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:09.259535 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "a9122d01-9c31-48d3-ae6b-e2d6305fe8d7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:09.260378 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:01:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1190305643',display_name='tempest-VolumesBackupsTest-instance-1190305643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumesbackupstest-instance-1190305643',id=32,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTFZAfivaY4B9zu1d49d7nHqJDWRVudFsrX3cS583l58RBZNWCdmhJiz2THSglo2FISlqSPp8PhnVsYs0YBeFmWNYjEiPxt/urUWjGF6XYLDF7qEG3w8J+RTVXX+Feuag==',key_name='tempest-keypair-681468811',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b80759164bf4465b0bd873db74c9c49',ramdisk_id='',reservation_id='r-2z90whge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-2139172395',owner_user_name='tempest-VolumesBackupsTest-2139172395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:02:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f43f6f5427ba4a5b896019555a2ef47a',uuid=a9122d01-9c31-48d3-ae6b-e2d6305fe8d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78e03974-3a80-43b7-8198-eb4e28fb8e4f", "address": "fa:16:3e:2e:7b:c9", "network": {"id": "be63e483-23b8-4753-b2fa-d9fc516b53f9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-518223995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b80759164bf4465b0bd873db74c9c49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78e03974-3a", "ovs_interfaceid": "78e03974-3a80-43b7-8198-eb4e28fb8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:02:09.262728 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Converting VIF {"id": "78e03974-3a80-43b7-8198-eb4e28fb8e4f", "address": "fa:16:3e:2e:7b:c9", "network": {"id": "be63e483-23b8-4753-b2fa-d9fc516b53f9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-518223995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b80759164bf4465b0bd873db74c9c49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78e03974-3a", "ovs_interfaceid": "78e03974-3a80-43b7-8198-eb4e28fb8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:02:09.263453 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:7b:c9,bridge_name='br-int',has_traffic_filtering=True,id=78e03974-3a80-43b7-8198-eb4e28fb8e4f,network=Network(be63e483-23b8-4753-b2fa-d9fc516b53f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78e03974-3a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:02:09.263828 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:7b:c9,bridge_name='br-int',has_traffic_filtering=True,id=78e03974-3a80-43b7-8198-eb4e28fb8e4f,network=Network(be63e483-23b8-4753-b2fa-d9fc516b53f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78e03974-3a') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:02:09.264344 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:09.265648 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:09.266068 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:02:09.267670 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:09.267928 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '076dbae1-b02f-5d06-9524-95c6d4becc98', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:09.283072 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:09.284256 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:02:09.293201 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:09.295887 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:09.296131 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78e03974-3a, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:09.296672 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78e03974-3a, col_values=(('qos', UUID('bd3d00e5-1a03-44ce-8fb9-01979a83f55f')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:09.296898 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78e03974-3a, col_values=(('external_ids', {'iface-id': '78e03974-3a80-43b7-8198-eb4e28fb8e4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:7b:c9', 'vm-uuid': 'a9122d01-9c31-48d3-ae6b-e2d6305fe8d7'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:09.298449 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:09.300652 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:02:09.314554 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:09.315719 np0000001577 nova-compute[98319]: INFO os_vif [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:7b:c9,bridge_name='br-int',has_traffic_filtering=True,id=78e03974-3a80-43b7-8198-eb4e28fb8e4f,network=Network(be63e483-23b8-4753-b2fa-d9fc516b53f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78e03974-3a')
May 28 01:02:09.325403 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ae8051a4-b816-47c5-9cf7-7dbd75f9a566 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxv9ltx38/239235f615434325a6a71727f5c2490f.delta /opt/stack/data/nova/instances/snapshots/tmpxv9ltx38/239235f615434325a6a71727f5c2490f" returned: 0 in 0.105s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:09.328000 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ae8051a4-b816-47c5-9cf7-7dbd75f9a566 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Snapshot extracted, beginning image upload
May 28 01:02:09.589481 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Shelve offloading
May 28 01:02:09.709967 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:09.754671 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:09.842398 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:09.943950 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-71f1e547-da52-4eea-a8f7-3434c4020f80 req-bfd283dd-4b36-42c5-9647-ed1743484396 service nova] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Received event network-vif-plugged-22ff5930-d13e-450c-9898-d435893e84ee {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:09.944631 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-71f1e547-da52-4eea-a8f7-3434c4020f80 req-bfd283dd-4b36-42c5-9647-ed1743484396 service nova] Acquiring lock "090f8701-682e-4da8-bd51-e80aa1633d36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:09.944789 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-71f1e547-da52-4eea-a8f7-3434c4020f80 req-bfd283dd-4b36-42c5-9647-ed1743484396 service nova] Lock "090f8701-682e-4da8-bd51-e80aa1633d36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:09.944915 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-71f1e547-da52-4eea-a8f7-3434c4020f80 req-bfd283dd-4b36-42c5-9647-ed1743484396 service nova] Lock "090f8701-682e-4da8-bd51-e80aa1633d36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:09.945099 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-71f1e547-da52-4eea-a8f7-3434c4020f80 req-bfd283dd-4b36-42c5-9647-ed1743484396 service nova] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Processing event network-vif-plugged-22ff5930-d13e-450c-9898-d435893e84ee {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:02:10.102417 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Instance destroyed successfully.
May 28 01:02:10.105733 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:10.106648 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:10.114340 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "refresh_cache-03f1821a-592e-4e02-b609-74f3d7e69b53" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:02:10.114481 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquired lock "refresh_cache-03f1821a-592e-4e02-b609-74f3d7e69b53" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:02:10.114581 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:02:10.118936 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:10.124143 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:10.158567 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:10.158567 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:10.580274 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930130.5799062, 090f8701-682e-4da8-bd51-e80aa1633d36 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:02:10.580938 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:02:10.581138 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] VM Started (Lifecycle Event)
May 28 01:02:10.585610 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:02:10.592150 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Instance spawned successfully.
May 28 01:02:10.593383 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:02:10.620967 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:10.840985 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:02:10.841339 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:02:10.841598 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] No VIF found with MAC fa:16:3e:2e:7b:c9, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:02:10.842188 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Using config drive
May 28 01:02:10.984525 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:11.087477 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:11.089128 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:11.092151 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:02:11.102828 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:02:11.103039 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:02:11.103371 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:02:11.103989 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:02:11.103989 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:02:11.104292 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:02:11.163755 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Updating instance_info_cache with network_info: [{"id": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "address": "fa:16:3e:5e:ef:9c", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f81148-2a", "ovs_interfaceid": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:02:11.349371 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:11.562703 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Creating config drive at /opt/stack/data/nova/instances/a9122d01-9c31-48d3-ae6b-e2d6305fe8d7/disk.config
May 28 01:02:11.568234 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a9122d01-9c31-48d3-ae6b-e2d6305fe8d7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpuvdq1q4b {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:11.598037 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:02:11.598676 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930131.5983624, 090f8701-682e-4da8-bd51-e80aa1633d36 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:02:11.598868 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] VM Paused (Lifecycle Event)
May 28 01:02:11.611056 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Took 8.83 seconds to spawn the instance on the hypervisor.
May 28 01:02:11.611258 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:11.646572 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a9122d01-9c31-48d3-ae6b-e2d6305fe8d7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpuvdq1q4b" returned: 0 in 0.078s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:11.666135 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Releasing lock "refresh_cache-03f1821a-592e-4e02-b609-74f3d7e69b53" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:02:11.666689 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:11.667017 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:11.732579 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ae8051a4-b816-47c5-9cf7-7dbd75f9a566 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Snapshot image upload complete
May 28 01:02:11.732579 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-ae8051a4-b816-47c5-9cf7-7dbd75f9a566 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Took 4.79 seconds to snapshot the instance on the hypervisor.
May 28 01:02:12.039271 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7fc91f8d-5950-4080-94a1-d88c0ec21e47 req-e097440e-ab84-463f-8a36-72aab490d8a0 service nova] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Received event network-vif-plugged-22ff5930-d13e-450c-9898-d435893e84ee {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:12.039271 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7fc91f8d-5950-4080-94a1-d88c0ec21e47 req-e097440e-ab84-463f-8a36-72aab490d8a0 service nova] Acquiring lock "090f8701-682e-4da8-bd51-e80aa1633d36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:12.039271 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7fc91f8d-5950-4080-94a1-d88c0ec21e47 req-e097440e-ab84-463f-8a36-72aab490d8a0 service nova] Lock "090f8701-682e-4da8-bd51-e80aa1633d36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:12.039271 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7fc91f8d-5950-4080-94a1-d88c0ec21e47 req-e097440e-ab84-463f-8a36-72aab490d8a0 service nova] Lock "090f8701-682e-4da8-bd51-e80aa1633d36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:12.039271 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7fc91f8d-5950-4080-94a1-d88c0ec21e47 req-e097440e-ab84-463f-8a36-72aab490d8a0 service nova] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] No waiting events found dispatching network-vif-plugged-22ff5930-d13e-450c-9898-d435893e84ee {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:02:12.039271 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-7fc91f8d-5950-4080-94a1-d88c0ec21e47 req-e097440e-ab84-463f-8a36-72aab490d8a0 service nova] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Received unexpected event network-vif-plugged-22ff5930-d13e-450c-9898-d435893e84ee for instance with vm_state active and task_state None.
May 28 01:02:12.101477 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Instance destroyed successfully.
May 28 01:02:12.101906 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lazy-loading 'resources' on Instance uuid 03f1821a-592e-4e02-b609-74f3d7e69b53 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:12.103416 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:12.105735 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930132.1046858, 090f8701-682e-4da8-bd51-e80aa1633d36 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:02:12.105735 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] VM Resumed (Lifecycle Event)
May 28 01:02:12.121912 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Took 19.34 seconds to build instance.
May 28 01:02:12.149763 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:12.181633 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b103b6cb-ecba-4f5a-813f-058362451a0e req-ad996fa6-689e-4974-94b7-65aa95ee7dee service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Received event network-changed-95f81148-2a4e-4ca8-ad05-cb73d6f2951f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:12.181829 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b103b6cb-ecba-4f5a-813f-058362451a0e req-ad996fa6-689e-4974-94b7-65aa95ee7dee service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Refreshing instance network info cache due to event network-changed-95f81148-2a4e-4ca8-ad05-cb73d6f2951f. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:02:12.182022 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b103b6cb-ecba-4f5a-813f-058362451a0e req-ad996fa6-689e-4974-94b7-65aa95ee7dee service nova] Acquiring lock "refresh_cache-03f1821a-592e-4e02-b609-74f3d7e69b53" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:02:12.182135 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b103b6cb-ecba-4f5a-813f-058362451a0e req-ad996fa6-689e-4974-94b7-65aa95ee7dee service nova] Acquired lock "refresh_cache-03f1821a-592e-4e02-b609-74f3d7e69b53" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:02:12.182307 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b103b6cb-ecba-4f5a-813f-058362451a0e req-ad996fa6-689e-4974-94b7-65aa95ee7dee service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Refreshing network info cache for port 95f81148-2a4e-4ca8-ad05-cb73d6f2951f {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:02:12.189519 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:12.192904 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:12.271309 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:12.529267 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Stashing vm_state: active {{(pid=98319) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 28 01:02:12.533678 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:12.538089 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:12.573759 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:12.604807 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Object Instance<03f1821a-592e-4e02-b609-74f3d7e69b53> lazy-loaded attributes: numa_topology,resources {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:02:12.606045 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:01:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-115051965',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumeshelvetestjson-server-115051965',id=28,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJykW7m/TlAU+aCXrHFQnqiLeGirg6DvP6jvEv6WQuNWyEgZM1BR3mEfPcGdFFvRQCbM6rCIAUsPhy5D6TwkP7OO9xbCj+TqMkt88Fpp/YwpAzmqGqGKPLSLEqkOjvz1A==',key_name='tempest-keypair-636601780',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:01:21Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f6a7090a79f448f3abe4737bf127df53',ramdisk_id='',reservation_id='r-oad6jyzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1260503814',owner_user_name='tempest-AttachVolumeShelveTestJSON-1260503814-project-member',shelved_at='2026-05-28T01:02:09.077953',shelved_host='np0000001577',shelved_image_id='959921f1-3b1a-4c37-ab6f-5184ee80cabe'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:02:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d375089981f8493598b33c4b6f122374',uuid=03f1821a-592e-4e02-b609-74f3d7e69b53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "address": "fa:16:3e:5e:ef:9c", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f81148-2a", "ovs_interfaceid": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:02:12.606451 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Converting VIF {"id": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "address": "fa:16:3e:5e:ef:9c", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f81148-2a", "ovs_interfaceid": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:02:12.607987 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:ef:9c,bridge_name='br-int',has_traffic_filtering=True,id=95f81148-2a4e-4ca8-ad05-cb73d6f2951f,network=Network(e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f81148-2a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:02:12.608749 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:12.609072 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:ef:9c,bridge_name='br-int',has_traffic_filtering=True,id=95f81148-2a4e-4ca8-ad05-cb73d6f2951f,network=Network(e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f81148-2a') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:02:12.611682 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:12.615511 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95f81148-2a, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:12.615511 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:12.615511 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:02:12.615511 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:02:12.618564 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:12.621353 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:12.621353 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=294b5531-8455-4ac3-997b-75493668adca) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:12.621353 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:12.622235 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:02:12.624156 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "090f8701-682e-4da8-bd51-e80aa1633d36" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.872s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:12.625045 np0000001577 nova-compute[98319]: INFO os_vif [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:ef:9c,bridge_name='br-int',has_traffic_filtering=True,id=95f81148-2a4e-4ca8-ad05-cb73d6f2951f,network=Network(e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f81148-2a')
May 28 01:02:12.625302 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Deleting instance files /opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53_del
May 28 01:02:12.630114 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Deletion of /opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53_del complete
May 28 01:02:12.689157 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-b103b6cb-ecba-4f5a-813f-058362451a0e req-ad996fa6-689e-4974-94b7-65aa95ee7dee service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:13.083525 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:13.083922 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:13.111126 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-b103b6cb-ecba-4f5a-813f-058362451a0e req-ad996fa6-689e-4974-94b7-65aa95ee7dee service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:13.121336 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930133.1210046, a9122d01-9c31-48d3-ae6b-e2d6305fe8d7 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:02:13.121441 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] VM Started (Lifecycle Event)
May 28 01:02:13.241147 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Deleted allocations for instance 03f1821a-592e-4e02-b609-74f3d7e69b53
May 28 01:02:13.285713 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b103b6cb-ecba-4f5a-813f-058362451a0e req-ad996fa6-689e-4974-94b7-65aa95ee7dee service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Updated VIF entry in instance network info cache for port 95f81148-2a4e-4ca8-ad05-cb73d6f2951f. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:02:13.286071 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b103b6cb-ecba-4f5a-813f-058362451a0e req-ad996fa6-689e-4974-94b7-65aa95ee7dee service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Updating instance_info_cache with network_info: [{"id": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "address": "fa:16:3e:5e:ef:9c", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap95f81148-2a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:02:13.547713 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:13.547971 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:13.594620 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:02:13.594819 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Claim successful on node np0000001577
May 28 01:02:13.636694 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:13.638407 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930133.6381998, a9122d01-9c31-48d3-ae6b-e2d6305fe8d7 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:02:13.638554 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] VM Paused (Lifecycle Event)
May 28 01:02:13.747081 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:13.788703 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b103b6cb-ecba-4f5a-813f-058362451a0e req-ad996fa6-689e-4974-94b7-65aa95ee7dee service nova] Releasing lock "refresh_cache-03f1821a-592e-4e02-b609-74f3d7e69b53" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:02:14.051566 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Detaching volume 6cd99b2a-2938-4324-8370-3666d88f3a56
May 28 01:02:14.099794 np0000001577 nova-compute[98319]: INFO nova.compute.resource_tracker [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Updating resource usage from migration 051a43ee-49af-4137-bc6b-3c98b0d50969
May 28 01:02:14.105572 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Attempting to driver detach volume 6cd99b2a-2938-4324-8370-3666d88f3a56 from mountpoint /dev/vdb
May 28 01:02:14.109353 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Found disk vdb by alias ua-6cd99b2a-2938-4324-8370-3666d88f3a56 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:02:14.110500 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Found disk vdb by alias ua-6cd99b2a-2938-4324-8370-3666d88f3a56 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:02:14.110669 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Attempting to detach device vdb from instance bb62eb94-ea3e-47ec-bae7-43acb74061ef from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:02:14.110970 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:02:14.110970 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:02:14.110970 np0000001577 nova-compute[98319]:   <alias name="ua-6cd99b2a-2938-4324-8370-3666d88f3a56"/>
May 28 01:02:14.110970 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 28 01:02:14.110970 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:02:14.110970 np0000001577 nova-compute[98319]:   <serial>6cd99b2a-2938-4324-8370-3666d88f3a56</serial>
May 28 01:02:14.110970 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:02:14.110970 np0000001577 nova-compute[98319]: </disk>
May 28 01:02:14.110970 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:02:14.117342 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Successfully detached device vdb from instance bb62eb94-ea3e-47ec-bae7-43acb74061ef from the persistent domain config.
May 28 01:02:14.117533 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] (1/8): Attempting to detach device vdb with device alias ua-6cd99b2a-2938-4324-8370-3666d88f3a56 from instance bb62eb94-ea3e-47ec-bae7-43acb74061ef from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:02:14.117811 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:02:14.117811 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:02:14.117811 np0000001577 nova-compute[98319]:   <alias name="ua-6cd99b2a-2938-4324-8370-3666d88f3a56"/>
May 28 01:02:14.117811 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 28 01:02:14.117811 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:02:14.117811 np0000001577 nova-compute[98319]:   <serial>6cd99b2a-2938-4324-8370-3666d88f3a56</serial>
May 28 01:02:14.117811 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:02:14.117811 np0000001577 nova-compute[98319]: </disk>
May 28 01:02:14.117811 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:02:14.141940 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:14.146140 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:02:14.315406 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7c83ad1d-0fb5-422c-bb10-eb39a0fc92ca req-6a4511b9-1280-4f7f-9dcc-8d60fc5874bb service nova] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Received event network-vif-plugged-78e03974-3a80-43b7-8198-eb4e28fb8e4f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:14.315654 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7c83ad1d-0fb5-422c-bb10-eb39a0fc92ca req-6a4511b9-1280-4f7f-9dcc-8d60fc5874bb service nova] Acquiring lock "a9122d01-9c31-48d3-ae6b-e2d6305fe8d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:14.317907 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7c83ad1d-0fb5-422c-bb10-eb39a0fc92ca req-6a4511b9-1280-4f7f-9dcc-8d60fc5874bb service nova] Lock "a9122d01-9c31-48d3-ae6b-e2d6305fe8d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:14.318256 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7c83ad1d-0fb5-422c-bb10-eb39a0fc92ca req-6a4511b9-1280-4f7f-9dcc-8d60fc5874bb service nova] Lock "a9122d01-9c31-48d3-ae6b-e2d6305fe8d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:14.318256 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7c83ad1d-0fb5-422c-bb10-eb39a0fc92ca req-6a4511b9-1280-4f7f-9dcc-8d60fc5874bb service nova] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Processing event network-vif-plugged-78e03974-3a80-43b7-8198-eb4e28fb8e4f {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:02:14.318850 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7c83ad1d-0fb5-422c-bb10-eb39a0fc92ca req-6a4511b9-1280-4f7f-9dcc-8d60fc5874bb service nova] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Received event network-vif-plugged-78e03974-3a80-43b7-8198-eb4e28fb8e4f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:14.318850 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7c83ad1d-0fb5-422c-bb10-eb39a0fc92ca req-6a4511b9-1280-4f7f-9dcc-8d60fc5874bb service nova] Acquiring lock "a9122d01-9c31-48d3-ae6b-e2d6305fe8d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:14.318850 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7c83ad1d-0fb5-422c-bb10-eb39a0fc92ca req-6a4511b9-1280-4f7f-9dcc-8d60fc5874bb service nova] Lock "a9122d01-9c31-48d3-ae6b-e2d6305fe8d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:14.319036 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7c83ad1d-0fb5-422c-bb10-eb39a0fc92ca req-6a4511b9-1280-4f7f-9dcc-8d60fc5874bb service nova] Lock "a9122d01-9c31-48d3-ae6b-e2d6305fe8d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:14.319036 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7c83ad1d-0fb5-422c-bb10-eb39a0fc92ca req-6a4511b9-1280-4f7f-9dcc-8d60fc5874bb service nova] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] No waiting events found dispatching network-vif-plugged-78e03974-3a80-43b7-8198-eb4e28fb8e4f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:02:14.319292 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-7c83ad1d-0fb5-422c-bb10-eb39a0fc92ca req-6a4511b9-1280-4f7f-9dcc-8d60fc5874bb service nova] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Received unexpected event network-vif-plugged-78e03974-3a80-43b7-8198-eb4e28fb8e4f for instance with vm_state building and task_state spawning.
May 28 01:02:14.319870 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7c83ad1d-0fb5-422c-bb10-eb39a0fc92ca req-6a4511b9-1280-4f7f-9dcc-8d60fc5874bb service nova] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Received event network-changed-22ff5930-d13e-450c-9898-d435893e84ee {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:14.319870 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7c83ad1d-0fb5-422c-bb10-eb39a0fc92ca req-6a4511b9-1280-4f7f-9dcc-8d60fc5874bb service nova] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Refreshing instance network info cache due to event network-changed-22ff5930-d13e-450c-9898-d435893e84ee. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:02:14.320223 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:02:14.320335 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7c83ad1d-0fb5-422c-bb10-eb39a0fc92ca req-6a4511b9-1280-4f7f-9dcc-8d60fc5874bb service nova] Acquiring lock "refresh_cache-090f8701-682e-4da8-bd51-e80aa1633d36" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:02:14.320474 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7c83ad1d-0fb5-422c-bb10-eb39a0fc92ca req-6a4511b9-1280-4f7f-9dcc-8d60fc5874bb service nova] Acquired lock "refresh_cache-090f8701-682e-4da8-bd51-e80aa1633d36" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:02:14.320633 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-7c83ad1d-0fb5-422c-bb10-eb39a0fc92ca req-6a4511b9-1280-4f7f-9dcc-8d60fc5874bb service nova] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Refreshing network info cache for port 22ff5930-d13e-450c-9898-d435893e84ee {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:02:14.332296 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:02:14.338255 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Instance spawned successfully.
May 28 01:02:14.339726 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:02:14.349726 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:14.349726 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:14.649133 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:02:14.649385 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930134.6491938, a9122d01-9c31-48d3-ae6b-e2d6305fe8d7 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:02:14.649558 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] VM Resumed (Lifecycle Event)
May 28 01:02:14.820009 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-6cd99b2a-2938-4324-8370-3666d88f3a56 for instance bb62eb94-ea3e-47ec-bae7-43acb74061ef {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:02:14.823525 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-7c83ad1d-0fb5-422c-bb10-eb39a0fc92ca req-6a4511b9-1280-4f7f-9dcc-8d60fc5874bb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:14.849651 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:02:14.849979 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:02:14.850522 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:02:14.851187 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:02:14.854088 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:02:14.854892 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:02:14.856064 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:02:15.119231 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:02:15.119764 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:02:15.152197 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:15.154598 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:02:15.250729 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-7c83ad1d-0fb5-422c-bb10-eb39a0fc92ca req-6a4511b9-1280-4f7f-9dcc-8d60fc5874bb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:15.361077 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Took 8.44 seconds to spawn the instance on the hypervisor.
May 28 01:02:15.361478 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:15.400990 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-7c83ad1d-0fb5-422c-bb10-eb39a0fc92ca req-6a4511b9-1280-4f7f-9dcc-8d60fc5874bb service nova] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Updated VIF entry in instance network info cache for port 22ff5930-d13e-450c-9898-d435893e84ee. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:02:15.401377 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-7c83ad1d-0fb5-422c-bb10-eb39a0fc92ca req-6a4511b9-1280-4f7f-9dcc-8d60fc5874bb service nova] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Updating instance_info_cache with network_info: [{"id": "22ff5930-d13e-450c-9898-d435893e84ee", "address": "fa:16:3e:f8:be:e0", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ff5930-d1", "ovs_interfaceid": "22ff5930-d13e-450c-9898-d435893e84ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:02:15.418803 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:15.622176 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:02:15.658213 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:02:15.658476 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930135.6582773, bb62eb94-ea3e-47ec-bae7-43acb74061ef => ua-6cd99b2a-2938-4324-8370-3666d88f3a56> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:02:15.661325 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Successfully detached device vdb from instance bb62eb94-ea3e-47ec-bae7-43acb74061ef from the live domain config.
May 28 01:02:15.664495 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:02:15.664495 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56', 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6cd99b2a-2938-4324-8370-3666d88f3a56', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:02:15.664495 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:02:15.664495 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:02:15.664495 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56', 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6cd99b2a-2938-4324-8370-3666d88f3a56', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:02:15.664495 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:02:15.695898 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:15.695898 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:15.695898 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:15.695898 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:15.695898 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:02:15.695898 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:02:15.695898 np0000001577 nova-compute[98319]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:15.695898 np0000001577 nova-compute[98319]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:15.695898 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:15.695898 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:15.695898 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:02:15.696116 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:15.696116 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:15.696116 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:15.696116 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:15.696116 np0000001577 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:02:15.696116 np0000001577 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56 (non-flash)
May 28 01:02:15.696116 np0000001577 nova-compute[98319]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:15.696116 np0000001577 nova-compute[98319]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:15.696116 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:15.696116 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:15.696116 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:02:15.696289 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56', '48'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', '58'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', '59'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd', '60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd', '61')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:02:15.696428 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56', '49')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:02:15.697830 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56', '48')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:02:15.702568 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c984c43fa60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56'): ({'sdd'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:02:15.702568 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Removing multipathed devices sde, sdd {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:02:15.702568 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Flush multipath device 33000000088797cc6 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:02:15.737256 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:02:15.773927 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:02:15.810686 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:02:15.810686 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:02:15.811269 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:02:15.831607 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:02:15.831877 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:02:15.846952 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:15.878058 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Took 14.34 seconds to build instance.
May 28 01:02:15.888842 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56, portal: 192.168.40.100,3260]
May 28 01:02:15.888842 np0000001577 nova-compute[98319]: Logout of [sid: 49, target: iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56, portal: 192.168.40.100,3260] successful.
May 28 01:02:15.888842 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:15.906754 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7c83ad1d-0fb5-422c-bb10-eb39a0fc92ca req-6a4511b9-1280-4f7f-9dcc-8d60fc5874bb service nova] Releasing lock "refresh_cache-090f8701-682e-4da8-bd51-e80aa1633d36" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:02:15.911056 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:15.924856 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:15.962939 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56, portal: 192.168.50.100,3260]
May 28 01:02:15.962939 np0000001577 nova-compute[98319]: Logout of [sid: 48, target: iqn.2023-03.storpool.com:os--volume-6cd99b2a-2938-4324-8370-3666d88f3a56, portal: 192.168.50.100,3260] successful.
May 28 01:02:15.962939 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:15.983787 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:15.983787 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:02:15.983787 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] <== disconnect_volume: return (319ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:02:15.983921 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:02:16.093234 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:16.131165 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 3.047s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:16.132139 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.384s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:16.132382 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Migrating
May 28 01:02:16.132705 np0000001577 nova-compute[98319]: DEBUG nova.compute.rpcapi [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98319) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 01:02:16.354566 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "03f1821a-592e-4e02-b609-74f3d7e69b53" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:16.382702 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "a9122d01-9c31-48d3-ae6b-e2d6305fe8d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.864s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:16.510610 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e5b72086-26a2-40bd-baa1-d46ff4796fc4 req-603a6058-ff48-428c-bd9a-59c1e6dbf211 service nova] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Received event network-changed-78e03974-3a80-43b7-8198-eb4e28fb8e4f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:16.512448 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e5b72086-26a2-40bd-baa1-d46ff4796fc4 req-603a6058-ff48-428c-bd9a-59c1e6dbf211 service nova] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Refreshing instance network info cache due to event network-changed-78e03974-3a80-43b7-8198-eb4e28fb8e4f. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:02:16.512448 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e5b72086-26a2-40bd-baa1-d46ff4796fc4 req-603a6058-ff48-428c-bd9a-59c1e6dbf211 service nova] Acquiring lock "refresh_cache-a9122d01-9c31-48d3-ae6b-e2d6305fe8d7" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:02:16.512448 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e5b72086-26a2-40bd-baa1-d46ff4796fc4 req-603a6058-ff48-428c-bd9a-59c1e6dbf211 service nova] Acquired lock "refresh_cache-a9122d01-9c31-48d3-ae6b-e2d6305fe8d7" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:02:16.512448 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-e5b72086-26a2-40bd-baa1-d46ff4796fc4 req-603a6058-ff48-428c-bd9a-59c1e6dbf211 service nova] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Refreshing network info cache for port 78e03974-3a80-43b7-8198-eb4e28fb8e4f {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:02:16.545969 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'flavor' on Instance uuid bb62eb94-ea3e-47ec-bae7-43acb74061ef {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:16.663865 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "refresh_cache-04880ef4-5eee-4221-ad42-29788eb26358" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:02:16.663865 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquired lock "refresh_cache-04880ef4-5eee-4221-ad42-29788eb26358" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:02:16.663865 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:02:16.970312 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:02:16.970513 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:02:17.014481 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-e5b72086-26a2-40bd-baa1-d46ff4796fc4 req-603a6058-ff48-428c-bd9a-59c1e6dbf211 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:17.165572 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:17.407521 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-e5b72086-26a2-40bd-baa1-d46ff4796fc4 req-603a6058-ff48-428c-bd9a-59c1e6dbf211 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:17.472861 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:02:17.554231 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2d71b400-1c5c-4592-9dc5-00f275b03ba4 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.006s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:17.576008 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:17.619450 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:17.624294 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-e5b72086-26a2-40bd-baa1-d46ff4796fc4 req-603a6058-ff48-428c-bd9a-59c1e6dbf211 service nova] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Updated VIF entry in instance network info cache for port 78e03974-3a80-43b7-8198-eb4e28fb8e4f. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:02:17.624415 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-e5b72086-26a2-40bd-baa1-d46ff4796fc4 req-603a6058-ff48-428c-bd9a-59c1e6dbf211 service nova] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Updating instance_info_cache with network_info: [{"id": "78e03974-3a80-43b7-8198-eb4e28fb8e4f", "address": "fa:16:3e:2e:7b:c9", "network": {"id": "be63e483-23b8-4753-b2fa-d9fc516b53f9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-518223995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b80759164bf4465b0bd873db74c9c49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78e03974-3a", "ovs_interfaceid": "78e03974-3a80-43b7-8198-eb4e28fb8e4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:02:17.720254 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Updating instance_info_cache with network_info: [{"id": "d80f49b7-bd41-46df-9743-8ad514696557", "address": "fa:16:3e:e7:fe:bd", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80f49b7-bd", "ovs_interfaceid": "d80f49b7-bd41-46df-9743-8ad514696557", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:02:17.979166 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.847s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:17.980989 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.561s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:17.983653 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:02:17.983783 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Claim successful on node np0000001577
May 28 01:02:18.023422 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52beee0b-e161-4b30-b0e4-d9acc66d24de tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:18.023623 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52beee0b-e161-4b30-b0e4-d9acc66d24de tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:18.023747 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52beee0b-e161-4b30-b0e4-d9acc66d24de tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:18.023943 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52beee0b-e161-4b30-b0e4-d9acc66d24de tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:18.024273 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52beee0b-e161-4b30-b0e4-d9acc66d24de tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:18.026332 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-52beee0b-e161-4b30-b0e4-d9acc66d24de tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Terminating instance
May 28 01:02:18.126492 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e5b72086-26a2-40bd-baa1-d46ff4796fc4 req-603a6058-ff48-428c-bd9a-59c1e6dbf211 service nova] Releasing lock "refresh_cache-a9122d01-9c31-48d3-ae6b-e2d6305fe8d7" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:02:18.222566 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Releasing lock "refresh_cache-04880ef4-5eee-4221-ad42-29788eb26358" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:02:18.491647 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9935e32d-6858-4198-b5e4-53e0fd0134e1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "03f1821a-592e-4e02-b609-74f3d7e69b53" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 16.467s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:18.492430 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "03f1821a-592e-4e02-b609-74f3d7e69b53" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 2.138s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:18.492577 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Unshelving
May 28 01:02:18.529495 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-52beee0b-e161-4b30-b0e4-d9acc66d24de tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:02:18.556083 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:18.558466 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:18.590645 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:18.721491 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5396312e-c947-4d32-a917-c8afb486be41 req-bf90afb8-24d7-4e27-bfc0-6e457e9ab002 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Received event network-vif-unplugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:18.721656 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5396312e-c947-4d32-a917-c8afb486be41 req-bf90afb8-24d7-4e27-bfc0-6e457e9ab002 service nova] Acquiring lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:18.721792 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5396312e-c947-4d32-a917-c8afb486be41 req-bf90afb8-24d7-4e27-bfc0-6e457e9ab002 service nova] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:18.721912 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5396312e-c947-4d32-a917-c8afb486be41 req-bf90afb8-24d7-4e27-bfc0-6e457e9ab002 service nova] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:18.722013 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5396312e-c947-4d32-a917-c8afb486be41 req-bf90afb8-24d7-4e27-bfc0-6e457e9ab002 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] No waiting events found dispatching network-vif-unplugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:02:18.722119 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5396312e-c947-4d32-a917-c8afb486be41 req-bf90afb8-24d7-4e27-bfc0-6e457e9ab002 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Received event network-vif-unplugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:02:18.734444 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:18.739399 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:18.870618 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.99967264799966 future=<Future at 0x7c984c5eefc0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:18.871930 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Instance destroyed successfully.
May 28 01:02:18.872287 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-52beee0b-e161-4b30-b0e4-d9acc66d24de tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'resources' on Instance uuid bb62eb94-ea3e-47ec-bae7-43acb74061ef {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:19.374964 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-52beee0b-e161-4b30-b0e4-d9acc66d24de tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:00:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-240361421',display_name='tempest-ServerRescueNegativeTestJSON-server-240361421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serverrescuenegativetestjson-server-240361421',id=23,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKn7tTGLKk5GWx/qXsTtMMPyTqpWzMQ3+xGcXKydQCCNbo47i9cV9uNt/ZMr4p7wotQSWkHq9iYZow9PLIPuvBzizYu/67KPau/RyQOJogkvkzBvtRSy37knH43xmdD1+w==',key_name='tempest-keypair-172442327',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:01:28Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3c5a1da6bb242e9a58cb82855897726',ramdisk_id='',reservation_id='r-dygf7jik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-509890320',owner_user_name='tempest-ServerRescueNegativeTestJSON-509890320-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:01:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e2684c1dc140407b91687ee5abadef9d',uuid=bb62eb94-ea3e-47ec-bae7-43acb74061ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "address": "fa:16:3e:df:9f:b0", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab3e003-1c", "ovs_interfaceid": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:02:19.378157 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-52beee0b-e161-4b30-b0e4-d9acc66d24de tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Converting VIF {"id": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "address": "fa:16:3e:df:9f:b0", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab3e003-1c", "ovs_interfaceid": "9ab3e003-1c3a-467a-ad12-abbd852f7eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:02:19.378753 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-52beee0b-e161-4b30-b0e4-d9acc66d24de tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:9f:b0,bridge_name='br-int',has_traffic_filtering=True,id=9ab3e003-1c3a-467a-ad12-abbd852f7eaa,network=Network(1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ab3e003-1c') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:02:19.378976 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-52beee0b-e161-4b30-b0e4-d9acc66d24de tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:9f:b0,bridge_name='br-int',has_traffic_filtering=True,id=9ab3e003-1c3a-467a-ad12-abbd852f7eaa,network=Network(1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ab3e003-1c') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:02:19.380136 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:19.380409 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ab3e003-1c, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:19.383373 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:19.385564 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:02:19.386038 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:19.386038 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fc70cef9-faf4-4ee7-a2df-28979977b1e4) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:19.389079 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:02:19.391897 np0000001577 nova-compute[98319]: INFO os_vif [None req-52beee0b-e161-4b30-b0e4-d9acc66d24de tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:9f:b0,bridge_name='br-int',has_traffic_filtering=True,id=9ab3e003-1c3a-467a-ad12-abbd852f7eaa,network=Network(1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ab3e003-1c')
May 28 01:02:19.392251 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-52beee0b-e161-4b30-b0e4-d9acc66d24de tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Deleting instance files /opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef_del
May 28 01:02:19.394147 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-52beee0b-e161-4b30-b0e4-d9acc66d24de tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Deletion of /opt/stack/data/nova/instances/bb62eb94-ea3e-47ec-bae7-43acb74061ef_del complete
May 28 01:02:19.735640 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Starting migrate_disk_and_power_off {{(pid=98319) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 28 01:02:19.770608 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:19.771933 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:19.800589 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:19.823101 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:02:19.823399 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:02:19.905489 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-52beee0b-e161-4b30-b0e4-d9acc66d24de tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Took 1.38 seconds to destroy the instance on the hypervisor.
May 28 01:02:19.906125 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-52beee0b-e161-4b30-b0e4-d9acc66d24de tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:02:19.906342 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:02:19.906458 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:02:19.906801 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:19.937615 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6a0b1f61-11b3-4645-bd94-e2ab6fe51ef5 req-afe9f33a-6cfc-4ff4-9cd3-0ae20eb6e80f service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Received event network-vif-unplugged-d80f49b7-bd41-46df-9743-8ad514696557 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:19.937954 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6a0b1f61-11b3-4645-bd94-e2ab6fe51ef5 req-afe9f33a-6cfc-4ff4-9cd3-0ae20eb6e80f service nova] Acquiring lock "04880ef4-5eee-4221-ad42-29788eb26358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:19.937954 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6a0b1f61-11b3-4645-bd94-e2ab6fe51ef5 req-afe9f33a-6cfc-4ff4-9cd3-0ae20eb6e80f service nova] Lock "04880ef4-5eee-4221-ad42-29788eb26358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:19.938239 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6a0b1f61-11b3-4645-bd94-e2ab6fe51ef5 req-afe9f33a-6cfc-4ff4-9cd3-0ae20eb6e80f service nova] Lock "04880ef4-5eee-4221-ad42-29788eb26358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:19.938239 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6a0b1f61-11b3-4645-bd94-e2ab6fe51ef5 req-afe9f33a-6cfc-4ff4-9cd3-0ae20eb6e80f service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] No waiting events found dispatching network-vif-unplugged-d80f49b7-bd41-46df-9743-8ad514696557 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:02:19.938575 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-6a0b1f61-11b3-4645-bd94-e2ab6fe51ef5 req-afe9f33a-6cfc-4ff4-9cd3-0ae20eb6e80f service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Received unexpected event network-vif-unplugged-d80f49b7-bd41-46df-9743-8ad514696557 for instance with vm_state active and task_state resize_migrating.
May 28 01:02:19.946396 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:19.952992 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:20.008439 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Booting with volume fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c at /dev/vdc
May 28 01:02:20.036426 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:20.045775 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:20.055303 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:02:20.066372 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:20.071007 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:02:20.082323 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999781673000143 future=<Future at 0x7c984c4369c0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:20.084445 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Instance destroyed successfully.
May 28 01:02:20.085685 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='multiattach-server-1',id=26,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7fHo3fyBWUybZxdNVpYEXXxMYY3ACB7D4odfvDXtuf5uMmk/o2XggiQakoJbwdRCXKjpHaMcmXgSyAS8x+3bDHMUWn1qlznnyXp/nDVRmoqTgLFpV2Do6YlUuA3zZ+mw==',key_name='tempest-keypair-627531643',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:00:42Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='938c2829112843edb2054984e80ce7ad',ramdisk_id='',reservation_id='r-v6qv000f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-89204095',owner_user_name='tempest-AttachVolumeMultiAttachTest-89204095-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:02:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8586a18edcf42cab0a60028135ae401',uuid=04880ef4-5eee-4221-ad42-29788eb26358,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d80f49b7-bd41-46df-9743-8ad514696557", "address": "fa:16:3e:e7:fe:bd", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "vif_mac": "fa:16:3e:e7:fe:bd"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80f49b7-bd", "ovs_interfaceid": "d80f49b7-bd41-46df-9743-8ad514696557", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:02:20.087763 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converting VIF {"id": "d80f49b7-bd41-46df-9743-8ad514696557", "address": "fa:16:3e:e7:fe:bd", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "vif_mac": "fa:16:3e:e7:fe:bd"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80f49b7-bd", "ovs_interfaceid": "d80f49b7-bd41-46df-9743-8ad514696557", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:02:20.087763 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:fe:bd,bridge_name='br-int',has_traffic_filtering=True,id=d80f49b7-bd41-46df-9743-8ad514696557,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd80f49b7-bd') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:02:20.087763 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:fe:bd,bridge_name='br-int',has_traffic_filtering=True,id=d80f49b7-bd41-46df-9743-8ad514696557,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd80f49b7-bd') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:02:20.089344 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:20.089688 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd80f49b7-bd, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:20.091642 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:02:20.092409 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:20.093369 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:20.093523 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fcd772e3-ee5f-46b9-b434-3f2007a84989) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:20.094321 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:20.094937 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:02:20.095785 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:20.099569 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:20.115939 np0000001577 nova-compute[98319]: INFO os_vif [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:fe:bd,bridge_name='br-int',has_traffic_filtering=True,id=d80f49b7-bd41-46df-9743-8ad514696557,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd80f49b7-bd')
May 28 01:02:20.145307 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:02:20.145620 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:02:20.157455 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:02:20.159586 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe75:1c46', 'fe80::8c3:73ff:fe68:9ea1', 'fe80::fc16:3eff:fef0:246e', 'fe80::fc16:3eff:feca:a831', 'fe80::e8d7:d3ff:fe11:4890', 'fe80::fc16:3eff:fe12:3f51', 'fe80::64e0:a4ff:fe34:ffd6', 'fe80::fc16:3eff:fe72:df47', 'fe80::fc16:3eff:fe3e:2329', 'fe80::fc16:3eff:fe28:5665', 'fe80::fc16:3eff:fe9d:9858', 'fe80::fc16:3eff:fe6e:a824', 'fe80::1457:8aff:feb2:8bfb', 'fe80::fc16:3eff:fe11:792b', 'fe80::94c0:c3ff:fe67:958f', 'fe80::fc16:3eff:fef8:bee0', 'fe80::e873:f8ff:fed0:1522', 'fe80::fc16:3eff:fe2e:7bc9', 'fe80::3834:39ff:fe20:36ec'] 
May 28 01:02:20.160746 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:02:20.161705 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:02:20.162133 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:02:20.162566 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Updating existing volume attachment record: 12c9b6ef-fa38-4585-b5c4-43cf338ee7a7 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:02:20.326754 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:02:20.558685 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9a277991-4cd9-437d-8c29-36829a78e587 req-88e7c451-a708-4756-b5c3-dad73d3430c8 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Received event network-vif-deleted-9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:20.558685 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-9a277991-4cd9-437d-8c29-36829a78e587 req-88e7c451-a708-4756-b5c3-dad73d3430c8 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Neutron deleted interface 9ab3e003-1c3a-467a-ad12-abbd852f7eaa; detaching it from the instance and deleting it from the info cache
May 28 01:02:20.560155 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9a277991-4cd9-437d-8c29-36829a78e587 req-88e7c451-a708-4756-b5c3-dad73d3430c8 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Detach interface failed, port_id=9ab3e003-1c3a-467a-ad12-abbd852f7eaa, reason: Instance bb62eb94-ea3e-47ec-bae7-43acb74061ef could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:02:20.668142 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Detected multiple connections on this host for volume: d15f465c-138e-4c23-9b17-0b08887300f1, skipping target disconnect.
May 28 01:02:20.674643 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:20.693148 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0012238250001246342 future=<Future at 0x7c987047c7a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:20.693288 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:20.693440 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=13.176785641999686 future=<Future at 0x7c984c5eefc0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:20.693535 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=13.176686336999637 future=<Future at 0x7c984c5eefc0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:20.694403 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Emitting event <LifecycleEvent: 1779930125.6917136, 03f1821a-592e-4e02-b609-74f3d7e69b53 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:02:20.694753 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] VM Stopped (Lifecycle Event)
May 28 01:02:20.758710 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:20.761655 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:20.797504 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-95afc8c8-9877-4eb5-9737-bd359d581f79 req-17bd8162-ab80-41c6-96a7-737634ed99d1 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Received event network-vif-unplugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:20.797807 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95afc8c8-9877-4eb5-9737-bd359d581f79 req-17bd8162-ab80-41c6-96a7-737634ed99d1 service nova] Acquiring lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:20.798049 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95afc8c8-9877-4eb5-9737-bd359d581f79 req-17bd8162-ab80-41c6-96a7-737634ed99d1 service nova] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:20.798187 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95afc8c8-9877-4eb5-9737-bd359d581f79 req-17bd8162-ab80-41c6-96a7-737634ed99d1 service nova] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:20.798307 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-95afc8c8-9877-4eb5-9737-bd359d581f79 req-17bd8162-ab80-41c6-96a7-737634ed99d1 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] No waiting events found dispatching network-vif-unplugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:02:20.798507 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-95afc8c8-9877-4eb5-9737-bd359d581f79 req-17bd8162-ab80-41c6-96a7-737634ed99d1 service nova] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Received event network-vif-unplugged-9ab3e003-1c3a-467a-ad12-abbd852f7eaa for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:02:20.846737 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.868s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:20.847389 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:02:20.851494 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:20.852275 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:02:20.852686 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358_resize/disk /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:20.933217 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "cp -r /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358_resize/disk /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk" returned: 0 in 0.080s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:20.933797 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358_resize/disk.config /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk.config {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:20.971626 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "cp -r /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358_resize/disk.config /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk.config" returned: 0 in 0.035s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:20.971626 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358_resize/disk.info /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk.info {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:21.003735 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:02:21.006484 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "cp -r /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358_resize/disk.info /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk.info" returned: 0 in 0.036s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:21.094248 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:21.199538 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:21.355224 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:02:21.355357 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:02:21.355671 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:21.355909 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:21.448471 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb6c20970bf0401190583f6348e00e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e28acf25c4445ea969bd7bca3eac146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:02:21.507316 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Took 1.60 seconds to deallocate network for instance.
May 28 01:02:21.824590 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:21.825043 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:21.827291 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lazy-loading 'pci_requests' on Instance uuid 03f1821a-592e-4e02-b609-74f3d7e69b53 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:21.857902 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:02:21.925559 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Successfully created port: 165b2ee7-8c11-422b-ad45-9cc83cfea68c {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:02:22.012485 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a5706562-28b5-4877-a954-63b8ef6bac84 req-aeb64a4b-0649-4011-b7cf-7f300bd0b0b9 service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Received event network-vif-unplugged-d80f49b7-bd41-46df-9743-8ad514696557 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:22.013395 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5706562-28b5-4877-a954-63b8ef6bac84 req-aeb64a4b-0649-4011-b7cf-7f300bd0b0b9 service nova] Acquiring lock "04880ef4-5eee-4221-ad42-29788eb26358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:22.015313 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52beee0b-e161-4b30-b0e4-d9acc66d24de tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:22.015741 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5706562-28b5-4877-a954-63b8ef6bac84 req-aeb64a4b-0649-4011-b7cf-7f300bd0b0b9 service nova] Lock "04880ef4-5eee-4221-ad42-29788eb26358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:22.015948 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5706562-28b5-4877-a954-63b8ef6bac84 req-aeb64a4b-0649-4011-b7cf-7f300bd0b0b9 service nova] Lock "04880ef4-5eee-4221-ad42-29788eb26358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:22.016090 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a5706562-28b5-4877-a954-63b8ef6bac84 req-aeb64a4b-0649-4011-b7cf-7f300bd0b0b9 service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] No waiting events found dispatching network-vif-unplugged-d80f49b7-bd41-46df-9743-8ad514696557 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:02:22.016206 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-a5706562-28b5-4877-a954-63b8ef6bac84 req-aeb64a4b-0649-4011-b7cf-7f300bd0b0b9 service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Received unexpected event network-vif-unplugged-d80f49b7-bd41-46df-9743-8ad514696557 for instance with vm_state active and task_state resize_migrating.
May 28 01:02:22.124137 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:22.124375 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:22.201903 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Port d80f49b7-bd41-46df-9743-8ad514696557 binding to destination host np0000001577 is already ACTIVE {{(pid=98319) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 01:02:22.330725 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lazy-loading 'numa_topology' on Instance uuid 03f1821a-592e-4e02-b609-74f3d7e69b53 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:22.361878 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:02:22.448227 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Successfully updated port: 165b2ee7-8c11-422b-ad45-9cc83cfea68c {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:02:22.833191 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:02:22.833574 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Claim successful on node np0000001577
May 28 01:02:22.855508 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-152932e4-a0eb-4181-8df5-8044b8a5caa6 req-a02ee7de-f5bf-4d25-b2a1-2fc87c586613 service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Received event network-changed-165b2ee7-8c11-422b-ad45-9cc83cfea68c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:22.855975 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-152932e4-a0eb-4181-8df5-8044b8a5caa6 req-a02ee7de-f5bf-4d25-b2a1-2fc87c586613 service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Refreshing instance network info cache due to event network-changed-165b2ee7-8c11-422b-ad45-9cc83cfea68c. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:02:22.856189 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-152932e4-a0eb-4181-8df5-8044b8a5caa6 req-a02ee7de-f5bf-4d25-b2a1-2fc87c586613 service nova] Acquiring lock "refresh_cache-0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:02:22.856326 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-152932e4-a0eb-4181-8df5-8044b8a5caa6 req-a02ee7de-f5bf-4d25-b2a1-2fc87c586613 service nova] Acquired lock "refresh_cache-0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:02:22.856478 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-152932e4-a0eb-4181-8df5-8044b8a5caa6 req-a02ee7de-f5bf-4d25-b2a1-2fc87c586613 service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Refreshing network info cache for port 165b2ee7-8c11-422b-ad45-9cc83cfea68c {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:02:22.868252 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Booting with blank volume at /dev/vda
May 28 01:02:22.951618 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "refresh_cache-0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:02:23.211272 np0000001577 nova-compute[98319]: DEBUG nova.compute.rpcapi [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98319) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 01:02:23.228329 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "04880ef4-5eee-4221-ad42-29788eb26358-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:23.228595 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "04880ef4-5eee-4221-ad42-29788eb26358-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:23.228641 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "04880ef4-5eee-4221-ad42-29788eb26358-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:23.358356 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-152932e4-a0eb-4181-8df5-8044b8a5caa6 req-a02ee7de-f5bf-4d25-b2a1-2fc87c586613 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:23.416427 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-152932e4-a0eb-4181-8df5-8044b8a5caa6 req-a02ee7de-f5bf-4d25-b2a1-2fc87c586613 service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:02:23.532263 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-152932e4-a0eb-4181-8df5-8044b8a5caa6 req-a02ee7de-f5bf-4d25-b2a1-2fc87c586613 service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:02:24.033976 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-152932e4-a0eb-4181-8df5-8044b8a5caa6 req-a02ee7de-f5bf-4d25-b2a1-2fc87c586613 service nova] Releasing lock "refresh_cache-0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:02:24.034405 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquired lock "refresh_cache-0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:02:24.034405 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:02:24.232769 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:24.336887 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "refresh_cache-04880ef4-5eee-4221-ad42-29788eb26358" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:02:24.337063 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquired lock "refresh_cache-04880ef4-5eee-4221-ad42-29788eb26358" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:02:24.337233 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:02:24.634908 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:02:24.635093 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:02:24.638167 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:02:24.793694 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:24.840905 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:24.925151 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Updating instance_info_cache with network_info: [{"id": "165b2ee7-8c11-422b-ad45-9cc83cfea68c", "address": "fa:16:3e:71:99:0d", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap165b2ee7-8c", "ovs_interfaceid": "165b2ee7-8c11-422b-ad45-9cc83cfea68c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:02:25.095050 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:25.139573 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:02:25.149779 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:25.269501 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Updating instance_info_cache with network_info: [{"id": "d80f49b7-bd41-46df-9743-8ad514696557", "address": "fa:16:3e:e7:fe:bd", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80f49b7-bd", "ovs_interfaceid": "d80f49b7-bd41-46df-9743-8ad514696557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:02:25.429736 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Releasing lock "refresh_cache-0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:02:25.430061 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Instance network_info: |[{"id": "165b2ee7-8c11-422b-ad45-9cc83cfea68c", "address": "fa:16:3e:71:99:0d", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap165b2ee7-8c", "ovs_interfaceid": "165b2ee7-8c11-422b-ad45-9cc83cfea68c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:02:25.649296 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.824s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:25.650574 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52beee0b-e161-4b30-b0e4-d9acc66d24de tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.635s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:25.650574 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:25.733606 np0000001577 nova-compute[98319]: INFO nova.network.neutron [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Updating port 95f81148-2a4e-4ca8-ad05-cb73d6f2951f with attributes {'binding:host_id': 'np0000001577', 'device_owner': 'compute:nova'}
May 28 01:02:25.771372 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Releasing lock "refresh_cache-04880ef4-5eee-4221-ad42-29788eb26358" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:02:26.095508 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:26.273121 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:02:26.284470 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:02:26.289678 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:02:26.299004 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "refresh_cache-03f1821a-592e-4e02-b609-74f3d7e69b53" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:02:26.299233 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquired lock "refresh_cache-03f1821a-592e-4e02-b609-74f3d7e69b53" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:02:26.299342 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:02:26.307658 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:02:26.326897 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:26.354967 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:26.358064 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5eec0cec-ce50-4d6c-8404-339cfffcdd88 req-65094fb4-1072-4903-9028-196706421829 service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Received event network-changed-95f81148-2a4e-4ca8-ad05-cb73d6f2951f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:26.358274 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5eec0cec-ce50-4d6c-8404-339cfffcdd88 req-65094fb4-1072-4903-9028-196706421829 service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Refreshing instance network info cache due to event network-changed-95f81148-2a4e-4ca8-ad05-cb73d6f2951f. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:02:26.358526 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5eec0cec-ce50-4d6c-8404-339cfffcdd88 req-65094fb4-1072-4903-9028-196706421829 service nova] Acquiring lock "refresh_cache-03f1821a-592e-4e02-b609-74f3d7e69b53" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:02:26.382485 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:02:26.383579 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:02:26.392705 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:02:26.395395 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe75:1c46', 'fe80::8c3:73ff:fe68:9ea1', 'fe80::fc16:3eff:fef0:246e', 'fe80::fc16:3eff:feca:a831', 'fe80::e8d7:d3ff:fe11:4890', 'fe80::fc16:3eff:fe12:3f51', 'fe80::64e0:a4ff:fe34:ffd6', 'fe80::fc16:3eff:fe72:df47', 'fe80::fc16:3eff:fe3e:2329', 'fe80::fc16:3eff:fe28:5665', 'fe80::fc16:3eff:fe9d:9858', 'fe80::fc16:3eff:fe6e:a824', 'fe80::1457:8aff:feb2:8bfb', 'fe80::fc16:3eff:fe11:792b', 'fe80::94c0:c3ff:fe67:958f', 'fe80::fc16:3eff:fef8:bee0', 'fe80::e873:f8ff:fed0:1522', 'fe80::fc16:3eff:fe2e:7bc9', 'fe80::3834:39ff:fe20:36ec'] 
May 28 01:02:26.395928 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:02:26.396057 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:02:26.396389 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:02:26.396928 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Updating existing volume attachment record: 9e485867-8f11-4525-bdc8-00112761c137 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:02:26.402161 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:02:26.402399 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:02:26.410312 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:02:26.411672 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe75:1c46', 'fe80::8c3:73ff:fe68:9ea1', 'fe80::fc16:3eff:fef0:246e', 'fe80::fc16:3eff:feca:a831', 'fe80::e8d7:d3ff:fe11:4890', 'fe80::fc16:3eff:fe12:3f51', 'fe80::64e0:a4ff:fe34:ffd6', 'fe80::fc16:3eff:fe72:df47', 'fe80::fc16:3eff:fe3e:2329', 'fe80::fc16:3eff:fe28:5665', 'fe80::fc16:3eff:fe9d:9858', 'fe80::fc16:3eff:fe6e:a824', 'fe80::1457:8aff:feb2:8bfb', 'fe80::fc16:3eff:fe11:792b', 'fe80::94c0:c3ff:fe67:958f', 'fe80::fc16:3eff:fef8:bee0', 'fe80::e873:f8ff:fed0:1522', 'fe80::fc16:3eff:fe2e:7bc9', 'fe80::3834:39ff:fe20:36ec'] 
May 28 01:02:26.411805 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:02:26.411947 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:02:26.415882 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:02:26.526212 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-52beee0b-e161-4b30-b0e4-d9acc66d24de tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:02:26.526349 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-52beee0b-e161-4b30-b0e4-d9acc66d24de tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:02:26.805273 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:27.029609 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-52beee0b-e161-4b30-b0e4-d9acc66d24de tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:02:27.139688 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:27.259921 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Updating instance_info_cache with network_info: [{"id": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "address": "fa:16:3e:5e:ef:9c", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f81148-2a", "ovs_interfaceid": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:02:27.535906 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52beee0b-e161-4b30-b0e4-d9acc66d24de tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.886s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:27.573428 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Starting finish_migration {{(pid=98319) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 28 01:02:27.574701 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Instance directory exists: not creating {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 01:02:27.575071 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Creating image(s)
May 28 01:02:27.576161 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:27.602651 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-52beee0b-e161-4b30-b0e4-d9acc66d24de tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Deleted allocations for instance bb62eb94-ea3e-47ec-bae7-43acb74061ef
May 28 01:02:27.665258 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:27.665632 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Checking if we can resize image /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:02:27.665855 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:27.744751 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:27.745315 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Cannot resize image /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:02:27.762210 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Releasing lock "refresh_cache-03f1821a-592e-4e02-b609-74f3d7e69b53" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:02:27.763537 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:02:27.764151 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5eec0cec-ce50-4d6c-8404-339cfffcdd88 req-65094fb4-1072-4903-9028-196706421829 service nova] Acquired lock "refresh_cache-03f1821a-592e-4e02-b609-74f3d7e69b53" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:02:27.764151 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-5eec0cec-ce50-4d6c-8404-339cfffcdd88 req-65094fb4-1072-4903-9028-196706421829 service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Refreshing network info cache for port 95f81148-2a4e-4ca8-ad05-cb73d6f2951f {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:02:27.765316 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Creating image(s)
May 28 01:02:27.766330 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "/opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:27.766629 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "/opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:27.767184 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "/opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:27.767379 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lazy-loading 'trusted_certs' on Instance uuid 03f1821a-592e-4e02-b609-74f3d7e69b53 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:28.247981 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:02:28.248484 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Ensure instance console log exists: /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:02:28.248484 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:28.248634 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:28.248800 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:28.251047 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Start _get_guest_xml network_info=[{"id": "d80f49b7-bd41-46df-9743-8ad514696557", "address": "fa:16:3e:e7:fe:bd", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "vif_mac": "fa:16:3e:e7:fe:bd"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80f49b7-bd", "ovs_interfaceid": "d80f49b7-bd41-46df-9743-8ad514696557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd15f465c-138e-4c23-9b17-0b08887300f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '04880ef4-5eee-4221-ad42-29788eb26358', 'attached_at': '2026-05-28T01:02:27.000000', 'detached_at': '', 'volume_id': 'd15f465c-138e-4c23-9b17-0b08887300f1', 'multiattach': True, 'serial': 'd15f465c-138e-4c23-9b17-0b08887300f1'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '61bd8d76-c30c-4fe4-97fa-84cca6955461', 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:02:28.253564 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:02:28.254631 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='04880ef4-5eee-4221-ad42-29788eb26358'), owner=OwnerMeta(userid='f8586a18edcf42cab0a60028135ae401', username='tempest-AttachVolumeMultiAttachTest-89204095-project-member', projectid='938c2829112843edb2054984e80ce7ad', projectname='tempest-AttachVolumeMultiAttachTest-89204095'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d80f49b7-bd41-46df-9743-8ad514696557", "address": "fa:16:3e:e7:fe:bd", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "vif_mac": "fa:16:3e:e7:fe:bd"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80f49b7-bd", "ovs_interfaceid": "d80f49b7-bd41-46df-9743-8ad514696557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930148.254309) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:02:28.255361 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:02:28.255722 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:02:28.256430 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:02:28.256630 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:02:28.257435 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:02:28.257747 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:02:28.257949 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:02:28.258085 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:02:28.258250 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:02:28.258373 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:02:28.258506 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:02:28.258712 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:02:28.258871 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:02:28.259012 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:02:28.259163 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:02:28.259316 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:02:28.267221 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-5eec0cec-ce50-4d6c-8404-339cfffcdd88 req-65094fb4-1072-4903-9028-196706421829 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:28.271977 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Object Instance<03f1821a-592e-4e02-b609-74f3d7e69b53> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:02:28.272466 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "d94e7ed25e3535bde4140a59bbcd994f937ddaa9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:28.272921 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk.config --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:28.273225 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "d94e7ed25e3535bde4140a59bbcd994f937ddaa9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:28.379925 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk.config --force-share --output=json" returned: 0 in 0.107s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:28.380344 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "/opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:28.380646 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "/opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:28.381207 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "/opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:28.381654 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:02:28.382032 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd15f465c-138e-4c23-9b17-0b08887300f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:02:28.382222 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:02:28.382535 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:02:28.382790 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd15f465c-138e-4c23-9b17-0b08887300f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:02:28.395204 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:02:28.395731 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:02:28.396296 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:02:28.396702 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:02:28.397009 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:02:28.397290 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.startup = automatic
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.session.scan = manual
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:02:28.413637 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:02:28.413637 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.startup = automatic
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.session.scan = manual
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:02:28.421334 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:02:28.421334 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:28.426899 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:28.431925 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:28.443807 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:28.443807 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:28.443807 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:28.443807 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:28.443807 np0000001577 nova-compute[98319]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:28.443807 np0000001577 nova-compute[98319]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:28.443807 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:28.443807 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:28.443807 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:02:28.444180 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:28.444180 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:28.444180 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:28.444180 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:28.444180 np0000001577 nova-compute[98319]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:28.444180 np0000001577 nova-compute[98319]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:28.444180 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:28.444180 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:28.444180 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:02:28.444431 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.048s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:02:28.444510 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:02:28.445469 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] HCTL ('16', '0', '0', 0) found on session 46 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:02:28.445469 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Scanning host 16 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:02:28.446118 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:28.446118 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:28.446118 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:28.446118 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:28.446118 np0000001577 nova-compute[98319]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:28.446118 np0000001577 nova-compute[98319]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:28.446118 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:28.446118 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:28.446118 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:02:28.446393 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:28.446393 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:28.446393 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:28.446393 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:28.446393 np0000001577 nova-compute[98319]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:28.446393 np0000001577 nova-compute[98319]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:28.446393 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:28.446393 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:28.446393 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:02:28.446680 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.050s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:02:28.446821 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:02:28.447962 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] HCTL ('15', '0', '0', 0) found on session 45 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:02:28.448190 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Scanning host 15 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:02:28.458110 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Searching for a device in session 46 and hctl ('16', '0', '0', 0) yield: sdk {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:02:28.458593 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd15f465c-138e-4c23-9b17-0b08887300f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:02:28.462150 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Searching for a device in session 45 and hctl ('15', '0', '0', 0) yield: sdj {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:02:28.462339 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd15f465c-138e-4c23-9b17-0b08887300f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:02:28.502427 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:02:28.503769 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:02:28.504059 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Creating image(s)
May 28 01:02:28.504403 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:02:28.504540 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Ensure instance console log exists: /opt/stack/data/nova/instances/0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:02:28.504750 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:28.504918 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:28.505073 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:28.505619 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Start _get_guest_xml network_info=[{"id": "165b2ee7-8c11-422b-ad45-9cc83cfea68c", "address": "fa:16:3e:71:99:0d", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap165b2ee7-8c", "ovs_interfaceid": "165b2ee7-8c11-422b-ad45-9cc83cfea68c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '773fdc14-869d-4cd3-b671-b799bcc94e1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c', 'attached_at': '', 'detached_at': '', 'volume_id': '773fdc14-869d-4cd3-b671-b799bcc94e1f', 'serial': '773fdc14-869d-4cd3-b671-b799bcc94e1f'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '9e485867-8f11-4525-bdc8-00112761c137', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:02:28.508602 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:02:28.509007 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-694763940', uuid='0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c'), owner=OwnerMeta(userid='fb6c20970bf0401190583f6348e00e4b', username='tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member', projectid='9e28acf25c4445ea969bd7bca3eac146', projectname='tempest-ServerBootFromVolumeStableRescueTest-568223226'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "165b2ee7-8c11-422b-ad45-9cc83cfea68c", "address": "fa:16:3e:71:99:0d", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap165b2ee7-8c", "ovs_interfaceid": "165b2ee7-8c11-422b-ad45-9cc83cfea68c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930148.508699) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:02:28.509854 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:02:28.511592 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:02:28.511592 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:02:28.511592 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:02:28.511899 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:02:28.512218 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:02:28.512349 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:02:28.512435 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:02:28.512557 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:02:28.512640 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:02:28.512736 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:02:28.512885 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:02:28.512980 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:02:28.513080 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:02:28.513171 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:02:28.513274 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:02:28.523311 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:02:28.523311 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '773fdc14-869d-4cd3-b671-b799bcc94e1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:02:28.523311 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:02:28.616344 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52beee0b-e161-4b30-b0e4-d9acc66d24de tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "bb62eb94-ea3e-47ec-bae7-43acb74061ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.593s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:28.705970 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-5eec0cec-ce50-4d6c-8404-339cfffcdd88 req-65094fb4-1072-4903-9028-196706421829 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:28.859738 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-5eec0cec-ce50-4d6c-8404-339cfffcdd88 req-65094fb4-1072-4903-9028-196706421829 service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Updated VIF entry in instance network info cache for port 95f81148-2a4e-4ca8-ad05-cb73d6f2951f. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:02:28.860110 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-5eec0cec-ce50-4d6c-8404-339cfffcdd88 req-65094fb4-1072-4903-9028-196706421829 service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Updating instance_info_cache with network_info: [{"id": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "address": "fa:16:3e:5e:ef:9c", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f81148-2a", "ovs_interfaceid": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:02:29.025796 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:02:29.028125 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:02:29.028383 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d94e7ed25e3535bde4140a59bbcd994f937ddaa9.part --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:29.119722 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d94e7ed25e3535bde4140a59bbcd994f937ddaa9.part --force-share --output=json" returned: 0 in 0.091s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:29.120563 np0000001577 nova-compute[98319]: DEBUG nova.virt.images [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] 959921f1-3b1a-4c37-ab6f-5184ee80cabe was qcow2, converting to raw {{(pid=98319) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 01:02:29.121292 np0000001577 nova-compute[98319]: DEBUG nova.privsep.utils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 01:02:29.121292 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d94e7ed25e3535bde4140a59bbcd994f937ddaa9.part /opt/stack/data/nova/instances/_base/d94e7ed25e3535bde4140a59bbcd994f937ddaa9.converted {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:29.277583 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d94e7ed25e3535bde4140a59bbcd994f937ddaa9.part /opt/stack/data/nova/instances/_base/d94e7ed25e3535bde4140a59bbcd994f937ddaa9.converted" returned: 0 in 0.156s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:29.292136 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d94e7ed25e3535bde4140a59bbcd994f937ddaa9.converted --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:29.363202 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5eec0cec-ce50-4d6c-8404-339cfffcdd88 req-65094fb4-1072-4903-9028-196706421829 service nova] Releasing lock "refresh_cache-03f1821a-592e-4e02-b609-74f3d7e69b53" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:02:29.376019 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d94e7ed25e3535bde4140a59bbcd994f937ddaa9.converted --force-share --output=json" returned: 0 in 0.084s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:29.376665 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "d94e7ed25e3535bde4140a59bbcd994f937ddaa9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.103s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:29.377206 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:02:29.380220 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:02:29.381205 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d94e7ed25e3535bde4140a59bbcd994f937ddaa9 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:29.398961 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:02:29.470733 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d94e7ed25e3535bde4140a59bbcd994f937ddaa9 --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:29.471061 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "d94e7ed25e3535bde4140a59bbcd994f937ddaa9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:29.471463 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "d94e7ed25e3535bde4140a59bbcd994f937ddaa9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:29.471961 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:02:29.474246 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:02:29.474644 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d94e7ed25e3535bde4140a59bbcd994f937ddaa9 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:29.564646 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d94e7ed25e3535bde4140a59bbcd994f937ddaa9 --force-share --output=json" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:29.565107 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d94e7ed25e3535bde4140a59bbcd994f937ddaa9,backing_fmt=raw /opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:29.617171 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d94e7ed25e3535bde4140a59bbcd994f937ddaa9,backing_fmt=raw /opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/disk 1073741824" returned: 0 in 0.052s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:29.617367 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "d94e7ed25e3535bde4140a59bbcd994f937ddaa9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.146s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:29.617662 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d94e7ed25e3535bde4140a59bbcd994f937ddaa9 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:29.698976 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d94e7ed25e3535bde4140a59bbcd994f937ddaa9 --force-share --output=json" returned: 0 in 0.081s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:29.699414 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lazy-loading 'migration_context' on Instance uuid 03f1821a-592e-4e02-b609-74f3d7e69b53 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:30.095874 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:30.110013 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:30.110285 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:30.202696 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Object Instance<03f1821a-592e-4e02-b609-74f3d7e69b53> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:02:30.203093 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Rebasing disk image.
May 28 01:02:30.203358 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:30.286232 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.082s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:30.286745 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 -F raw /opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/disk {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:30.615010 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Detaching volume 31108657-63be-401c-a00e-137d133f11d8
May 28 01:02:30.660031 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Attempting to driver detach volume 31108657-63be-401c-a00e-137d133f11d8 from mountpoint /dev/vdb
May 28 01:02:30.664877 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Found disk vdb by alias ua-31108657-63be-401c-a00e-137d133f11d8 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:02:30.666424 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Found disk vdb by alias ua-31108657-63be-401c-a00e-137d133f11d8 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:02:30.666504 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Attempting to detach device vdb from instance e2cc3304-bf2b-4196-b6c8-8ad56da19af4 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:02:30.667061 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:02:30.667061 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:02:30.667061 np0000001577 nova-compute[98319]:   <alias name="ua-31108657-63be-401c-a00e-137d133f11d8"/>
May 28 01:02:30.667061 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 28 01:02:30.667061 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:02:30.667061 np0000001577 nova-compute[98319]:   <serial>31108657-63be-401c-a00e-137d133f11d8</serial>
May 28 01:02:30.667061 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 01:02:30.667061 np0000001577 nova-compute[98319]: </disk>
May 28 01:02:30.667061 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:02:30.672905 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Successfully detached device vdb from instance e2cc3304-bf2b-4196-b6c8-8ad56da19af4 from the persistent domain config.
May 28 01:02:30.673573 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] (1/8): Attempting to detach device vdb with device alias ua-31108657-63be-401c-a00e-137d133f11d8 from instance e2cc3304-bf2b-4196-b6c8-8ad56da19af4 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:02:30.673573 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:02:30.673573 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:02:30.673573 np0000001577 nova-compute[98319]:   <alias name="ua-31108657-63be-401c-a00e-137d133f11d8"/>
May 28 01:02:30.673573 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 28 01:02:30.673573 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:02:30.673573 np0000001577 nova-compute[98319]:   <serial>31108657-63be-401c-a00e-137d133f11d8</serial>
May 28 01:02:30.673573 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 01:02:30.673573 np0000001577 nova-compute[98319]: </disk>
May 28 01:02:30.673573 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:02:31.070189 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 -F raw /opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/disk" returned: 0 in 0.783s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:31.070557 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:02:31.070728 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Ensure instance console log exists: /opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:02:31.071002 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:31.071190 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:31.071315 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:31.073222 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Start _get_guest_xml network_info=[{"id": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "address": "fa:16:3e:5e:ef:9c", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f81148-2a", "ovs_interfaceid": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='8b09ba5b9d8dd97d90fb7624aa204fc3',container_format='bare',created_at=2026-05-28T01:02:01Z,direct_url=<?>,disk_format='qcow2',id=959921f1-3b1a-4c37-ab6f-5184ee80cabe,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-115051965-shelved',owner='f6a7090a79f448f3abe4737bf127df53',properties=ImageMetaProps,protected=<?>,size=53608448,status='active',tags=<?>,updated_at=2026-05-28T01:02:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c', 'iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attached', 'instance': '03f1821a-592e-4e02-b609-74f3d7e69b53', 'attached_at': '', 'detached_at': '', 'volume_id': 'fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c', 'serial': 'fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '12c9b6ef-fa38-4585-b5c4-43cf338ee7a7', 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:02:31.076342 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:02:31.077558 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-115051965', uuid='03f1821a-592e-4e02-b609-74f3d7e69b53'), owner=OwnerMeta(userid='d375089981f8493598b33c4b6f122374', username='tempest-AttachVolumeShelveTestJSON-1260503814-project-member', projectid='f6a7090a79f448f3abe4737bf127df53', projectname='tempest-AttachVolumeShelveTestJSON-1260503814'), image=ImageMeta(id='959921f1-3b1a-4c37-ab6f-5184ee80cabe', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "address": "fa:16:3e:5e:ef:9c", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f81148-2a", "ovs_interfaceid": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930151.0772264) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:02:31.078395 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:02:31.078735 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:02:31.079503 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:02:31.079693 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:02:31.080481 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:02:31.080787 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='8b09ba5b9d8dd97d90fb7624aa204fc3',container_format='bare',created_at=2026-05-28T01:02:01Z,direct_url=<?>,disk_format='qcow2',id=959921f1-3b1a-4c37-ab6f-5184ee80cabe,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-115051965-shelved',owner='f6a7090a79f448f3abe4737bf127df53',properties=ImageMetaProps,protected=<?>,size=53608448,status='active',tags=<?>,updated_at=2026-05-28T01:02:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:02:31.080934 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:02:31.081040 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:02:31.081166 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:02:31.081302 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:02:31.081448 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:02:31.081612 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:02:31.081706 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:02:31.081808 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:02:31.081911 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:02:31.082019 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:02:31.082152 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lazy-loading 'vcpu_model' on Instance uuid 03f1821a-592e-4e02-b609-74f3d7e69b53 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:31.098373 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:31.225896 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930151.2254553, e2cc3304-bf2b-4196-b6c8-8ad56da19af4 => ua-31108657-63be-401c-a00e-137d133f11d8> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:02:31.227795 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-31108657-63be-401c-a00e-137d133f11d8 for instance e2cc3304-bf2b-4196-b6c8-8ad56da19af4 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:02:31.229683 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Successfully detached device vdb from instance e2cc3304-bf2b-4196-b6c8-8ad56da19af4 from the live domain config.
May 28 01:02:31.230757 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:02:31.231120 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31108657-63be-401c-a00e-137d133f11d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:02:31.231246 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:02:31.584405 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Object Instance<03f1821a-592e-4e02-b609-74f3d7e69b53> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:02:31.595713 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:02:31.595950 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c', 'iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:02:31.596067 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:02:32.276921 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e3a1c870-85ca-4e3f-8e54-f6b66d22fabc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "b73b73f0-79a5-448c-a374-bbb182da41a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:32.277094 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e3a1c870-85ca-4e3f-8e54-f6b66d22fabc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "b73b73f0-79a5-448c-a374-bbb182da41a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:32.277295 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e3a1c870-85ca-4e3f-8e54-f6b66d22fabc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "b73b73f0-79a5-448c-a374-bbb182da41a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:32.277434 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e3a1c870-85ca-4e3f-8e54-f6b66d22fabc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "b73b73f0-79a5-448c-a374-bbb182da41a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:32.277518 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e3a1c870-85ca-4e3f-8e54-f6b66d22fabc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "b73b73f0-79a5-448c-a374-bbb182da41a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:32.280203 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e3a1c870-85ca-4e3f-8e54-f6b66d22fabc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Terminating instance
May 28 01:02:32.782912 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e3a1c870-85ca-4e3f-8e54-f6b66d22fabc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:02:32.804912 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:32.806644 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:32.834605 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:32.955281 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:32.962073 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:32.969506 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-094aaf78-8b93-444a-ad5c-25a5171921b7 req-ca493342-7793-40ee-b3fb-903621e5c5f3 service nova] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Received event network-vif-unplugged-c023bfc4-a99c-4a75-81f2-981583584dcd {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:32.970370 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-094aaf78-8b93-444a-ad5c-25a5171921b7 req-ca493342-7793-40ee-b3fb-903621e5c5f3 service nova] Acquiring lock "b73b73f0-79a5-448c-a374-bbb182da41a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:32.970974 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-094aaf78-8b93-444a-ad5c-25a5171921b7 req-ca493342-7793-40ee-b3fb-903621e5c5f3 service nova] Lock "b73b73f0-79a5-448c-a374-bbb182da41a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:32.970974 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-094aaf78-8b93-444a-ad5c-25a5171921b7 req-ca493342-7793-40ee-b3fb-903621e5c5f3 service nova] Lock "b73b73f0-79a5-448c-a374-bbb182da41a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:32.970974 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-094aaf78-8b93-444a-ad5c-25a5171921b7 req-ca493342-7793-40ee-b3fb-903621e5c5f3 service nova] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] No waiting events found dispatching network-vif-unplugged-c023bfc4-a99c-4a75-81f2-981583584dcd {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:02:32.970974 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-094aaf78-8b93-444a-ad5c-25a5171921b7 req-ca493342-7793-40ee-b3fb-903621e5c5f3 service nova] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Received event network-vif-unplugged-c023bfc4-a99c-4a75-81f2-981583584dcd for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:02:33.106869 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999652019999758 future=<Future at 0x7c984c69fad0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:33.108409 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Instance destroyed successfully.
May 28 01:02:33.108861 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-e3a1c870-85ca-4e3f-8e54-f6b66d22fabc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'resources' on Instance uuid b73b73f0-79a5-448c-a374-bbb182da41a9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:33.610974 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-e3a1c870-85ca-4e3f-8e54-f6b66d22fabc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-717350635',display_name='tempest-ServerRescueNegativeTestJSON-server-717350635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serverrescuenegativetestjson-server-717350635',id=16,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T00:59:48Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3c5a1da6bb242e9a58cb82855897726',ramdisk_id='',reservation_id='r-f8vnn170',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-509890320',owner_user_name='tempest-ServerRescueNegativeTestJSON-509890320-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T00:59:48Z,user_data=None,user_id='e2684c1dc140407b91687ee5abadef9d',uuid=b73b73f0-79a5-448c-a374-bbb182da41a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "c023bfc4-a99c-4a75-81f2-981583584dcd", "address": "fa:16:3e:72:df:47", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc023bfc4-a9", "ovs_interfaceid": "c023bfc4-a99c-4a75-81f2-981583584dcd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:02:33.611198 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-e3a1c870-85ca-4e3f-8e54-f6b66d22fabc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Converting VIF {"id": "c023bfc4-a99c-4a75-81f2-981583584dcd", "address": "fa:16:3e:72:df:47", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc023bfc4-a9", "ovs_interfaceid": "c023bfc4-a99c-4a75-81f2-981583584dcd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:02:33.611703 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-e3a1c870-85ca-4e3f-8e54-f6b66d22fabc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:df:47,bridge_name='br-int',has_traffic_filtering=True,id=c023bfc4-a99c-4a75-81f2-981583584dcd,network=Network(1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc023bfc4-a9') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:02:33.611915 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-e3a1c870-85ca-4e3f-8e54-f6b66d22fabc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:df:47,bridge_name='br-int',has_traffic_filtering=True,id=c023bfc4-a99c-4a75-81f2-981583584dcd,network=Network(1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc023bfc4-a9') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:02:33.612991 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:33.613165 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc023bfc4-a9, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:33.614149 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:33.615046 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:02:33.615439 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:33.616334 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:33.616464 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5331047f-6b95-480f-beae-f0e6d940e288) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:33.616932 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:33.617456 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:02:33.617850 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:33.619421 np0000001577 nova-compute[98319]: INFO os_vif [None req-e3a1c870-85ca-4e3f-8e54-f6b66d22fabc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:df:47,bridge_name='br-int',has_traffic_filtering=True,id=c023bfc4-a99c-4a75-81f2-981583584dcd,network=Network(1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc023bfc4-a9')
May 28 01:02:33.619678 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-e3a1c870-85ca-4e3f-8e54-f6b66d22fabc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Deleting instance files /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9_del
May 28 01:02:33.620563 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-e3a1c870-85ca-4e3f-8e54-f6b66d22fabc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Deletion of /opt/stack/data/nova/instances/b73b73f0-79a5-448c-a374-bbb182da41a9_del complete
May 28 01:02:33.870679 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0004389840000840195 future=<Future at 0x7c984c5eefc0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:33.871586 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Emitting event <LifecycleEvent: 1779930138.8701415, bb62eb94-ea3e-47ec-bae7-43acb74061ef => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:02:33.871586 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:33.871809 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] VM Stopped (Lifecycle Event)
May 28 01:02:33.872778 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=1.2092488470002536 future=<Future at 0x7c984c4369c0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:33.872934 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=1.2090695420001794 future=<Future at 0x7c984c4369c0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:33.978749 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:02:33.979080 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:02:34.125811 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e3a1c870-85ca-4e3f-8e54-f6b66d22fabc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Took 1.34 seconds to destroy the instance on the hypervisor.
May 28 01:02:34.126291 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-e3a1c870-85ca-4e3f-8e54-f6b66d22fabc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:02:34.126594 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:02:34.126743 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:02:34.127002 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:34.210935 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:34.374261 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: bb62eb94-ea3e-47ec-bae7-43acb74061ef] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:34.454941 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-be75ed08-d25d-47fa-aadb-710ab509da7f req-f6004f03-4d68-4282-86fc-ddbda449fb5f service nova] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Received event network-vif-deleted-c023bfc4-a99c-4a75-81f2-981583584dcd {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:34.455484 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-be75ed08-d25d-47fa-aadb-710ab509da7f req-f6004f03-4d68-4282-86fc-ddbda449fb5f service nova] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Neutron deleted interface c023bfc4-a99c-4a75-81f2-981583584dcd; detaching it from the instance and deleting it from the info cache
May 28 01:02:34.456807 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-be75ed08-d25d-47fa-aadb-710ab509da7f req-f6004f03-4d68-4282-86fc-ddbda449fb5f service nova] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Detach interface failed, port_id=c023bfc4-a99c-4a75-81f2-981583584dcd, reason: Instance b73b73f0-79a5-448c-a374-bbb182da41a9 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:02:34.484432 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:34.484633 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:34.484761 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:34.484834 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Auditing locally available compute resources for np0000001577 (node: np0000001577) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 01:02:34.892657 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:02:35.022381 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-3d4bfcd5-5b6d-4927-bed4-c781f6e0ab5a req-099db5da-21e0-4f05-bc1b-f923ae76345a service nova] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Received event network-vif-unplugged-c023bfc4-a99c-4a75-81f2-981583584dcd {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:35.022435 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3d4bfcd5-5b6d-4927-bed4-c781f6e0ab5a req-099db5da-21e0-4f05-bc1b-f923ae76345a service nova] Acquiring lock "b73b73f0-79a5-448c-a374-bbb182da41a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:35.022619 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3d4bfcd5-5b6d-4927-bed4-c781f6e0ab5a req-099db5da-21e0-4f05-bc1b-f923ae76345a service nova] Lock "b73b73f0-79a5-448c-a374-bbb182da41a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:35.022729 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3d4bfcd5-5b6d-4927-bed4-c781f6e0ab5a req-099db5da-21e0-4f05-bc1b-f923ae76345a service nova] Lock "b73b73f0-79a5-448c-a374-bbb182da41a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:35.022855 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-3d4bfcd5-5b6d-4927-bed4-c781f6e0ab5a req-099db5da-21e0-4f05-bc1b-f923ae76345a service nova] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] No waiting events found dispatching network-vif-unplugged-c023bfc4-a99c-4a75-81f2-981583584dcd {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:02:35.023047 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-3d4bfcd5-5b6d-4927-bed4-c781f6e0ab5a req-099db5da-21e0-4f05-bc1b-f923ae76345a service nova] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Received event network-vif-unplugged-c023bfc4-a99c-4a75-81f2-981583584dcd for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:02:35.082332 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.000298433999887493 future=<Future at 0x7c984c4369c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:35.082729 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Emitting event <LifecycleEvent: 1779930140.0819542, 04880ef4-5eee-4221-ad42-29788eb26358 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:02:35.082835 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:35.082983 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] VM Stopped (Lifecycle Event)
May 28 01:02:35.083057 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=13.023417265999797 future=<Future at 0x7c984c69fad0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:35.083153 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=13.023321997999574 future=<Future at 0x7c984c69fad0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:35.394661 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Took 1.27 seconds to deallocate network for instance.
May 28 01:02:35.517366 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:35.586137 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:35.588287 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:02:35.593020 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk --force-share --output=json" returned: 0 in 0.076s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:35.593402 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:35.668789 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:35.669261 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:02:35.672146 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:02:35.673348 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9122d01-9c31-48d3-ae6b-e2d6305fe8d7/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:35.753199 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9122d01-9c31-48d3-ae6b-e2d6305fe8d7/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:35.753694 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9122d01-9c31-48d3-ae6b-e2d6305fe8d7/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:35.830810 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9122d01-9c31-48d3-ae6b-e2d6305fe8d7/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:35.834217 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:35.900786 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e3a1c870-85ca-4e3f-8e54-f6b66d22fabc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:35.901502 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e3a1c870-85ca-4e3f-8e54-f6b66d22fabc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:35.914963 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:35.914963 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:35.998202 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:36.002215 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:36.089698 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:36.090910 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 28 01:02:36.091314 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:36.102074 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:36.168947 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:36.169352 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:02:36.172129 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:36.276293 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:36.276812 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:36.369576 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:36.373208 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:36.439964 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Found WWN 330000000d00ec62f for multipath device dm-6 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:02:36.440575 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 8.058s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:02:36.440841 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] <== connect_volume: return (8058ms) {'type': 'block', 'scsi_wwn': '330000000d00ec62f', 'path': '/dev/dm-6', 'multipath_id': '330000000d00ec62f'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:02:36.441077 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d00ec62f', 'path': '/dev/dm-6', 'multipath_id': '330000000d00ec62f'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:02:36.442289 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 7.920s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:02:36.442628 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '773fdc14-869d-4cd3-b671-b799bcc94e1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:02:36.455689 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:02:36.457835 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:02:36.460635 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:02:36.461935 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:02:36.461935 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:02:36.461935 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:02:36.478077 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:36.478621 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:36.507165 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:02:36.507165 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:36.508539 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:02:36.508539 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:36.525922 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f] added
May 28 01:02:36.525922 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:02:36.525922 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:02:36.525922 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:02:36.525922 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:02:36.525922 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:02:36.525922 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:36.526226 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:02:36.526577 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.065(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:02:36.526805 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:02:36.538557 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f] added
May 28 01:02:36.538557 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:02:36.538557 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:02:36.538557 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:02:36.538557 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:02:36.538557 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:02:36.538557 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:36.538841 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:02:36.538900 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0778(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:02:36.539070 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:02:36.570012 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:36.573071 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:36.658178 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:36.661565 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:36.739925 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:36.744569 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:36.820452 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:36.821273 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:36.859301 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e3a1c870-85ca-4e3f-8e54-f6b66d22fabc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:02:36.859518 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-e3a1c870-85ca-4e3f-8e54-f6b66d22fabc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:02:36.909981 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:36.912785 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-9 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:02:36.914344 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:36.951276 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001577',hostname='multiattach-server-1',id=26,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7fHo3fyBWUybZxdNVpYEXXxMYY3ACB7D4odfvDXtuf5uMmk/o2XggiQakoJbwdRCXKjpHaMcmXgSyAS8x+3bDHMUWn1qlznnyXp/nDVRmoqTgLFpV2Do6YlUuA3zZ+mw==',key_name='tempest-keypair-627531643',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:00:42Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001577',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='938c2829112843edb2054984e80ce7ad',ramdisk_id='',reservation_id='r-v6qv000f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-89204095',owner_user_name='tempest-AttachVolumeMultiAttachTest-89204095-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:02:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8586a18edcf42cab0a60028135ae401',uuid=04880ef4-5eee-4221-ad42-29788eb26358,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d80f49b7-bd41-46df-9743-8ad514696557", "address": "fa:16:3e:e7:fe:bd", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "vif_mac": "fa:16:3e:e7:fe:bd"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80f49b7-bd", "ovs_interfaceid": "d80f49b7-bd41-46df-9743-8ad514696557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:02:36.951721 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converting VIF {"id": "d80f49b7-bd41-46df-9743-8ad514696557", "address": "fa:16:3e:e7:fe:bd", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "vif_mac": "fa:16:3e:e7:fe:bd"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80f49b7-bd", "ovs_interfaceid": "d80f49b7-bd41-46df-9743-8ad514696557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:02:36.952796 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:fe:bd,bridge_name='br-int',has_traffic_filtering=True,id=d80f49b7-bd41-46df-9743-8ad514696557,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd80f49b7-bd') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:02:36.955494 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] End _get_guest_xml xml=<domain type="qemu">
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:   <uuid>04880ef4-5eee-4221-ad42-29788eb26358</uuid>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:   <name>instance-0000001a</name>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:   <memory>262144</memory>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <nova:name>multiattach-server-1</nova:name>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:02:28</nova:creationTime>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.micro" id="84">
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:         <nova:memory>256</nova:memory>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:         <nova:user uuid="f8586a18edcf42cab0a60028135ae401">tempest-AttachVolumeMultiAttachTest-89204095-project-member</nova:user>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:         <nova:project uuid="938c2829112843edb2054984e80ce7ad">tempest-AttachVolumeMultiAttachTest-89204095</nova:project>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:         <nova:port uuid="d80f49b7-bd41-46df-9743-8ad514696557">
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:     <system>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <entry name="serial">04880ef4-5eee-4221-ad42-29788eb26358</entry>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <entry name="uuid">04880ef4-5eee-4221-ad42-29788eb26358</entry>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:     </system>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:   <os>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:   </os>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:   <features>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:   </features>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:   <devices>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk"/>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:     </disk>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk.config"/>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:     </disk>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <alias name="ua-d15f465c-138e-4c23-9b17-0b08887300f1"/>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-6"/>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <serial>d15f465c-138e-4c23-9b17-0b08887300f1</serial>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <shareable/>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:     </disk>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:e7:fe:bd"/>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <target dev="tapd80f49b7-bd"/>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:     </interface>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/console.log" append="off"/>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:     </serial>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:     <video>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:     </video>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:     </rng>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:   </devices>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]: </domain>
May 28 01:02:36.955494 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:02:36.958835 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001577',hostname='multiattach-server-1',id=26,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7fHo3fyBWUybZxdNVpYEXXxMYY3ACB7D4odfvDXtuf5uMmk/o2XggiQakoJbwdRCXKjpHaMcmXgSyAS8x+3bDHMUWn1qlznnyXp/nDVRmoqTgLFpV2Do6YlUuA3zZ+mw==',key_name='tempest-keypair-627531643',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:00:42Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001577',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='938c2829112843edb2054984e80ce7ad',ramdisk_id='',reservation_id='r-v6qv000f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-89204095',owner_user_name='tempest-AttachVolumeMultiAttachTest-89204095-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:02:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8586a18edcf42cab0a60028135ae401',uuid=04880ef4-5eee-4221-ad42-29788eb26358,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d80f49b7-bd41-46df-9743-8ad514696557", "address": "fa:16:3e:e7:fe:bd", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "vif_mac": "fa:16:3e:e7:fe:bd"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80f49b7-bd", "ovs_interfaceid": "d80f49b7-bd41-46df-9743-8ad514696557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:02:36.963126 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converting VIF {"id": "d80f49b7-bd41-46df-9743-8ad514696557", "address": "fa:16:3e:e7:fe:bd", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "vif_mac": "fa:16:3e:e7:fe:bd"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80f49b7-bd", "ovs_interfaceid": "d80f49b7-bd41-46df-9743-8ad514696557", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:02:36.963877 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:fe:bd,bridge_name='br-int',has_traffic_filtering=True,id=d80f49b7-bd41-46df-9743-8ad514696557,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd80f49b7-bd') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:02:36.964260 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:fe:bd,bridge_name='br-int',has_traffic_filtering=True,id=d80f49b7-bd41-46df-9743-8ad514696557,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd80f49b7-bd') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:02:36.965831 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:36.966201 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:36.966507 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:02:36.969698 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:36.969845 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e21fee8-42c4-53fc-8d0a-52ab596b4fd5', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:36.973687 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:36.974486 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:02:36.977247 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:36.977426 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd80f49b7-bd, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:36.977801 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd80f49b7-bd, col_values=(('qos', UUID('3ae910e3-0698-4233-a9c6-c535aa668699')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:36.977973 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd80f49b7-bd, col_values=(('external_ids', {'iface-id': 'd80f49b7-bd41-46df-9743-8ad514696557', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:fe:bd', 'vm-uuid': '04880ef4-5eee-4221-ad42-29788eb26358'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:36.981674 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:36.982734 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:02:36.986380 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:36.987542 np0000001577 nova-compute[98319]: INFO os_vif [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:fe:bd,bridge_name='br-int',has_traffic_filtering=True,id=d80f49b7-bd41-46df-9743-8ad514696557,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd80f49b7-bd')
May 28 01:02:37.002738 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:37.003183 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:37.082172 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:37.086476 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:37.181216 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:37.181804 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:37.264762 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:37.267791 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:02:37.268942 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:37.306063 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "env LANG=C uptime" returned: 0 in 0.037s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:37.306405 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Hypervisor/Node resource view: name=np0000001577 free_ram=10232MB free_disk=73.96577453613281GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 01:02:37.306589 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:37.363502 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-e3a1c870-85ca-4e3f-8e54-f6b66d22fabc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:02:37.527312 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:02:37.539589 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:02:37.539589 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:37.542079 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:02:37.552516 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:02:37.555245 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:02:37.555245 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:37.569230 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:37.574626 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:37.574626 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:37.574626 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:37.574626 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:37.574626 np0000001577 nova-compute[98319]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:37.574626 np0000001577 nova-compute[98319]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:37.574626 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:37.574626 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:37.574626 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:02:37.574984 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:37.574984 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:37.574984 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:37.574984 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:37.574984 np0000001577 nova-compute[98319]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:37.574984 np0000001577 nova-compute[98319]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:37.574984 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:37.574984 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:37.574984 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:02:37.586834 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:37.586834 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:37.586834 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:37.586834 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:37.586834 np0000001577 nova-compute[98319]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:37.586834 np0000001577 nova-compute[98319]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:37.586834 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:37.586834 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:37.586834 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:02:37.587038 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:37.587038 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:37.587038 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:37.587038 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:37.587038 np0000001577 nova-compute[98319]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:37.587038 np0000001577 nova-compute[98319]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:37.587038 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:37.587038 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:37.587038 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:02:37.624991 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f, portal: 192.168.50.100,3260]
May 28 01:02:37.624991 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f, portal: 192.168.50.100,3260] successful.
May 28 01:02:37.624991 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:37.633408 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f, portal: 192.168.40.100,3260]
May 28 01:02:37.633408 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f, portal: 192.168.40.100,3260] successful.
May 28 01:02:37.633408 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:37.638112 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:37.656437 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:37.663090 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:37.663090 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:37.663090 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:37.663090 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:37.663090 np0000001577 nova-compute[98319]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:37.663090 np0000001577 nova-compute[98319]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:37.663090 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:37.663090 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:37.663090 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:37.663090 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:37.663090 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:02:37.663395 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:37.663395 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:37.663395 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:37.663395 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:37.663395 np0000001577 nova-compute[98319]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:37.663395 np0000001577 nova-compute[98319]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:37.663395 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:37.663395 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:37.663395 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:37.663395 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:37.663395 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:02:37.663602 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.203s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:02:37.663669 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:02:37.664630 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] HCTL ('9', '-', '-', 0) found on session 62 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:02:37.664793 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:02:37.678288 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:37.678288 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:37.678288 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:37.678288 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:37.678288 np0000001577 nova-compute[98319]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:37.678288 np0000001577 nova-compute[98319]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:37.678288 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:37.678288 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:37.678288 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:37.678288 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:37.678288 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:02:37.678288 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:37.678288 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:37.678288 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:37.678288 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:37.678288 np0000001577 nova-compute[98319]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:37.678288 np0000001577 nova-compute[98319]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:37.678288 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:37.678288 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:37.678288 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:37.678288 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:37.678288 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:02:37.678288 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.217s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:02:37.678288 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:02:37.682874 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Searching for a device in session 62 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:02:37.682874 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '773fdc14-869d-4cd3-b671-b799bcc94e1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:02:37.683509 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] HCTL ('10', '-', '-', 0) found on session 63 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:02:37.683509 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:02:37.701188 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Searching for a device in session 63 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:02:37.701188 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '773fdc14-869d-4cd3-b671-b799bcc94e1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:02:37.870383 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e3a1c870-85ca-4e3f-8e54-f6b66d22fabc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.969s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:37.872455 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.564s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:37.920388 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-e3a1c870-85ca-4e3f-8e54-f6b66d22fabc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Deleted allocations for instance b73b73f0-79a5-448c-a374-bbb182da41a9
May 28 01:02:38.461277 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:02:38.500861 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4ca5c60f-577d-40d9-828e-29defcd0563e tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:38.507043 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:02:38.507158 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:02:38.507241 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:02:38.507331 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No VIF found with MAC fa:16:3e:e7:fe:bd, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:02:38.507843 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Using config drive
May 28 01:02:38.885786 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Applying migration context for instance 04880ef4-5eee-4221-ad42-29788eb26358 as it has an incoming, in-progress migration 051a43ee-49af-4137-bc6b-3c98b0d50969. Migration status is post-migrating {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 28 01:02:38.890856 np0000001577 nova-compute[98319]: INFO nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Updating resource usage from migration 051a43ee-49af-4137-bc6b-3c98b0d50969
May 28 01:02:38.924817 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:38.936094 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e3a1c870-85ca-4e3f-8e54-f6b66d22fabc tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "b73b73f0-79a5-448c-a374-bbb182da41a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.657s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:38.954893 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 8bca25d8-071e-4b2d-960c-50582381cc75 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:02:38.955509 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance d09e5674-c5ab-4ace-9952-554361002541 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:02:38.955739 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance d988b526-836d-48b8-a381-1f7679caf41d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:02:38.955834 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance dccaa2b7-3c00-45f9-bf40-1a8a15030825 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:02:38.955954 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance f2b64af8-9a7b-4726-b298-cf9d2cb24498 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:02:38.956097 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance e2cc3304-bf2b-4196-b6c8-8ad56da19af4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:02:38.956216 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance d87bb95b-a1e9-4786-8bee-16f2cfaabf2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:02:38.956332 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:02:38.956453 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 63eb5e59-29a0-4b0c-b731-6d7265f7d91f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:02:38.956595 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 090f8701-682e-4da8-bd51-e80aa1633d36 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:02:38.956798 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance a9122d01-9c31-48d3-ae6b-e2d6305fe8d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:02:38.956910 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Migration 051a43ee-49af-4137-bc6b-3c98b0d50969 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 28 01:02:38.956974 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 04880ef4-5eee-4221-ad42-29788eb26358 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:02:38.957083 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:02:38.957199 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 03f1821a-592e-4e02-b609-74f3d7e69b53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:02:38.957494 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 01:02:38.957706 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Final resource view: name=np0000001577 phys_ram=24030MB used_ram=3520MB phys_disk=95GB used_disk=12GB total_vcpus=12 used_vcpus=15 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:02:37 up 34 min,  2 users,  load average: 7.68, 6.58, 3.43\n', 'num_instances': '14', 'num_vm_active': '12', 'num_task_None': '10', 'num_os_type_None': '14', 'num_proj_938c2829112843edb2054984e80ce7ad': '5', 'io_workload': '1', 'num_proj_a3c5a1da6bb242e9a58cb82855897726': '1', 'num_proj_73ee6b376bb14dffb5664085cca58288': '2', 'num_task_resize_finish': '1', 'num_vm_shelved_offloaded': '1', 'num_task_spawning': '2', 'num_proj_f6a7090a79f448f3abe4737bf127df53': '1', 'num_task_image_snapshot_pending': '1', 'num_proj_8efd8caac5eb46ae9af16a2452ee0353': '1', 'num_proj_9e28acf25c4445ea969bd7bca3eac146': '2', 'num_proj_050f928f1ce449d6a447cd343dc4ff80': '1', 'num_proj_6b80759164bf4465b0bd873db74c9c49': '1', 'num_vm_building': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 01:02:38.959354 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:39.009498 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-4ca5c60f-577d-40d9-828e-29defcd0563e tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] instance snapshotting
May 28 01:02:39.101675 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:39.123248 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:39.136414 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4ca5c60f-577d-40d9-828e-29defcd0563e tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Beginning live snapshot process
May 28 01:02:39.159479 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5f4e90d2-d075-4237-b575-a7f4565645c5 req-10328d14-3717-4aaa-97ba-faa4094734ef service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Received event network-vif-plugged-d80f49b7-bd41-46df-9743-8ad514696557 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:39.159711 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5f4e90d2-d075-4237-b575-a7f4565645c5 req-10328d14-3717-4aaa-97ba-faa4094734ef service nova] Acquiring lock "04880ef4-5eee-4221-ad42-29788eb26358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:39.160058 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5f4e90d2-d075-4237-b575-a7f4565645c5 req-10328d14-3717-4aaa-97ba-faa4094734ef service nova] Lock "04880ef4-5eee-4221-ad42-29788eb26358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:39.160131 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5f4e90d2-d075-4237-b575-a7f4565645c5 req-10328d14-3717-4aaa-97ba-faa4094734ef service nova] Lock "04880ef4-5eee-4221-ad42-29788eb26358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:39.160316 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5f4e90d2-d075-4237-b575-a7f4565645c5 req-10328d14-3717-4aaa-97ba-faa4094734ef service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] No waiting events found dispatching network-vif-plugged-d80f49b7-bd41-46df-9743-8ad514696557 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:02:39.160448 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-5f4e90d2-d075-4237-b575-a7f4565645c5 req-10328d14-3717-4aaa-97ba-faa4094734ef service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Received unexpected event network-vif-plugged-d80f49b7-bd41-46df-9743-8ad514696557 for instance with vm_state active and task_state resize_finish.
May 28 01:02:39.291808 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-345be066-6fcb-4598-a6c8-bfed29bdbfd1 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:39.291998 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-345be066-6fcb-4598-a6c8-bfed29bdbfd1 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:39.292183 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-345be066-6fcb-4598-a6c8-bfed29bdbfd1 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:39.292336 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-345be066-6fcb-4598-a6c8-bfed29bdbfd1 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:39.292473 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-345be066-6fcb-4598-a6c8-bfed29bdbfd1 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:39.301010 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-345be066-6fcb-4598-a6c8-bfed29bdbfd1 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Terminating instance
May 28 01:02:39.476027 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Found WWN 3300000006800a6c7 for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:02:39.476388 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:02:39.476614 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] <== connect_volume: return (10953ms) {'type': 'block', 'scsi_wwn': '3300000006800a6c7', 'path': '/dev/dm-1', 'multipath_id': '3300000006800a6c7'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:02:39.476781 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006800a6c7', 'path': '/dev/dm-1', 'multipath_id': '3300000006800a6c7'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:02:39.477365 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 8.246s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:02:39.477800 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31108657-63be-401c-a00e-137d133f11d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:02:39.477940 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:02:39.504244 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:39.504244 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:39.504244 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:39.504244 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:39.504244 np0000001577 nova-compute[98319]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:39.504244 np0000001577 nova-compute[98319]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:39.504244 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:39.504244 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:39.504244 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:39.504244 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:39.504244 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:02:39.504538 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:39.504538 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:39.504538 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:39.504538 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:39.504538 np0000001577 nova-compute[98319]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:39.504538 np0000001577 nova-compute[98319]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8 (non-flash)
May 28 01:02:39.504538 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:39.504538 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:39.504538 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:39.504538 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:39.504538 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:02:39.504538 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', '58'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', '59'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd', '60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd', '61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', '63')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:02:39.504538 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', '59')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:02:39.505505 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8', '58')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:02:39.506303 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c984c52d120>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8'): ({'sdc'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:02:39.506493 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Removing multipathed devices sdf, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:02:39.506790 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Flush multipath device 330000000c92c0359 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:02:39.543963 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:02:39.586083 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:02:39.630869 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Checking to see if SCSI volumes sdf, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:02:39.631039 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] SCSI volumes sdf, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:02:39.632082 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Checking to see if device paths {'sdf', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:02:39.645111 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Device paths {'sdf', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:02:39.645370 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:02:39.658741 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:39.692524 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8, portal: 192.168.40.100,3260]
May 28 01:02:39.692524 np0000001577 nova-compute[98319]: Logout of [sid: 59, target: iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8, portal: 192.168.40.100,3260] successful.
May 28 01:02:39.692524 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:39.705860 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:02:39.706132 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:02:39.710389 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930159.7100697, 04880ef4-5eee-4221-ad42-29788eb26358 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:02:39.710590 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] VM Resumed (Lifecycle Event)
May 28 01:02:39.712318 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:39.713962 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Instance event wait completed in 0 seconds for  {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:02:39.717290 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Instance running successfully.
May 28 01:02:39.718056 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Failed to set time: agent not configured {{(pid=98319) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 28 01:02:39.718180 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-53cbde8e-7b7f-49d4-b2b5-a99ca96e4303 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] finish_migration finished successfully. {{(pid=98319) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 28 01:02:39.728692 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:39.769343 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8, portal: 192.168.50.100,3260]
May 28 01:02:39.769343 np0000001577 nova-compute[98319]: Logout of [sid: 58, target: iqn.2023-03.storpool.com:os--volume-31108657-63be-401c-a00e-137d133f11d8, portal: 192.168.50.100,3260] successful.
May 28 01:02:39.769343 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:39.789247 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:39.789477 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:02:39.789637 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] <== disconnect_volume: return (8557ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:02:39.789798 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:02:39.791423 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 8.195s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:02:39.791612 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c', 'iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:02:39.803983 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-345be066-6fcb-4598-a6c8-bfed29bdbfd1 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:02:39.805500 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:02:39.807036 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:02:39.807036 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:02:39.807036 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:02:39.807391 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:02:39.807391 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:02:39.819924 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:02:39.819924 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:39.825251 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:02:39.825251 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:39.831885 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:39.840867 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:39.843397 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c] added
May 28 01:02:39.843397 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:02:39.843397 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:02:39.843397 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:02:39.843397 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:02:39.843397 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:02:39.843397 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:39.843786 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:02:39.844204 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0372(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:02:39.844260 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:02:39.846105 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c] added
May 28 01:02:39.846105 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:02:39.846105 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:02:39.846105 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:02:39.846105 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:02:39.846105 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:02:39.846105 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:39.846263 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:02:39.846450 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0392(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:02:39.846656 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:02:39.853112 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:39.858151 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:39.879092 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:39.884520 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:39.984863 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:02:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-694763940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serverbootfromvolumestablerescuetest-server-694763940',id=33,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e28acf25c4445ea969bd7bca3eac146',ramdisk_id='',reservation_id='r-c0ydlb5a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-568223226',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:02:22Z,user_data=None,user_id='fb6c20970bf0401190583f6348e00e4b',uuid=0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "165b2ee7-8c11-422b-ad45-9cc83cfea68c", "address": "fa:16:3e:71:99:0d", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap165b2ee7-8c", "ovs_interfaceid": "165b2ee7-8c11-422b-ad45-9cc83cfea68c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:02:39.985226 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Converting VIF {"id": "165b2ee7-8c11-422b-ad45-9cc83cfea68c", "address": "fa:16:3e:71:99:0d", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap165b2ee7-8c", "ovs_interfaceid": "165b2ee7-8c11-422b-ad45-9cc83cfea68c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:02:39.985860 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:99:0d,bridge_name='br-int',has_traffic_filtering=True,id=165b2ee7-8c11-422b-ad45-9cc83cfea68c,network=Network(c25f8563-bd10-4e42-b4ce-fd2164eca324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap165b2ee7-8c') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:02:39.986755 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lazy-loading 'pci_devices' on Instance uuid 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:40.159965 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Instance destroyed successfully.
May 28 01:02:40.161533 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-345be066-6fcb-4598-a6c8-bfed29bdbfd1 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lazy-loading 'resources' on Instance uuid dccaa2b7-3c00-45f9-bf40-1a8a15030825 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:40.210492 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:02:40.217164 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:40.222078 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:02:40.347391 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lazy-loading 'flavor' on Instance uuid e2cc3304-bf2b-4196-b6c8-8ad56da19af4 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:40.489385 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] End _get_guest_xml xml=<domain type="qemu">
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:   <uuid>0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c</uuid>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:   <name>instance-00000021</name>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-694763940</nova:name>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:02:28</nova:creationTime>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:         <nova:user uuid="fb6c20970bf0401190583f6348e00e4b">tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member</nova:user>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:         <nova:project uuid="9e28acf25c4445ea969bd7bca3eac146">tempest-ServerBootFromVolumeStableRescueTest-568223226</nova:project>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:         <nova:port uuid="165b2ee7-8c11-422b-ad45-9cc83cfea68c">
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:     <system>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       <entry name="serial">0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c</entry>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       <entry name="uuid">0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c</entry>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:     </system>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:   <os>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:   </os>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:   <features>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:   </features>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:   <devices>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c/disk.config"/>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:     </disk>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       <alias name="ua-773fdc14-869d-4cd3-b671-b799bcc94e1f"/>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-1"/>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       <serial>773fdc14-869d-4cd3-b671-b799bcc94e1f</serial>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:     </disk>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:71:99:0d"/>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       <target dev="tap165b2ee7-8c"/>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:     </interface>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c/console.log" append="off"/>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:     </serial>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:     <video>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:     </video>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:     </rng>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:   </devices>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]: </domain>
May 28 01:02:40.489385 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:02:40.491212 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Preparing to wait for external event network-vif-plugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:02:40.491212 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:40.491212 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:40.491212 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:40.491212 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:02:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-694763940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serverbootfromvolumestablerescuetest-server-694763940',id=33,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e28acf25c4445ea969bd7bca3eac146',ramdisk_id='',reservation_id='r-c0ydlb5a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-568223226',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:02:22Z,user_data=None,user_id='fb6c20970bf0401190583f6348e00e4b',uuid=0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "165b2ee7-8c11-422b-ad45-9cc83cfea68c", "address": "fa:16:3e:71:99:0d", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap165b2ee7-8c", "ovs_interfaceid": "165b2ee7-8c11-422b-ad45-9cc83cfea68c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:02:40.491212 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Converting VIF {"id": "165b2ee7-8c11-422b-ad45-9cc83cfea68c", "address": "fa:16:3e:71:99:0d", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap165b2ee7-8c", "ovs_interfaceid": "165b2ee7-8c11-422b-ad45-9cc83cfea68c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:02:40.491212 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:99:0d,bridge_name='br-int',has_traffic_filtering=True,id=165b2ee7-8c11-422b-ad45-9cc83cfea68c,network=Network(c25f8563-bd10-4e42-b4ce-fd2164eca324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap165b2ee7-8c') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:02:40.491500 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:99:0d,bridge_name='br-int',has_traffic_filtering=True,id=165b2ee7-8c11-422b-ad45-9cc83cfea68c,network=Network(c25f8563-bd10-4e42-b4ce-fd2164eca324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap165b2ee7-8c') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:02:40.491666 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:40.492498 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:40.492498 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:02:40.492995 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:40.493154 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '627e6449-6e89-53a4-89bb-b7566538620a', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:40.493886 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:40.494474 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:02:40.499083 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:40.501010 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:40.501141 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap165b2ee7-8c, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:40.501423 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap165b2ee7-8c, col_values=(('qos', UUID('2d9be23a-e8fc-40a8-b76e-fdf2185ebf65')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:40.501599 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap165b2ee7-8c, col_values=(('external_ids', {'iface-id': '165b2ee7-8c11-422b-ad45-9cc83cfea68c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:99:0d', 'vm-uuid': '0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:40.502241 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:40.504676 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:02:40.510961 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:40.511703 np0000001577 nova-compute[98319]: INFO os_vif [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:99:0d,bridge_name='br-int',has_traffic_filtering=True,id=165b2ee7-8c11-422b-ad45-9cc83cfea68c,network=Network(c25f8563-bd10-4e42-b4ce-fd2164eca324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap165b2ee7-8c')
May 28 01:02:40.655567 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4ca5c60f-577d-40d9-828e-29defcd0563e tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk --force-share --output=json -f qcow2 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:40.670220 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-345be066-6fcb-4598-a6c8-bfed29bdbfd1 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1356732443',display_name='tempest-ServerRescueNegativeTestJSON-server-1356732443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serverrescuenegativetestjson-server-1356732443',id=15,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:00:03Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3c5a1da6bb242e9a58cb82855897726',ramdisk_id='',reservation_id='r-ptb9d526',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-509890320',owner_user_name='tempest-ServerRescueNegativeTestJSON-509890320-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:00:09Z,user_data=None,user_id='e2684c1dc140407b91687ee5abadef9d',uuid=dccaa2b7-3c00-45f9-bf40-1a8a15030825,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c4c4d7c-c6bd-4039-b75c-70bce7052b58", "address": "fa:16:3e:3e:23:29", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4c4d7c-c6", "ovs_interfaceid": "3c4c4d7c-c6bd-4039-b75c-70bce7052b58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:02:40.670527 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-345be066-6fcb-4598-a6c8-bfed29bdbfd1 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Converting VIF {"id": "3c4c4d7c-c6bd-4039-b75c-70bce7052b58", "address": "fa:16:3e:3e:23:29", "network": {"id": "1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981322036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a3c5a1da6bb242e9a58cb82855897726", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4c4d7c-c6", "ovs_interfaceid": "3c4c4d7c-c6bd-4039-b75c-70bce7052b58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:02:40.671649 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-345be066-6fcb-4598-a6c8-bfed29bdbfd1 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:23:29,bridge_name='br-int',has_traffic_filtering=True,id=3c4c4d7c-c6bd-4039-b75c-70bce7052b58,network=Network(1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c4c4d7c-c6') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:02:40.672039 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-345be066-6fcb-4598-a6c8-bfed29bdbfd1 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:23:29,bridge_name='br-int',has_traffic_filtering=True,id=3c4c4d7c-c6bd-4039-b75c-70bce7052b58,network=Network(1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c4c4d7c-c6') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:02:40.674286 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:40.675119 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c4c4d7c-c6, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:40.677635 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:40.678922 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:02:40.683455 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:40.684536 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:40.684698 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ac951e1-f35b-4163-9d07-59ba0c692caf) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:40.685172 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:40.686098 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:02:40.689997 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:40.691844 np0000001577 nova-compute[98319]: INFO os_vif [None req-345be066-6fcb-4598-a6c8-bfed29bdbfd1 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:23:29,bridge_name='br-int',has_traffic_filtering=True,id=3c4c4d7c-c6bd-4039-b75c-70bce7052b58,network=Network(1cf7153d-ec51-4f93-96f5-ceff8eb3ffa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c4c4d7c-c6')
May 28 01:02:40.692176 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-345be066-6fcb-4598-a6c8-bfed29bdbfd1 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Deleting instance files /opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825_del
May 28 01:02:40.692889 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-345be066-6fcb-4598-a6c8-bfed29bdbfd1 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Deletion of /opt/stack/data/nova/instances/dccaa2b7-3c00-45f9-bf40-1a8a15030825_del complete
May 28 01:02:40.718886 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Compute_service record updated for np0000001577:np0000001577 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 01:02:40.719267 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.849s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:40.719669 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:02:40.724862 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 28 01:02:40.725591 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930160.7252848, 04880ef4-5eee-4221-ad42-29788eb26358 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:02:40.725733 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] VM Started (Lifecycle Event)
May 28 01:02:40.736385 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4ca5c60f-577d-40d9-828e-29defcd0563e tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk --force-share --output=json -f qcow2" returned: 0 in 0.081s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:40.736802 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4ca5c60f-577d-40d9-828e-29defcd0563e tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk --force-share --output=json -f qcow2 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:40.813843 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4ca5c60f-577d-40d9-828e-29defcd0563e tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk --force-share --output=json -f qcow2" returned: 0 in 0.077s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:40.814579 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-4ca5c60f-577d-40d9-828e-29defcd0563e tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:02:40.816980 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-4ca5c60f-577d-40d9-828e-29defcd0563e tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:02:40.817318 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4ca5c60f-577d-40d9-828e-29defcd0563e tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:40.845300 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:02:40.847357 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:02:40.858148 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:02:40.858148 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:02:40.864900 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:02:40.864900 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:40.869876 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:40.877485 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:40.887560 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:40.887560 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:40.887560 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:40.887560 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:40.887560 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:40.887560 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:40.887560 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:40.887560 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:40.887560 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:02:40.887871 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:40.887871 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:40.887871 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:40.887871 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:40.887871 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:40.887871 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:40.887871 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:40.887871 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:40.887871 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:02:40.895700 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:40.895700 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:40.895700 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:40.895700 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:40.895700 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:40.895700 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:40.895700 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:40.895700 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:40.895700 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:02:40.896251 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:40.896251 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:40.896251 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:40.896251 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:40.896251 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:40.896251 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:40.896251 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:40.896251 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:40.896251 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:02:40.899055 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4ca5c60f-577d-40d9-828e-29defcd0563e tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.081s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:40.899562 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4ca5c60f-577d-40d9-828e-29defcd0563e tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkld3sfxs/0d1af42767f046318b9ba8c1f262c6b1.delta 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:40.933136 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c, portal: 192.168.50.100,3260]
May 28 01:02:40.933136 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c, portal: 192.168.50.100,3260] successful.
May 28 01:02:40.933136 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:40.941565 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c, portal: 192.168.40.100,3260]
May 28 01:02:40.941565 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c, portal: 192.168.40.100,3260] successful.
May 28 01:02:40.941565 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:40.947064 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:40.953068 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:40.960148 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4ca5c60f-577d-40d9-828e-29defcd0563e tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkld3sfxs/0d1af42767f046318b9ba8c1f262c6b1.delta 1073741824" returned: 0 in 0.060s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:40.960751 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4ca5c60f-577d-40d9-828e-29defcd0563e tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Quiescing instance not available: QEMU guest agent is not enabled.
May 28 01:02:40.964623 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:40.964623 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:40.964623 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:40.964623 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:40.964623 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:40.964623 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:40.964623 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:40.964623 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:40.964623 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:40.964623 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:40.964623 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:02:40.965081 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:40.965081 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:40.965081 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:40.965081 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:40.965081 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:40.965081 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:40.965081 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:40.965081 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:40.965081 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:40.965081 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:40.965081 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:02:40.965504 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:02:40.965504 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:02:40.966413 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] HCTL ('8', '-', '-', 0) found on session 64 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:02:40.966509 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:02:40.971456 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:40.971456 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:40.971456 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:40.971456 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:40.971456 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:40.971456 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:40.971456 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:40.971456 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:40.971456 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:40.971456 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:40.971456 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:02:40.971859 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:40.971859 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:40.971859 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:40.971859 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:40.971859 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:40.971859 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:40.971859 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:40.971859 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:40.971859 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:40.971859 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:40.971859 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:02:40.971859 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:02:40.972243 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:02:40.972762 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] HCTL ('11', '-', '-', 0) found on session 65 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:02:40.972891 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:02:40.995763 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Searching for a device in session 65 and hctl ['11', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:02:40.995763 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Searching for a device in session 64 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:02:40.995763 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:02:41.104711 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:41.199834 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-345be066-6fcb-4598-a6c8-bfed29bdbfd1 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Took 1.40 seconds to destroy the instance on the hypervisor.
May 28 01:02:41.200271 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-345be066-6fcb-4598-a6c8-bfed29bdbfd1 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:02:41.200780 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:02:41.200780 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:02:41.201106 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:41.213149 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-4ca5c60f-577d-40d9-828e-29defcd0563e tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] COPY block job progress, current cursor: 196608 final cursor: 76611584 {{(pid=98319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 28 01:02:41.228141 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:41.232057 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:02:41.248976 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-22746a0d-7f60-4a4f-9d1a-93e21a1baaf8 req-16728e9b-61d5-4239-8573-30d454d3bb97 service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Received event network-vif-plugged-d80f49b7-bd41-46df-9743-8ad514696557 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:41.248976 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-22746a0d-7f60-4a4f-9d1a-93e21a1baaf8 req-16728e9b-61d5-4239-8573-30d454d3bb97 service nova] Acquiring lock "04880ef4-5eee-4221-ad42-29788eb26358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:41.249104 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-22746a0d-7f60-4a4f-9d1a-93e21a1baaf8 req-16728e9b-61d5-4239-8573-30d454d3bb97 service nova] Lock "04880ef4-5eee-4221-ad42-29788eb26358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:41.249168 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-22746a0d-7f60-4a4f-9d1a-93e21a1baaf8 req-16728e9b-61d5-4239-8573-30d454d3bb97 service nova] Lock "04880ef4-5eee-4221-ad42-29788eb26358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:41.249292 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-22746a0d-7f60-4a4f-9d1a-93e21a1baaf8 req-16728e9b-61d5-4239-8573-30d454d3bb97 service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] No waiting events found dispatching network-vif-plugged-d80f49b7-bd41-46df-9743-8ad514696557 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:02:41.249393 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-22746a0d-7f60-4a4f-9d1a-93e21a1baaf8 req-16728e9b-61d5-4239-8573-30d454d3bb97 service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Received unexpected event network-vif-plugged-d80f49b7-bd41-46df-9743-8ad514696557 for instance with vm_state resized and task_state None.
May 28 01:02:41.249490 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-22746a0d-7f60-4a4f-9d1a-93e21a1baaf8 req-16728e9b-61d5-4239-8573-30d454d3bb97 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Received event network-vif-unplugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:41.250505 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-22746a0d-7f60-4a4f-9d1a-93e21a1baaf8 req-16728e9b-61d5-4239-8573-30d454d3bb97 service nova] Acquiring lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:41.250789 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-22746a0d-7f60-4a4f-9d1a-93e21a1baaf8 req-16728e9b-61d5-4239-8573-30d454d3bb97 service nova] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:41.251103 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-22746a0d-7f60-4a4f-9d1a-93e21a1baaf8 req-16728e9b-61d5-4239-8573-30d454d3bb97 service nova] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:41.251355 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-22746a0d-7f60-4a4f-9d1a-93e21a1baaf8 req-16728e9b-61d5-4239-8573-30d454d3bb97 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] No waiting events found dispatching network-vif-unplugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:02:41.251480 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-22746a0d-7f60-4a4f-9d1a-93e21a1baaf8 req-16728e9b-61d5-4239-8573-30d454d3bb97 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Received event network-vif-unplugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:02:41.251713 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-22746a0d-7f60-4a4f-9d1a-93e21a1baaf8 req-16728e9b-61d5-4239-8573-30d454d3bb97 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Received event network-vif-unplugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:41.251918 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-22746a0d-7f60-4a4f-9d1a-93e21a1baaf8 req-16728e9b-61d5-4239-8573-30d454d3bb97 service nova] Acquiring lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:41.252354 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-22746a0d-7f60-4a4f-9d1a-93e21a1baaf8 req-16728e9b-61d5-4239-8573-30d454d3bb97 service nova] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:41.252473 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-22746a0d-7f60-4a4f-9d1a-93e21a1baaf8 req-16728e9b-61d5-4239-8573-30d454d3bb97 service nova] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:41.252617 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-22746a0d-7f60-4a4f-9d1a-93e21a1baaf8 req-16728e9b-61d5-4239-8573-30d454d3bb97 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] No waiting events found dispatching network-vif-unplugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:02:41.252724 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-22746a0d-7f60-4a4f-9d1a-93e21a1baaf8 req-16728e9b-61d5-4239-8573-30d454d3bb97 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Received event network-vif-unplugged-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:02:41.307310 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:41.358152 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d93a19a-c0ee-4668-b133-7ff7b2accd7c tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 11.248s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:41.567421 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8144d452-2a67-40ee-8971-1d6064005cb0 req-fc90f350-b2d5-4061-adc3-0185502b57b8 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Received event network-vif-deleted-3c4c4d7c-c6bd-4039-b75c-70bce7052b58 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:41.567421 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-8144d452-2a67-40ee-8971-1d6064005cb0 req-fc90f350-b2d5-4061-adc3-0185502b57b8 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Neutron deleted interface 3c4c4d7c-c6bd-4039-b75c-70bce7052b58; detaching it from the instance and deleting it from the info cache
May 28 01:02:41.568363 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8144d452-2a67-40ee-8971-1d6064005cb0 req-fc90f350-b2d5-4061-adc3-0185502b57b8 service nova] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Detach interface failed, port_id=3c4c4d7c-c6bd-4039-b75c-70bce7052b58, reason: Instance dccaa2b7-3c00-45f9-bf40-1a8a15030825 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:02:41.714902 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-4ca5c60f-577d-40d9-828e-29defcd0563e tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] COPY block job progress, current cursor: 76611584 final cursor: 76611584 {{(pid=98319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 28 01:02:41.716663 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4ca5c60f-577d-40d9-828e-29defcd0563e tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Skipping quiescing instance: QEMU guest agent is not enabled.
May 28 01:02:41.720946 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:02:41.720946 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:02:41.720946 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:02:41.720946 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:02:41.720946 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:02:41.720946 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:02:41.720946 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:02:41.720946 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 01:02:41.720946 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 52.26 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:02:41.734536 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999764350000078 future=<Future at 0x7c984c7d6ff0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:41.755941 np0000001577 nova-compute[98319]: DEBUG nova.privsep.utils [None req-4ca5c60f-577d-40d9-828e-29defcd0563e tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 01:02:41.756202 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4ca5c60f-577d-40d9-828e-29defcd0563e tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkld3sfxs/0d1af42767f046318b9ba8c1f262c6b1.delta /opt/stack/data/nova/instances/snapshots/tmpkld3sfxs/0d1af42767f046318b9ba8c1f262c6b1 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:41.813981 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a3bc7dbc-850a-4611-a79c-1b930657a08e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:41.814235 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a3bc7dbc-850a-4611-a79c-1b930657a08e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:41.814477 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a3bc7dbc-850a-4611-a79c-1b930657a08e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:41.814670 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a3bc7dbc-850a-4611-a79c-1b930657a08e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:41.814829 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a3bc7dbc-850a-4611-a79c-1b930657a08e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:41.820168 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-a3bc7dbc-850a-4611-a79c-1b930657a08e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Terminating instance
May 28 01:02:41.937882 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4ca5c60f-577d-40d9-828e-29defcd0563e tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkld3sfxs/0d1af42767f046318b9ba8c1f262c6b1.delta /opt/stack/data/nova/instances/snapshots/tmpkld3sfxs/0d1af42767f046318b9ba8c1f262c6b1" returned: 0 in 0.182s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:41.941823 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4ca5c60f-577d-40d9-828e-29defcd0563e tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Snapshot extracted, beginning image upload
May 28 01:02:41.987175 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Searching for a device in session 65 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:02:41.987341 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:02:42.028339 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:02:42.031014 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:02:42.031289 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:02:42.031468 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] No VIF found with MAC fa:16:3e:71:99:0d, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:02:42.032027 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Using config drive
May 28 01:02:42.179341 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bcb9d152-2903-4831-abb9-5d50686a5ca0 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "04880ef4-5eee-4221-ad42-29788eb26358" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:42.179497 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bcb9d152-2903-4831-abb9-5d50686a5ca0 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "04880ef4-5eee-4221-ad42-29788eb26358" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:42.179663 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-bcb9d152-2903-4831-abb9-5d50686a5ca0 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Going to confirm migration 3 {{(pid=98319) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 28 01:02:42.322615 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-a3bc7dbc-850a-4611-a79c-1b930657a08e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:02:42.346849 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:42.381131 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:42.518273 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c2841d15-ffea-4fdf-8c67-cece3f876dd5 req-813125a0-a8d8-46a1-b035-26ac9096ac6c service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Received event network-vif-unplugged-b1c5ca58-a892-4f67-840e-810089b1fe6a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:42.518273 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c2841d15-ffea-4fdf-8c67-cece3f876dd5 req-813125a0-a8d8-46a1-b035-26ac9096ac6c service nova] Acquiring lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:42.518273 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c2841d15-ffea-4fdf-8c67-cece3f876dd5 req-813125a0-a8d8-46a1-b035-26ac9096ac6c service nova] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:42.518410 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c2841d15-ffea-4fdf-8c67-cece3f876dd5 req-813125a0-a8d8-46a1-b035-26ac9096ac6c service nova] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:42.518446 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c2841d15-ffea-4fdf-8c67-cece3f876dd5 req-813125a0-a8d8-46a1-b035-26ac9096ac6c service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] No waiting events found dispatching network-vif-unplugged-b1c5ca58-a892-4f67-840e-810089b1fe6a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:02:42.518588 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c2841d15-ffea-4fdf-8c67-cece3f876dd5 req-813125a0-a8d8-46a1-b035-26ac9096ac6c service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Received event network-vif-unplugged-b1c5ca58-a892-4f67-840e-810089b1fe6a for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:02:42.520485 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:42.529101 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:42.530686 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Took 1.33 seconds to deallocate network for instance.
May 28 01:02:42.537747 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:42.612782 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:42.678300 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999691415000143 future=<Future at 0x7c984c47f4d0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:42.679128 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Instance destroyed successfully.
May 28 01:02:42.679655 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-a3bc7dbc-850a-4611-a79c-1b930657a08e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lazy-loading 'resources' on Instance uuid e2cc3304-bf2b-4196-b6c8-8ad56da19af4 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:42.685434 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-bcb9d152-2903-4831-abb9-5d50686a5ca0 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:42.701822 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Creating config drive at /opt/stack/data/nova/instances/0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c/disk.config
May 28 01:02:42.704701 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj2kwyldy {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:42.750993 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj2kwyldy" returned: 0 in 0.046s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:42.782349 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-bcb9d152-2903-4831-abb9-5d50686a5ca0 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:42.783312 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bcb9d152-2903-4831-abb9-5d50686a5ca0 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "refresh_cache-04880ef4-5eee-4221-ad42-29788eb26358" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:02:42.783416 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bcb9d152-2903-4831-abb9-5d50686a5ca0 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquired lock "refresh_cache-04880ef4-5eee-4221-ad42-29788eb26358" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:02:42.783566 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-bcb9d152-2903-4831-abb9-5d50686a5ca0 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:02:42.783769 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-bcb9d152-2903-4831-abb9-5d50686a5ca0 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lazy-loading 'info_cache' on Instance uuid 04880ef4-5eee-4221-ad42-29788eb26358 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:42.821896 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Found WWN 330000000d50195f9 for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:02:42.822313 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:02:42.822484 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] <== connect_volume: return (11226ms) {'type': 'block', 'scsi_wwn': '330000000d50195f9', 'path': '/dev/dm-0', 'multipath_id': '330000000d50195f9'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:02:42.822657 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d50195f9', 'path': '/dev/dm-0', 'multipath_id': '330000000d50195f9'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:02:43.045476 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-345be066-6fcb-4598-a6c8-bfed29bdbfd1 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:43.046076 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-345be066-6fcb-4598-a6c8-bfed29bdbfd1 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:43.133316 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:43.165078 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:43.167745 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:43.187927 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-a3bc7dbc-850a-4611-a79c-1b930657a08e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T01:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-778733213',display_name='tempest-ServerActionsTestOtherA-server-1104107866',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-tempest-common-compute-instance-778733213',id=25,image_ref='5574e7a7-cbb4-4ae2-8b7f-aa34fd051b87',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkiPLdYbCo1S3Q8zHTI1NipWScu+iP6NIHT7weBqNR/4DW9uVU8JGbzlGA44pLzm48mu9WdSdzEcSZJe6dOWPJFIyxn7tMsGB3fbMiFLIYEXAldqT3xnfulQjdD578NKQ==',key_name='tempest-keypair-1759049740',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:01:51Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73ee6b376bb14dffb5664085cca58288',ramdisk_id='',reservation_id='r-0r9cnnkw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5574e7a7-cbb4-4ae2-8b7f-aa34fd051b87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1279266727',owner_user_name='tempest-ServerActionsTestOtherA-1279266727-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:01:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84e218b589ef4968828db0c740eaa72b',uuid=e2cc3304-bf2b-4196-b6c8-8ad56da19af4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "address": "fa:16:3e:9d:98:58", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c5ca58-a8", "ovs_interfaceid": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:02:43.188156 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-a3bc7dbc-850a-4611-a79c-1b930657a08e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Converting VIF {"id": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "address": "fa:16:3e:9d:98:58", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c5ca58-a8", "ovs_interfaceid": "b1c5ca58-a892-4f67-840e-810089b1fe6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:02:43.188697 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-a3bc7dbc-850a-4611-a79c-1b930657a08e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:98:58,bridge_name='br-int',has_traffic_filtering=True,id=b1c5ca58-a892-4f67-840e-810089b1fe6a,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c5ca58-a8') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:02:43.189578 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-a3bc7dbc-850a-4611-a79c-1b930657a08e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:98:58,bridge_name='br-int',has_traffic_filtering=True,id=b1c5ca58-a892-4f67-840e-810089b1fe6a,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c5ca58-a8') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:02:43.191022 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:43.191275 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1c5ca58-a8, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:43.196954 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:02:43.202355 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:43.202536 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9cf365d3-3656-46ec-878e-819b9bec9704) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:43.205263 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:43.205263 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:02:43.205263 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:43.209432 np0000001577 nova-compute[98319]: INFO os_vif [None req-a3bc7dbc-850a-4611-a79c-1b930657a08e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:98:58,bridge_name='br-int',has_traffic_filtering=True,id=b1c5ca58-a892-4f67-840e-810089b1fe6a,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c5ca58-a8')
May 28 01:02:43.209806 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-a3bc7dbc-850a-4611-a79c-1b930657a08e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Deleting instance files /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4_del
May 28 01:02:43.210506 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-a3bc7dbc-850a-4611-a79c-1b930657a08e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Deletion of /opt/stack/data/nova/instances/e2cc3304-bf2b-4196-b6c8-8ad56da19af4_del complete
May 28 01:02:43.247369 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:43.308273 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:43.308273 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:43.332882 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T01:01:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-115051965',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumeshelvetestjson-server-115051965',id=28,image_ref='959921f1-3b1a-4c37-ab6f-5184ee80cabe',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-636601780',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:01:21Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f6a7090a79f448f3abe4737bf127df53',ramdisk_id='',reservation_id='r-oad6jyzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1260503814',owner_user_name='tempest-AttachVolumeShelveTestJSON-1260503814-project-member',shelved_at='2026-05-28T01:02:09.077953',shelved_host='np0000001577',shelved_image_id='959921f1-3b1a-4c37-ab6f-5184ee80cabe'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:02:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d375089981f8493598b33c4b6f122374',uuid=03f1821a-592e-4e02-b609-74f3d7e69b53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "address": "fa:16:3e:5e:ef:9c", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f81148-2a", "ovs_interfaceid": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:02:43.332882 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Converting VIF {"id": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "address": "fa:16:3e:5e:ef:9c", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f81148-2a", "ovs_interfaceid": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:02:43.332882 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:ef:9c,bridge_name='br-int',has_traffic_filtering=True,id=95f81148-2a4e-4ca8-ad05-cb73d6f2951f,network=Network(e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f81148-2a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:02:43.333345 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lazy-loading 'pci_devices' on Instance uuid 03f1821a-592e-4e02-b609-74f3d7e69b53 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:43.722342 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-a3bc7dbc-850a-4611-a79c-1b930657a08e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Took 1.40 seconds to destroy the instance on the hypervisor.
May 28 01:02:43.723319 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-a3bc7dbc-850a-4611-a79c-1b930657a08e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:02:43.727507 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:02:43.727507 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:02:43.727507 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:43.767629 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-345be066-6fcb-4598-a6c8-bfed29bdbfd1 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:02:43.767629 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-345be066-6fcb-4598-a6c8-bfed29bdbfd1 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:02:43.790745 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-bcb9d152-2903-4831-abb9-5d50686a5ca0 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:43.801125 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:43.841760 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Object Instance<03f1821a-592e-4e02-b609-74f3d7e69b53> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:02:43.847011 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] End _get_guest_xml xml=<domain type="qemu">
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:   <uuid>03f1821a-592e-4e02-b609-74f3d7e69b53</uuid>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:   <name>instance-0000001c</name>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-115051965</nova:name>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:02:31</nova:creationTime>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:         <nova:user uuid="d375089981f8493598b33c4b6f122374">tempest-AttachVolumeShelveTestJSON-1260503814-project-member</nova:user>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:         <nova:project uuid="f6a7090a79f448f3abe4737bf127df53">tempest-AttachVolumeShelveTestJSON-1260503814</nova:project>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:         <nova:port uuid="95f81148-2a4e-4ca8-ad05-cb73d6f2951f">
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:     <system>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <entry name="serial">03f1821a-592e-4e02-b609-74f3d7e69b53</entry>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <entry name="uuid">03f1821a-592e-4e02-b609-74f3d7e69b53</entry>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:     </system>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:   <os>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:   </os>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:   <features>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:   </features>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:   <devices>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/disk"/>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:     </disk>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/disk.config"/>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:     </disk>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <alias name="ua-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c"/>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-0"/>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <target dev="vdc" bus="virtio"/>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <serial>fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c</serial>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:     </disk>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:5e:ef:9c"/>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <target dev="tap95f81148-2a"/>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:     </interface>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/console.log" append="off"/>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:     </serial>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:     <video>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:     </video>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:     </rng>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:   </devices>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]: </domain>
May 28 01:02:43.847011 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:02:43.850041 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Preparing to wait for external event network-vif-plugged-95f81148-2a4e-4ca8-ad05-cb73d6f2951f {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:02:43.850041 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "03f1821a-592e-4e02-b609-74f3d7e69b53-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:43.850041 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "03f1821a-592e-4e02-b609-74f3d7e69b53-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:43.850041 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "03f1821a-592e-4e02-b609-74f3d7e69b53-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:43.850041 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T01:01:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-115051965',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumeshelvetestjson-server-115051965',id=28,image_ref='959921f1-3b1a-4c37-ab6f-5184ee80cabe',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-636601780',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:01:21Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f6a7090a79f448f3abe4737bf127df53',ramdisk_id='',reservation_id='r-oad6jyzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1260503814',owner_user_name='tempest-AttachVolumeShelveTestJSON-1260503814-project-member',shelved_at='2026-05-28T01:02:09.077953',shelved_host='np0000001577',shelved_image_id='959921f1-3b1a-4c37-ab6f-5184ee80cabe'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:02:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d375089981f8493598b33c4b6f122374',uuid=03f1821a-592e-4e02-b609-74f3d7e69b53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "address": "fa:16:3e:5e:ef:9c", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f81148-2a", "ovs_interfaceid": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:02:43.850041 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Converting VIF {"id": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "address": "fa:16:3e:5e:ef:9c", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f81148-2a", "ovs_interfaceid": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:02:43.850041 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:ef:9c,bridge_name='br-int',has_traffic_filtering=True,id=95f81148-2a4e-4ca8-ad05-cb73d6f2951f,network=Network(e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f81148-2a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:02:43.852620 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:ef:9c,bridge_name='br-int',has_traffic_filtering=True,id=95f81148-2a4e-4ca8-ad05-cb73d6f2951f,network=Network(e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f81148-2a') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:02:43.853093 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:43.853289 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:43.853975 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:02:43.855483 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:43.855658 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '90b9eed8-6c86-5017-a23d-dd081bdb6fdc', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:43.857791 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:43.858635 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:02:43.862835 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:43.863221 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95f81148-2a, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:43.863920 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap95f81148-2a, col_values=(('qos', UUID('6101a069-4aa5-445d-b6aa-9ca52f65f6bc')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:43.864157 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap95f81148-2a, col_values=(('external_ids', {'iface-id': '95f81148-2a4e-4ca8-ad05-cb73d6f2951f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:ef:9c', 'vm-uuid': '03f1821a-592e-4e02-b609-74f3d7e69b53'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:02:43.865410 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:43.867448 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:02:43.875611 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:43.878494 np0000001577 nova-compute[98319]: INFO os_vif [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:ef:9c,bridge_name='br-int',has_traffic_filtering=True,id=95f81148-2a4e-4ca8-ad05-cb73d6f2951f,network=Network(e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f81148-2a')
May 28 01:02:43.978944 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930163.9785836, 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:02:43.979143 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] VM Started (Lifecycle Event)
May 28 01:02:44.187756 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-bcb9d152-2903-4831-abb9-5d50686a5ca0 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:44.272808 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-345be066-6fcb-4598-a6c8-bfed29bdbfd1 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:02:44.338754 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-30a2810f-af64-45dd-9641-fa06ba35341f req-6c402ee2-6011-4abe-8df6-380ff78c0c53 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Received event network-vif-deleted-b1c5ca58-a892-4f67-840e-810089b1fe6a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:44.338877 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-30a2810f-af64-45dd-9641-fa06ba35341f req-6c402ee2-6011-4abe-8df6-380ff78c0c53 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Neutron deleted interface b1c5ca58-a892-4f67-840e-810089b1fe6a; detaching it from the instance and deleting it from the info cache
May 28 01:02:44.340021 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-30a2810f-af64-45dd-9641-fa06ba35341f req-6c402ee2-6011-4abe-8df6-380ff78c0c53 service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Detach interface failed, port_id=b1c5ca58-a892-4f67-840e-810089b1fe6a, reason: Instance e2cc3304-bf2b-4196-b6c8-8ad56da19af4 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:02:44.348074 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-bcb9d152-2903-4831-abb9-5d50686a5ca0 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Updating instance_info_cache with network_info: [{"id": "d80f49b7-bd41-46df-9743-8ad514696557", "address": "fa:16:3e:e7:fe:bd", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80f49b7-bd", "ovs_interfaceid": "d80f49b7-bd41-46df-9743-8ad514696557", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:02:44.483924 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:44.485186 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930164.4849901, 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:02:44.485352 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] VM Paused (Lifecycle Event)
May 28 01:02:44.498810 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4ca5c60f-577d-40d9-828e-29defcd0563e tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Snapshot image upload complete
May 28 01:02:44.499044 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-4ca5c60f-577d-40d9-828e-29defcd0563e tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Took 5.49 seconds to snapshot the instance on the hypervisor.
May 28 01:02:44.584692 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e34b1a08-84c0-4cbd-a9aa-8b7a5aa9c2d2 req-4f43a0ec-eef1-4fba-8924-b748111741ed service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Received event network-vif-unplugged-b1c5ca58-a892-4f67-840e-810089b1fe6a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:44.587124 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e34b1a08-84c0-4cbd-a9aa-8b7a5aa9c2d2 req-4f43a0ec-eef1-4fba-8924-b748111741ed service nova] Acquiring lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:44.587124 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e34b1a08-84c0-4cbd-a9aa-8b7a5aa9c2d2 req-4f43a0ec-eef1-4fba-8924-b748111741ed service nova] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:44.587124 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e34b1a08-84c0-4cbd-a9aa-8b7a5aa9c2d2 req-4f43a0ec-eef1-4fba-8924-b748111741ed service nova] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:44.587124 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e34b1a08-84c0-4cbd-a9aa-8b7a5aa9c2d2 req-4f43a0ec-eef1-4fba-8924-b748111741ed service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] No waiting events found dispatching network-vif-unplugged-b1c5ca58-a892-4f67-840e-810089b1fe6a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:02:44.587124 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e34b1a08-84c0-4cbd-a9aa-8b7a5aa9c2d2 req-4f43a0ec-eef1-4fba-8924-b748111741ed service nova] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Received event network-vif-unplugged-b1c5ca58-a892-4f67-840e-810089b1fe6a for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:02:44.587124 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e34b1a08-84c0-4cbd-a9aa-8b7a5aa9c2d2 req-4f43a0ec-eef1-4fba-8924-b748111741ed service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Received event network-vif-plugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:44.587124 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e34b1a08-84c0-4cbd-a9aa-8b7a5aa9c2d2 req-4f43a0ec-eef1-4fba-8924-b748111741ed service nova] Acquiring lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:44.587124 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e34b1a08-84c0-4cbd-a9aa-8b7a5aa9c2d2 req-4f43a0ec-eef1-4fba-8924-b748111741ed service nova] Lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:44.587124 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e34b1a08-84c0-4cbd-a9aa-8b7a5aa9c2d2 req-4f43a0ec-eef1-4fba-8924-b748111741ed service nova] Lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:44.587124 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e34b1a08-84c0-4cbd-a9aa-8b7a5aa9c2d2 req-4f43a0ec-eef1-4fba-8924-b748111741ed service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Processing event network-vif-plugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:02:44.587124 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e34b1a08-84c0-4cbd-a9aa-8b7a5aa9c2d2 req-4f43a0ec-eef1-4fba-8924-b748111741ed service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Received event network-vif-plugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:44.587124 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e34b1a08-84c0-4cbd-a9aa-8b7a5aa9c2d2 req-4f43a0ec-eef1-4fba-8924-b748111741ed service nova] Acquiring lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:44.587124 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e34b1a08-84c0-4cbd-a9aa-8b7a5aa9c2d2 req-4f43a0ec-eef1-4fba-8924-b748111741ed service nova] Lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:44.587124 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e34b1a08-84c0-4cbd-a9aa-8b7a5aa9c2d2 req-4f43a0ec-eef1-4fba-8924-b748111741ed service nova] Lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:44.587124 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e34b1a08-84c0-4cbd-a9aa-8b7a5aa9c2d2 req-4f43a0ec-eef1-4fba-8924-b748111741ed service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] No waiting events found dispatching network-vif-plugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:02:44.587124 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-e34b1a08-84c0-4cbd-a9aa-8b7a5aa9c2d2 req-4f43a0ec-eef1-4fba-8924-b748111741ed service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Received unexpected event network-vif-plugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c for instance with vm_state building and task_state spawning.
May 28 01:02:44.588196 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:02:44.591846 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:02:44.593511 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Instance spawned successfully.
May 28 01:02:44.593829 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:02:44.789568 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-345be066-6fcb-4598-a6c8-bfed29bdbfd1 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.741s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:44.790092 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:02:44.846606 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-345be066-6fcb-4598-a6c8-bfed29bdbfd1 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Deleted allocations for instance dccaa2b7-3c00-45f9-bf40-1a8a15030825
May 28 01:02:44.849929 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bcb9d152-2903-4831-abb9-5d50686a5ca0 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Releasing lock "refresh_cache-04880ef4-5eee-4221-ad42-29788eb26358" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:02:44.850392 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-bcb9d152-2903-4831-abb9-5d50686a5ca0 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lazy-loading 'migration_context' on Instance uuid 04880ef4-5eee-4221-ad42-29788eb26358 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:44.988208 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:44.991608 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930164.9895012, 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:02:44.991608 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] VM Resumed (Lifecycle Event)
May 28 01:02:45.100319 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:02:45.100431 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:02:45.100642 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:02:45.100838 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:02:45.101105 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:02:45.101356 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:02:45.294481 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Took 1.57 seconds to deallocate network for instance.
May 28 01:02:45.352610 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-bcb9d152-2903-4831-abb9-5d50686a5ca0 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Object Instance<04880ef4-5eee-4221-ad42-29788eb26358> lazy-loaded attributes: info_cache,migration_context {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:02:45.357701 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bcb9d152-2903-4831-abb9-5d50686a5ca0 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:45.357858 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bcb9d152-2903-4831-abb9-5d50686a5ca0 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:45.403094 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:02:45.403209 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:02:45.403300 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:02:45.403387 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] No VIF found with MAC fa:16:3e:5e:ef:9c, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:02:45.403816 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Using config drive
May 28 01:02:45.492828 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:45.495979 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:02:45.605415 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Took 17.10 seconds to spawn the instance on the hypervisor.
May 28 01:02:45.605557 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:45.799002 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a3bc7dbc-850a-4611-a79c-1b930657a08e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:45.855044 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-345be066-6fcb-4598-a6c8-bfed29bdbfd1 tempest-ServerRescueNegativeTestJSON-509890320 tempest-ServerRescueNegativeTestJSON-509890320-project-member] Lock "dccaa2b7-3c00-45f9-bf40-1a8a15030825" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.563s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:45.905989 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lazy-loading 'ec2_ids' on Instance uuid 03f1821a-592e-4e02-b609-74f3d7e69b53 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:45.998164 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:02:46.109872 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:46.119486 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Took 30.76 seconds to build instance.
May 28 01:02:46.196944 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Acquiring lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:46.197539 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:46.410249 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Object Instance<03f1821a-592e-4e02-b609-74f3d7e69b53> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:02:46.410694 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lazy-loading 'keypairs' on Instance uuid 03f1821a-592e-4e02-b609-74f3d7e69b53 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:46.516107 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bcb9d152-2903-4831-abb9-5d50686a5ca0 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:02:46.516316 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-bcb9d152-2903-4831-abb9-5d50686a5ca0 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:02:46.621057 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0e46913f-555b-496f-9f46-efabc6a7485f tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.273s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:46.700759 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lazy-loading 'flavor' on Instance uuid 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:46.913333 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Object Instance<03f1821a-592e-4e02-b609-74f3d7e69b53> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:02:46.915855 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:47.020078 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-bcb9d152-2903-4831-abb9-5d50686a5ca0 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:02:47.027670 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Creating config drive at /opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/disk.config
May 28 01:02:47.031865 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8qwth76b {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:47.081215 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8qwth76b" returned: 0 in 0.049s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:47.133034 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Rescuing
May 28 01:02:47.133270 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "refresh_cache-0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:02:47.133350 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquired lock "refresh_cache-0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:02:47.133470 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:02:47.499855 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:47.532388 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:47.620109 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:47.636700 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:47.713599 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:47.785244 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-02788cef-42f7-4b0e-99fc-6abbd4d47337 req-13d3f162-b750-4b0e-9801-f7fc7a1ef9de service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Received event network-vif-plugged-95f81148-2a4e-4ca8-ad05-cb73d6f2951f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:47.793016 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-02788cef-42f7-4b0e-99fc-6abbd4d47337 req-13d3f162-b750-4b0e-9801-f7fc7a1ef9de service nova] Acquiring lock "03f1821a-592e-4e02-b609-74f3d7e69b53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:47.793612 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-02788cef-42f7-4b0e-99fc-6abbd4d47337 req-13d3f162-b750-4b0e-9801-f7fc7a1ef9de service nova] Lock "03f1821a-592e-4e02-b609-74f3d7e69b53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:47.793612 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-02788cef-42f7-4b0e-99fc-6abbd4d47337 req-13d3f162-b750-4b0e-9801-f7fc7a1ef9de service nova] Lock "03f1821a-592e-4e02-b609-74f3d7e69b53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:47.793612 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-02788cef-42f7-4b0e-99fc-6abbd4d47337 req-13d3f162-b750-4b0e-9801-f7fc7a1ef9de service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Processing event network-vif-plugged-95f81148-2a4e-4ca8-ad05-cb73d6f2951f {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:02:47.864412 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:47.871835 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:47.914333 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:47.959890 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:48.038159 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bcb9d152-2903-4831-abb9-5d50686a5ca0 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.680s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:48.041646 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a3bc7dbc-850a-4611-a79c-1b930657a08e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.243s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:48.107998 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0007856450001781923 future=<Future at 0x7c984c69fad0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:48.108110 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:48.108221 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=8.625998364000225 future=<Future at 0x7c984c7d6ff0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:48.108295 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=8.625912554000024 future=<Future at 0x7c984c7d6ff0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:48.108992 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Emitting event <LifecycleEvent: 1779930153.106411, b73b73f0-79a5-448c-a374-bbb182da41a9 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:02:48.109180 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] VM Stopped (Lifecycle Event)
May 28 01:02:48.130946 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Updating instance_info_cache with network_info: [{"id": "165b2ee7-8c11-422b-ad45-9cc83cfea68c", "address": "fa:16:3e:71:99:0d", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap165b2ee7-8c", "ovs_interfaceid": "165b2ee7-8c11-422b-ad45-9cc83cfea68c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:02:48.202450 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:48.329333 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930168.3289666, 03f1821a-592e-4e02-b609-74f3d7e69b53 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:02:48.329491 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] VM Started (Lifecycle Event)
May 28 01:02:48.330825 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:02:48.334576 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:02:48.336193 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Instance spawned successfully.
May 28 01:02:48.617317 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-5bb458df-382a-4733-895c-0b73f69f7082 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: b73b73f0-79a5-448c-a374-bbb182da41a9] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:48.633597 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Releasing lock "refresh_cache-0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:02:48.699750 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:48.736345 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-bcb9d152-2903-4831-abb9-5d50686a5ca0 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Deleted allocation for migration 051a43ee-49af-4137-bc6b-3c98b0d50969
May 28 01:02:48.786282 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Acquiring lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:48.788407 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:48.788407 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Attaching volume 37b25d6b-f126-4563-a58f-8b4a23c52397 to /dev/vdb
May 28 01:02:48.827670 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:02:48.832129 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:48.834507 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:02:48.837029 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a3bc7dbc-850a-4611-a79c-1b930657a08e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:02:48.837029 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a3bc7dbc-850a-4611-a79c-1b930657a08e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:02:48.844668 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:02:48.867492 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:48.869471 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:48.912590 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:02:48.912714 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:02:48.921749 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:02:48.923362 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe75:1c46', 'fe80::8c3:73ff:fe68:9ea1', 'fe80::fc16:3eff:fef0:246e', 'fe80::fc16:3eff:feca:a831', 'fe80::fc16:3eff:fe12:3f51', 'fe80::64e0:a4ff:fe34:ffd6', 'fe80::fc16:3eff:fe28:5665', 'fe80::fc16:3eff:fe6e:a824', 'fe80::1457:8aff:feb2:8bfb', 'fe80::fc16:3eff:fe11:792b', 'fe80::94c0:c3ff:fe67:958f', 'fe80::fc16:3eff:fef8:bee0', 'fe80::e873:f8ff:fed0:1522', 'fe80::fc16:3eff:fe2e:7bc9', 'fe80::3834:39ff:fe20:36ec', 'fe80::fc16:3eff:fee7:febd', 'fe80::fc16:3eff:fe71:990d', 'fe80::fc16:3eff:fe5e:ef9c', 'fe80::6cd5:f5ff:fe52:2a3e'] 
May 28 01:02:48.923495 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:02:48.923647 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:02:48.923866 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:02:48.924091 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Updating existing volume attachment record: 3197831c-5e41-465c-b149-3218e2713f43 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:02:49.211885 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01cb0a90-f421-40c9-8ea1-cd332effedd2 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "03f1821a-592e-4e02-b609-74f3d7e69b53" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 30.719s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:49.241189 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bcb9d152-2903-4831-abb9-5d50686a5ca0 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "04880ef4-5eee-4221-ad42-29788eb26358" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 7.062s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:49.339377 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930169.3390827, 03f1821a-592e-4e02-b609-74f3d7e69b53 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:02:49.339493 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] VM Paused (Lifecycle Event)
May 28 01:02:49.340973 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a3bc7dbc-850a-4611-a79c-1b930657a08e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:02:49.481379 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:02:49.481515 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37b25d6b-f126-4563-a58f-8b4a23c52397', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:02:49.483074 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:02:49.483074 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:02:49.483074 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37b25d6b-f126-4563-a58f-8b4a23c52397', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:02:49.494822 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:02:49.495480 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:02:49.496074 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:02:49.496274 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:02:49.496639 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:02:49.496817 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:02:49.516607 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:02:49.516607 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:49.527057 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:02:49.527057 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:49.536965 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397] added
May 28 01:02:49.536965 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:02:49.536965 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:02:49.536965 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:02:49.536965 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:02:49.536965 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:02:49.536965 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:49.537173 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:02:49.537253 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0404(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:02:49.537376 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:02:49.544970 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397] added
May 28 01:02:49.544970 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:02:49.544970 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:02:49.544970 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:02:49.544970 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:02:49.544970 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:02:49.544970 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:49.545211 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:02:49.545423 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.049(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:02:49.545423 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:02:49.842472 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:49.844112 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930169.84391, 03f1821a-592e-4e02-b609-74f3d7e69b53 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:02:49.844230 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] VM Resumed (Lifecycle Event)
May 28 01:02:49.847132 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a3bc7dbc-850a-4611-a79c-1b930657a08e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.806s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:49.857757 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a20ab79b-04be-4b2a-9e1b-3bfa79f1902e req-1c44c2c2-e05e-475d-b367-c87cb2e9c493 service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Received event network-vif-plugged-95f81148-2a4e-4ca8-ad05-cb73d6f2951f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:49.857904 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a20ab79b-04be-4b2a-9e1b-3bfa79f1902e req-1c44c2c2-e05e-475d-b367-c87cb2e9c493 service nova] Acquiring lock "03f1821a-592e-4e02-b609-74f3d7e69b53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:49.858096 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a20ab79b-04be-4b2a-9e1b-3bfa79f1902e req-1c44c2c2-e05e-475d-b367-c87cb2e9c493 service nova] Lock "03f1821a-592e-4e02-b609-74f3d7e69b53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:49.858186 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a20ab79b-04be-4b2a-9e1b-3bfa79f1902e req-1c44c2c2-e05e-475d-b367-c87cb2e9c493 service nova] Lock "03f1821a-592e-4e02-b609-74f3d7e69b53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:49.858312 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a20ab79b-04be-4b2a-9e1b-3bfa79f1902e req-1c44c2c2-e05e-475d-b367-c87cb2e9c493 service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] No waiting events found dispatching network-vif-plugged-95f81148-2a4e-4ca8-ad05-cb73d6f2951f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:02:49.858424 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-a20ab79b-04be-4b2a-9e1b-3bfa79f1902e req-1c44c2c2-e05e-475d-b367-c87cb2e9c493 service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Received unexpected event network-vif-plugged-95f81148-2a4e-4ca8-ad05-cb73d6f2951f for instance with vm_state active and task_state None.
May 28 01:02:49.905593 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-a3bc7dbc-850a-4611-a79c-1b930657a08e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Deleted allocations for instance e2cc3304-bf2b-4196-b6c8-8ad56da19af4
May 28 01:02:50.221199 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-67790162-6b44-470b-b0c8-f259e0667ead req-1e788310-3f2c-4e5d-9dd4-240b46d2c37e service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Received event network-changed-3ed3d348-6b93-4492-9c18-7b0eecc6454a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:50.224053 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-67790162-6b44-470b-b0c8-f259e0667ead req-1e788310-3f2c-4e5d-9dd4-240b46d2c37e service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Refreshing instance network info cache due to event network-changed-3ed3d348-6b93-4492-9c18-7b0eecc6454a. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:02:50.224053 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-67790162-6b44-470b-b0c8-f259e0667ead req-1e788310-3f2c-4e5d-9dd4-240b46d2c37e service nova] Acquiring lock "refresh_cache-d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:02:50.224053 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-67790162-6b44-470b-b0c8-f259e0667ead req-1e788310-3f2c-4e5d-9dd4-240b46d2c37e service nova] Acquired lock "refresh_cache-d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:02:50.224053 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-67790162-6b44-470b-b0c8-f259e0667ead req-1e788310-3f2c-4e5d-9dd4-240b46d2c37e service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Refreshing network info cache for port 3ed3d348-6b93-4492-9c18-7b0eecc6454a {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:02:50.316240 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:50.322159 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:50.344464 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:50.346750 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:50.350346 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:02:50.477773 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:50.484618 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-41fad5f8-1bfd-47f1-80c9-b2b2ffbd51fe req-844bdb19-b13c-4a9e-b44f-2e0c4f574c93 service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Received event network-vif-unplugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:50.485408 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:50.486496 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-41fad5f8-1bfd-47f1-80c9-b2b2ffbd51fe req-844bdb19-b13c-4a9e-b44f-2e0c4f574c93 service nova] Acquiring lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:50.486496 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-41fad5f8-1bfd-47f1-80c9-b2b2ffbd51fe req-844bdb19-b13c-4a9e-b44f-2e0c4f574c93 service nova] Lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:50.486496 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-41fad5f8-1bfd-47f1-80c9-b2b2ffbd51fe req-844bdb19-b13c-4a9e-b44f-2e0c4f574c93 service nova] Lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:50.486496 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-41fad5f8-1bfd-47f1-80c9-b2b2ffbd51fe req-844bdb19-b13c-4a9e-b44f-2e0c4f574c93 service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] No waiting events found dispatching network-vif-unplugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:02:50.486496 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-41fad5f8-1bfd-47f1-80c9-b2b2ffbd51fe req-844bdb19-b13c-4a9e-b44f-2e0c4f574c93 service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Received unexpected event network-vif-unplugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c for instance with vm_state active and task_state rescuing.
May 28 01:02:50.537770 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:02:50.545859 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:02:50.549985 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:02:50.549985 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:02:50.560563 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:02:50.560563 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:50.569923 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:50.576736 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:50.588160 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:50.588160 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:50.588160 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:50.588160 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:50.588160 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:50.588160 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:50.588160 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:50.588160 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:50.588160 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:50.588160 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:50.588160 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:02:50.588527 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:50.588527 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:50.588527 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:50.588527 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:50.588527 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:50.588527 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:50.588527 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:50.588527 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:50.588527 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:50.588527 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:50.588527 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:02:50.600518 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:50.600518 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:50.600518 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:50.600518 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:50.600518 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:50.600518 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:50.600518 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:50.600518 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:50.600518 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:50.600518 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:50.600518 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:02:50.600843 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:50.600843 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:50.600843 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:50.600843 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:50.600843 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:50.600843 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:50.600843 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:50.600843 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:50.600843 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:50.600843 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:50.600843 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:02:50.609227 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Instance destroyed successfully.
May 28 01:02:50.609761 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lazy-loading 'numa_topology' on Instance uuid 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:50.648896 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397, portal: 192.168.40.100,3260]
May 28 01:02:50.648896 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397, portal: 192.168.40.100,3260] successful.
May 28 01:02:50.648896 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:50.662863 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:50.681366 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:50.681366 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:50.681366 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:50.681366 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:50.681366 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:50.681366 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:50.681366 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:50.681366 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:50.681366 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:50.681366 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:50.681366 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:02:50.681366 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:02:50.681973 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:50.681973 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:50.681973 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:50.681973 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:50.681973 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:50.681973 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:50.681973 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:50.681973 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:50.681973 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:50.681973 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:50.681973 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:02:50.681973 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:02:50.681973 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.186s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:02:50.681973 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:02:50.682919 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] HCTL ('13', '-', '-', 0) found on session 66 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:02:50.683010 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:02:50.696321 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Searching for a device in session 66 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:02:50.696321 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37b25d6b-f126-4563-a58f-8b4a23c52397', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:02:50.728646 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-67790162-6b44-470b-b0c8-f259e0667ead req-1e788310-3f2c-4e5d-9dd4-240b46d2c37e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:50.851675 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999722151999777 future=<Future at 0x7c984c5103e0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:50.913280 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a3bc7dbc-850a-4611-a79c-1b930657a08e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "e2cc3304-bf2b-4196-b6c8-8ad56da19af4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.099s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:50.993628 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-67790162-6b44-470b-b0c8-f259e0667ead req-1e788310-3f2c-4e5d-9dd4-240b46d2c37e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:51.108885 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:51.118199 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Attempting a stable device rescue
May 28 01:02:51.128382 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-67790162-6b44-470b-b0c8-f259e0667ead req-1e788310-3f2c-4e5d-9dd4-240b46d2c37e service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Updated VIF entry in instance network info cache for port 3ed3d348-6b93-4492-9c18-7b0eecc6454a. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:02:51.128703 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-67790162-6b44-470b-b0c8-f259e0667ead req-1e788310-3f2c-4e5d-9dd4-240b46d2c37e service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Updating instance_info_cache with network_info: [{"id": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "address": "fa:16:3e:28:56:65", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3d348-6b", "ovs_interfaceid": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:02:51.225292 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98319) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 28 01:02:51.229778 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Instance directory exists: not creating {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 01:02:51.229999 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Creating image(s)
May 28 01:02:51.230634 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "/opt/stack/data/nova/instances/0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:51.230823 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "/opt/stack/data/nova/instances/0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:51.231662 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "/opt/stack/data/nova/instances/0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:51.231875 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:51.633249 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-67790162-6b44-470b-b0c8-f259e0667ead req-1e788310-3f2c-4e5d-9dd4-240b46d2c37e service nova] Releasing lock "refresh_cache-d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:02:51.652090 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397, portal: 192.168.50.100,3260]
May 28 01:02:51.652090 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397, portal: 192.168.50.100,3260] successful.
May 28 01:02:51.652090 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:51.665051 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:51.686073 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:51.686073 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:51.686073 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:51.686073 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:51.686073 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:51.686073 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:51.686073 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:51.686073 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:51.686073 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:51.686073 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:51.686073 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:02:51.686073 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:02:51.686073 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:02:51.686347 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:51.686347 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:51.686347 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:51.686347 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:51.686347 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:51.686347 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:51.686347 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:51.686347 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:51.686347 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:51.686347 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:51.686347 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:02:51.686347 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:02:51.686347 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:02:51.687019 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.190s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:02:51.687019 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:02:51.687689 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] HCTL ('14', '-', '-', 0) found on session 67 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:02:51.687819 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:02:51.700421 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Searching for a device in session 67 and hctl ['14', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:02:51.734385 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Object Instance<0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:02:51.734628 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "664f120750dd9326fd05123f16c121d316424b59" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:51.735014 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "664f120750dd9326fd05123f16c121d316424b59" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:52.283371 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-70f7d464-11ce-4194-81de-b290507a34ea req-607c0d12-dc11-40cd-a354-db265a2e008a service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Received event network-changed-d80f49b7-bd41-46df-9743-8ad514696557 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:52.283726 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-70f7d464-11ce-4194-81de-b290507a34ea req-607c0d12-dc11-40cd-a354-db265a2e008a service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Refreshing instance network info cache due to event network-changed-d80f49b7-bd41-46df-9743-8ad514696557. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:02:52.283726 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-70f7d464-11ce-4194-81de-b290507a34ea req-607c0d12-dc11-40cd-a354-db265a2e008a service nova] Acquiring lock "refresh_cache-04880ef4-5eee-4221-ad42-29788eb26358" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:02:52.283726 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-70f7d464-11ce-4194-81de-b290507a34ea req-607c0d12-dc11-40cd-a354-db265a2e008a service nova] Acquired lock "refresh_cache-04880ef4-5eee-4221-ad42-29788eb26358" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:02:52.283805 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-70f7d464-11ce-4194-81de-b290507a34ea req-607c0d12-dc11-40cd-a354-db265a2e008a service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Refreshing network info cache for port d80f49b7-bd41-46df-9743-8ad514696557 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:02:52.322511 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:02:52.325088 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:02:52.325565 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/664f120750dd9326fd05123f16c121d316424b59.part --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:52.377668 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "a9122d01-9c31-48d3-ae6b-e2d6305fe8d7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:52.378114 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "a9122d01-9c31-48d3-ae6b-e2d6305fe8d7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:52.414601 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/664f120750dd9326fd05123f16c121d316424b59.part --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:52.414908 np0000001577 nova-compute[98319]: DEBUG nova.virt.images [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] adbdd453-4bff-49cd-98b8-e9728c78f78d was qcow2, converting to raw {{(pid=98319) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 01:02:52.415511 np0000001577 nova-compute[98319]: DEBUG nova.privsep.utils [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 01:02:52.415779 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/664f120750dd9326fd05123f16c121d316424b59.part /opt/stack/data/nova/instances/_base/664f120750dd9326fd05123f16c121d316424b59.converted {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:52.490971 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/664f120750dd9326fd05123f16c121d316424b59.part /opt/stack/data/nova/instances/_base/664f120750dd9326fd05123f16c121d316424b59.converted" returned: 0 in 0.075s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:52.496145 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/664f120750dd9326fd05123f16c121d316424b59.converted --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:52.544696 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e1807c63-4bba-4c57-a1f2-1d4643f33fd8 req-6631933d-97a7-45a2-bdcc-ed80015d5088 service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Received event network-vif-unplugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:52.544696 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e1807c63-4bba-4c57-a1f2-1d4643f33fd8 req-6631933d-97a7-45a2-bdcc-ed80015d5088 service nova] Acquiring lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:52.544696 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e1807c63-4bba-4c57-a1f2-1d4643f33fd8 req-6631933d-97a7-45a2-bdcc-ed80015d5088 service nova] Lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:52.544696 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e1807c63-4bba-4c57-a1f2-1d4643f33fd8 req-6631933d-97a7-45a2-bdcc-ed80015d5088 service nova] Lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:52.544696 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e1807c63-4bba-4c57-a1f2-1d4643f33fd8 req-6631933d-97a7-45a2-bdcc-ed80015d5088 service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] No waiting events found dispatching network-vif-unplugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:02:52.544696 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-e1807c63-4bba-4c57-a1f2-1d4643f33fd8 req-6631933d-97a7-45a2-bdcc-ed80015d5088 service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Received unexpected event network-vif-unplugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c for instance with vm_state active and task_state rescuing.
May 28 01:02:52.594069 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/664f120750dd9326fd05123f16c121d316424b59.converted --force-share --output=json" returned: 0 in 0.098s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:52.594763 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "664f120750dd9326fd05123f16c121d316424b59" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.860s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:52.595262 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:02:52.598637 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:02:52.599494 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "664f120750dd9326fd05123f16c121d316424b59" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:52.599885 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "664f120750dd9326fd05123f16c121d316424b59" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:52.600143 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:02:52.602919 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:02:52.603304 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/664f120750dd9326fd05123f16c121d316424b59 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:52.699777 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/664f120750dd9326fd05123f16c121d316424b59 --force-share --output=json" returned: 0 in 0.096s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:52.701568 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/664f120750dd9326fd05123f16c121d316424b59,backing_fmt=raw /opt/stack/data/nova/instances/0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c/disk.rescue {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:52.714568 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Searching for a device in session 67 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:02:52.714568 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '37b25d6b-f126-4563-a58f-8b4a23c52397', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:02:52.747052 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/664f120750dd9326fd05123f16c121d316424b59,backing_fmt=raw /opt/stack/data/nova/instances/0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c/disk.rescue" returned: 0 in 0.047s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:52.747359 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "664f120750dd9326fd05123f16c121d316424b59" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.147s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:52.747754 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lazy-loading 'migration_context' on Instance uuid 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:52.785918 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-70f7d464-11ce-4194-81de-b290507a34ea req-607c0d12-dc11-40cd-a354-db265a2e008a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:52.884571 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lazy-loading 'flavor' on Instance uuid a9122d01-9c31-48d3-ae6b-e2d6305fe8d7 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:53.091541 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-70f7d464-11ce-4194-81de-b290507a34ea req-607c0d12-dc11-40cd-a354-db265a2e008a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:53.217109 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-70f7d464-11ce-4194-81de-b290507a34ea req-607c0d12-dc11-40cd-a354-db265a2e008a service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Updated VIF entry in instance network info cache for port d80f49b7-bd41-46df-9743-8ad514696557. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:02:53.217368 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-70f7d464-11ce-4194-81de-b290507a34ea req-607c0d12-dc11-40cd-a354-db265a2e008a service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Updating instance_info_cache with network_info: [{"id": "d80f49b7-bd41-46df-9743-8ad514696557", "address": "fa:16:3e:e7:fe:bd", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80f49b7-bd", "ovs_interfaceid": "d80f49b7-bd41-46df-9743-8ad514696557", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:02:53.250881 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Object Instance<0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:02:53.251129 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:02:53.251712 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Start _get_guest_xml network_info=[{"id": "165b2ee7-8c11-422b-ad45-9cc83cfea68c", "address": "fa:16:3e:71:99:0d", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "vif_mac": "fa:16:3e:71:99:0d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap165b2ee7-8c", "ovs_interfaceid": "165b2ee7-8c11-422b-ad45-9cc83cfea68c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'adbdd453-4bff-49cd-98b8-e9728c78f78d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '773fdc14-869d-4cd3-b671-b799bcc94e1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, 'status': 'reserved', 'instance': '0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c', 'attached_at': '', 'detached_at': '', 'volume_id': '773fdc14-869d-4cd3-b671-b799bcc94e1f', 'serial': '773fdc14-869d-4cd3-b671-b799bcc94e1f'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '9e485867-8f11-4525-bdc8-00112761c137', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:02:53.251858 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lazy-loading 'resources' on Instance uuid 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:53.387598 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Ignoring supplied device name: /dev/vdb
May 28 01:02:53.535389 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Found WWN 1StorPooliSCSI_DISK_1034578903445798985 for multipath device dm-5 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:02:53.535915 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.054s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:02:53.536351 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] <== connect_volume: return (4054ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798985', 'path': '/dev/dm-5', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445798985'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:02:53.536506 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798985', 'path': '/dev/dm-5', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445798985'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:02:53.546182 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lazy-loading 'flavor' on Instance uuid 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:53.719471 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-70f7d464-11ce-4194-81de-b290507a34ea req-607c0d12-dc11-40cd-a354-db265a2e008a service nova] Releasing lock "refresh_cache-04880ef4-5eee-4221-ad42-29788eb26358" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:02:53.753468 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Object Instance<0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:02:53.755360 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:02:53.756521 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-694763940', uuid='0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c'), owner=OwnerMeta(userid='fb6c20970bf0401190583f6348e00e4b', username='tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member', projectid='9e28acf25c4445ea969bd7bca3eac146', projectname='tempest-ServerBootFromVolumeStableRescueTest-568223226'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "165b2ee7-8c11-422b-ad45-9cc83cfea68c", "address": "fa:16:3e:71:99:0d", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "vif_mac": "fa:16:3e:71:99:0d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap165b2ee7-8c", "ovs_interfaceid": "165b2ee7-8c11-422b-ad45-9cc83cfea68c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930173.7561626) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:02:53.757369 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:02:53.757739 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:02:53.758425 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:02:53.758573 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:02:53.759350 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:02:53.759629 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:02:53.759759 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:02:53.759844 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:02:53.759970 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:02:53.760060 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:02:53.760144 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:02:53.760267 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:02:53.760366 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:02:53.760469 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:02:53.760622 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:02:53.760740 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:02:53.760885 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:53.859750 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "0ad69caa-c797-4e9d-96e3-7ad63523be49" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:53.860233 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "0ad69caa-c797-4e9d-96e3-7ad63523be49" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:53.867835 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:53.890021 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "a9122d01-9c31-48d3-ae6b-e2d6305fe8d7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:54.045248 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2e6c3c32-7184-4e16-975f-585998abdb23 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "090f8701-682e-4da8-bd51-e80aa1633d36" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:54.045403 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2e6c3c32-7184-4e16-975f-585998abdb23 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "090f8701-682e-4da8-bd51-e80aa1633d36" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:54.045524 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-2e6c3c32-7184-4e16-975f-585998abdb23 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:54.047477 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-2e6c3c32-7184-4e16-975f-585998abdb23 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98319) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 28 01:02:54.047899 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-2e6c3c32-7184-4e16-975f-585998abdb23 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lazy-loading 'flavor' on Instance uuid 090f8701-682e-4da8-bd51-e80aa1633d36 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:54.051619 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Attempting to attach volume 37b25d6b-f126-4563-a58f-8b4a23c52397 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:02:54.055692 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:02:54.055692 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:02:54.055692 np0000001577 nova-compute[98319]:   <alias name="ua-37b25d6b-f126-4563-a58f-8b4a23c52397"/>
May 28 01:02:54.055692 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-5"/>
May 28 01:02:54.055692 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:02:54.055692 np0000001577 nova-compute[98319]:   <serial>37b25d6b-f126-4563-a58f-8b4a23c52397</serial>
May 28 01:02:54.055692 np0000001577 nova-compute[98319]: </disk>
May 28 01:02:54.055692 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:02:54.262915 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Object Instance<0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:02:54.278919 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c/disk.config --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:54.362743 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:02:54.368322 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c/disk.config --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:02:54.368801 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "/opt/stack/data/nova/instances/0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:54.369375 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "/opt/stack/data/nova/instances/0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:54.369785 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "/opt/stack/data/nova/instances/0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:54.370262 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:02:54.370794 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '773fdc14-869d-4cd3-b671-b799bcc94e1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:02:54.371016 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:02:54.371496 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:02:54.371839 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '773fdc14-869d-4cd3-b671-b799bcc94e1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:02:54.386007 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:02:54.386611 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:02:54.387052 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:02:54.387292 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:02:54.387672 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:02:54.388013 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.startup = automatic
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.session.scan = manual
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:02:54.399987 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:02:54.399987 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.startup = automatic
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.session.scan = manual
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:02:54.410419 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:02:54.410419 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:54.417863 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:54.425738 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:54.445051 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:54.445051 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:54.445051 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:54.445051 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:54.445051 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:54.445051 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:54.445051 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:54.445051 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:54.445051 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:54.445051 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:54.445051 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:02:54.445051 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:02:54.445051 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:02:54.445439 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:54.445439 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:54.445439 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:54.445439 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:54.445439 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:54.445439 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:54.445439 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:54.445439 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:54.445439 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:54.445439 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:54.445439 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:02:54.445439 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:02:54.445439 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:02:54.445684 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.058s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:02:54.445760 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:02:54.447024 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] HCTL ('9', '0', '0', 0) found on session 62 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:02:54.447171 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Scanning host 9 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:02:54.455188 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:54.455188 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:54.455188 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:54.455188 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:54.455188 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:54.455188 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:54.455188 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:54.455188 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:54.455188 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:54.455188 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:54.455188 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:02:54.455188 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:02:54.455188 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:02:54.455561 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:54.455561 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:54.455561 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:54.455561 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:54.455561 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:54.455561 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:54.455561 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:54.455561 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:54.455561 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:54.455561 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:54.455561 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:02:54.455561 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:02:54.455561 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:02:54.455849 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.069s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:02:54.455849 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:02:54.456154 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Searching for a device in session 62 and hctl ('9', '0', '0', 0) yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:02:54.456292 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '773fdc14-869d-4cd3-b671-b799bcc94e1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:02:54.456971 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] HCTL ('10', '0', '0', 0) found on session 63 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:02:54.457224 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:02:54.470057 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Searching for a device in session 63 and hctl ('10', '0', '0', 0) yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:02:54.470193 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '773fdc14-869d-4cd3-b671-b799bcc94e1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:02:54.915467 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:54.915667 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:54.919517 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:02:54.919691 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Claim successful on node np0000001577
May 28 01:02:54.985269 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "a9122d01-9c31-48d3-ae6b-e2d6305fe8d7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:54.985379 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "a9122d01-9c31-48d3-ae6b-e2d6305fe8d7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:54.985565 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Attaching volume 7d1dca13-bb8b-459a-b99b-e1b6b24118a1 to /dev/vdb
May 28 01:02:55.017359 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:02:55.028445 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:02:55.046668 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:55.085116 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:02:55.087797 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:02:55.094774 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:02:55.096015 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe75:1c46', 'fe80::8c3:73ff:fe68:9ea1', 'fe80::fc16:3eff:fef0:246e', 'fe80::fc16:3eff:feca:a831', 'fe80::fc16:3eff:fe12:3f51', 'fe80::64e0:a4ff:fe34:ffd6', 'fe80::fc16:3eff:fe28:5665', 'fe80::fc16:3eff:fe6e:a824', 'fe80::1457:8aff:feb2:8bfb', 'fe80::fc16:3eff:fe11:792b', 'fe80::94c0:c3ff:fe67:958f', 'fe80::e873:f8ff:fed0:1522', 'fe80::fc16:3eff:fe2e:7bc9', 'fe80::3834:39ff:fe20:36ec', 'fe80::fc16:3eff:fee7:febd', 'fe80::fc16:3eff:fe5e:ef9c', 'fe80::6cd5:f5ff:fe52:2a3e'] 
May 28 01:02:55.096151 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:02:55.096276 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:02:55.096600 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] <== get_connector_properties: return (78ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:02:55.096867 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Updating existing volume attachment record: 29d30fb6-1d5e-4a14-980b-ca903e0d60d7 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:02:55.104981 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:55.125783 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:55.127809 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:55.164359 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:55.273108 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-963b66bf-da5e-4ec4-a9b9-e1b9c0e09946 req-68a7b510-edeb-42bf-856b-e16c5d056894 service nova] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Received event network-vif-unplugged-22ff5930-d13e-450c-9898-d435893e84ee {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:55.273108 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-963b66bf-da5e-4ec4-a9b9-e1b9c0e09946 req-68a7b510-edeb-42bf-856b-e16c5d056894 service nova] Acquiring lock "090f8701-682e-4da8-bd51-e80aa1633d36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:55.273467 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-963b66bf-da5e-4ec4-a9b9-e1b9c0e09946 req-68a7b510-edeb-42bf-856b-e16c5d056894 service nova] Lock "090f8701-682e-4da8-bd51-e80aa1633d36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:55.273467 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-963b66bf-da5e-4ec4-a9b9-e1b9c0e09946 req-68a7b510-edeb-42bf-856b-e16c5d056894 service nova] Lock "090f8701-682e-4da8-bd51-e80aa1633d36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:55.273568 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-963b66bf-da5e-4ec4-a9b9-e1b9c0e09946 req-68a7b510-edeb-42bf-856b-e16c5d056894 service nova] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] No waiting events found dispatching network-vif-unplugged-22ff5930-d13e-450c-9898-d435893e84ee {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:02:55.273784 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-963b66bf-da5e-4ec4-a9b9-e1b9c0e09946 req-68a7b510-edeb-42bf-856b-e16c5d056894 service nova] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Received unexpected event network-vif-unplugged-22ff5930-d13e-450c-9898-d435893e84ee for instance with vm_state active and task_state powering-off.
May 28 01:02:55.391412 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:02:55.405277 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999637094000263 future=<Future at 0x7c984c56aa20 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:55.406689 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Instance destroyed successfully.
May 28 01:02:55.409257 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-2e6c3c32-7184-4e16-975f-585998abdb23 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lazy-loading 'numa_topology' on Instance uuid 090f8701-682e-4da8-bd51-e80aa1633d36 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:55.676044 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:02:55.676419 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7d1dca13-bb8b-459a-b99b-e1b6b24118a1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:02:55.676730 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:02:55.708622 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:02:55.708622 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:02:55.708622 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:02:55.708622 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] No VIF found with MAC fa:16:3e:6e:a8:24, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:02:55.912320 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-2e6c3c32-7184-4e16-975f-585998abdb23 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Object Instance<090f8701-682e-4da8-bd51-e80aa1633d36> lazy-loaded attributes: flavor,numa_topology {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:02:55.912320 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-2e6c3c32-7184-4e16-975f-585998abdb23 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:56.111331 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:56.165789 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:02:56.406011 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Found WWN 3300000006800a6c7 for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:02:56.406343 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.035s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:02:56.406479 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] <== connect_volume: return (2035ms) {'type': 'block', 'scsi_wwn': '3300000006800a6c7', 'path': '/dev/dm-1', 'multipath_id': '3300000006800a6c7'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:02:56.406621 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006800a6c7', 'path': '/dev/dm-1', 'multipath_id': '3300000006800a6c7'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:02:56.407297 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.730s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:02:56.407297 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7d1dca13-bb8b-459a-b99b-e1b6b24118a1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:02:56.417534 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2e6c3c32-7184-4e16-975f-585998abdb23 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "090f8701-682e-4da8-bd51-e80aa1633d36" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.372s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:56.418724 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:02:56.419483 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:02:56.420458 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:02:56.420767 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:02:56.421391 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:02:56.421603 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:02:56.433176 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:02:56.433176 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:56.438991 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:02:56.438991 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:56.448280 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1] added
May 28 01:02:56.448280 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:02:56.448280 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:02:56.448280 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:02:56.448280 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:02:56.448280 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:02:56.448280 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:56.448460 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:02:56.448609 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0278(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:02:56.448754 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:02:56.451191 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1] added
May 28 01:02:56.451191 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:02:56.451191 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:02:56.451191 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:02:56.451191 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:02:56.451191 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:02:56.451191 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:56.451341 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:02:56.451488 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0299(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:02:56.451627 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:02:56.574943 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:02:56.575175 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:02:56.734621 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0003550679998625128 future=<Future at 0x7c984c7d6ff0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:56.734993 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Emitting event <LifecycleEvent: 1779930161.7341573, dccaa2b7-3c00-45f9-bf40-1a8a15030825 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:02:56.735113 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:56.735269 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] VM Stopped (Lifecycle Event)
May 28 01:02:56.736131 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=0.9418371189999561 future=<Future at 0x7c984c47f4d0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:56.736259 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=0.9417388760002723 future=<Future at 0x7c984c47f4d0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:56.918621 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:02:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-694763940',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serverbootfromvolumestablerescuetest-server-694763940',id=33,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:02:45Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e28acf25c4445ea969bd7bca3eac146',ramdisk_id='',reservation_id='r-c0ydlb5a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-568223226',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:02:46Z,user_data=None,user_id='fb6c20970bf0401190583f6348e00e4b',uuid=0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "165b2ee7-8c11-422b-ad45-9cc83cfea68c", "address": "fa:16:3e:71:99:0d", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "vif_mac": "fa:16:3e:71:99:0d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap165b2ee7-8c", "ovs_interfaceid": "165b2ee7-8c11-422b-ad45-9cc83cfea68c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:02:56.918822 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Converting VIF {"id": "165b2ee7-8c11-422b-ad45-9cc83cfea68c", "address": "fa:16:3e:71:99:0d", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "vif_mac": "fa:16:3e:71:99:0d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap165b2ee7-8c", "ovs_interfaceid": "165b2ee7-8c11-422b-ad45-9cc83cfea68c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:02:56.919326 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:99:0d,bridge_name='br-int',has_traffic_filtering=True,id=165b2ee7-8c11-422b-ad45-9cc83cfea68c,network=Network(c25f8563-bd10-4e42-b4ce-fd2164eca324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap165b2ee7-8c') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:02:56.919858 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lazy-loading 'pci_devices' on Instance uuid 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:57.078269 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:02:57.237906 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: dccaa2b7-3c00-45f9-bf40-1a8a15030825] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:57.247729 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e003324a-3928-42a4-908d-78a0980c2b5c tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.461s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:57.335040 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f77d8d46-ba60-442f-8e23-4ed7b8c7f92a req-6d40a876-96e4-48a9-bf60-105a32ec6e71 service nova] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Received event network-vif-unplugged-22ff5930-d13e-450c-9898-d435893e84ee {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:57.335562 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f77d8d46-ba60-442f-8e23-4ed7b8c7f92a req-6d40a876-96e4-48a9-bf60-105a32ec6e71 service nova] Acquiring lock "090f8701-682e-4da8-bd51-e80aa1633d36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:02:57.335700 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f77d8d46-ba60-442f-8e23-4ed7b8c7f92a req-6d40a876-96e4-48a9-bf60-105a32ec6e71 service nova] Lock "090f8701-682e-4da8-bd51-e80aa1633d36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:02:57.336033 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f77d8d46-ba60-442f-8e23-4ed7b8c7f92a req-6d40a876-96e4-48a9-bf60-105a32ec6e71 service nova] Lock "090f8701-682e-4da8-bd51-e80aa1633d36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:57.336169 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f77d8d46-ba60-442f-8e23-4ed7b8c7f92a req-6d40a876-96e4-48a9-bf60-105a32ec6e71 service nova] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] No waiting events found dispatching network-vif-unplugged-22ff5930-d13e-450c-9898-d435893e84ee {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:02:57.336275 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-f77d8d46-ba60-442f-8e23-4ed7b8c7f92a req-6d40a876-96e4-48a9-bf60-105a32ec6e71 service nova] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Received unexpected event network-vif-unplugged-22ff5930-d13e-450c-9898-d435893e84ee for instance with vm_state stopped and task_state None.
May 28 01:02:57.421768 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Object Instance<0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:02:57.423250 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] End _get_guest_xml xml=<domain type="qemu">
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:   <uuid>0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c</uuid>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:   <name>instance-00000021</name>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-694763940</nova:name>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:02:53</nova:creationTime>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:         <nova:user uuid="fb6c20970bf0401190583f6348e00e4b">tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member</nova:user>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:         <nova:project uuid="9e28acf25c4445ea969bd7bca3eac146">tempest-ServerBootFromVolumeStableRescueTest-568223226</nova:project>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:         <nova:port uuid="165b2ee7-8c11-422b-ad45-9cc83cfea68c">
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:     <system>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <entry name="serial">0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c</entry>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <entry name="uuid">0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c</entry>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:     </system>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:   <os>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:   </os>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:   <features>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:   </features>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:   <devices>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c/disk.config"/>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:     </disk>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <alias name="ua-773fdc14-869d-4cd3-b671-b799bcc94e1f"/>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-1"/>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <serial>773fdc14-869d-4cd3-b671-b799bcc94e1f</serial>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:     </disk>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c/disk.rescue"/>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <boot order="1"/>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:     </disk>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:71:99:0d"/>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <target dev="tap165b2ee7-8c"/>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:     </interface>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c/console.log" append="off"/>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:     </serial>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:     <video>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:     </video>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:     </rng>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:   </devices>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]: </domain>
May 28 01:02:57.423250 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:02:57.428172 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Instance destroyed successfully.
May 28 01:02:57.449128 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:02:57.452134 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:02:57.461662 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:02:57.461662 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:02:57.467562 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:02:57.467562 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:57.477647 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:57.484608 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:57.494968 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:57.494968 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:57.494968 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:57.494968 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:57.494968 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:57.494968 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:57.494968 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:57.494968 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:57.494968 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:57.494968 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:57.494968 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:02:57.494968 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:02:57.494968 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:02:57.495666 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:57.495666 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:57.495666 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:57.495666 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:57.495666 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:57.495666 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:57.495666 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:57.495666 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:57.495666 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:57.495666 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:57.495666 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:02:57.495666 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:02:57.495666 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:02:57.504744 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:57.504744 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:57.504744 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:57.504744 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:57.504744 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:57.504744 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:57.504744 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:57.504744 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:57.504744 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:57.504744 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:57.504744 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:02:57.504744 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:02:57.504744 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:02:57.505051 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:57.505051 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:57.505051 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:57.505051 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:57.505051 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:57.505051 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:57.505051 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:57.505051 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:57.505051 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:57.505051 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:57.505051 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:02:57.505051 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:02:57.505051 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:02:57.546903 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1, portal: 192.168.40.100,3260]
May 28 01:02:57.546903 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1, portal: 192.168.40.100,3260] successful.
May 28 01:02:57.546903 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:57.559566 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1, portal: 192.168.50.100,3260]
May 28 01:02:57.559566 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1, portal: 192.168.50.100,3260] successful.
May 28 01:02:57.559566 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:57.560195 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:57.571763 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:02:57.585499 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:57.585499 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:57.585499 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:57.585499 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:57.585499 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:57.585499 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:57.585499 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:57.585499 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:57.585499 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:57.585499 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:57.585499 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:02:57.585499 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:02:57.585499 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:02:57.585499 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:02:57.585499 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:02:57.585499 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:57.585499 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:57.585499 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:57.585499 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:57.585499 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:57.585499 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:57.585499 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:57.585499 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:57.585499 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:57.585499 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:57.585499 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:02:57.585499 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:02:57.585499 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:02:57.585499 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:02:57.585499 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:02:57.585499 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:02:57.585499 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:02:57.586619 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] HCTL ('17', '-', '-', 0) found on session 68 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:02:57.586619 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:02:57.588367 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.673s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:02:57.588933 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:02:57.596057 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:57.596057 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:57.596057 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:57.596057 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:57.596057 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:57.596057 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:57.596057 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:57.596057 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:57.596057 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:57.596057 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:57.596057 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:02:57.596057 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:02:57.596057 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:02:57.596057 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:02:57.596057 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:02:57.596450 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:57.596450 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:02:57.596450 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:57.596450 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:02:57.596450 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:57.596450 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:02:57.596450 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:57.596450 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:02:57.596450 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:57.596450 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:02:57.596450 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:02:57.596450 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:02:57.596450 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:02:57.596450 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:02:57.596450 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:02:57.596450 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:02:57.596935 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:02:57.598032 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] HCTL ('18', '-', '-', 0) found on session 69 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:02:57.598164 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:02:57.605989 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Searching for a device in session 68 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:02:57.605989 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7d1dca13-bb8b-459a-b99b-e1b6b24118a1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:02:57.612163 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Searching for a device in session 69 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:02:57.612163 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7d1dca13-bb8b-459a-b99b-e1b6b24118a1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:02:57.680712 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.002553136999722483 future=<Future at 0x7c984c47f4d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:57.681087 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Emitting event <LifecycleEvent: 1779930162.6778798, e2cc3304-bf2b-4196-b6c8-8ad56da19af4 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:02:57.681222 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] VM Stopped (Lifecycle Event)
May 28 01:02:57.682183 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:57.682355 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=8.16901186799987 future=<Future at 0x7c984c5103e0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:57.682462 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=8.168890260999888 future=<Future at 0x7c984c5103e0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:02:57.833093 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Rescuing
May 28 01:02:57.833292 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Acquiring lock "refresh_cache-5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:02:57.833378 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Acquired lock "refresh_cache-5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:02:57.833501 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:02:58.094690 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:02:58.094847 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:02:58.095161 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:58.095391 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:58.170973 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '84e218b589ef4968828db0c740eaa72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ee6b376bb14dffb5664085cca58288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:02:58.183493 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: e2cc3304-bf2b-4196-b6c8-8ad56da19af4] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:02:58.335423 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:58.420531 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:02:58.599392 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:02:58.615351 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Successfully created port: 99ce3f06-1207-4d71-a43a-4cd61a8ae36c {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:02:58.657729 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:58.783683 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Updating instance_info_cache with network_info: [{"id": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "address": "fa:16:3e:6e:a8:24", "network": {"id": "6403eebe-dcdf-49f8-8196-07e14e099cf4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-219519001-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8efd8caac5eb46ae9af16a2452ee0353", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d66a5a-b3", "ovs_interfaceid": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:02:58.870421 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:02:58.946299 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:02:58.946299 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:02:58.946299 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:02:58.946465 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] No VIF found with MAC fa:16:3e:71:99:0d, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:02:58.946921 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Using config drive
May 28 01:02:59.104991 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:02:59.125851 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Successfully updated port: 99ce3f06-1207-4d71-a43a-4cd61a8ae36c {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:02:59.166302 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-3743d8cf-9269-4778-87d2-fa23a26448ea req-ba3424fb-6254-4cc1-a679-221cf337ec8c service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Received event network-changed-99ce3f06-1207-4d71-a43a-4cd61a8ae36c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:02:59.166377 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-3743d8cf-9269-4778-87d2-fa23a26448ea req-ba3424fb-6254-4cc1-a679-221cf337ec8c service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Refreshing instance network info cache due to event network-changed-99ce3f06-1207-4d71-a43a-4cd61a8ae36c. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:02:59.166752 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3743d8cf-9269-4778-87d2-fa23a26448ea req-ba3424fb-6254-4cc1-a679-221cf337ec8c service nova] Acquiring lock "refresh_cache-0ad69caa-c797-4e9d-96e3-7ad63523be49" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:02:59.166828 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3743d8cf-9269-4778-87d2-fa23a26448ea req-ba3424fb-6254-4cc1-a679-221cf337ec8c service nova] Acquired lock "refresh_cache-0ad69caa-c797-4e9d-96e3-7ad63523be49" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:02:59.166936 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-3743d8cf-9269-4778-87d2-fa23a26448ea req-ba3424fb-6254-4cc1-a679-221cf337ec8c service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Refreshing network info cache for port 99ce3f06-1207-4d71-a43a-4cd61a8ae36c {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:02:59.285332 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Releasing lock "refresh_cache-5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:02:59.434736 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Found WWN 33000000004067b4b for multipath device dm-7 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:02:59.434984 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.028s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:02:59.435158 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] <== connect_volume: return (3758ms) {'type': 'block', 'scsi_wwn': '33000000004067b4b', 'path': '/dev/dm-7', 'multipath_id': '33000000004067b4b'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:02:59.435273 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000004067b4b', 'path': '/dev/dm-7', 'multipath_id': '33000000004067b4b'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:02:59.439713 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lazy-loading 'flavor' on Instance uuid a9122d01-9c31-48d3-ae6b-e2d6305fe8d7 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:59.452148 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lazy-loading 'ec2_ids' on Instance uuid 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:02:59.608917 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Booting with volume 48069396-3383-47de-ba84-d39b106a7dd3 at /dev/vda
May 28 01:02:59.626725 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "refresh_cache-0ad69caa-c797-4e9d-96e3-7ad63523be49" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:02:59.645306 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:02:59.654604 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:02:59.669980 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-3743d8cf-9269-4778-87d2-fa23a26448ea req-ba3424fb-6254-4cc1-a679-221cf337ec8c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:02:59.673908 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:02:59.712051 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:02:59.712364 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:02:59.719618 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:02:59.722329 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe75:1c46', 'fe80::8c3:73ff:fe68:9ea1', 'fe80::fc16:3eff:fef0:246e', 'fe80::fc16:3eff:feca:a831', 'fe80::fc16:3eff:fe12:3f51', 'fe80::64e0:a4ff:fe34:ffd6', 'fe80::fc16:3eff:fe28:5665', 'fe80::fc16:3eff:fe6e:a824', 'fe80::1457:8aff:feb2:8bfb', 'fe80::fc16:3eff:fe11:792b', 'fe80::94c0:c3ff:fe67:958f', 'fe80::fc16:3eff:fe2e:7bc9', 'fe80::3834:39ff:fe20:36ec', 'fe80::fc16:3eff:fee7:febd', 'fe80::fc16:3eff:fe5e:ef9c', 'fe80::6cd5:f5ff:fe52:2a3e'] 
May 28 01:02:59.722467 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:02:59.722630 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:02:59.722879 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] <== get_connector_properties: return (77ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:02:59.723147 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Updating existing volume attachment record: aa59f1ee-3913-487b-a470-020ca73e4aea {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:02:59.741526 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-3743d8cf-9269-4778-87d2-fa23a26448ea req-ba3424fb-6254-4cc1-a679-221cf337ec8c service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:02:59.884559 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-3743d8cf-9269-4778-87d2-fa23a26448ea req-ba3424fb-6254-4cc1-a679-221cf337ec8c service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:02:59.942572 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Attempting to attach volume 7d1dca13-bb8b-459a-b99b-e1b6b24118a1 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:02:59.944500 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:02:59.944500 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:02:59.944500 np0000001577 nova-compute[98319]:   <alias name="ua-7d1dca13-bb8b-459a-b99b-e1b6b24118a1"/>
May 28 01:02:59.944500 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-7"/>
May 28 01:02:59.944500 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:02:59.944500 np0000001577 nova-compute[98319]:   <serial>7d1dca13-bb8b-459a-b99b-e1b6b24118a1</serial>
May 28 01:02:59.944500 np0000001577 nova-compute[98319]: </disk>
May 28 01:02:59.944500 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:02:59.955742 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Object Instance<0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:02:59.955896 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lazy-loading 'keypairs' on Instance uuid 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:03:00.388816 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3743d8cf-9269-4778-87d2-fa23a26448ea req-ba3424fb-6254-4cc1-a679-221cf337ec8c service nova] Releasing lock "refresh_cache-0ad69caa-c797-4e9d-96e3-7ad63523be49" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:03:00.389207 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquired lock "refresh_cache-0ad69caa-c797-4e9d-96e3-7ad63523be49" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:03:00.390147 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:03:00.458463 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Object Instance<0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:03:00.460885 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:00.573653 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Creating config drive at /opt/stack/data/nova/instances/0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c/disk.config.rescue
May 28 01:03:00.576674 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpx1ihwvgt {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:00.628346 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpx1ihwvgt" returned: 0 in 0.051s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:00.906568 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:00.908048 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:00.942848 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:00.950017 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:00.970824 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:03:00.982015 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:00.982015 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:01.034606 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:01.073127 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:01.112558 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:01.117521 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "090f8701-682e-4da8-bd51-e80aa1633d36" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:01.117737 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "090f8701-682e-4da8-bd51-e80aa1633d36" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:01.117923 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "090f8701-682e-4da8-bd51-e80aa1633d36-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:01.118072 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "090f8701-682e-4da8-bd51-e80aa1633d36-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:01.118198 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "090f8701-682e-4da8-bd51-e80aa1633d36-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:01.121021 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Terminating instance
May 28 01:03:01.143610 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:01.173925 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:01.211251 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:01.224798 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e31d6a28-41e7-4488-a577-591813135b29 req-ce77fd40-47f1-4393-9794-df4dd0c727df service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Received event network-vif-unplugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:01.224798 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e31d6a28-41e7-4488-a577-591813135b29 req-ce77fd40-47f1-4393-9794-df4dd0c727df service nova] Acquiring lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:01.225512 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e31d6a28-41e7-4488-a577-591813135b29 req-ce77fd40-47f1-4393-9794-df4dd0c727df service nova] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:01.225851 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e31d6a28-41e7-4488-a577-591813135b29 req-ce77fd40-47f1-4393-9794-df4dd0c727df service nova] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:01.226009 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e31d6a28-41e7-4488-a577-591813135b29 req-ce77fd40-47f1-4393-9794-df4dd0c727df service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] No waiting events found dispatching network-vif-unplugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:03:01.226258 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:01.226447 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-e31d6a28-41e7-4488-a577-591813135b29 req-ce77fd40-47f1-4393-9794-df4dd0c727df service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Received unexpected event network-vif-unplugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 for instance with vm_state active and task_state rescuing.
May 28 01:03:01.260362 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999660044999928 future=<Future at 0x7c9870481dc0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:03:01.268751 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Instance destroyed successfully.
May 28 01:03:01.268751 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lazy-loading 'numa_topology' on Instance uuid 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:03:01.335731 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Updating instance_info_cache with network_info: [{"id": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "address": "fa:16:3e:2e:5f:00", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ce3f06-12", "ovs_interfaceid": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:03:01.596569 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:03:01.596696 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:03:01.596794 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:03:01.596884 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] No VIF found with MAC fa:16:3e:2e:7b:c9, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:03:01.624899 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:03:01.628563 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Instance destroyed successfully.
May 28 01:03:01.629030 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lazy-loading 'resources' on Instance uuid 090f8701-682e-4da8-bd51-e80aa1633d36 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:03:01.775596 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Attempting a stable device rescue
May 28 01:03:01.823564 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:03:01.823691 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:03:01.823853 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Creating image(s)
May 28 01:03:01.825012 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:03:01.825012 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Ensure instance console log exists: /opt/stack/data/nova/instances/0ad69caa-c797-4e9d-96e3-7ad63523be49/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:03:01.825012 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:01.825012 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:01.825012 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:01.838242 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Releasing lock "refresh_cache-0ad69caa-c797-4e9d-96e3-7ad63523be49" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:03:01.838523 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Instance network_info: |[{"id": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "address": "fa:16:3e:2e:5f:00", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ce3f06-12", "ovs_interfaceid": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:03:01.839305 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Start _get_guest_xml network_info=[{"id": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "address": "fa:16:3e:2e:5f:00", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ce3f06-12", "ovs_interfaceid": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '48069396-3383-47de-ba84-d39b106a7dd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '0ad69caa-c797-4e9d-96e3-7ad63523be49', 'attached_at': '', 'detached_at': '', 'volume_id': '48069396-3383-47de-ba84-d39b106a7dd3', 'serial': '48069396-3383-47de-ba84-d39b106a7dd3'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'aa59f1ee-3913-487b-a470-020ca73e4aea', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:03:01.843281 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:03:01.843689 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-126410006', uuid='0ad69caa-c797-4e9d-96e3-7ad63523be49'), owner=OwnerMeta(userid='84e218b589ef4968828db0c740eaa72b', username='tempest-ServerActionsTestOtherA-1279266727-project-member', projectid='73ee6b376bb14dffb5664085cca58288', projectname='tempest-ServerActionsTestOtherA-1279266727'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "address": "fa:16:3e:2e:5f:00", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ce3f06-12", "ovs_interfaceid": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930181.8433642) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:03:01.844718 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:03:01.845422 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:03:01.846009 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:03:01.846679 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:03:01.847239 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:03:01.847511 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:03:01.847653 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:03:01.847740 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:03:01.847865 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:03:01.847949 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:03:01.848059 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:03:01.848205 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:03:01.848316 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:03:01.848399 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:03:01.848493 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:03:01.848626 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:03:01.858397 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Removed pending STOPPED event for 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c due to new event <LifecycleEvent: 1779930181.8580544, 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c => Resumed> {{(pid=98319) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 01:03:01.858566 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930181.8580544, 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:03:01.858720 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] VM Resumed (Lifecycle Event)
May 28 01:03:01.860715 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-2c8878ad-1a3f-4e03-b5ff-bbcd2386ea27 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:01.863839 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:03:01.864829 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '48069396-3383-47de-ba84-d39b106a7dd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:03:01.864829 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:03:01.864829 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:03:01.864829 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '48069396-3383-47de-ba84-d39b106a7dd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:03:01.879827 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=98319) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 28 01:03:01.881291 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:03:01.881626 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:03:01.882268 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:03:01.884646 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:03:01.884646 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:03:01.884646 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:03:01.885335 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Instance directory exists: not creating {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 01:03:01.885504 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Creating image(s)
May 28 01:03:01.888947 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Acquiring lock "/opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:01.889140 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "/opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:01.889964 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "/opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:01.890404 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:03:01.897260 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:03:01.897260 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:01.903597 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:03:01.903597 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:01.911179 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3] added
May 28 01:03:01.911179 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:03:01.911179 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:03:01.911179 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:03:01.911179 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:03:01.911179 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:03:01.911179 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:01.912936 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:03:01.912936 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0291(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:03:01.912936 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:03:01.915338 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3] added
May 28 01:03:01.915338 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:03:01.915338 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:03:01.915338 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:03:01.915338 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:03:01.915338 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:03:01.915338 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:01.915507 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:03:01.917723 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0324(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:03:01.917723 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:03:02.132121 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:01:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-541658760',display_name='tempest-TestVolumeBootPattern-server-541658760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpattern-server-541658760',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTv25yrQ3s0TbPbCrDSd+GoI2f0UdDwk/W38CiCCv+YARRkBAVGf5UOJO55OoH9kSwt8i0m12+wHnB37bSw+YJd2DsVdqH3urR9C0DDH8CHMRoo1WH/IUKCEjEfwBV1qA==',key_name='tempest-keypair-1524072439',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:02:11Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='050f928f1ce449d6a447cd343dc4ff80',ramdisk_id='',reservation_id='r-zfwv86qe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1449742411',owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c803ddeaf4f4b3db07587419087b3b2',uuid=090f8701-682e-4da8-bd51-e80aa1633d36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "22ff5930-d13e-450c-9898-d435893e84ee", "address": "fa:16:3e:f8:be:e0", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ff5930-d1", "ovs_interfaceid": "22ff5930-d13e-450c-9898-d435893e84ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:03:02.133004 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converting VIF {"id": "22ff5930-d13e-450c-9898-d435893e84ee", "address": "fa:16:3e:f8:be:e0", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ff5930-d1", "ovs_interfaceid": "22ff5930-d13e-450c-9898-d435893e84ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:03:02.137688 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:be:e0,bridge_name='br-int',has_traffic_filtering=True,id=22ff5930-d13e-450c-9898-d435893e84ee,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22ff5930-d1') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:03:02.138118 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:be:e0,bridge_name='br-int',has_traffic_filtering=True,id=22ff5930-d13e-450c-9898-d435893e84ee,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22ff5930-d1') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:03:02.139747 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:02.139967 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22ff5930-d1, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:02.143539 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:03:02.148502 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:02.150563 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:02.150563 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e503e60-cc32-44e4-80e0-417cb51c5e8c) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:02.150858 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:02.151709 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:03:02.157409 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:02.159445 np0000001577 nova-compute[98319]: INFO os_vif [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:be:e0,bridge_name='br-int',has_traffic_filtering=True,id=22ff5930-d13e-450c-9898-d435893e84ee,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22ff5930-d1')
May 28 01:03:02.160777 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:03:02.161153 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd', 'iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cb4e4708-5c28-498f-ba26-71dd5596e0bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:03:02.161317 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:03:02.362864 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:02.367534 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:03:02.392383 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Object Instance<5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:03:02.393307 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Acquiring lock "e78eae1137e3d60302a9db0948f03dfbc16e8557" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:02.393412 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "e78eae1137e3d60302a9db0948f03dfbc16e8557" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:02.869719 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930182.869384, 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:03:02.870047 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] VM Started (Lifecycle Event)
May 28 01:03:02.914891 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:03:02.919652 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:03:02.929517 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:03:02.929517 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:03:02.943697 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:03:02.943697 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:02.954912 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:02.959153 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:02.983052 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:02.983052 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:02.983052 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:03:02.983052 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:03:02.983052 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:03:02.983052 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:03:02.983052 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:02.983052 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:02.983052 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:02.983052 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:02.983052 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:02.983052 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:02.983052 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:02.983052 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:02.983052 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:03:02.983517 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:02.983517 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:02.983517 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:03:02.983517 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:03:02.983517 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:03:02.983517 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:03:02.983517 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:02.983517 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:02.983517 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:02.983517 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:02.983517 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:02.983517 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:02.983517 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:02.983517 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:02.983517 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:03:02.990292 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:02.990292 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:02.990292 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:03:02.990292 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:03:02.990292 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:03:02.990292 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:03:02.990292 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:02.990292 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:02.990292 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:02.990292 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:02.990292 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:02.990292 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:02.990292 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:02.990292 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:02.990292 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:03:02.990650 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:02.990650 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:02.990650 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:03:02.990650 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:03:02.990650 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:03:02.990650 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:03:02.990650 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:02.990650 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:02.990650 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:02.990650 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:02.990650 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:02.990650 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:02.990650 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:02.990650 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:02.990650 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:03:03.057224 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3, portal: 192.168.50.100,3260]
May 28 01:03:03.057224 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3, portal: 192.168.50.100,3260] successful.
May 28 01:03:03.057224 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:03.063606 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3, portal: 192.168.40.100,3260]
May 28 01:03:03.063606 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3, portal: 192.168.40.100,3260] successful.
May 28 01:03:03.063606 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:03.072642 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:03.085143 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:03.096540 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:03.096540 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:03.096540 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:03:03.096540 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:03:03.096540 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:03:03.096540 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:03:03.096540 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:03.096540 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:03.096540 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:03.096540 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:03.096540 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:03.096540 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:03.096540 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:03.096540 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:03.096540 np0000001577 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:03.096540 np0000001577 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:03.096540 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:03:03.097278 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:03.097278 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:03.097278 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:03:03.097278 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:03:03.097278 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:03:03.097278 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:03:03.097278 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:03.097278 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:03.097278 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:03.097278 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:03.097278 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:03.097278 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:03.097278 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:03.097278 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:03.097278 np0000001577 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:03.097278 np0000001577 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:03.097278 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:03:03.100005 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.215s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:03:03.100005 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:03:03.103242 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] HCTL ('19', '-', '-', 0) found on session 70 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:03:03.103242 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:03:03.104322 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:03.104322 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:03.104322 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:03:03.104322 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:03:03.104322 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:03:03.104322 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:03:03.104322 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:03.104322 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:03.104322 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:03.104322 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:03.104322 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:03.104322 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:03.104322 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:03.104322 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:03.104322 np0000001577 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:03.104322 np0000001577 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:03.104322 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:03:03.105178 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:03.105178 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:03.105178 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:03:03.105178 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:03:03.105178 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:03:03.105178 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:03:03.105178 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:03.105178 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:03.105178 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:03.105178 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:03.105178 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:03.105178 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:03.105178 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:03.105178 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:03.105178 np0000001577 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:03.105178 np0000001577 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:03.105178 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:03:03.105178 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.223s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:03:03.105178 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:03:03.110864 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] HCTL ('20', '-', '-', 0) found on session 71 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:03:03.110864 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:03:03.120809 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Searching for a device in session 70 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:03:03.121690 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '48069396-3383-47de-ba84-d39b106a7dd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:03:03.132691 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Searching for a device in session 71 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:03:03.132691 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '48069396-3383-47de-ba84-d39b106a7dd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:03:03.144748 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3c0c9598-b1bb-4613-8986-ad781e990854 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "a9122d01-9c31-48d3-ae6b-e2d6305fe8d7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.159s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:03.316716 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-3731da3f-20bb-4e2f-8064-c5f6998e61bd tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Unrescuing
May 28 01:03:03.316996 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3731da3f-20bb-4e2f-8064-c5f6998e61bd tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "refresh_cache-0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:03:03.318012 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3731da3f-20bb-4e2f-8064-c5f6998e61bd tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquired lock "refresh_cache-0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:03:03.318012 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-3731da3f-20bb-4e2f-8064-c5f6998e61bd tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:03:03.325611 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:03:03.335312 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a1588388-1919-4b3e-9ae1-98ad0770b1de req-8bcc0395-526d-4411-834f-88d2e5c28000 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Received event network-vif-unplugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:03.335520 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a1588388-1919-4b3e-9ae1-98ad0770b1de req-8bcc0395-526d-4411-834f-88d2e5c28000 service nova] Acquiring lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:03.335855 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a1588388-1919-4b3e-9ae1-98ad0770b1de req-8bcc0395-526d-4411-834f-88d2e5c28000 service nova] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:03.343286 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:03:03.345783 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a1588388-1919-4b3e-9ae1-98ad0770b1de req-8bcc0395-526d-4411-834f-88d2e5c28000 service nova] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:03.345783 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a1588388-1919-4b3e-9ae1-98ad0770b1de req-8bcc0395-526d-4411-834f-88d2e5c28000 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] No waiting events found dispatching network-vif-unplugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:03:03.345783 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-a1588388-1919-4b3e-9ae1-98ad0770b1de req-8bcc0395-526d-4411-834f-88d2e5c28000 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Received unexpected event network-vif-unplugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 for instance with vm_state active and task_state rescuing.
May 28 01:03:03.346040 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e78eae1137e3d60302a9db0948f03dfbc16e8557.part --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:03.347225 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a1588388-1919-4b3e-9ae1-98ad0770b1de req-8bcc0395-526d-4411-834f-88d2e5c28000 service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Received event network-vif-plugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:03.347225 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a1588388-1919-4b3e-9ae1-98ad0770b1de req-8bcc0395-526d-4411-834f-88d2e5c28000 service nova] Acquiring lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:03.347225 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a1588388-1919-4b3e-9ae1-98ad0770b1de req-8bcc0395-526d-4411-834f-88d2e5c28000 service nova] Lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:03.347422 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a1588388-1919-4b3e-9ae1-98ad0770b1de req-8bcc0395-526d-4411-834f-88d2e5c28000 service nova] Lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:03.347472 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a1588388-1919-4b3e-9ae1-98ad0770b1de req-8bcc0395-526d-4411-834f-88d2e5c28000 service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] No waiting events found dispatching network-vif-plugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:03:03.349737 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-a1588388-1919-4b3e-9ae1-98ad0770b1de req-8bcc0395-526d-4411-834f-88d2e5c28000 service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Received unexpected event network-vif-plugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c for instance with vm_state rescued and task_state unrescuing.
May 28 01:03:03.349737 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a1588388-1919-4b3e-9ae1-98ad0770b1de req-8bcc0395-526d-4411-834f-88d2e5c28000 service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Received event network-vif-plugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:03.349737 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a1588388-1919-4b3e-9ae1-98ad0770b1de req-8bcc0395-526d-4411-834f-88d2e5c28000 service nova] Acquiring lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:03.349737 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a1588388-1919-4b3e-9ae1-98ad0770b1de req-8bcc0395-526d-4411-834f-88d2e5c28000 service nova] Lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:03.365575 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a1588388-1919-4b3e-9ae1-98ad0770b1de req-8bcc0395-526d-4411-834f-88d2e5c28000 service nova] Lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.016s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:03.365695 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a1588388-1919-4b3e-9ae1-98ad0770b1de req-8bcc0395-526d-4411-834f-88d2e5c28000 service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] No waiting events found dispatching network-vif-plugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:03:03.365893 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-a1588388-1919-4b3e-9ae1-98ad0770b1de req-8bcc0395-526d-4411-834f-88d2e5c28000 service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Received unexpected event network-vif-plugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c for instance with vm_state rescued and task_state unrescuing.
May 28 01:03:03.374504 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:03.379083 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:03:03.437356 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e78eae1137e3d60302a9db0948f03dfbc16e8557.part --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:03.438048 np0000001577 nova-compute[98319]: DEBUG nova.virt.images [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] f9fec437-d9c1-41e5-8338-e651ce2a1b5a was qcow2, converting to raw {{(pid=98319) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 01:03:03.439584 np0000001577 nova-compute[98319]: DEBUG nova.privsep.utils [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 01:03:03.439584 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e78eae1137e3d60302a9db0948f03dfbc16e8557.part /opt/stack/data/nova/instances/_base/e78eae1137e3d60302a9db0948f03dfbc16e8557.converted {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:03.591784 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e78eae1137e3d60302a9db0948f03dfbc16e8557.part /opt/stack/data/nova/instances/_base/e78eae1137e3d60302a9db0948f03dfbc16e8557.converted" returned: 0 in 0.152s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:03.607076 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e78eae1137e3d60302a9db0948f03dfbc16e8557.converted --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:03.699496 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e78eae1137e3d60302a9db0948f03dfbc16e8557.converted --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:03.700359 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "e78eae1137e3d60302a9db0948f03dfbc16e8557" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.307s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:03.700479 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:03:03.703163 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:03:03.704088 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Acquiring lock "e78eae1137e3d60302a9db0948f03dfbc16e8557" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:03.704437 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "e78eae1137e3d60302a9db0948f03dfbc16e8557" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:03.706566 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:03:03.706867 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:03:03.707154 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e78eae1137e3d60302a9db0948f03dfbc16e8557 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:03.791661 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e78eae1137e3d60302a9db0948f03dfbc16e8557 --force-share --output=json" returned: 0 in 0.084s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:03.792145 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e78eae1137e3d60302a9db0948f03dfbc16e8557,backing_fmt=raw /opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk.rescue {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:03.828135 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-3731da3f-20bb-4e2f-8064-c5f6998e61bd tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:03.848848 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e78eae1137e3d60302a9db0948f03dfbc16e8557,backing_fmt=raw /opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk.rescue" returned: 0 in 0.057s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:03.849340 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "e78eae1137e3d60302a9db0948f03dfbc16e8557" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.145s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:03.849675 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lazy-loading 'migration_context' on Instance uuid 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:03:03.883376 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:03:03.884783 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 28 01:03:04.127673 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-3731da3f-20bb-4e2f-8064-c5f6998e61bd tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:04.286167 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-3731da3f-20bb-4e2f-8064-c5f6998e61bd tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Updating instance_info_cache with network_info: [{"id": "165b2ee7-8c11-422b-ad45-9cc83cfea68c", "address": "fa:16:3e:71:99:0d", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap165b2ee7-8c", "ovs_interfaceid": "165b2ee7-8c11-422b-ad45-9cc83cfea68c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:03:04.352098 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Object Instance<5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:03:04.352347 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:03:04.355505 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Start _get_guest_xml network_info=[{"id": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "address": "fa:16:3e:6e:a8:24", "network": {"id": "6403eebe-dcdf-49f8-8196-07e14e099cf4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-219519001-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-219519001-network", "vif_mac": "fa:16:3e:6e:a8:24"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8efd8caac5eb46ae9af16a2452ee0353", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d66a5a-b3", "ovs_interfaceid": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f9fec437-d9c1-41e5-8338-e651ce2a1b5a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37b25d6b-f126-4563-a58f-8b4a23c52397', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, 'status': 'reserved', 'instance': '5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b', 'attached_at': '', 'detached_at': '', 'volume_id': '37b25d6b-f126-4563-a58f-8b4a23c52397', 'serial': '37b25d6b-f126-4563-a58f-8b4a23c52397'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '3197831c-5e41-465c-b149-3218e2713f43', 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:03:04.355505 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lazy-loading 'resources' on Instance uuid 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:03:04.789833 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3731da3f-20bb-4e2f-8064-c5f6998e61bd tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Releasing lock "refresh_cache-0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:03:04.789833 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-3731da3f-20bb-4e2f-8064-c5f6998e61bd tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lazy-loading 'flavor' on Instance uuid 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:03:04.856183 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Object Instance<5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:03:04.861005 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:03:04.862209 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-1176978347', uuid='5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b'), owner=OwnerMeta(userid='00466e4787894abe9c5b57f909d4bd80', username='tempest-ServerStableDeviceRescueTest-1831534173-project-member', projectid='8efd8caac5eb46ae9af16a2452ee0353', projectname='tempest-ServerStableDeviceRescueTest-1831534173'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "address": "fa:16:3e:6e:a8:24", "network": {"id": "6403eebe-dcdf-49f8-8196-07e14e099cf4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-219519001-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-219519001-network", "vif_mac": "fa:16:3e:6e:a8:24"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8efd8caac5eb46ae9af16a2452ee0353", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d66a5a-b3", "ovs_interfaceid": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930184.8618767) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:03:04.863505 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:03:04.863505 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:03:04.864285 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:03:04.864500 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:03:04.865176 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:03:04.865437 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:03:04.865628 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:03:04.865742 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:03:04.866068 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:03:04.866156 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:03:04.866252 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:03:04.866396 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:03:04.866491 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:03:04.866626 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:03:04.866726 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:03:04.866838 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:03:04.866958 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:03:04.899064 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Found WWN 33000000069cb9e3a for multipath device dm-8 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:03:04.899064 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:03:04.899064 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '33000000069cb9e3a', 'path': '/dev/dm-8', 'multipath_id': '33000000069cb9e3a'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:03:04.899064 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000069cb9e3a', 'path': '/dev/dm-8', 'multipath_id': '33000000069cb9e3a'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:03:04.901298 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.739s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:03:04.901298 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd', 'iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cb4e4708-5c28-498f-ba26-71dd5596e0bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:03:04.901298 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:03:04.932089 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:04.932089 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:04.932089 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:03:04.932089 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:03:04.932089 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:03:04.932089 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:03:04.932089 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:04.932089 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:04.932089 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:04.932089 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:04.932089 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:04.932089 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:04.932089 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:04.932089 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:04.932089 np0000001577 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:04.932089 np0000001577 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:04.932089 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:03:04.935614 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:04.935614 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:04.935614 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:03:04.935614 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:03:04.935614 np0000001577 nova-compute[98319]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:03:04.935614 np0000001577 nova-compute[98319]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd (non-flash)
May 28 01:03:04.935614 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:04.935614 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:04.935614 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:04.935614 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:04.935614 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:04.935614 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:04.935614 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:04.935614 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:04.935614 np0000001577 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:04.935614 np0000001577 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:04.935614 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:03:04.935614 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd', '60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd', '61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', '63'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c', '65'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', '71')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:03:04.935614 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd', '60')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:03:04.935614 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd', '61')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:03:04.935614 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c9870680540>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd'): ({'sdg'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:03:04.938958 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Removing multipathed devices sdb, sdg {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:03:04.939531 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Flush multipath device 3300000009fad0407 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:03:05.007100 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:03:05.049833 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:03:05.088520 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Checking to see if SCSI volumes sdb, sdg have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:03:05.088903 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] SCSI volumes sdb, sdg have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:03:05.091450 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Checking to see if device paths {'sdb', 'sdg'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:03:05.103185 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Device paths {'sdb', 'sdg'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:03:05.103185 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:03:05.115701 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:05.151647 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd, portal: 192.168.40.100,3260]
May 28 01:03:05.151647 np0000001577 nova-compute[98319]: Logout of [sid: 60, target: iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd, portal: 192.168.40.100,3260] successful.
May 28 01:03:05.151647 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:05.176327 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:05.189570 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:05.225696 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd, portal: 192.168.50.100,3260]
May 28 01:03:05.225696 np0000001577 nova-compute[98319]: Logout of [sid: 61, target: iqn.2023-03.storpool.com:os--volume-cb4e4708-5c28-498f-ba26-71dd5596e0bd, portal: 192.168.50.100,3260] successful.
May 28 01:03:05.225696 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:05.250011 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:05.251642 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:03:05.251642 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] <== disconnect_volume: return (3088ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:03:05.251642 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:03:05.251642 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Deleting instance files /opt/stack/data/nova/instances/090f8701-682e-4da8-bd51-e80aa1633d36_del
May 28 01:03:05.251642 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Deletion of /opt/stack/data/nova/instances/090f8701-682e-4da8-bd51-e80aa1633d36_del complete
May 28 01:03:05.337025 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:05.362782 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:05.371570 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Object Instance<5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:03:05.378586 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk.config --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:05.411445 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:02:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-126410006',display_name='tempest-ServerActionsTestOtherA-server-126410006',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serveractionstestothera-server-126410006',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOEhInnYH8OIPIS+AoDN91vRrTIl7emQTWVv1MQvwyvOos+qsDslhGKWhjOWQnKEu789RlRl8BiqEdHw4m/ZZapwhCdnQdK7FOovVNbbHnETkK3QhUrm9lcqluHt42QLQ==',key_name='tempest-keypair-1959255291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73ee6b376bb14dffb5664085cca58288',ramdisk_id='',reservation_id='r-m5d9fumv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1279266727',owner_user_name='tempest-ServerActionsTestOtherA-1279266727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84e218b589ef4968828db0c740eaa72b',uuid=0ad69caa-c797-4e9d-96e3-7ad63523be49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "address": "fa:16:3e:2e:5f:00", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ce3f06-12", "ovs_interfaceid": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:03:05.412155 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Converting VIF {"id": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "address": "fa:16:3e:2e:5f:00", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ce3f06-12", "ovs_interfaceid": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:03:05.413500 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:5f:00,bridge_name='br-int',has_traffic_filtering=True,id=99ce3f06-1207-4d71-a43a-4cd61a8ae36c,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99ce3f06-12') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:03:05.416287 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ad69caa-c797-4e9d-96e3-7ad63523be49 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:03:05.476051 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk.config --force-share --output=json" returned: 0 in 0.097s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:05.476883 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Acquiring lock "/opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:05.476883 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "/opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:05.477483 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "/opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:05.477483 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:03:05.477871 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37b25d6b-f126-4563-a58f-8b4a23c52397', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:03:05.478043 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:03:05.483648 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-76d89566-b924-45e4-8734-473c5ec108d1 req-9b6ea5f5-927f-4c3b-8eb1-286b8528a45b service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Received event network-vif-unplugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:05.484121 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76d89566-b924-45e4-8734-473c5ec108d1 req-9b6ea5f5-927f-4c3b-8eb1-286b8528a45b service nova] Acquiring lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:05.484355 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76d89566-b924-45e4-8734-473c5ec108d1 req-9b6ea5f5-927f-4c3b-8eb1-286b8528a45b service nova] Lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:05.484489 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76d89566-b924-45e4-8734-473c5ec108d1 req-9b6ea5f5-927f-4c3b-8eb1-286b8528a45b service nova] Lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:05.484815 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-76d89566-b924-45e4-8734-473c5ec108d1 req-9b6ea5f5-927f-4c3b-8eb1-286b8528a45b service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] No waiting events found dispatching network-vif-unplugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:03:05.485016 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-76d89566-b924-45e4-8734-473c5ec108d1 req-9b6ea5f5-927f-4c3b-8eb1-286b8528a45b service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Received unexpected event network-vif-unplugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c for instance with vm_state rescued and task_state unrescuing.
May 28 01:03:05.505611 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:05.516666 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:05.611659 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:05.626014 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:05.640407 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999730097000338 future=<Future at 0x7c984c5c9b50 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:03:05.642415 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Instance destroyed successfully.
May 28 01:03:05.642903 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-3731da3f-20bb-4e2f-8064-c5f6998e61bd tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lazy-loading 'numa_topology' on Instance uuid 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:03:05.758923 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Took 4.13 seconds to destroy the instance on the hypervisor.
May 28 01:03:05.759463 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:03:05.759697 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:03:05.759799 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:03:05.760154 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:05.813208 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:05.851762 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0003567170001588238 future=<Future at 0x7c984c5103e0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:03:05.851816 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:03:05.851914 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=4.552949076999994 future=<Future at 0x7c984c56aa20 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:03:05.852004 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=4.552858558000025 future=<Future at 0x7c984c56aa20 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:03:05.921543 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] End _get_guest_xml xml=<domain type="qemu">
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:   <uuid>0ad69caa-c797-4e9d-96e3-7ad63523be49</uuid>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:   <name>instance-00000022</name>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       <nova:name>tempest-ServerActionsTestOtherA-server-126410006</nova:name>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:03:01</nova:creationTime>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       <nova:image uuid="">
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:         <nova:user uuid="84e218b589ef4968828db0c740eaa72b">tempest-ServerActionsTestOtherA-1279266727-project-member</nova:user>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:         <nova:project uuid="73ee6b376bb14dffb5664085cca58288">tempest-ServerActionsTestOtherA-1279266727</nova:project>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:         <nova:port uuid="99ce3f06-1207-4d71-a43a-4cd61a8ae36c">
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:     <system>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       <entry name="serial">0ad69caa-c797-4e9d-96e3-7ad63523be49</entry>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       <entry name="uuid">0ad69caa-c797-4e9d-96e3-7ad63523be49</entry>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:     </system>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:   <os>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:   </os>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:   <features>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:   </features>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:   <devices>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/0ad69caa-c797-4e9d-96e3-7ad63523be49/disk.config"/>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:     </disk>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       <alias name="ua-48069396-3383-47de-ba84-d39b106a7dd3"/>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-8"/>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       <serial>48069396-3383-47de-ba84-d39b106a7dd3</serial>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:     </disk>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:2e:5f:00"/>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       <target dev="tap99ce3f06-12"/>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:     </interface>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/0ad69caa-c797-4e9d-96e3-7ad63523be49/console.log" append="off"/>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:     </serial>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:     <video>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:     </video>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:     </rng>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:   </devices>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]: </domain>
May 28 01:03:05.921543 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:03:05.923576 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Preparing to wait for external event network-vif-plugged-99ce3f06-1207-4d71-a43a-4cd61a8ae36c {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:03:05.923576 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "0ad69caa-c797-4e9d-96e3-7ad63523be49-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:05.923576 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "0ad69caa-c797-4e9d-96e3-7ad63523be49-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:05.923576 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "0ad69caa-c797-4e9d-96e3-7ad63523be49-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:05.923576 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:02:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-126410006',display_name='tempest-ServerActionsTestOtherA-server-126410006',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serveractionstestothera-server-126410006',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOEhInnYH8OIPIS+AoDN91vRrTIl7emQTWVv1MQvwyvOos+qsDslhGKWhjOWQnKEu789RlRl8BiqEdHw4m/ZZapwhCdnQdK7FOovVNbbHnETkK3QhUrm9lcqluHt42QLQ==',key_name='tempest-keypair-1959255291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73ee6b376bb14dffb5664085cca58288',ramdisk_id='',reservation_id='r-m5d9fumv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1279266727',owner_user_name='tempest-ServerActionsTestOtherA-1279266727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84e218b589ef4968828db0c740eaa72b',uuid=0ad69caa-c797-4e9d-96e3-7ad63523be49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "address": "fa:16:3e:2e:5f:00", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ce3f06-12", "ovs_interfaceid": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:03:05.923576 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Converting VIF {"id": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "address": "fa:16:3e:2e:5f:00", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ce3f06-12", "ovs_interfaceid": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:03:05.923576 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:5f:00,bridge_name='br-int',has_traffic_filtering=True,id=99ce3f06-1207-4d71-a43a-4cd61a8ae36c,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99ce3f06-12') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:03:05.923576 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:5f:00,bridge_name='br-int',has_traffic_filtering=True,id=99ce3f06-1207-4d71-a43a-4cd61a8ae36c,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99ce3f06-12') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:03:05.924592 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:05.924783 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:05.925012 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:03:05.926663 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:05.926818 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad3ee9de-f931-582c-8f47-06d23fafd404', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:05.928196 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:05.929167 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:03:05.939237 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:05.942264 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:05.942420 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99ce3f06-12, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:05.942765 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap99ce3f06-12, col_values=(('qos', UUID('664f870b-ec82-412f-9e53-6c7a830a7be1')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:05.942943 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap99ce3f06-12, col_values=(('external_ids', {'iface-id': '99ce3f06-1207-4d71-a43a-4cd61a8ae36c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:5f:00', 'vm-uuid': '0ad69caa-c797-4e9d-96e3-7ad63523be49'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:05.943647 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:05.944721 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:03:05.959181 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:05.960072 np0000001577 nova-compute[98319]: INFO os_vif [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:5f:00,bridge_name='br-int',has_traffic_filtering=True,id=99ce3f06-1207-4d71-a43a-4cd61a8ae36c,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99ce3f06-12')
May 28 01:03:06.115489 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:06.145454 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-3731da3f-20bb-4e2f-8064-c5f6998e61bd tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Object Instance<0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c> lazy-loaded attributes: flavor,numa_topology {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:03:06.263599 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f95da0ad-5e24-4a45-be6e-0b92c3e72a29 req-955e524f-f5c1-445c-9a40-aeec6cb3e7e6 service nova] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Received event network-vif-deleted-22ff5930-d13e-450c-9898-d435893e84ee {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:06.263964 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-f95da0ad-5e24-4a45-be6e-0b92c3e72a29 req-955e524f-f5c1-445c-9a40-aeec6cb3e7e6 service nova] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Neutron deleted interface 22ff5930-d13e-450c-9898-d435893e84ee; detaching it from the instance and deleting it from the info cache
May 28 01:03:06.265285 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f95da0ad-5e24-4a45-be6e-0b92c3e72a29 req-955e524f-f5c1-445c-9a40-aeec6cb3e7e6 service nova] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Detach interface failed, port_id=22ff5930-d13e-450c-9898-d435893e84ee, reason: Instance 090f8701-682e-4da8-bd51-e80aa1633d36 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:03:06.544265 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:06.581966 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:06.583962 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:06.654432 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:06.696051 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:06.706835 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:06.721238 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:03:07.224727 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Took 1.46 seconds to deallocate network for instance.
May 28 01:03:07.232165 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Removed pending STOPPED event for 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c due to new event <LifecycleEvent: 1779930187.2318337, 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c => Resumed> {{(pid=98319) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 01:03:07.232345 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930187.2318337, 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:03:07.232489 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] VM Resumed (Lifecycle Event)
May 28 01:03:07.234235 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-3731da3f-20bb-4e2f-8064-c5f6998e61bd tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:07.474608 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:03:07.474734 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:03:07.474830 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] No VIF found with MAC fa:16:3e:2e:5f:00, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:03:07.475676 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Using config drive
May 28 01:03:07.536782 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.058s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:03:07.536782 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37b25d6b-f126-4563-a58f-8b4a23c52397', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:03:07.542384 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b6dd6755-d908-4cc0-9a51-bc414470804b req-ecc33c51-ed2d-4c47-b833-36884f19e8ac service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Received event network-vif-unplugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:07.542384 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b6dd6755-d908-4cc0-9a51-bc414470804b req-ecc33c51-ed2d-4c47-b833-36884f19e8ac service nova] Acquiring lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:07.542384 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b6dd6755-d908-4cc0-9a51-bc414470804b req-ecc33c51-ed2d-4c47-b833-36884f19e8ac service nova] Lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:07.542384 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b6dd6755-d908-4cc0-9a51-bc414470804b req-ecc33c51-ed2d-4c47-b833-36884f19e8ac service nova] Lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:07.542384 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b6dd6755-d908-4cc0-9a51-bc414470804b req-ecc33c51-ed2d-4c47-b833-36884f19e8ac service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] No waiting events found dispatching network-vif-unplugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:03:07.542384 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-b6dd6755-d908-4cc0-9a51-bc414470804b req-ecc33c51-ed2d-4c47-b833-36884f19e8ac service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Received unexpected event network-vif-unplugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c for instance with vm_state active and task_state None.
May 28 01:03:07.542384 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b6dd6755-d908-4cc0-9a51-bc414470804b req-ecc33c51-ed2d-4c47-b833-36884f19e8ac service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Received event network-vif-plugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:07.542384 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b6dd6755-d908-4cc0-9a51-bc414470804b req-ecc33c51-ed2d-4c47-b833-36884f19e8ac service nova] Acquiring lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:07.544580 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b6dd6755-d908-4cc0-9a51-bc414470804b req-ecc33c51-ed2d-4c47-b833-36884f19e8ac service nova] Lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:07.544580 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b6dd6755-d908-4cc0-9a51-bc414470804b req-ecc33c51-ed2d-4c47-b833-36884f19e8ac service nova] Lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:07.544580 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b6dd6755-d908-4cc0-9a51-bc414470804b req-ecc33c51-ed2d-4c47-b833-36884f19e8ac service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] No waiting events found dispatching network-vif-plugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:03:07.544580 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-b6dd6755-d908-4cc0-9a51-bc414470804b req-ecc33c51-ed2d-4c47-b833-36884f19e8ac service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Received unexpected event network-vif-plugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c for instance with vm_state active and task_state None.
May 28 01:03:07.544961 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b6dd6755-d908-4cc0-9a51-bc414470804b req-ecc33c51-ed2d-4c47-b833-36884f19e8ac service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Received event network-vif-plugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:07.545623 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b6dd6755-d908-4cc0-9a51-bc414470804b req-ecc33c51-ed2d-4c47-b833-36884f19e8ac service nova] Acquiring lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:07.545623 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b6dd6755-d908-4cc0-9a51-bc414470804b req-ecc33c51-ed2d-4c47-b833-36884f19e8ac service nova] Lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:07.545903 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b6dd6755-d908-4cc0-9a51-bc414470804b req-ecc33c51-ed2d-4c47-b833-36884f19e8ac service nova] Lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:07.546592 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b6dd6755-d908-4cc0-9a51-bc414470804b req-ecc33c51-ed2d-4c47-b833-36884f19e8ac service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] No waiting events found dispatching network-vif-plugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:03:07.546592 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-b6dd6755-d908-4cc0-9a51-bc414470804b req-ecc33c51-ed2d-4c47-b833-36884f19e8ac service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Received unexpected event network-vif-plugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c for instance with vm_state active and task_state None.
May 28 01:03:07.547679 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:03:07.548306 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:03:07.548901 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:03:07.549419 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:03:07.550174 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:03:07.550416 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.startup = automatic
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.session.scan = manual
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:03:07.562709 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:03:07.562709 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.startup = automatic
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.session.scan = manual
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:03:07.568828 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:03:07.568828 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:07.574182 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:07.585642 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:07.593268 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:07.593268 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:07.593268 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:03:07.593268 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:03:07.593268 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:07.593268 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:07.593268 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:07.593268 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:07.593268 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:07.593268 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:07.593268 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:07.593268 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:07.593268 np0000001577 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:07.593268 np0000001577 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:07.593268 np0000001577 nova-compute[98319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c781f80e-facb-4944-be31-8b118e2e3381 (non-flash)
May 28 01:03:07.593268 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:03:07.593638 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:07.593638 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:07.593638 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:03:07.593638 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:03:07.593638 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:07.593638 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:07.593638 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:07.593638 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:07.593638 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:07.593638 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:07.593638 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:07.593638 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:07.593638 np0000001577 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:07.593638 np0000001577 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:07.593638 np0000001577 nova-compute[98319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c781f80e-facb-4944-be31-8b118e2e3381 (non-flash)
May 28 01:03:07.593638 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:03:07.593935 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.045s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:03:07.593935 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:03:07.594747 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] HCTL ('13', '0', '0', 0) found on session 66 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:03:07.594876 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Scanning host 13 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:03:07.604059 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Searching for a device in session 66 and hctl ('13', '0', '0', 0) yield: sdh {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:03:07.604162 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37b25d6b-f126-4563-a58f-8b4a23c52397', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:03:07.608703 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:07.608703 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:07.608703 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:03:07.608703 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:03:07.608703 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:07.608703 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:07.608703 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:07.608703 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:07.608703 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:07.608703 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:07.608703 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:07.608703 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:07.608703 np0000001577 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:07.608703 np0000001577 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:07.608703 np0000001577 nova-compute[98319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c781f80e-facb-4944-be31-8b118e2e3381 (non-flash)
May 28 01:03:07.608703 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:03:07.609242 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:07.609242 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:07.609242 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:03:07.609242 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:03:07.609242 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:07.609242 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:07.609242 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:07.609242 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:07.609242 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:07.609242 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:07.609242 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:07.609242 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:07.609242 np0000001577 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:07.609242 np0000001577 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:07.609242 np0000001577 nova-compute[98319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c781f80e-facb-4944-be31-8b118e2e3381 (non-flash)
May 28 01:03:07.609242 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:03:07.609242 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.060s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:03:07.609242 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:03:07.612489 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] HCTL ('14', '0', '0', 0) found on session 67 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:03:07.612489 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:03:07.617938 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Searching for a device in session 67 and hctl ('14', '0', '0', 0) yield: sdi {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:03:07.618092 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '37b25d6b-f126-4563-a58f-8b4a23c52397', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:03:07.736282 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:07.744322 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:03:07.773991 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Took 0.55 seconds to detach 1 volumes for instance.
May 28 01:03:07.979873 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:08.087205 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Creating config drive at /opt/stack/data/nova/instances/0ad69caa-c797-4e9d-96e3-7ad63523be49/disk.config
May 28 01:03:08.091225 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0ad69caa-c797-4e9d-96e3-7ad63523be49/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwn309_wl {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:08.141139 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0ad69caa-c797-4e9d-96e3-7ad63523be49/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwn309_wl" returned: 0 in 0.050s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:08.250377 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930188.2499604, 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:03:08.250786 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] VM Started (Lifecycle Event)
May 28 01:03:08.281092 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:08.281283 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:08.553882 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:03:08.589141 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:08.620184 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:08.624715 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:08.694372 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:08.756458 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:08.759015 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:08.762509 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:03:08.764404 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:08.807647 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0b2240a7-61f5-4e4d-8f02-6f560f06cd68 req-f619c6e6-d914-4276-b637-2d82d38fe465 service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Received event network-vif-plugged-99ce3f06-1207-4d71-a43a-4cd61a8ae36c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:08.807647 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b2240a7-61f5-4e4d-8f02-6f560f06cd68 req-f619c6e6-d914-4276-b637-2d82d38fe465 service nova] Acquiring lock "0ad69caa-c797-4e9d-96e3-7ad63523be49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:08.807707 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b2240a7-61f5-4e4d-8f02-6f560f06cd68 req-f619c6e6-d914-4276-b637-2d82d38fe465 service nova] Lock "0ad69caa-c797-4e9d-96e3-7ad63523be49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:08.807927 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b2240a7-61f5-4e4d-8f02-6f560f06cd68 req-f619c6e6-d914-4276-b637-2d82d38fe465 service nova] Lock "0ad69caa-c797-4e9d-96e3-7ad63523be49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:08.807927 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0b2240a7-61f5-4e4d-8f02-6f560f06cd68 req-f619c6e6-d914-4276-b637-2d82d38fe465 service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Processing event network-vif-plugged-99ce3f06-1207-4d71-a43a-4cd61a8ae36c {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:03:08.958358 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:03:08.958578 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:03:09.323106 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "e410372b-c799-4d0d-879c-4e935f2f2244" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:09.323532 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "e410372b-c799-4d0d-879c-4e935f2f2244" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:09.347134 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930189.3468125, 0ad69caa-c797-4e9d-96e3-7ad63523be49 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:03:09.347300 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] VM Started (Lifecycle Event)
May 28 01:03:09.348285 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:03:09.354434 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:03:09.358225 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Instance spawned successfully.
May 28 01:03:09.360287 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:03:09.463604 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:03:09.578121 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Found WWN 3300000008b2199bb for multipath device dm-5 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:03:09.578289 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.042s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:03:09.578519 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] <== connect_volume: return (4100ms) {'type': 'block', 'scsi_wwn': '3300000008b2199bb', 'path': '/dev/dm-5', 'multipath_id': '3300000008b2199bb'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:03:09.578676 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008b2199bb', 'path': '/dev/dm-5', 'multipath_id': '3300000008b2199bb'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:03:09.827467 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:03:09.849528 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:09.852938 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:03:09.865360 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:09.865501 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:09.865729 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:09.865963 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:09.866126 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:09.866431 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:09.972569 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.689s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:10.027471 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Deleted allocations for instance 090f8701-682e-4da8-bd51-e80aa1633d36
May 28 01:03:10.087059 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:01:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1176978347',display_name='tempest-ServerStableDeviceRescueTest-server-1176978347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serverstabledevicerescuetest-server-1176978347',id=29,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPboZm7ws4t1wEvtZdWzsFVGfNAtB4ijiaRXP0ILEOIyDMla/IV8XOeOh4GaCFErFIkUt97cERef0s2ccqsfOs3RN6JctfpcwjL4XjJhAm1ABrtlDHL+kEgJV1JBwPSzbg==',key_name='tempest-keypair-97535522',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:01:59Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8efd8caac5eb46ae9af16a2452ee0353',ramdisk_id='',reservation_id='r-t01ghn10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1831534173',owner_user_name='tempest-ServerStableDeviceRescueTest-1831534173-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:02:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00466e4787894abe9c5b57f909d4bd80',uuid=5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "address": "fa:16:3e:6e:a8:24", "network": {"id": "6403eebe-dcdf-49f8-8196-07e14e099cf4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-219519001-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-219519001-network", "vif_mac": "fa:16:3e:6e:a8:24"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8efd8caac5eb46ae9af16a2452ee0353", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d66a5a-b3", "ovs_interfaceid": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:03:10.087469 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Converting VIF {"id": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "address": "fa:16:3e:6e:a8:24", "network": {"id": "6403eebe-dcdf-49f8-8196-07e14e099cf4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-219519001-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-219519001-network", "vif_mac": "fa:16:3e:6e:a8:24"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8efd8caac5eb46ae9af16a2452ee0353", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d66a5a-b3", "ovs_interfaceid": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:03:10.088159 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:a8:24,bridge_name='br-int',has_traffic_filtering=True,id=56d66a5a-b38c-4f84-9a46-d0acab5cea53,network=Network(6403eebe-dcdf-49f8-8196-07e14e099cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d66a5a-b3') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:03:10.088961 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lazy-loading 'pci_devices' on Instance uuid 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:03:10.342495 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-35864f09-6b27-49d2-9009-4bc0a60b05c5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:10.343034 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-35864f09-6b27-49d2-9009-4bc0a60b05c5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:10.355256 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:03:10.355534 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930190.355274, 0ad69caa-c797-4e9d-96e3-7ad63523be49 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:03:10.355722 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] VM Paused (Lifecycle Event)
May 28 01:03:10.372654 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Took 8.55 seconds to spawn the instance on the hypervisor.
May 28 01:03:10.372807 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:10.382083 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:10.382271 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:10.385785 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:03:10.386852 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Claim successful on node np0000001577
May 28 01:03:10.405321 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00040134599976227037 future=<Future at 0x7c984c56aa20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:03:10.405519 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:03:10.405519 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=5.853279296999972 future=<Future at 0x7c9870481dc0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:03:10.405519 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=5.853210327999932 future=<Future at 0x7c9870481dc0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:03:10.405823 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Emitting event <LifecycleEvent: 1779930175.4047933, 090f8701-682e-4da8-bd51-e80aa1633d36 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:03:10.406027 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] VM Stopped (Lifecycle Event)
May 28 01:03:10.593389 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Object Instance<5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:03:10.594633 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] End _get_guest_xml xml=<domain type="qemu">
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:   <uuid>5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b</uuid>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:   <name>instance-0000001d</name>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1176978347</nova:name>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:03:04</nova:creationTime>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:         <nova:user uuid="00466e4787894abe9c5b57f909d4bd80">tempest-ServerStableDeviceRescueTest-1831534173-project-member</nova:user>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:         <nova:project uuid="8efd8caac5eb46ae9af16a2452ee0353">tempest-ServerStableDeviceRescueTest-1831534173</nova:project>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:         <nova:port uuid="56d66a5a-b38c-4f84-9a46-d0acab5cea53">
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:     <system>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <entry name="serial">5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b</entry>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <entry name="uuid">5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b</entry>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:     </system>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:   <os>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:   </os>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:   <features>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:   </features>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:   <devices>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk"/>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:     </disk>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk.config"/>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:     </disk>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <alias name="ua-37b25d6b-f126-4563-a58f-8b4a23c52397"/>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-5"/>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <serial>37b25d6b-f126-4563-a58f-8b4a23c52397</serial>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:     </disk>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk.rescue"/>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <target dev="vdc" bus="virtio"/>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <boot order="1"/>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:     </disk>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:6e:a8:24"/>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <target dev="tap56d66a5a-b3"/>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:     </interface>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/console.log" append="off"/>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:     </serial>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:     <video>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:     </video>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:     </rng>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:   </devices>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]: </domain>
May 28 01:03:10.594633 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:03:10.599748 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Instance destroyed successfully.
May 28 01:03:10.849085 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-35864f09-6b27-49d2-9009-4bc0a60b05c5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Detaching volume d15f465c-138e-4c23-9b17-0b08887300f1
May 28 01:03:10.858589 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:10.862103 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930190.8618495, 0ad69caa-c797-4e9d-96e3-7ad63523be49 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:03:10.862233 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] VM Resumed (Lifecycle Event)
May 28 01:03:10.882131 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Took 16.01 seconds to build instance.
May 28 01:03:10.902276 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c4e62604-f752-4100-8293-e89756d62ce8 req-4196bc26-6f37-47fd-ad38-80943af996b0 service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Received event network-vif-plugged-99ce3f06-1207-4d71-a43a-4cd61a8ae36c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:10.902506 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c4e62604-f752-4100-8293-e89756d62ce8 req-4196bc26-6f37-47fd-ad38-80943af996b0 service nova] Acquiring lock "0ad69caa-c797-4e9d-96e3-7ad63523be49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:10.909525 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c4e62604-f752-4100-8293-e89756d62ce8 req-4196bc26-6f37-47fd-ad38-80943af996b0 service nova] Lock "0ad69caa-c797-4e9d-96e3-7ad63523be49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:10.909525 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c4e62604-f752-4100-8293-e89756d62ce8 req-4196bc26-6f37-47fd-ad38-80943af996b0 service nova] Lock "0ad69caa-c797-4e9d-96e3-7ad63523be49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:10.909525 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c4e62604-f752-4100-8293-e89756d62ce8 req-4196bc26-6f37-47fd-ad38-80943af996b0 service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] No waiting events found dispatching network-vif-plugged-99ce3f06-1207-4d71-a43a-4cd61a8ae36c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:03:10.909688 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-c4e62604-f752-4100-8293-e89756d62ce8 req-4196bc26-6f37-47fd-ad38-80943af996b0 service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Received unexpected event network-vif-plugged-99ce3f06-1207-4d71-a43a-4cd61a8ae36c for instance with vm_state active and task_state None.
May 28 01:03:10.910396 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: 090f8701-682e-4da8-bd51-e80aa1633d36] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:10.912477 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-35864f09-6b27-49d2-9009-4bc0a60b05c5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Attempting to driver detach volume d15f465c-138e-4c23-9b17-0b08887300f1 from mountpoint /dev/vdb
May 28 01:03:10.921031 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-35864f09-6b27-49d2-9009-4bc0a60b05c5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Found disk vdb by alias ua-d15f465c-138e-4c23-9b17-0b08887300f1 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:03:10.922058 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-35864f09-6b27-49d2-9009-4bc0a60b05c5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Found disk vdb by alias ua-d15f465c-138e-4c23-9b17-0b08887300f1 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:03:10.922175 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-35864f09-6b27-49d2-9009-4bc0a60b05c5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Attempting to detach device vdb from instance d87bb95b-a1e9-4786-8bee-16f2cfaabf2d from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:03:10.922382 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-35864f09-6b27-49d2-9009-4bc0a60b05c5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:03:10.922382 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:03:10.922382 np0000001577 nova-compute[98319]:   <alias name="ua-d15f465c-138e-4c23-9b17-0b08887300f1"/>
May 28 01:03:10.922382 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-6"/>
May 28 01:03:10.922382 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:03:10.922382 np0000001577 nova-compute[98319]:   <serial>d15f465c-138e-4c23-9b17-0b08887300f1</serial>
May 28 01:03:10.922382 np0000001577 nova-compute[98319]:   <shareable/>
May 28 01:03:10.922382 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 01:03:10.922382 np0000001577 nova-compute[98319]: </disk>
May 28 01:03:10.922382 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:03:10.931206 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-35864f09-6b27-49d2-9009-4bc0a60b05c5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Successfully detached device vdb from instance d87bb95b-a1e9-4786-8bee-16f2cfaabf2d from the persistent domain config.
May 28 01:03:10.934620 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-35864f09-6b27-49d2-9009-4bc0a60b05c5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] (1/8): Attempting to detach device vdb with device alias ua-d15f465c-138e-4c23-9b17-0b08887300f1 from instance d87bb95b-a1e9-4786-8bee-16f2cfaabf2d from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:03:10.934620 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-35864f09-6b27-49d2-9009-4bc0a60b05c5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:03:10.934620 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:03:10.934620 np0000001577 nova-compute[98319]:   <alias name="ua-d15f465c-138e-4c23-9b17-0b08887300f1"/>
May 28 01:03:10.934620 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-6"/>
May 28 01:03:10.934620 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:03:10.934620 np0000001577 nova-compute[98319]:   <serial>d15f465c-138e-4c23-9b17-0b08887300f1</serial>
May 28 01:03:10.934620 np0000001577 nova-compute[98319]:   <shareable/>
May 28 01:03:10.934620 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 01:03:10.934620 np0000001577 nova-compute[98319]: </disk>
May 28 01:03:10.934620 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:03:10.945107 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:11.034572 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-78687c3a-9c20-456d-b1c7-6fbdfadc8bd3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "090f8701-682e-4da8-bd51-e80aa1633d36" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.917s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:11.117797 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:11.365316 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:11.367916 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:03:11.383095 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-354f4f00-0072-42be-801e-1aa503246108 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "0ad69caa-c797-4e9d-96e3-7ad63523be49" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.522s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:11.471138 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-35864f09-6b27-49d2-9009-4bc0a60b05c5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-d15f465c-138e-4c23-9b17-0b08887300f1 for instance d87bb95b-a1e9-4786-8bee-16f2cfaabf2d {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:03:11.870366 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930191.8696506, d87bb95b-a1e9-4786-8bee-16f2cfaabf2d => ua-d15f465c-138e-4c23-9b17-0b08887300f1> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:03:11.877538 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b5a7a03c-0173-48c5-a533-80410c949947 req-c66e033f-6355-4841-bc3f-8f5771aa3718 service nova] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Received event network-changed-4bd7989d-5591-41bb-a6e4-29c3a6aa27de {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:11.878944 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b5a7a03c-0173-48c5-a533-80410c949947 req-c66e033f-6355-4841-bc3f-8f5771aa3718 service nova] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Refreshing instance network info cache due to event network-changed-4bd7989d-5591-41bb-a6e4-29c3a6aa27de. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:03:11.879777 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-35864f09-6b27-49d2-9009-4bc0a60b05c5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Successfully detached device vdb from instance d87bb95b-a1e9-4786-8bee-16f2cfaabf2d from the live domain config.
May 28 01:03:11.879777 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b5a7a03c-0173-48c5-a533-80410c949947 req-c66e033f-6355-4841-bc3f-8f5771aa3718 service nova] Acquiring lock "refresh_cache-f2b64af8-9a7b-4726-b298-cf9d2cb24498" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:03:11.879777 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b5a7a03c-0173-48c5-a533-80410c949947 req-c66e033f-6355-4841-bc3f-8f5771aa3718 service nova] Acquired lock "refresh_cache-f2b64af8-9a7b-4726-b298-cf9d2cb24498" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:03:11.879777 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b5a7a03c-0173-48c5-a533-80410c949947 req-c66e033f-6355-4841-bc3f-8f5771aa3718 service nova] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Refreshing network info cache for port 4bd7989d-5591-41bb-a6e4-29c3a6aa27de {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:03:12.061882 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:03:12.062638 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:03:12.121419 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:03:12.121419 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:03:12.121419 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:03:12.121419 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:03:12.121419 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] No VIF found with MAC fa:16:3e:6e:a8:24, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:03:12.121419 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Using config drive
May 28 01:03:12.383964 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-b5a7a03c-0173-48c5-a533-80410c949947 req-c66e033f-6355-4841-bc3f-8f5771aa3718 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:12.430906 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-35864f09-6b27-49d2-9009-4bc0a60b05c5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Detected multiple connections on this host for volume: d15f465c-138e-4c23-9b17-0b08887300f1, skipping target disconnect.
May 28 01:03:12.565577 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:03:12.625989 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lazy-loading 'ec2_ids' on Instance uuid 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:03:12.724706 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-b5a7a03c-0173-48c5-a533-80410c949947 req-c66e033f-6355-4841-bc3f-8f5771aa3718 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:12.894235 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b5a7a03c-0173-48c5-a533-80410c949947 req-c66e033f-6355-4841-bc3f-8f5771aa3718 service nova] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Updated VIF entry in instance network info cache for port 4bd7989d-5591-41bb-a6e4-29c3a6aa27de. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:03:12.894709 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b5a7a03c-0173-48c5-a533-80410c949947 req-c66e033f-6355-4841-bc3f-8f5771aa3718 service nova] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Updating instance_info_cache with network_info: [{"id": "4bd7989d-5591-41bb-a6e4-29c3a6aa27de", "address": "fa:16:3e:12:3f:51", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bd7989d-55", "ovs_interfaceid": "4bd7989d-5591-41bb-a6e4-29c3a6aa27de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:03:13.011347 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-35864f09-6b27-49d2-9009-4bc0a60b05c5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lazy-loading 'flavor' on Instance uuid d87bb95b-a1e9-4786-8bee-16f2cfaabf2d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:03:13.071820 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.689s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:13.073348 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:03:13.130079 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Object Instance<5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:03:13.130079 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lazy-loading 'keypairs' on Instance uuid 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:03:13.398205 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b5a7a03c-0173-48c5-a533-80410c949947 req-c66e033f-6355-4841-bc3f-8f5771aa3718 service nova] Releasing lock "refresh_cache-f2b64af8-9a7b-4726-b298-cf9d2cb24498" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:03:13.579082 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:03:13.579082 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:03:13.579432 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:13.579488 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:13.631942 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Object Instance<5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:03:13.635971 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:13.715793 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb6c20970bf0401190583f6348e00e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e28acf25c4445ea969bd7bca3eac146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:03:13.784749 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "04880ef4-5eee-4221-ad42-29788eb26358" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:13.784749 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "04880ef4-5eee-4221-ad42-29788eb26358" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:13.807673 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Creating config drive at /opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk.config.rescue
May 28 01:03:13.812144 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkdbarj5b {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:13.868192 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkdbarj5b" returned: 0 in 0.056s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:13.869840 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Stashing vm_state: active {{(pid=98319) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 28 01:03:13.947830 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-22e2868b-b8fe-41be-a023-e14282990b1d req-f6cc54b0-ebaa-4c79-bd40-3466b9419d94 service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Received event network-changed-99ce3f06-1207-4d71-a43a-4cd61a8ae36c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:13.948242 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-22e2868b-b8fe-41be-a023-e14282990b1d req-f6cc54b0-ebaa-4c79-bd40-3466b9419d94 service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Refreshing instance network info cache due to event network-changed-99ce3f06-1207-4d71-a43a-4cd61a8ae36c. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:03:13.949154 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-22e2868b-b8fe-41be-a023-e14282990b1d req-f6cc54b0-ebaa-4c79-bd40-3466b9419d94 service nova] Acquiring lock "refresh_cache-0ad69caa-c797-4e9d-96e3-7ad63523be49" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:03:13.949297 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-22e2868b-b8fe-41be-a023-e14282990b1d req-f6cc54b0-ebaa-4c79-bd40-3466b9419d94 service nova] Acquired lock "refresh_cache-0ad69caa-c797-4e9d-96e3-7ad63523be49" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:03:13.949653 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-22e2868b-b8fe-41be-a023-e14282990b1d req-f6cc54b0-ebaa-4c79-bd40-3466b9419d94 service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Refreshing network info cache for port 99ce3f06-1207-4d71-a43a-4cd61a8ae36c {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:03:14.021689 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-35864f09-6b27-49d2-9009-4bc0a60b05c5 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.679s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:14.085584 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:03:14.219997 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Successfully created port: 1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:03:14.288013 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Detaching volume d15f465c-138e-4c23-9b17-0b08887300f1
May 28 01:03:14.344742 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Attempting to driver detach volume d15f465c-138e-4c23-9b17-0b08887300f1 from mountpoint /dev/vdb
May 28 01:03:14.358413 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Found disk vdb by alias ua-d15f465c-138e-4c23-9b17-0b08887300f1 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:03:14.360986 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Found disk vdb by alias ua-d15f465c-138e-4c23-9b17-0b08887300f1 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:03:14.360986 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Attempting to detach device vdb from instance 04880ef4-5eee-4221-ad42-29788eb26358 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:03:14.360986 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:03:14.360986 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:03:14.360986 np0000001577 nova-compute[98319]:   <alias name="ua-d15f465c-138e-4c23-9b17-0b08887300f1"/>
May 28 01:03:14.360986 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-6"/>
May 28 01:03:14.360986 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:03:14.360986 np0000001577 nova-compute[98319]:   <serial>d15f465c-138e-4c23-9b17-0b08887300f1</serial>
May 28 01:03:14.360986 np0000001577 nova-compute[98319]:   <shareable/>
May 28 01:03:14.360986 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 01:03:14.360986 np0000001577 nova-compute[98319]: </disk>
May 28 01:03:14.360986 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:03:14.371686 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Successfully detached device vdb from instance 04880ef4-5eee-4221-ad42-29788eb26358 from the persistent domain config.
May 28 01:03:14.371686 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] (1/8): Attempting to detach device vdb with device alias ua-d15f465c-138e-4c23-9b17-0b08887300f1 from instance 04880ef4-5eee-4221-ad42-29788eb26358 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:03:14.371686 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:03:14.371686 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:03:14.371686 np0000001577 nova-compute[98319]:   <alias name="ua-d15f465c-138e-4c23-9b17-0b08887300f1"/>
May 28 01:03:14.371686 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-6"/>
May 28 01:03:14.371686 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:03:14.371686 np0000001577 nova-compute[98319]:   <serial>d15f465c-138e-4c23-9b17-0b08887300f1</serial>
May 28 01:03:14.371686 np0000001577 nova-compute[98319]:   <shareable/>
May 28 01:03:14.371686 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 01:03:14.371686 np0000001577 nova-compute[98319]: </disk>
May 28 01:03:14.371686 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:03:14.421565 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:14.456955 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-22e2868b-b8fe-41be-a023-e14282990b1d req-f6cc54b0-ebaa-4c79-bd40-3466b9419d94 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:14.461218 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:14.478618 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:14.478877 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:14.548297 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:14.588016 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:03:14.863299 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:14.873582 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:14.895947 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:14.953857 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-22e2868b-b8fe-41be-a023-e14282990b1d req-f6cc54b0-ebaa-4c79-bd40-3466b9419d94 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:14.963825 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Successfully updated port: 1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:03:14.991432 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:03:14.991706 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Claim successful on node np0000001577
May 28 01:03:15.039420 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-91da84f0-e4b1-4f4e-8c94-de2e109526e0 req-1a34d0f7-4cb2-4d5e-b3e8-8ccfaf107ced service nova] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Received event network-changed-1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:15.039513 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-91da84f0-e4b1-4f4e-8c94-de2e109526e0 req-1a34d0f7-4cb2-4d5e-b3e8-8ccfaf107ced service nova] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Refreshing instance network info cache due to event network-changed-1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:03:15.039684 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-91da84f0-e4b1-4f4e-8c94-de2e109526e0 req-1a34d0f7-4cb2-4d5e-b3e8-8ccfaf107ced service nova] Acquiring lock "refresh_cache-e410372b-c799-4d0d-879c-4e935f2f2244" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:03:15.039753 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-91da84f0-e4b1-4f4e-8c94-de2e109526e0 req-1a34d0f7-4cb2-4d5e-b3e8-8ccfaf107ced service nova] Acquired lock "refresh_cache-e410372b-c799-4d0d-879c-4e935f2f2244" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:03:15.039868 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-91da84f0-e4b1-4f4e-8c94-de2e109526e0 req-1a34d0f7-4cb2-4d5e-b3e8-8ccfaf107ced service nova] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Refreshing network info cache for port 1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:03:15.113709 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-22e2868b-b8fe-41be-a023-e14282990b1d req-f6cc54b0-ebaa-4c79-bd40-3466b9419d94 service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Updated VIF entry in instance network info cache for port 99ce3f06-1207-4d71-a43a-4cd61a8ae36c. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:03:15.113960 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-22e2868b-b8fe-41be-a023-e14282990b1d req-f6cc54b0-ebaa-4c79-bd40-3466b9419d94 service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Updating instance_info_cache with network_info: [{"id": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "address": "fa:16:3e:2e:5f:00", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ce3f06-12", "ovs_interfaceid": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:03:15.369537 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Removed pending STOPPED event for 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b due to new event <LifecycleEvent: 1779930195.369192, 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b => Resumed> {{(pid=98319) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 01:03:15.369699 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930195.369192, 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:03:15.369792 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] VM Resumed (Lifecycle Event)
May 28 01:03:15.379181 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-8a25f9e7-17c3-4b6a-92ae-35e3198cbe0d tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:15.469084 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "refresh_cache-e410372b-c799-4d0d-879c-4e935f2f2244" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:03:15.499939 np0000001577 nova-compute[98319]: INFO nova.compute.resource_tracker [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Updating resource usage from migration 6a9d896f-83cd-4713-80ec-6964bae95639
May 28 01:03:15.547836 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-91da84f0-e4b1-4f4e-8c94-de2e109526e0 req-1a34d0f7-4cb2-4d5e-b3e8-8ccfaf107ced service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:15.600161 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:03:15.601914 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:03:15.602241 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Creating image(s)
May 28 01:03:15.602767 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "/opt/stack/data/nova/instances/e410372b-c799-4d0d-879c-4e935f2f2244/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:15.605365 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "/opt/stack/data/nova/instances/e410372b-c799-4d0d-879c-4e935f2f2244/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:15.605365 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "/opt/stack/data/nova/instances/e410372b-c799-4d0d-879c-4e935f2f2244/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:15.605365 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:03:15.606855 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:03:15.607910 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:15.639800 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-91da84f0-e4b1-4f4e-8c94-de2e109526e0 req-1a34d0f7-4cb2-4d5e-b3e8-8ccfaf107ced service nova] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:03:15.644656 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-22e2868b-b8fe-41be-a023-e14282990b1d req-f6cc54b0-ebaa-4c79-bd40-3466b9419d94 service nova] Releasing lock "refresh_cache-0ad69caa-c797-4e9d-96e3-7ad63523be49" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:03:15.708815 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.100s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:15.710695 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:15.710695 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:15.710695 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:03:15.713561 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:03:15.713988 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:15.812222 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.098s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:15.812742 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/e410372b-c799-4d0d-879c-4e935f2f2244/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:15.864723 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/e410372b-c799-4d0d-879c-4e935f2f2244/disk 1073741824" returned: 0 in 0.051s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:15.865893 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.156s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:15.867738 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:15.889230 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:15.916374 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-91da84f0-e4b1-4f4e-8c94-de2e109526e0 req-1a34d0f7-4cb2-4d5e-b3e8-8ccfaf107ced service nova] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:03:15.920960 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:03:15.970689 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.104s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:15.974159 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:15.975012 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e410372b-c799-4d0d-879c-4e935f2f2244/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:03:15.976722 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e410372b-c799-4d0d-879c-4e935f2f2244/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:16.027921 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-78b1b695-c06e-4f52-8fcb-47af8305156b req-ee8fe4f1-0550-44ff-a655-1fbd4e00b9c5 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Received event network-vif-plugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:16.028994 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-78b1b695-c06e-4f52-8fcb-47af8305156b req-ee8fe4f1-0550-44ff-a655-1fbd4e00b9c5 service nova] Acquiring lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:16.029813 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-78b1b695-c06e-4f52-8fcb-47af8305156b req-ee8fe4f1-0550-44ff-a655-1fbd4e00b9c5 service nova] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:16.030103 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-78b1b695-c06e-4f52-8fcb-47af8305156b req-ee8fe4f1-0550-44ff-a655-1fbd4e00b9c5 service nova] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:16.032573 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-78b1b695-c06e-4f52-8fcb-47af8305156b req-ee8fe4f1-0550-44ff-a655-1fbd4e00b9c5 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] No waiting events found dispatching network-vif-plugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:03:16.032573 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-78b1b695-c06e-4f52-8fcb-47af8305156b req-ee8fe4f1-0550-44ff-a655-1fbd4e00b9c5 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Received unexpected event network-vif-plugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 for instance with vm_state rescued and task_state None.
May 28 01:03:16.032897 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-78b1b695-c06e-4f52-8fcb-47af8305156b req-ee8fe4f1-0550-44ff-a655-1fbd4e00b9c5 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Received event network-vif-plugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:16.034125 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-78b1b695-c06e-4f52-8fcb-47af8305156b req-ee8fe4f1-0550-44ff-a655-1fbd4e00b9c5 service nova] Acquiring lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:16.034125 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-78b1b695-c06e-4f52-8fcb-47af8305156b req-ee8fe4f1-0550-44ff-a655-1fbd4e00b9c5 service nova] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:16.034295 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-78b1b695-c06e-4f52-8fcb-47af8305156b req-ee8fe4f1-0550-44ff-a655-1fbd4e00b9c5 service nova] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:16.039613 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-78b1b695-c06e-4f52-8fcb-47af8305156b req-ee8fe4f1-0550-44ff-a655-1fbd4e00b9c5 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] No waiting events found dispatching network-vif-plugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:03:16.040250 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-78b1b695-c06e-4f52-8fcb-47af8305156b req-ee8fe4f1-0550-44ff-a655-1fbd4e00b9c5 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Received unexpected event network-vif-plugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 for instance with vm_state rescued and task_state None.
May 28 01:03:16.086987 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e410372b-c799-4d0d-879c-4e935f2f2244/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:16.088010 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Cannot resize image /opt/stack/data/nova/instances/e410372b-c799-4d0d-879c-4e935f2f2244/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:03:16.088423 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:03:16.088657 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Ensure instance console log exists: /opt/stack/data/nova/instances/e410372b-c799-4d0d-879c-4e935f2f2244/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:03:16.089091 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:16.089258 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:16.089315 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:16.118280 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:16.259157 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0003766740001083235 future=<Future at 0x7c9870481dc0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:03:16.259468 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:03:16.259468 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=4.380694568000308 future=<Future at 0x7c984c5c9b50 state=cancelled>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:03:16.259468 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=4.380601224000202 future=<Future at 0x7c984c5c9b50 state=cancelled>) was cancelled while queued, skipping {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:03:16.260591 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:03:16.421583 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-91da84f0-e4b1-4f4e-8c94-de2e109526e0 req-1a34d0f7-4cb2-4d5e-b3e8-8ccfaf107ced service nova] Releasing lock "refresh_cache-e410372b-c799-4d0d-879c-4e935f2f2244" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:03:16.422177 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquired lock "refresh_cache-e410372b-c799-4d0d-879c-4e935f2f2244" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:03:16.422420 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:03:16.428636 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930196.4265633, 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:03:16.429575 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] VM Started (Lifecycle Event)
May 28 01:03:16.542845 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-ca1485f5-7731-464e-a0dc-61f3edcbabc8 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Unrescuing
May 28 01:03:16.543193 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca1485f5-7731-464e-a0dc-61f3edcbabc8 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Acquiring lock "refresh_cache-5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:03:16.543193 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca1485f5-7731-464e-a0dc-61f3edcbabc8 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Acquired lock "refresh_cache-5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:03:16.543282 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ca1485f5-7731-464e-a0dc-61f3edcbabc8 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:03:16.548807 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:03:16.549013 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:03:16.932103 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:16.934171 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:03:16.991764 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:03:17.046615 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ca1485f5-7731-464e-a0dc-61f3edcbabc8 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:17.051130 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:03:17.117256 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1706eda0-64a0-4157-ae66-5964e6235d85 req-387f7878-8a7a-46eb-9c17-d6be2e064b34 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Received event network-changed-56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:17.123686 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1706eda0-64a0-4157-ae66-5964e6235d85 req-387f7878-8a7a-46eb-9c17-d6be2e064b34 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Refreshing instance network info cache due to event network-changed-56d66a5a-b38c-4f84-9a46-d0acab5cea53. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:03:17.124958 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1706eda0-64a0-4157-ae66-5964e6235d85 req-387f7878-8a7a-46eb-9c17-d6be2e064b34 service nova] Acquiring lock "refresh_cache-5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:03:17.196487 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:17.332459 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "27a2f570-fa9f-4f8d-8b04-b485a51b63cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:17.332685 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "27a2f570-fa9f-4f8d-8b04-b485a51b63cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:17.407059 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Updating instance_info_cache with network_info: [{"id": "1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e", "address": "fa:16:3e:21:09:40", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fbc12c7-4e", "ovs_interfaceid": "1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:03:17.419598 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ca1485f5-7731-464e-a0dc-61f3edcbabc8 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:17.436399 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 28 01:03:17.546285 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ca1485f5-7731-464e-a0dc-61f3edcbabc8 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Updating instance_info_cache with network_info: [{"id": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "address": "fa:16:3e:6e:a8:24", "network": {"id": "6403eebe-dcdf-49f8-8196-07e14e099cf4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-219519001-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8efd8caac5eb46ae9af16a2452ee0353", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d66a5a-b3", "ovs_interfaceid": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:03:17.558269 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 3.079s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:17.558397 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Migrating
May 28 01:03:17.558593 np0000001577 nova-compute[98319]: DEBUG nova.compute.rpcapi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98319) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 01:03:17.831094 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930197.8306382, 04880ef4-5eee-4221-ad42-29788eb26358 => ua-d15f465c-138e-4c23-9b17-0b08887300f1> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:03:17.833086 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-d15f465c-138e-4c23-9b17-0b08887300f1 for instance 04880ef4-5eee-4221-ad42-29788eb26358 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:03:17.837009 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:03:17.838659 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Successfully detached device vdb from instance 04880ef4-5eee-4221-ad42-29788eb26358 from the live domain config.
May 28 01:03:18.045116 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Releasing lock "refresh_cache-e410372b-c799-4d0d-879c-4e935f2f2244" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:03:18.056859 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:03:18.057716 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca1485f5-7731-464e-a0dc-61f3edcbabc8 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Releasing lock "refresh_cache-5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:03:18.057949 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Instance network_info: |[{"id": "1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e", "address": "fa:16:3e:21:09:40", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fbc12c7-4e", "ovs_interfaceid": "1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:03:18.058291 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd15f465c-138e-4c23-9b17-0b08887300f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:03:18.058425 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:03:18.060983 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1706eda0-64a0-4157-ae66-5964e6235d85 req-387f7878-8a7a-46eb-9c17-d6be2e064b34 service nova] Acquired lock "refresh_cache-5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:03:18.060983 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-1706eda0-64a0-4157-ae66-5964e6235d85 req-387f7878-8a7a-46eb-9c17-d6be2e064b34 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Refreshing network info cache for port 56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:03:18.061374 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Start _get_guest_xml network_info=[{"id": "1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e", "address": "fa:16:3e:21:09:40", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fbc12c7-4e", "ovs_interfaceid": "1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:03:18.062367 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ca1485f5-7731-464e-a0dc-61f3edcbabc8 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lazy-loading 'flavor' on Instance uuid 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:03:18.062716 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:03:18.062987 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd15f465c-138e-4c23-9b17-0b08887300f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:03:18.063152 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:03:18.065230 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:03:18.066560 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-969032899', uuid='e410372b-c799-4d0d-879c-4e935f2f2244'), owner=OwnerMeta(userid='fb6c20970bf0401190583f6348e00e4b', username='tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member', projectid='9e28acf25c4445ea969bd7bca3eac146', projectname='tempest-ServerBootFromVolumeStableRescueTest-568223226'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e", "address": "fa:16:3e:21:09:40", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fbc12c7-4e", "ovs_interfaceid": "1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930198.0660977) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:03:18.067312 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:03:18.067976 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:03:18.069332 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:03:18.069332 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:03:18.069775 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:03:18.070253 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:03:18.070401 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:03:18.070498 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:03:18.070713 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:03:18.070804 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:03:18.071015 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:03:18.071182 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:03:18.071558 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:03:18.071837 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:03:18.071955 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:03:18.072074 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:03:18.079557 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "refresh_cache-0ad69caa-c797-4e9d-96e3-7ad63523be49" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:03:18.080339 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquired lock "refresh_cache-0ad69caa-c797-4e9d-96e3-7ad63523be49" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:03:18.081318 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:03:18.088996 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:03:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-969032899',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serverbootfromvolumestablerescuetest-server-969032899',id=35,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e28acf25c4445ea969bd7bca3eac146',ramdisk_id='',reservation_id='r-s9rj8vpe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-568223226',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:03:15Z,user_data=None,user_id='fb6c20970bf0401190583f6348e00e4b',uuid=e410372b-c799-4d0d-879c-4e935f2f2244,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e", "address": "fa:16:3e:21:09:40", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fbc12c7-4e", "ovs_interfaceid": "1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:03:18.089265 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Converting VIF {"id": "1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e", "address": "fa:16:3e:21:09:40", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fbc12c7-4e", "ovs_interfaceid": "1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:03:18.089702 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:09:40,bridge_name='br-int',has_traffic_filtering=True,id=1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e,network=Network(c25f8563-bd10-4e42-b4ce-fd2164eca324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fbc12c7-4e') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:03:18.090788 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lazy-loading 'pci_devices' on Instance uuid e410372b-c799-4d0d-879c-4e935f2f2244 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:03:18.102023 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:18.102023 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:18.102023 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:03:18.102023 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:03:18.102023 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:18.102023 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:18.102023 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:18.102023 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:18.102023 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:18.102023 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:18.102023 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:18.102023 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:18.102023 np0000001577 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:18.102023 np0000001577 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:18.102023 np0000001577 nova-compute[98319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c781f80e-facb-4944-be31-8b118e2e3381 (non-flash)
May 28 01:03:18.102023 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:03:18.103427 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:18.103427 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:18.103427 np0000001577 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:03:18.103427 np0000001577 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1 (non-flash)
May 28 01:03:18.103427 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:18.103427 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:18.103427 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:18.103427 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:18.103427 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:18.103427 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:18.103427 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:18.103427 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:18.103427 np0000001577 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:18.103427 np0000001577 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:18.103427 np0000001577 nova-compute[98319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c781f80e-facb-4944-be31-8b118e2e3381 (non-flash)
May 28 01:03:18.103427 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:03:18.103427 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', '63'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c', '65'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c781f80e-facb-4944-be31-8b118e2e3381', '72')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:03:18.103427 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', '45')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:03:18.104808 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1', '46')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:03:18.105781 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c98703096c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1'): ({'sdk'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:03:18.106005 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Removing multipathed devices sdj, sdk {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:03:18.106266 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Flush multipath device 330000000d00ec62f {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:03:18.140154 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:03:18.181508 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:03:18.228148 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:03:18.228353 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:03:18.230157 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:03:18.247628 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:03:18.247628 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:03:18.258634 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:18.295630 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1, portal: 192.168.40.100,3260]
May 28 01:03:18.295630 np0000001577 nova-compute[98319]: Logout of [sid: 45, target: iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1, portal: 192.168.40.100,3260] successful.
May 28 01:03:18.295630 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:18.317625 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:18.328530 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:18.371198 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1, portal: 192.168.50.100,3260]
May 28 01:03:18.371198 np0000001577 nova-compute[98319]: Logout of [sid: 46, target: iqn.2023-03.storpool.com:os--volume-d15f465c-138e-4c23-9b17-0b08887300f1, portal: 192.168.50.100,3260] successful.
May 28 01:03:18.371198 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:18.388894 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:18.389150 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:18.392218 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:03:18.392347 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Claim successful on node np0000001577
May 28 01:03:18.396707 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:18.396915 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:03:18.397024 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] <== disconnect_volume: return (338ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:03:18.397134 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:03:18.565588 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-1706eda0-64a0-4157-ae66-5964e6235d85 req-387f7878-8a7a-46eb-9c17-d6be2e064b34 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:18.586379 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:18.593396 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] End _get_guest_xml xml=<domain type="qemu">
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:   <uuid>e410372b-c799-4d0d-879c-4e935f2f2244</uuid>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:   <name>instance-00000023</name>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-969032899</nova:name>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:03:18</nova:creationTime>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:         <nova:user uuid="fb6c20970bf0401190583f6348e00e4b">tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member</nova:user>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:         <nova:project uuid="9e28acf25c4445ea969bd7bca3eac146">tempest-ServerBootFromVolumeStableRescueTest-568223226</nova:project>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:         <nova:port uuid="1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e">
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:     <system>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       <entry name="serial">e410372b-c799-4d0d-879c-4e935f2f2244</entry>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       <entry name="uuid">e410372b-c799-4d0d-879c-4e935f2f2244</entry>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:     </system>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:   <os>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:   </os>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:   <features>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:   </features>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:   <devices>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/e410372b-c799-4d0d-879c-4e935f2f2244/disk"/>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:     </disk>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/e410372b-c799-4d0d-879c-4e935f2f2244/disk.config"/>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:     </disk>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:21:09:40"/>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       <target dev="tap1fbc12c7-4e"/>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:     </interface>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/e410372b-c799-4d0d-879c-4e935f2f2244/console.log" append="off"/>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:     </serial>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:     <video>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:     </video>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:     </rng>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:   </devices>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]: </domain>
May 28 01:03:18.593396 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:03:18.595498 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Preparing to wait for external event network-vif-plugged-1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:03:18.595498 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "e410372b-c799-4d0d-879c-4e935f2f2244-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:18.595498 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "e410372b-c799-4d0d-879c-4e935f2f2244-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:18.595498 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "e410372b-c799-4d0d-879c-4e935f2f2244-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:18.595498 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:03:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-969032899',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serverbootfromvolumestablerescuetest-server-969032899',id=35,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e28acf25c4445ea969bd7bca3eac146',ramdisk_id='',reservation_id='r-s9rj8vpe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-568223226',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:03:15Z,user_data=None,user_id='fb6c20970bf0401190583f6348e00e4b',uuid=e410372b-c799-4d0d-879c-4e935f2f2244,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e", "address": "fa:16:3e:21:09:40", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fbc12c7-4e", "ovs_interfaceid": "1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:03:18.595809 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:18.596717 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Converting VIF {"id": "1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e", "address": "fa:16:3e:21:09:40", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fbc12c7-4e", "ovs_interfaceid": "1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:03:18.597221 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:09:40,bridge_name='br-int',has_traffic_filtering=True,id=1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e,network=Network(c25f8563-bd10-4e42-b4ce-fd2164eca324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fbc12c7-4e') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:03:18.597454 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:09:40,bridge_name='br-int',has_traffic_filtering=True,id=1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e,network=Network(c25f8563-bd10-4e42-b4ce-fd2164eca324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fbc12c7-4e') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:03:18.597667 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:18.597824 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:18.598115 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:03:18.599278 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:18.599894 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3b2e3ea5-dc96-5b94-a2a5-9ffb3553596d', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:18.601092 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:18.601644 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:03:18.602686 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:18.627731 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:18.634914 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:18.652959 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:18.658494 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:18.658705 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1fbc12c7-4e, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:18.658981 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1fbc12c7-4e, col_values=(('qos', UUID('8b4c2945-1807-4b5b-b454-6765027666dd')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:18.659150 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1fbc12c7-4e, col_values=(('external_ids', {'iface-id': '1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:09:40', 'vm-uuid': 'e410372b-c799-4d0d-879c-4e935f2f2244'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:18.661350 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:03:18.662058 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:18.673642 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:18.674532 np0000001577 nova-compute[98319]: INFO os_vif [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:09:40,bridge_name='br-int',has_traffic_filtering=True,id=1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e,network=Network(c25f8563-bd10-4e42-b4ce-fd2164eca324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fbc12c7-4e')
May 28 01:03:18.828075 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8bce3a74-59ae-4e08-a637-31100ee60ca4 req-713e9cb7-cd9e-4c16-9fb3-dd366bd40b79 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Received event network-vif-unplugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:18.828297 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8bce3a74-59ae-4e08-a637-31100ee60ca4 req-713e9cb7-cd9e-4c16-9fb3-dd366bd40b79 service nova] Acquiring lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:18.829210 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8bce3a74-59ae-4e08-a637-31100ee60ca4 req-713e9cb7-cd9e-4c16-9fb3-dd366bd40b79 service nova] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:18.830370 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8bce3a74-59ae-4e08-a637-31100ee60ca4 req-713e9cb7-cd9e-4c16-9fb3-dd366bd40b79 service nova] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:18.830623 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8bce3a74-59ae-4e08-a637-31100ee60ca4 req-713e9cb7-cd9e-4c16-9fb3-dd366bd40b79 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] No waiting events found dispatching network-vif-unplugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:03:18.830824 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-8bce3a74-59ae-4e08-a637-31100ee60ca4 req-713e9cb7-cd9e-4c16-9fb3-dd366bd40b79 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Received unexpected event network-vif-unplugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 for instance with vm_state rescued and task_state unrescuing.
May 28 01:03:18.950291 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.9996412710002 future=<Future at 0x7c98706a45c0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:03:18.950718 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999179731000368 future=<Future at 0x7c98706a45c0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:03:18.950916 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999063635000311 future=<Future at 0x7c98706a45c0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:03:18.952875 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Instance destroyed successfully.
May 28 01:03:18.953511 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ca1485f5-7731-464e-a0dc-61f3edcbabc8 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lazy-loading 'numa_topology' on Instance uuid 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:03:18.966518 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-1706eda0-64a0-4157-ae66-5964e6235d85 req-387f7878-8a7a-46eb-9c17-d6be2e064b34 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:18.970935 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lazy-loading 'flavor' on Instance uuid 04880ef4-5eee-4221-ad42-29788eb26358 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:03:19.115124 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-1706eda0-64a0-4157-ae66-5964e6235d85 req-387f7878-8a7a-46eb-9c17-d6be2e064b34 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Updated VIF entry in instance network info cache for port 56d66a5a-b38c-4f84-9a46-d0acab5cea53. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:03:19.115417 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-1706eda0-64a0-4157-ae66-5964e6235d85 req-387f7878-8a7a-46eb-9c17-d6be2e064b34 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Updating instance_info_cache with network_info: [{"id": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "address": "fa:16:3e:6e:a8:24", "network": {"id": "6403eebe-dcdf-49f8-8196-07e14e099cf4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-219519001-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8efd8caac5eb46ae9af16a2452ee0353", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d66a5a-b3", "ovs_interfaceid": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:03:19.459206 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:19.466977 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-ca1485f5-7731-464e-a0dc-61f3edcbabc8 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Object Instance<5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b> lazy-loaded attributes: flavor,numa_topology {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:03:19.615457 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Updating instance_info_cache with network_info: [{"id": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "address": "fa:16:3e:2e:5f:00", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ce3f06-12", "ovs_interfaceid": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:03:19.619052 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1706eda0-64a0-4157-ae66-5964e6235d85 req-387f7878-8a7a-46eb-9c17-d6be2e064b34 service nova] Releasing lock "refresh_cache-5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:03:19.619236 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1706eda0-64a0-4157-ae66-5964e6235d85 req-387f7878-8a7a-46eb-9c17-d6be2e064b34 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Received event network-changed-56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:19.619336 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1706eda0-64a0-4157-ae66-5964e6235d85 req-387f7878-8a7a-46eb-9c17-d6be2e064b34 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Refreshing instance network info cache due to event network-changed-56d66a5a-b38c-4f84-9a46-d0acab5cea53. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:03:19.619465 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1706eda0-64a0-4157-ae66-5964e6235d85 req-387f7878-8a7a-46eb-9c17-d6be2e064b34 service nova] Acquiring lock "refresh_cache-5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:03:19.619558 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1706eda0-64a0-4157-ae66-5964e6235d85 req-387f7878-8a7a-46eb-9c17-d6be2e064b34 service nova] Acquired lock "refresh_cache-5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:03:19.619685 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-1706eda0-64a0-4157-ae66-5964e6235d85 req-387f7878-8a7a-46eb-9c17-d6be2e064b34 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Refreshing network info cache for port 56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:03:19.936475 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:19.966296 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:19.980303 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fe4f68f1-73dd-44ec-837b-27cd629e60fc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "04880ef4-5eee-4221-ad42-29788eb26358" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.196s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:20.055341 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:20.120189 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Releasing lock "refresh_cache-0ad69caa-c797-4e9d-96e3-7ad63523be49" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:03:20.126101 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-1706eda0-64a0-4157-ae66-5964e6235d85 req-387f7878-8a7a-46eb-9c17-d6be2e064b34 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:20.196419 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:03:20.196419 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:03:20.196419 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] No VIF found with MAC fa:16:3e:21:09:40, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:03:20.199463 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Using config drive
May 28 01:03:20.255907 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:03:20.256185 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:03:20.359830 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:20.366086 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:20.371823 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:20.398222 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:20.408940 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:20.547721 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-1706eda0-64a0-4157-ae66-5964e6235d85 req-387f7878-8a7a-46eb-9c17-d6be2e064b34 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:20.702734 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-1706eda0-64a0-4157-ae66-5964e6235d85 req-387f7878-8a7a-46eb-9c17-d6be2e064b34 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Updated VIF entry in instance network info cache for port 56d66a5a-b38c-4f84-9a46-d0acab5cea53. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:03:20.703262 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-1706eda0-64a0-4157-ae66-5964e6235d85 req-387f7878-8a7a-46eb-9c17-d6be2e064b34 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Updating instance_info_cache with network_info: [{"id": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "address": "fa:16:3e:6e:a8:24", "network": {"id": "6403eebe-dcdf-49f8-8196-07e14e099cf4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-219519001-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8efd8caac5eb46ae9af16a2452ee0353", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d66a5a-b3", "ovs_interfaceid": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:03:20.707484 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:20.762364 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:03:20.860297 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Creating config drive at /opt/stack/data/nova/instances/e410372b-c799-4d0d-879c-4e935f2f2244/disk.config
May 28 01:03:20.864005 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e410372b-c799-4d0d-879c-4e935f2f2244/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpg6p0f6ss {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:20.892032 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5b062670-1f2f-4abf-abd8-9f303685330b req-45615b44-89e6-4eeb-8787-5e93086340ee service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Received event network-vif-unplugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:20.892452 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5b062670-1f2f-4abf-abd8-9f303685330b req-45615b44-89e6-4eeb-8787-5e93086340ee service nova] Acquiring lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:20.892915 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5b062670-1f2f-4abf-abd8-9f303685330b req-45615b44-89e6-4eeb-8787-5e93086340ee service nova] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:20.892915 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5b062670-1f2f-4abf-abd8-9f303685330b req-45615b44-89e6-4eeb-8787-5e93086340ee service nova] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:20.893107 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5b062670-1f2f-4abf-abd8-9f303685330b req-45615b44-89e6-4eeb-8787-5e93086340ee service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] No waiting events found dispatching network-vif-unplugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:03:20.893276 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-5b062670-1f2f-4abf-abd8-9f303685330b req-45615b44-89e6-4eeb-8787-5e93086340ee service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Received unexpected event network-vif-unplugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 for instance with vm_state rescued and task_state unrescuing.
May 28 01:03:20.893378 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5b062670-1f2f-4abf-abd8-9f303685330b req-45615b44-89e6-4eeb-8787-5e93086340ee service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Received event network-vif-plugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:20.894004 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5b062670-1f2f-4abf-abd8-9f303685330b req-45615b44-89e6-4eeb-8787-5e93086340ee service nova] Acquiring lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:20.894194 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5b062670-1f2f-4abf-abd8-9f303685330b req-45615b44-89e6-4eeb-8787-5e93086340ee service nova] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:20.894302 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5b062670-1f2f-4abf-abd8-9f303685330b req-45615b44-89e6-4eeb-8787-5e93086340ee service nova] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:20.894402 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5b062670-1f2f-4abf-abd8-9f303685330b req-45615b44-89e6-4eeb-8787-5e93086340ee service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] No waiting events found dispatching network-vif-plugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:03:20.894507 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-5b062670-1f2f-4abf-abd8-9f303685330b req-45615b44-89e6-4eeb-8787-5e93086340ee service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Received unexpected event network-vif-plugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 for instance with vm_state rescued and task_state unrescuing.
May 28 01:03:20.894659 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5b062670-1f2f-4abf-abd8-9f303685330b req-45615b44-89e6-4eeb-8787-5e93086340ee service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Received event network-vif-plugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:20.894755 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5b062670-1f2f-4abf-abd8-9f303685330b req-45615b44-89e6-4eeb-8787-5e93086340ee service nova] Acquiring lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:20.895209 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5b062670-1f2f-4abf-abd8-9f303685330b req-45615b44-89e6-4eeb-8787-5e93086340ee service nova] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:20.895209 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5b062670-1f2f-4abf-abd8-9f303685330b req-45615b44-89e6-4eeb-8787-5e93086340ee service nova] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:20.895209 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5b062670-1f2f-4abf-abd8-9f303685330b req-45615b44-89e6-4eeb-8787-5e93086340ee service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] No waiting events found dispatching network-vif-plugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:03:20.895209 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-5b062670-1f2f-4abf-abd8-9f303685330b req-45615b44-89e6-4eeb-8787-5e93086340ee service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Received unexpected event network-vif-plugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 for instance with vm_state rescued and task_state unrescuing.
May 28 01:03:20.926890 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e410372b-c799-4d0d-879c-4e935f2f2244/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpg6p0f6ss" returned: 0 in 0.063s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:20.932245 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Removed pending STOPPED event for 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b due to new event <LifecycleEvent: 1779930200.9318972, 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b => Resumed> {{(pid=98319) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 01:03:20.932410 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930200.9318972, 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:03:20.932532 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] VM Resumed (Lifecycle Event)
May 28 01:03:20.939463 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ca1485f5-7731-464e-a0dc-61f3edcbabc8 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:21.140767 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:21.212292 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1706eda0-64a0-4157-ae66-5964e6235d85 req-387f7878-8a7a-46eb-9c17-d6be2e064b34 service nova] Releasing lock "refresh_cache-5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:03:21.274524 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.885s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:21.275528 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:03:21.409921 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:21.441132 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:21.453724 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:21.459887 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:03:21.554026 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:21.624472 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:21.627412 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-cff7519c-358f-471f-a706-19be8bdaa779 req-dc2fd21e-cda8-4611-9a54-b28a3785db8e service nova] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Received event network-vif-plugged-1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:21.627609 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cff7519c-358f-471f-a706-19be8bdaa779 req-dc2fd21e-cda8-4611-9a54-b28a3785db8e service nova] Acquiring lock "e410372b-c799-4d0d-879c-4e935f2f2244-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:21.628107 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:21.628559 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cff7519c-358f-471f-a706-19be8bdaa779 req-dc2fd21e-cda8-4611-9a54-b28a3785db8e service nova] Lock "e410372b-c799-4d0d-879c-4e935f2f2244-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:21.628755 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cff7519c-358f-471f-a706-19be8bdaa779 req-dc2fd21e-cda8-4611-9a54-b28a3785db8e service nova] Lock "e410372b-c799-4d0d-879c-4e935f2f2244-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:21.628845 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-cff7519c-358f-471f-a706-19be8bdaa779 req-dc2fd21e-cda8-4611-9a54-b28a3785db8e service nova] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Processing event network-vif-plugged-1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:03:21.640281 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Starting migrate_disk_and_power_off {{(pid=98319) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 28 01:03:21.667231 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:21.671223 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:21.698593 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:21.787748 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:03:21.788586 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:03:21.788586 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:21.788728 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:21.863744 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:21.872540 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:21.880600 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c803ddeaf4f4b3db07587419087b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050f928f1ce449d6a447cd343dc4ff80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:03:21.952318 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-66745ce8-1022-4047-b031-b3c0a42b64cc req-d81eb6ed-e3d4-4f83-85be-d66edf9c6a15 service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Received event network-vif-unplugged-99ce3f06-1207-4d71-a43a-4cd61a8ae36c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:21.952634 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-66745ce8-1022-4047-b031-b3c0a42b64cc req-d81eb6ed-e3d4-4f83-85be-d66edf9c6a15 service nova] Acquiring lock "0ad69caa-c797-4e9d-96e3-7ad63523be49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:21.952700 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-66745ce8-1022-4047-b031-b3c0a42b64cc req-d81eb6ed-e3d4-4f83-85be-d66edf9c6a15 service nova] Lock "0ad69caa-c797-4e9d-96e3-7ad63523be49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:21.952796 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-66745ce8-1022-4047-b031-b3c0a42b64cc req-d81eb6ed-e3d4-4f83-85be-d66edf9c6a15 service nova] Lock "0ad69caa-c797-4e9d-96e3-7ad63523be49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:21.952904 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-66745ce8-1022-4047-b031-b3c0a42b64cc req-d81eb6ed-e3d4-4f83-85be-d66edf9c6a15 service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] No waiting events found dispatching network-vif-unplugged-99ce3f06-1207-4d71-a43a-4cd61a8ae36c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:03:21.953011 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-66745ce8-1022-4047-b031-b3c0a42b64cc req-d81eb6ed-e3d4-4f83-85be-d66edf9c6a15 service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Received unexpected event network-vif-unplugged-99ce3f06-1207-4d71-a43a-4cd61a8ae36c for instance with vm_state active and task_state resize_migrating.
May 28 01:03:21.961989 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930201.9616318, 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:03:21.962153 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] VM Started (Lifecycle Event)
May 28 01:03:21.992737 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Instance destroyed successfully.
May 28 01:03:21.993576 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:02:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-126410006',display_name='tempest-ServerActionsTestOtherA-server-126410006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serveractionstestothera-server-126410006',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOEhInnYH8OIPIS+AoDN91vRrTIl7emQTWVv1MQvwyvOos+qsDslhGKWhjOWQnKEu789RlRl8BiqEdHw4m/ZZapwhCdnQdK7FOovVNbbHnETkK3QhUrm9lcqluHt42QLQ==',key_name='tempest-keypair-1959255291',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:03:10Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='73ee6b376bb14dffb5664085cca58288',ramdisk_id='',reservation_id='r-m5d9fumv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1279266727',owner_user_name='tempest-ServerActionsTestOtherA-1279266727-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:03:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84e218b589ef4968828db0c740eaa72b',uuid=0ad69caa-c797-4e9d-96e3-7ad63523be49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "address": "fa:16:3e:2e:5f:00", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1876212854-network", "vif_mac": "fa:16:3e:2e:5f:00"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ce3f06-12", "ovs_interfaceid": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:03:21.993769 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Converting VIF {"id": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "address": "fa:16:3e:2e:5f:00", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1876212854-network", "vif_mac": "fa:16:3e:2e:5f:00"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ce3f06-12", "ovs_interfaceid": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:03:21.994344 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:5f:00,bridge_name='br-int',has_traffic_filtering=True,id=99ce3f06-1207-4d71-a43a-4cd61a8ae36c,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99ce3f06-12') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:03:21.994811 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:5f:00,bridge_name='br-int',has_traffic_filtering=True,id=99ce3f06-1207-4d71-a43a-4cd61a8ae36c,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99ce3f06-12') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:03:21.998034 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:21.998250 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99ce3f06-12, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:22.002108 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:03:22.002583 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:22.003826 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:22.003940 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=664f870b-ec82-412f-9e53-6c7a830a7be1) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:22.006370 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:03:22.010418 np0000001577 nova-compute[98319]: INFO os_vif [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:5f:00,bridge_name='br-int',has_traffic_filtering=True,id=99ce3f06-1207-4d71-a43a-4cd61a8ae36c,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99ce3f06-12')
May 28 01:03:22.012395 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:03:22.012789 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '48069396-3383-47de-ba84-d39b106a7dd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:03:22.012979 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:03:22.013407 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:03:22.013710 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '48069396-3383-47de-ba84-d39b106a7dd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:03:22.013880 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:03:22.052380 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:22.052380 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:22.052380 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:22.052380 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:22.052380 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:22.052380 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:22.052380 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:22.052380 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:22.052380 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:22.052380 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:22.052380 np0000001577 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:22.052380 np0000001577 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:22.052380 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:03:22.052673 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:22.052673 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:22.052673 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:22.052673 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:22.052673 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:22.052673 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:22.052673 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:22.052673 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:22.052673 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:22.052673 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:22.052673 np0000001577 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:22.052673 np0000001577 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:22.052673 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:03:22.052673 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', '63'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c', '65'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', '71')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:03:22.052947 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', '71')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:03:22.053663 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', '70')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:03:22.054518 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c98704da160>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3'): ({'sdo'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3'): ({'sdn'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:03:22.054718 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Removing multipathed devices sdo, sdn {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:03:22.054905 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Flush multipath device 33000000069cb9e3a {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:03:22.108519 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:03:22.157885 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:03:22.211819 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Checking to see if SCSI volumes sdo, sdn have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:03:22.211968 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] SCSI volumes sdo, sdn have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:03:22.213484 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Checking to see if device paths {'sdo', 'sdn'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:03:22.226268 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Device paths {'sdo', 'sdn'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:03:22.226357 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:03:22.239729 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:22.281367 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 71, target: iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3, portal: 192.168.40.100,3260]
May 28 01:03:22.281367 np0000001577 nova-compute[98319]: Logout of [sid: 71, target: iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3, portal: 192.168.40.100,3260] successful.
May 28 01:03:22.281367 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:22.295190 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:03:22.310420 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:22.323910 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:22.362731 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3, portal: 192.168.50.100,3260]
May 28 01:03:22.362731 np0000001577 nova-compute[98319]: Logout of [sid: 70, target: iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3, portal: 192.168.50.100,3260] successful.
May 28 01:03:22.362731 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:22.379045 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:03:22.383011 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:03:22.387752 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:22.393680 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:03:22.393680 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] <== disconnect_volume: return (378ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:03:22.393680 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:03:22.393680 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Instance spawned successfully.
May 28 01:03:22.393680 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:03:22.395808 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] skipping disk /dev/dm-8 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:03:22.396170 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/0ad69caa-c797-4e9d-96e3-7ad63523be49_resize/disk.config /opt/stack/data/nova/instances/0ad69caa-c797-4e9d-96e3-7ad63523be49/disk.config {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:22.461421 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CMD "cp -r /opt/stack/data/nova/instances/0ad69caa-c797-4e9d-96e3-7ad63523be49_resize/disk.config /opt/stack/data/nova/instances/0ad69caa-c797-4e9d-96e3-7ad63523be49/disk.config" returned: 0 in 0.065s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:22.468663 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:22.475263 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:03:22.514838 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Successfully created port: a2072e10-c933-4dd6-84e1-43734392b12e {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:03:22.800894 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:03:22.904617 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:22.904617 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:22.904617 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:22.904617 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:22.904617 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:22.904617 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:22.910331 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "6e370bae-b201-42eb-b5ef-f629b6f6502c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:22.910585 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "6e370bae-b201-42eb-b5ef-f629b6f6502c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:22.978014 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.99978109299991 future=<Future at 0x7c987047d640 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:03:22.978187 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930202.9780412, e410372b-c799-4d0d-879c-4e935f2f2244 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:03:22.978293 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] VM Started (Lifecycle Event)
May 28 01:03:22.994167 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Successfully updated port: a2072e10-c933-4dd6-84e1-43734392b12e {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:03:23.307343 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Booting with volume 70941468-6e8f-4715-abc0-bd620ed1bb5d at /dev/vda
May 28 01:03:23.343258 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:03:23.353226 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:03:23.370400 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:23.411277 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Took 7.81 seconds to spawn the instance on the hypervisor.
May 28 01:03:23.411277 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:23.411277 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:03:23.411277 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:03:23.412760 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:03:23.423820 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:03:23.425712 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe75:1c46', 'fe80::8c3:73ff:fe68:9ea1', 'fe80::fc16:3eff:fef0:246e', 'fe80::fc16:3eff:feca:a831', 'fe80::fc16:3eff:fe12:3f51', 'fe80::64e0:a4ff:fe34:ffd6', 'fe80::fc16:3eff:fe28:5665', 'fe80::fc16:3eff:fe11:792b', 'fe80::94c0:c3ff:fe67:958f', 'fe80::fc16:3eff:fe2e:7bc9', 'fe80::3834:39ff:fe20:36ec', 'fe80::fc16:3eff:fee7:febd', 'fe80::fc16:3eff:fe5e:ef9c', 'fe80::6cd5:f5ff:fe52:2a3e', 'fe80::fc16:3eff:fe71:990d', 'fe80::fc16:3eff:fe6e:a824', 'fe80::1457:8aff:feb2:8bfb', 'fe80::fc16:3eff:fe21:940'] 
May 28 01:03:23.426206 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:03:23.426419 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:03:23.426916 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:03:23.427322 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Updating existing volume attachment record: 60d9fef2-b1d6-4b3c-9501-b76873c4e4ca {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:03:23.481638 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:23.485138 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:03:23.496374 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "refresh_cache-27a2f570-fa9f-4f8d-8b04-b485a51b63cb" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:03:23.496523 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquired lock "refresh_cache-27a2f570-fa9f-4f8d-8b04-b485a51b63cb" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:03:23.496636 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:03:23.608195 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:23.608533 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:23.683957 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Port 99ce3f06-1207-4d71-a43a-4cd61a8ae36c binding to destination host np0000001577 is already ACTIVE {{(pid=98319) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 01:03:23.689788 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-da67269a-1bcf-4e54-bc99-ab2791e89034 req-8fe5fc61-5a87-4328-b140-511f945336a2 service nova] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Received event network-vif-plugged-1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:23.689868 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-da67269a-1bcf-4e54-bc99-ab2791e89034 req-8fe5fc61-5a87-4328-b140-511f945336a2 service nova] Acquiring lock "e410372b-c799-4d0d-879c-4e935f2f2244-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:23.690313 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-da67269a-1bcf-4e54-bc99-ab2791e89034 req-8fe5fc61-5a87-4328-b140-511f945336a2 service nova] Lock "e410372b-c799-4d0d-879c-4e935f2f2244-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:23.690313 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-da67269a-1bcf-4e54-bc99-ab2791e89034 req-8fe5fc61-5a87-4328-b140-511f945336a2 service nova] Lock "e410372b-c799-4d0d-879c-4e935f2f2244-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:23.690313 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-da67269a-1bcf-4e54-bc99-ab2791e89034 req-8fe5fc61-5a87-4328-b140-511f945336a2 service nova] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] No waiting events found dispatching network-vif-plugged-1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:03:23.690398 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-da67269a-1bcf-4e54-bc99-ab2791e89034 req-8fe5fc61-5a87-4328-b140-511f945336a2 service nova] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Received unexpected event network-vif-plugged-1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e for instance with vm_state active and task_state None.
May 28 01:03:23.690492 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-da67269a-1bcf-4e54-bc99-ab2791e89034 req-8fe5fc61-5a87-4328-b140-511f945336a2 service nova] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Received event network-changed-a2072e10-c933-4dd6-84e1-43734392b12e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:23.690615 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-da67269a-1bcf-4e54-bc99-ab2791e89034 req-8fe5fc61-5a87-4328-b140-511f945336a2 service nova] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Refreshing instance network info cache due to event network-changed-a2072e10-c933-4dd6-84e1-43734392b12e. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:03:23.690713 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-da67269a-1bcf-4e54-bc99-ab2791e89034 req-8fe5fc61-5a87-4328-b140-511f945336a2 service nova] Acquiring lock "refresh_cache-27a2f570-fa9f-4f8d-8b04-b485a51b63cb" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:03:23.925981 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Took 13.59 seconds to build instance.
May 28 01:03:23.974847 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:23.975017 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:23.977628 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:03:23.977746 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Claim successful on node np0000001577
May 28 01:03:23.987338 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930203.987118, e410372b-c799-4d0d-879c-4e935f2f2244 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:03:23.988472 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] VM Paused (Lifecycle Event)
May 28 01:03:24.043706 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0f88a8a0-7d9e-4c36-b1bd-b5b383fa5fa1 req-8e3d4f71-6ea9-4b6e-92f4-29dbb31ae9f7 service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Received event network-vif-unplugged-99ce3f06-1207-4d71-a43a-4cd61a8ae36c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:24.043850 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0f88a8a0-7d9e-4c36-b1bd-b5b383fa5fa1 req-8e3d4f71-6ea9-4b6e-92f4-29dbb31ae9f7 service nova] Acquiring lock "0ad69caa-c797-4e9d-96e3-7ad63523be49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:24.043991 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0f88a8a0-7d9e-4c36-b1bd-b5b383fa5fa1 req-8e3d4f71-6ea9-4b6e-92f4-29dbb31ae9f7 service nova] Lock "0ad69caa-c797-4e9d-96e3-7ad63523be49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:24.044117 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0f88a8a0-7d9e-4c36-b1bd-b5b383fa5fa1 req-8e3d4f71-6ea9-4b6e-92f4-29dbb31ae9f7 service nova] Lock "0ad69caa-c797-4e9d-96e3-7ad63523be49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:24.044233 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0f88a8a0-7d9e-4c36-b1bd-b5b383fa5fa1 req-8e3d4f71-6ea9-4b6e-92f4-29dbb31ae9f7 service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] No waiting events found dispatching network-vif-unplugged-99ce3f06-1207-4d71-a43a-4cd61a8ae36c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:03:24.044339 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-0f88a8a0-7d9e-4c36-b1bd-b5b383fa5fa1 req-8e3d4f71-6ea9-4b6e-92f4-29dbb31ae9f7 service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Received unexpected event network-vif-unplugged-99ce3f06-1207-4d71-a43a-4cd61a8ae36c for instance with vm_state active and task_state resize_migrating.
May 28 01:03:24.066799 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:03:24.231971 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:24.373810 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Updating instance_info_cache with network_info: [{"id": "a2072e10-c933-4dd6-84e1-43734392b12e", "address": "fa:16:3e:29:2a:08", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2072e10-c9", "ovs_interfaceid": "a2072e10-c933-4dd6-84e1-43734392b12e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:03:24.427348 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "e410372b-c799-4d0d-879c-4e935f2f2244" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.104s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:24.490036 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:24.493616 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930204.493395, e410372b-c799-4d0d-879c-4e935f2f2244 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:03:24.494187 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] VM Resumed (Lifecycle Event)
May 28 01:03:24.695771 np0000001577 nova-compute[98319]: DEBUG nova.compute.rpcapi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98319) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 01:03:24.700195 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "0ad69caa-c797-4e9d-96e3-7ad63523be49-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:24.700337 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "0ad69caa-c797-4e9d-96e3-7ad63523be49-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:24.701098 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "0ad69caa-c797-4e9d-96e3-7ad63523be49-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:24.876567 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Releasing lock "refresh_cache-27a2f570-fa9f-4f8d-8b04-b485a51b63cb" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:03:24.876567 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Instance network_info: |[{"id": "a2072e10-c933-4dd6-84e1-43734392b12e", "address": "fa:16:3e:29:2a:08", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2072e10-c9", "ovs_interfaceid": "a2072e10-c933-4dd6-84e1-43734392b12e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:03:24.876567 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-da67269a-1bcf-4e54-bc99-ab2791e89034 req-8fe5fc61-5a87-4328-b140-511f945336a2 service nova] Acquired lock "refresh_cache-27a2f570-fa9f-4f8d-8b04-b485a51b63cb" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:03:24.876812 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-da67269a-1bcf-4e54-bc99-ab2791e89034 req-8fe5fc61-5a87-4328-b140-511f945336a2 service nova] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Refreshing network info cache for port a2072e10-c933-4dd6-84e1-43734392b12e {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:03:24.996357 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:24.997947 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:03:25.379203 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-da67269a-1bcf-4e54-bc99-ab2791e89034 req-8fe5fc61-5a87-4328-b140-511f945336a2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:25.562746 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:03:25.564019 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:03:25.564166 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Creating image(s)
May 28 01:03:25.564387 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:03:25.564516 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Ensure instance console log exists: /opt/stack/data/nova/instances/27a2f570-fa9f-4f8d-8b04-b485a51b63cb/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:03:25.567890 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:25.568079 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:25.568246 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:25.568815 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Start _get_guest_xml network_info=[{"id": "a2072e10-c933-4dd6-84e1-43734392b12e", "address": "fa:16:3e:29:2a:08", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2072e10-c9", "ovs_interfaceid": "a2072e10-c933-4dd6-84e1-43734392b12e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70941468-6e8f-4715-abc0-bd620ed1bb5d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '27a2f570-fa9f-4f8d-8b04-b485a51b63cb', 'attached_at': '', 'detached_at': '', 'volume_id': '70941468-6e8f-4715-abc0-bd620ed1bb5d', 'serial': '70941468-6e8f-4715-abc0-bd620ed1bb5d'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '60d9fef2-b1d6-4b3c-9501-b76873c4e4ca', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:03:25.574217 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:03:25.575428 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1503492322', uuid='27a2f570-fa9f-4f8d-8b04-b485a51b63cb'), owner=OwnerMeta(userid='0c803ddeaf4f4b3db07587419087b3b2', username='tempest-TestVolumeBootPattern-1449742411-project-member', projectid='050f928f1ce449d6a447cd343dc4ff80', projectname='tempest-TestVolumeBootPattern-1449742411'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a2072e10-c933-4dd6-84e1-43734392b12e", "address": "fa:16:3e:29:2a:08", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2072e10-c9", "ovs_interfaceid": "a2072e10-c933-4dd6-84e1-43734392b12e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930205.5750268) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:03:25.578747 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:03:25.579150 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:03:25.579993 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:03:25.580209 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:03:25.581195 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:03:25.581492 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:03:25.581654 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:03:25.581754 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:03:25.581882 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:03:25.581974 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:03:25.582092 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:03:25.582246 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:03:25.582362 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:03:25.582478 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:03:25.582605 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:03:25.582729 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:03:25.600753 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:03:25.601030 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70941468-6e8f-4715-abc0-bd620ed1bb5d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:03:25.601234 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:03:25.601648 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:03:25.601849 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70941468-6e8f-4715-abc0-bd620ed1bb5d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:03:25.616436 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:03:25.617431 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:03:25.618091 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:03:25.618350 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:03:25.619473 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:03:25.619727 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:03:25.633901 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:03:25.633901 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:25.649307 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d] added
May 28 01:03:25.649307 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:03:25.649307 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:03:25.649307 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:03:25.649307 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:03:25.649307 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:03:25.649307 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:25.662017 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:03:25.662017 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:25.664350 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:03:25.664656 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0449(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:03:25.664855 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:03:25.678168 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d] added
May 28 01:03:25.678168 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:03:25.678168 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:03:25.678168 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:03:25.678168 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:03:25.678168 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:03:25.678168 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:25.678168 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:03:25.678453 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.06(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:03:25.678453 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:03:25.709819 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:25.827237 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "refresh_cache-0ad69caa-c797-4e9d-96e3-7ad63523be49" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:03:25.827381 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquired lock "refresh_cache-0ad69caa-c797-4e9d-96e3-7ad63523be49" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:03:25.827571 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:03:25.836445 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-da67269a-1bcf-4e54-bc99-ab2791e89034 req-8fe5fc61-5a87-4328-b140-511f945336a2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:26.026863 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-da67269a-1bcf-4e54-bc99-ab2791e89034 req-8fe5fc61-5a87-4328-b140-511f945336a2 service nova] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Updated VIF entry in instance network info cache for port a2072e10-c933-4dd6-84e1-43734392b12e. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:03:26.027360 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-da67269a-1bcf-4e54-bc99-ab2791e89034 req-8fe5fc61-5a87-4328-b140-511f945336a2 service nova] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Updating instance_info_cache with network_info: [{"id": "a2072e10-c933-4dd6-84e1-43734392b12e", "address": "fa:16:3e:29:2a:08", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2072e10-c9", "ovs_interfaceid": "a2072e10-c933-4dd6-84e1-43734392b12e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:03:26.101893 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-140fcce3-6560-4e62-885b-3c80c916fab2 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:26.140980 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:26.206194 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:03:26.206468 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:03:26.330534 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:26.529988 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-da67269a-1bcf-4e54-bc99-ab2791e89034 req-8fe5fc61-5a87-4328-b140-511f945336a2 service nova] Releasing lock "refresh_cache-27a2f570-fa9f-4f8d-8b04-b485a51b63cb" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:03:26.621787 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-140fcce3-6560-4e62-885b-3c80c916fab2 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] instance snapshotting
May 28 01:03:26.665766 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:26.667995 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:03:26.679189 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:03:26.688575 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:03:26.688575 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:03:26.697165 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:03:26.697165 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:26.707590 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:26.710587 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:03:26.729939 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:26.729939 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:26.729939 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:26.729939 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:26.729939 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:26.729939 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:26.729939 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:26.729939 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:26.729939 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:26.729939 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:26.729939 np0000001577 nova-compute[98319]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0595ba3-19a8-47b1-bec9-6c6a431e0ff3 (non-flash)
May 28 01:03:26.729939 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:03:26.730523 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:26.730523 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:26.730523 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:26.730523 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:26.730523 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:26.730523 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:26.730523 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:26.730523 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:26.730523 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:26.730523 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:26.730523 np0000001577 nova-compute[98319]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0595ba3-19a8-47b1-bec9-6c6a431e0ff3 (non-flash)
May 28 01:03:26.730523 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:03:26.740173 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:26.767692 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:26.767692 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:26.767692 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:26.767692 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:26.767692 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:26.767692 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:26.767692 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:26.767692 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:26.767692 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:26.767692 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:26.767692 np0000001577 nova-compute[98319]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0595ba3-19a8-47b1-bec9-6c6a431e0ff3 (non-flash)
May 28 01:03:26.767692 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:03:26.767692 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:26.767692 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:26.767692 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:26.767692 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:26.767692 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:26.767692 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:26.767692 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:26.767692 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:26.767692 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:26.767692 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:26.767692 np0000001577 nova-compute[98319]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0595ba3-19a8-47b1-bec9-6c6a431e0ff3 (non-flash)
May 28 01:03:26.767692 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:03:26.770433 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-140fcce3-6560-4e62-885b-3c80c916fab2 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Beginning live snapshot process
May 28 01:03:26.789748 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d, portal: 192.168.50.100,3260]
May 28 01:03:26.789748 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d, portal: 192.168.50.100,3260] successful.
May 28 01:03:26.789748 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:26.806092 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:26.816023 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d, portal: 192.168.40.100,3260]
May 28 01:03:26.816023 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d, portal: 192.168.40.100,3260] successful.
May 28 01:03:26.816023 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:26.817000 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Updating instance_info_cache with network_info: [{"id": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "address": "fa:16:3e:2e:5f:00", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ce3f06-12", "ovs_interfaceid": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:03:26.827873 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:26.846572 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:26.846572 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:26.846572 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:26.846572 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:26.846572 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:26.846572 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:26.846572 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:26.846572 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:26.846572 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:26.846572 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:26.846572 np0000001577 nova-compute[98319]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0595ba3-19a8-47b1-bec9-6c6a431e0ff3 (non-flash)
May 28 01:03:26.846572 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:26.846572 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:26.846572 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:03:26.846572 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:26.846572 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:26.846572 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:26.846572 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:26.846572 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:26.846572 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:26.846572 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:26.846572 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:26.846572 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:26.846572 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:26.846572 np0000001577 nova-compute[98319]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0595ba3-19a8-47b1-bec9-6c6a431e0ff3 (non-flash)
May 28 01:03:26.846572 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:26.846572 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:26.846572 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:03:26.846572 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.225s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:03:26.846572 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:03:26.846572 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] HCTL ('12', '-', '-', 0) found on session 74 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:03:26.848764 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:03:26.869622 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:26.869622 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:26.869622 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:26.869622 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:26.869622 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:26.869622 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:26.869622 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:26.869622 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:26.869622 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:26.869622 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:26.869622 np0000001577 nova-compute[98319]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0595ba3-19a8-47b1-bec9-6c6a431e0ff3 (non-flash)
May 28 01:03:26.869622 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:26.869622 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:26.869622 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:03:26.869622 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:26.869622 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:26.869622 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:26.869622 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:26.869622 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:26.869622 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:26.869622 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:26.869622 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:26.869622 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:26.869622 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:26.869622 np0000001577 nova-compute[98319]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0595ba3-19a8-47b1-bec9-6c6a431e0ff3 (non-flash)
May 28 01:03:26.869622 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:26.869622 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:26.869622 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:03:26.869622 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.250s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:03:26.869622 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:03:26.874392 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching for a device in session 74 and hctl ['12', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:03:26.874392 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] HCTL ('15', '-', '-', 0) found on session 75 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:03:26.874392 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:03:26.891204 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching for a device in session 75 and hctl ['15', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:03:26.906613 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "03f1821a-592e-4e02-b609-74f3d7e69b53" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:26.906613 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "03f1821a-592e-4e02-b609-74f3d7e69b53" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:27.004894 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:27.224574 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.247s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:27.224574 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:03:27.320053 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Releasing lock "refresh_cache-0ad69caa-c797-4e9d-96e3-7ad63523be49" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:03:27.409441 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Detaching volume fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c
May 28 01:03:27.472928 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Attempting to driver detach volume fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c from mountpoint /dev/vdc
May 28 01:03:27.480681 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Found disk vdc by alias ua-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:03:27.481707 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Found disk vdc by alias ua-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:03:27.481811 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Attempting to detach device vdc from instance 03f1821a-592e-4e02-b609-74f3d7e69b53 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:03:27.482015 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:03:27.482015 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:03:27.482015 np0000001577 nova-compute[98319]:   <alias name="ua-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c"/>
May 28 01:03:27.482015 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 28 01:03:27.482015 np0000001577 nova-compute[98319]:   <target dev="vdc" bus="virtio"/>
May 28 01:03:27.482015 np0000001577 nova-compute[98319]:   <serial>fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c</serial>
May 28 01:03:27.482015 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 01:03:27.482015 np0000001577 nova-compute[98319]: </disk>
May 28 01:03:27.482015 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:03:27.493026 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Successfully detached device vdc from instance 03f1821a-592e-4e02-b609-74f3d7e69b53 from the persistent domain config.
May 28 01:03:27.493193 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] (1/8): Attempting to detach device vdc with device alias ua-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c from instance 03f1821a-592e-4e02-b609-74f3d7e69b53 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:03:27.493485 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:03:27.493485 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:03:27.493485 np0000001577 nova-compute[98319]:   <alias name="ua-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c"/>
May 28 01:03:27.493485 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 28 01:03:27.493485 np0000001577 nova-compute[98319]:   <target dev="vdc" bus="virtio"/>
May 28 01:03:27.493485 np0000001577 nova-compute[98319]:   <serial>fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c</serial>
May 28 01:03:27.493485 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 01:03:27.493485 np0000001577 nova-compute[98319]: </disk>
May 28 01:03:27.493485 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:03:27.734797 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:03:27.743710 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:03:27.744503 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:27.744783 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:27.829125 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:03:27.830337 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8586a18edcf42cab0a60028135ae401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938c2829112843edb2054984e80ce7ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:03:27.840574 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:03:27.861959 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:27.879327 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching for a device in session 74 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:03:27.879848 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '70941468-6e8f-4715-abc0-bd620ed1bb5d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:03:27.892025 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching for a device in session 75 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:03:27.892256 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70941468-6e8f-4715-abc0-bd620ed1bb5d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:03:27.908819 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:03:27.909111 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:03:27.920182 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:03:27.922221 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe75:1c46', 'fe80::8c3:73ff:fe68:9ea1', 'fe80::fc16:3eff:fef0:246e', 'fe80::fc16:3eff:feca:a831', 'fe80::fc16:3eff:fe12:3f51', 'fe80::64e0:a4ff:fe34:ffd6', 'fe80::fc16:3eff:fe28:5665', 'fe80::fc16:3eff:fe11:792b', 'fe80::94c0:c3ff:fe67:958f', 'fe80::fc16:3eff:fe2e:7bc9', 'fe80::3834:39ff:fe20:36ec', 'fe80::fc16:3eff:fee7:febd', 'fe80::fc16:3eff:fe5e:ef9c', 'fe80::6cd5:f5ff:fe52:2a3e', 'fe80::fc16:3eff:fe71:990d', 'fe80::fc16:3eff:fe6e:a824', 'fe80::1457:8aff:feb2:8bfb', 'fe80::fc16:3eff:fe21:940'] 
May 28 01:03:27.922361 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:03:27.922498 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:03:27.922796 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] <== get_connector_properties: return (93ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:03:28.157456 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930208.1568651, 03f1821a-592e-4e02-b609-74f3d7e69b53 => ua-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:03:28.158374 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c for instance 03f1821a-592e-4e02-b609-74f3d7e69b53 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:03:28.163593 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Successfully detached device vdc from instance 03f1821a-592e-4e02-b609-74f3d7e69b53 from the live domain config.
May 28 01:03:28.165036 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:03:28.165719 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c', 'iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:03:28.165858 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:03:28.244974 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:03:28.283347 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-140fcce3-6560-4e62-885b-3c80c916fab2 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e410372b-c799-4d0d-879c-4e935f2f2244/disk --force-share --output=json -f qcow2 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:28.344745 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Successfully created port: 22370d17-1928-456e-af7e-f2c86f0bc253 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:03:28.373216 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-140fcce3-6560-4e62-885b-3c80c916fab2 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e410372b-c799-4d0d-879c-4e935f2f2244/disk --force-share --output=json -f qcow2" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:28.373867 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-140fcce3-6560-4e62-885b-3c80c916fab2 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e410372b-c799-4d0d-879c-4e935f2f2244/disk --force-share --output=json -f qcow2 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:28.462888 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-140fcce3-6560-4e62-885b-3c80c916fab2 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e410372b-c799-4d0d-879c-4e935f2f2244/disk --force-share --output=json -f qcow2" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:28.464192 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-140fcce3-6560-4e62-885b-3c80c916fab2 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:03:28.467043 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-140fcce3-6560-4e62-885b-3c80c916fab2 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:03:28.467463 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-140fcce3-6560-4e62-885b-3c80c916fab2 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:28.567919 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-140fcce3-6560-4e62-885b-3c80c916fab2 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.100s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:28.568394 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-140fcce3-6560-4e62-885b-3c80c916fab2 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplulfqerg/559b198c1afd4d7bb37eac0b75a4729c.delta 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:28.618858 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:03:28.624953 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-140fcce3-6560-4e62-885b-3c80c916fab2 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplulfqerg/559b198c1afd4d7bb37eac0b75a4729c.delta 1073741824" returned: 0 in 0.056s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:28.624953 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-140fcce3-6560-4e62-885b-3c80c916fab2 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Quiescing instance not available: QEMU guest agent is not enabled.
May 28 01:03:28.749785 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:03:28.909258 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-140fcce3-6560-4e62-885b-3c80c916fab2 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 28 01:03:28.910538 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-140fcce3-6560-4e62-885b-3c80c916fab2 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Skipping quiescing instance: QEMU guest agent is not enabled.
May 28 01:03:28.955679 np0000001577 nova-compute[98319]: DEBUG nova.privsep.utils [None req-140fcce3-6560-4e62-885b-3c80c916fab2 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 01:03:28.955947 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-140fcce3-6560-4e62-885b-3c80c916fab2 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplulfqerg/559b198c1afd4d7bb37eac0b75a4729c.delta /opt/stack/data/nova/instances/snapshots/tmplulfqerg/559b198c1afd4d7bb37eac0b75a4729c {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:28.992195 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Successfully updated port: 22370d17-1928-456e-af7e-f2c86f0bc253 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:03:29.024942 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a5443022-9b91-4fa4-a9d1-dabfec69fe7d req-b76c2458-b548-4496-9e8a-e97c46d2b00b service nova] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Received event network-changed-22370d17-1928-456e-af7e-f2c86f0bc253 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:29.028493 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a5443022-9b91-4fa4-a9d1-dabfec69fe7d req-b76c2458-b548-4496-9e8a-e97c46d2b00b service nova] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Refreshing instance network info cache due to event network-changed-22370d17-1928-456e-af7e-f2c86f0bc253. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:03:29.029154 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5443022-9b91-4fa4-a9d1-dabfec69fe7d req-b76c2458-b548-4496-9e8a-e97c46d2b00b service nova] Acquiring lock "refresh_cache-6e370bae-b201-42eb-b5ef-f629b6f6502c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:03:29.029154 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5443022-9b91-4fa4-a9d1-dabfec69fe7d req-b76c2458-b548-4496-9e8a-e97c46d2b00b service nova] Acquired lock "refresh_cache-6e370bae-b201-42eb-b5ef-f629b6f6502c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:03:29.029264 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-a5443022-9b91-4fa4-a9d1-dabfec69fe7d req-b76c2458-b548-4496-9e8a-e97c46d2b00b service nova] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Refreshing network info cache for port 22370d17-1928-456e-af7e-f2c86f0bc253 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:03:29.066625 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-140fcce3-6560-4e62-885b-3c80c916fab2 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplulfqerg/559b198c1afd4d7bb37eac0b75a4729c.delta /opt/stack/data/nova/instances/snapshots/tmplulfqerg/559b198c1afd4d7bb37eac0b75a4729c" returned: 0 in 0.111s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:29.067050 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-140fcce3-6560-4e62-885b-3c80c916fab2 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Snapshot extracted, beginning image upload
May 28 01:03:29.085741 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Starting finish_migration {{(pid=98319) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 28 01:03:29.086828 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Instance directory exists: not creating {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 01:03:29.086975 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Creating image(s)
May 28 01:03:29.087563 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:03:29.087563 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Ensure instance console log exists: /opt/stack/data/nova/instances/0ad69caa-c797-4e9d-96e3-7ad63523be49/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:03:29.087893 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:29.088091 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:29.091126 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:29.091126 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Start _get_guest_xml network_info=[{"id": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "address": "fa:16:3e:2e:5f:00", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1876212854-network", "vif_mac": "fa:16:3e:2e:5f:00"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ce3f06-12", "ovs_interfaceid": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '48069396-3383-47de-ba84-d39b106a7dd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '0ad69caa-c797-4e9d-96e3-7ad63523be49', 'attached_at': '2026-05-28T01:03:28.000000', 'detached_at': '', 'volume_id': '48069396-3383-47de-ba84-d39b106a7dd3', 'serial': '48069396-3383-47de-ba84-d39b106a7dd3'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '01aac2a3-c10e-42aa-8f91-4f55e804bc72', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:03:29.093387 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:03:29.094810 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-126410006', uuid='0ad69caa-c797-4e9d-96e3-7ad63523be49'), owner=OwnerMeta(userid='84e218b589ef4968828db0c740eaa72b', username='tempest-ServerActionsTestOtherA-1279266727-project-member', projectid='73ee6b376bb14dffb5664085cca58288', projectname='tempest-ServerActionsTestOtherA-1279266727'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "address": "fa:16:3e:2e:5f:00", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1876212854-network", "vif_mac": "fa:16:3e:2e:5f:00"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ce3f06-12", "ovs_interfaceid": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930209.0944045) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:03:29.096065 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:03:29.096571 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:03:29.097438 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:03:29.098984 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:03:29.098984 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:03:29.098984 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:03:29.099197 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:03:29.099326 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:03:29.099598 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:03:29.099740 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:03:29.099892 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:03:29.100134 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:03:29.100282 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:03:29.100681 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:03:29.100858 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:03:29.101027 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:03:29.112742 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad69caa-c797-4e9d-96e3-7ad63523be49/disk.config --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:29.232283 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad69caa-c797-4e9d-96e3-7ad63523be49/disk.config --force-share --output=json" returned: 0 in 0.119s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:29.232781 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ad69caa-c797-4e9d-96e3-7ad63523be49/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:29.233025 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "/opt/stack/data/nova/instances/0ad69caa-c797-4e9d-96e3-7ad63523be49/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:29.233877 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "/opt/stack/data/nova/instances/0ad69caa-c797-4e9d-96e3-7ad63523be49/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:29.234364 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:03:29.234908 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '48069396-3383-47de-ba84-d39b106a7dd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:03:29.235405 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:03:29.260662 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Booting with volume abcd46b2-0a9a-4784-a743-1c36a51133ff at /dev/vda
May 28 01:03:29.300628 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:03:29.326572 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:03:29.352643 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:29.390329 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:03:29.390697 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:03:29.398401 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:03:29.400019 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe75:1c46', 'fe80::8c3:73ff:fe68:9ea1', 'fe80::fc16:3eff:fef0:246e', 'fe80::fc16:3eff:feca:a831', 'fe80::fc16:3eff:fe12:3f51', 'fe80::64e0:a4ff:fe34:ffd6', 'fe80::fc16:3eff:fe28:5665', 'fe80::fc16:3eff:fe11:792b', 'fe80::94c0:c3ff:fe67:958f', 'fe80::fc16:3eff:fe2e:7bc9', 'fe80::3834:39ff:fe20:36ec', 'fe80::fc16:3eff:fee7:febd', 'fe80::fc16:3eff:fe5e:ef9c', 'fe80::6cd5:f5ff:fe52:2a3e', 'fe80::fc16:3eff:fe71:990d', 'fe80::fc16:3eff:fe6e:a824', 'fe80::1457:8aff:feb2:8bfb', 'fe80::fc16:3eff:fe21:940'] 
May 28 01:03:29.400199 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:03:29.400260 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:03:29.400432 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] <== get_connector_properties: return (99ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:03:29.400926 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Updating existing volume attachment record: ef20f5f5-4516-4def-a855-73f8f8ccc6ef {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:03:29.499060 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "refresh_cache-6e370bae-b201-42eb-b5ef-f629b6f6502c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:03:29.534556 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-a5443022-9b91-4fa4-a9d1-dabfec69fe7d req-b76c2458-b548-4496-9e8a-e97c46d2b00b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:29.593623 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-a5443022-9b91-4fa4-a9d1-dabfec69fe7d req-b76c2458-b548-4496-9e8a-e97c46d2b00b service nova] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:03:29.634044 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Found WWN 3300000002b367c70 for multipath device dm-2 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:03:29.635049 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.033s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:03:29.635049 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] <== connect_volume: return (4032ms) {'type': 'block', 'scsi_wwn': '3300000002b367c70', 'path': '/dev/dm-2', 'multipath_id': '3300000002b367c70'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:03:29.635049 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002b367c70', 'path': '/dev/dm-2', 'multipath_id': '3300000002b367c70'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:03:29.635324 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.469s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:03:29.635713 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c', 'iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:03:29.635868 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:03:29.668475 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:29.668475 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:29.668475 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:29.668475 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:29.668475 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:29.668475 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:29.668475 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:29.668475 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:29.668475 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:29.668475 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:29.668475 np0000001577 nova-compute[98319]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0595ba3-19a8-47b1-bec9-6c6a431e0ff3 (non-flash)
May 28 01:03:29.668475 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:29.668475 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:29.668475 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:03:29.669011 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:29.669011 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:29.669011 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:29.669011 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:29.669011 np0000001577 nova-compute[98319]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:29.669011 np0000001577 nova-compute[98319]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c (non-flash)
May 28 01:03:29.669011 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:29.669011 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:29.669011 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:29.669011 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:29.669011 np0000001577 nova-compute[98319]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0595ba3-19a8-47b1-bec9-6c6a431e0ff3 (non-flash)
May 28 01:03:29.669011 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:29.669011 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:29.669011 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:03:29.669011 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', '63'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c', '65'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', '69'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0595ba3-19a8-47b1-bec9-6c6a431e0ff3', '73'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', '74'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', '75')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:03:29.669516 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c', '65')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:03:29.670978 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c', '64')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:03:29.672235 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c98705c2660>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c'): ({'sdc'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:03:29.672482 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Removing multipathed devices sdf, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:03:29.672800 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Flush multipath device 330000000d50195f9 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:03:29.714319 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:03:29.770920 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-a5443022-9b91-4fa4-a9d1-dabfec69fe7d req-b76c2458-b548-4496-9e8a-e97c46d2b00b service nova] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:03:29.774625 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:03:29.828168 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Checking to see if SCSI volumes sdf, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:03:29.828373 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] SCSI volumes sdf, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:03:29.830090 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Checking to see if device paths {'sdf', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:03:29.840931 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Device paths {'sdf', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:03:29.841112 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:03:29.852960 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:29.897814 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 65, target: iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c, portal: 192.168.40.100,3260]
May 28 01:03:29.897814 np0000001577 nova-compute[98319]: Logout of [sid: 65, target: iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c, portal: 192.168.40.100,3260] successful.
May 28 01:03:29.897814 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:29.917922 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:29.930982 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:29.966573 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 64, target: iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c, portal: 192.168.50.100,3260]
May 28 01:03:29.966573 np0000001577 nova-compute[98319]: Logout of [sid: 64, target: iqn.2023-03.storpool.com:os--volume-fd73b251-0e4d-4f35-b85b-0d38fb9dbe8c, portal: 192.168.50.100,3260] successful.
May 28 01:03:29.966573 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:29.987612 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:29.987807 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:03:29.987949 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] <== disconnect_volume: return (1822ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:03:29.988120 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:03:29.993407 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.757s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:03:29.993407 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '48069396-3383-47de-ba84-d39b106a7dd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:03:30.005262 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:03:30.006704 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:03:30.007959 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:03:30.008183 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:03:30.016102 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.009s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:03:30.016102 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:03:30.024311 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:03:30.024311 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:30.031530 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:03:30.031530 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:30.041265 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3] added
May 28 01:03:30.041265 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:03:30.041265 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:03:30.041265 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:03:30.041265 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:03:30.041265 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:03:30.041265 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:30.041724 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:03:30.041904 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0337(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:03:30.042200 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3] added
May 28 01:03:30.042200 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:03:30.042200 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:03:30.042200 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:03:30.042200 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:03:30.042200 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:03:30.042200 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:30.042647 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:03:30.042647 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:03:30.042726 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0276(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:03:30.042834 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:03:30.146319 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:03:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1503492322',display_name='tempest-TestVolumeBootPattern-server-1503492322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpattern-server-1503492322',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8QzN7WIM/7r+FXfxp48vv6ACDZyOEQjp19a7p1UcygauFxHFUkfzlUA3gFyPYoEyNZ3UhngJ8gsxkE2OmPRYuT7eZJnm0MUNhRjsZz5nqxS6AcX7i+n2BWwU1Ts1LTnw==',key_name='tempest-keypair-145839747',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='050f928f1ce449d6a447cd343dc4ff80',ramdisk_id='',reservation_id='r-m1wnmyaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1449742411',owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:03:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c803ddeaf4f4b3db07587419087b3b2',uuid=27a2f570-fa9f-4f8d-8b04-b485a51b63cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2072e10-c933-4dd6-84e1-43734392b12e", "address": "fa:16:3e:29:2a:08", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2072e10-c9", "ovs_interfaceid": "a2072e10-c933-4dd6-84e1-43734392b12e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:03:30.146573 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converting VIF {"id": "a2072e10-c933-4dd6-84e1-43734392b12e", "address": "fa:16:3e:29:2a:08", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2072e10-c9", "ovs_interfaceid": "a2072e10-c933-4dd6-84e1-43734392b12e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:03:30.147246 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:2a:08,bridge_name='br-int',has_traffic_filtering=True,id=a2072e10-c933-4dd6-84e1-43734392b12e,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2072e10-c9') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:03:30.148057 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lazy-loading 'pci_devices' on Instance uuid 27a2f570-fa9f-4f8d-8b04-b485a51b63cb {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:03:30.273835 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5443022-9b91-4fa4-a9d1-dabfec69fe7d req-b76c2458-b548-4496-9e8a-e97c46d2b00b service nova] Releasing lock "refresh_cache-6e370bae-b201-42eb-b5ef-f629b6f6502c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:03:30.275694 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquired lock "refresh_cache-6e370bae-b201-42eb-b5ef-f629b6f6502c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:03:30.275694 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:03:30.548427 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lazy-loading 'flavor' on Instance uuid 03f1821a-592e-4e02-b609-74f3d7e69b53 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:03:30.651016 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] End _get_guest_xml xml=<domain type="qemu">
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:   <uuid>27a2f570-fa9f-4f8d-8b04-b485a51b63cb</uuid>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:   <name>instance-00000024</name>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestVolumeBootPattern-server-1503492322</nova:name>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:03:25</nova:creationTime>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       <nova:image uuid="">
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:         <nova:user uuid="0c803ddeaf4f4b3db07587419087b3b2">tempest-TestVolumeBootPattern-1449742411-project-member</nova:user>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:         <nova:project uuid="050f928f1ce449d6a447cd343dc4ff80">tempest-TestVolumeBootPattern-1449742411</nova:project>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:         <nova:port uuid="a2072e10-c933-4dd6-84e1-43734392b12e">
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:     <system>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       <entry name="serial">27a2f570-fa9f-4f8d-8b04-b485a51b63cb</entry>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       <entry name="uuid">27a2f570-fa9f-4f8d-8b04-b485a51b63cb</entry>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:     </system>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:   <os>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:   </os>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:   <features>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:   </features>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:   <devices>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/27a2f570-fa9f-4f8d-8b04-b485a51b63cb/disk.config"/>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:     </disk>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       <alias name="ua-70941468-6e8f-4715-abc0-bd620ed1bb5d"/>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-2"/>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       <serial>70941468-6e8f-4715-abc0-bd620ed1bb5d</serial>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:     </disk>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:29:2a:08"/>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       <target dev="tapa2072e10-c9"/>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:     </interface>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/27a2f570-fa9f-4f8d-8b04-b485a51b63cb/console.log" append="off"/>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:     </serial>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:     <video>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:     </video>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:     </rng>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:   </devices>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]: </domain>
May 28 01:03:30.651016 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:03:30.652919 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Preparing to wait for external event network-vif-plugged-a2072e10-c933-4dd6-84e1-43734392b12e {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:03:30.652919 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "27a2f570-fa9f-4f8d-8b04-b485a51b63cb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:30.652919 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "27a2f570-fa9f-4f8d-8b04-b485a51b63cb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:30.652919 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "27a2f570-fa9f-4f8d-8b04-b485a51b63cb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:30.652919 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:03:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1503492322',display_name='tempest-TestVolumeBootPattern-server-1503492322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpattern-server-1503492322',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8QzN7WIM/7r+FXfxp48vv6ACDZyOEQjp19a7p1UcygauFxHFUkfzlUA3gFyPYoEyNZ3UhngJ8gsxkE2OmPRYuT7eZJnm0MUNhRjsZz5nqxS6AcX7i+n2BWwU1Ts1LTnw==',key_name='tempest-keypair-145839747',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='050f928f1ce449d6a447cd343dc4ff80',ramdisk_id='',reservation_id='r-m1wnmyaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1449742411',owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:03:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c803ddeaf4f4b3db07587419087b3b2',uuid=27a2f570-fa9f-4f8d-8b04-b485a51b63cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2072e10-c933-4dd6-84e1-43734392b12e", "address": "fa:16:3e:29:2a:08", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2072e10-c9", "ovs_interfaceid": "a2072e10-c933-4dd6-84e1-43734392b12e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:03:30.652919 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converting VIF {"id": "a2072e10-c933-4dd6-84e1-43734392b12e", "address": "fa:16:3e:29:2a:08", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2072e10-c9", "ovs_interfaceid": "a2072e10-c933-4dd6-84e1-43734392b12e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:03:30.652919 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:2a:08,bridge_name='br-int',has_traffic_filtering=True,id=a2072e10-c933-4dd6-84e1-43734392b12e,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2072e10-c9') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:03:30.653183 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:2a:08,bridge_name='br-int',has_traffic_filtering=True,id=a2072e10-c933-4dd6-84e1-43734392b12e,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2072e10-c9') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:03:30.653599 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:30.653973 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:30.654304 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:03:30.655495 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:30.655698 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2fc4e3de-bc33-5daa-be22-b1b834c90775', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:30.657557 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:30.658387 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:03:30.660683 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:30.660842 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2072e10-c9, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:30.661268 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2072e10-c9, col_values=(('qos', UUID('741b95e3-3843-4802-846f-befb94904114')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:30.661430 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2072e10-c9, col_values=(('external_ids', {'iface-id': 'a2072e10-c933-4dd6-84e1-43734392b12e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:2a:08', 'vm-uuid': '27a2f570-fa9f-4f8d-8b04-b485a51b63cb'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:30.664088 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:03:30.668830 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:30.669670 np0000001577 nova-compute[98319]: INFO os_vif [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:2a:08,bridge_name='br-int',has_traffic_filtering=True,id=a2072e10-c933-4dd6-84e1-43734392b12e,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2072e10-c9')
May 28 01:03:30.849107 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:03:30.987484 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:31.042865 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:03:31.043264 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:03:31.061802 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:03:31.061802 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:03:31.066071 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:03:31.066071 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:31.075314 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:31.083366 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:31.094121 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:31.094121 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:31.094121 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:31.094121 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:31.094121 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:31.094121 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:31.094121 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:31.094121 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:31.094121 np0000001577 nova-compute[98319]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0595ba3-19a8-47b1-bec9-6c6a431e0ff3 (non-flash)
May 28 01:03:31.094121 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:31.094121 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:31.094121 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:03:31.094427 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:31.094427 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:31.094427 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:31.094427 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:31.094427 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:31.094427 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:31.094427 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:31.094427 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:31.094427 np0000001577 nova-compute[98319]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0595ba3-19a8-47b1-bec9-6c6a431e0ff3 (non-flash)
May 28 01:03:31.094427 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:31.094427 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:31.094427 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:03:31.105023 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:31.105023 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:31.105023 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:31.105023 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:31.105023 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:31.105023 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:31.105023 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:31.105023 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:31.105023 np0000001577 nova-compute[98319]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0595ba3-19a8-47b1-bec9-6c6a431e0ff3 (non-flash)
May 28 01:03:31.105023 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:31.105023 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:31.105023 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:03:31.105023 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:31.105023 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:31.105023 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:31.105023 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:31.105023 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:31.105023 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:31.105023 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:31.105023 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:31.105023 np0000001577 nova-compute[98319]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0595ba3-19a8-47b1-bec9-6c6a431e0ff3 (non-flash)
May 28 01:03:31.105023 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:31.105023 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:31.105023 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:03:31.140979 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Updating instance_info_cache with network_info: [{"id": "22370d17-1928-456e-af7e-f2c86f0bc253", "address": "fa:16:3e:ab:54:e1", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22370d17-19", "ovs_interfaceid": "22370d17-1928-456e-af7e-f2c86f0bc253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:03:31.143449 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:31.149870 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3, portal: 192.168.40.100,3260]
May 28 01:03:31.149870 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3, portal: 192.168.40.100,3260] successful.
May 28 01:03:31.149870 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:31.158435 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3, portal: 192.168.50.100,3260]
May 28 01:03:31.158435 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3, portal: 192.168.50.100,3260] successful.
May 28 01:03:31.158435 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:31.166693 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:31.173319 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:31.190403 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:31.190403 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:31.190403 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:31.190403 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:31.190403 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:31.190403 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:31.190403 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:31.190403 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:31.190403 np0000001577 nova-compute[98319]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0595ba3-19a8-47b1-bec9-6c6a431e0ff3 (non-flash)
May 28 01:03:31.190403 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:31.190403 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:31.190403 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:31.190403 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:31.190403 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:03:31.191482 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:31.191482 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:31.191482 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:31.191482 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:31.191482 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:31.191482 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:31.191482 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:31.191482 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:31.191482 np0000001577 nova-compute[98319]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0595ba3-19a8-47b1-bec9-6c6a431e0ff3 (non-flash)
May 28 01:03:31.191482 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:31.191482 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:31.191482 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:31.191482 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:31.191482 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:03:31.192478 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.186s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:03:31.192926 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:03:31.194122 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:31.194122 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:31.194122 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:31.194122 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:31.194122 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:31.194122 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:31.194122 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:31.194122 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:31.194122 np0000001577 nova-compute[98319]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0595ba3-19a8-47b1-bec9-6c6a431e0ff3 (non-flash)
May 28 01:03:31.194122 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:31.194122 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:31.194122 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:31.194122 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:31.194122 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:03:31.194381 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:31.194381 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:31.194381 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:31.194381 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:31.194381 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:31.194381 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:31.194381 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:31.194381 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:31.194381 np0000001577 nova-compute[98319]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0595ba3-19a8-47b1-bec9-6c6a431e0ff3 (non-flash)
May 28 01:03:31.194381 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:31.194381 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:31.194381 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:31.194381 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:31.194381 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:03:31.194655 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.180s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:03:31.195054 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:03:31.196786 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] HCTL ('8', '-', '-', 0) found on session 76 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:03:31.196981 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:03:31.198670 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] HCTL ('11', '-', '-', 0) found on session 77 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:03:31.198793 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:03:31.211426 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Searching for a device in session 76 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:03:31.212569 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '48069396-3383-47de-ba84-d39b106a7dd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:03:31.219223 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Searching for a device in session 77 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:03:31.221093 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '48069396-3383-47de-ba84-d39b106a7dd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:03:31.463518 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-140fcce3-6560-4e62-885b-3c80c916fab2 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Snapshot image upload complete
May 28 01:03:31.463949 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-140fcce3-6560-4e62-885b-3c80c916fab2 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Took 4.84 seconds to snapshot the instance on the hypervisor.
May 28 01:03:31.496894 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:03:31.498656 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:03:31.498656 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Creating image(s)
May 28 01:03:31.499341 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:03:31.500261 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Ensure instance console log exists: /opt/stack/data/nova/instances/6e370bae-b201-42eb-b5ef-f629b6f6502c/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:03:31.500261 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:31.500261 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:31.500261 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:31.565082 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b521c1ee-faab-4b06-bfc4-b74d09557155 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "03f1821a-592e-4e02-b609-74f3d7e69b53" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.659s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:31.650823 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Releasing lock "refresh_cache-6e370bae-b201-42eb-b5ef-f629b6f6502c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:03:31.650978 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Instance network_info: |[{"id": "22370d17-1928-456e-af7e-f2c86f0bc253", "address": "fa:16:3e:ab:54:e1", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22370d17-19", "ovs_interfaceid": "22370d17-1928-456e-af7e-f2c86f0bc253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:03:31.651887 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Start _get_guest_xml network_info=[{"id": "22370d17-1928-456e-af7e-f2c86f0bc253", "address": "fa:16:3e:ab:54:e1", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22370d17-19", "ovs_interfaceid": "22370d17-1928-456e-af7e-f2c86f0bc253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff', 'iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'abcd46b2-0a9a-4784-a743-1c36a51133ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '6e370bae-b201-42eb-b5ef-f629b6f6502c', 'attached_at': '', 'detached_at': '', 'volume_id': 'abcd46b2-0a9a-4784-a743-1c36a51133ff', 'serial': 'abcd46b2-0a9a-4784-a743-1c36a51133ff', 'multiattach': True}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'ef20f5f5-4516-4def-a855-73f8f8ccc6ef', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:03:31.654578 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:03:31.656016 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-1249093534', uuid='6e370bae-b201-42eb-b5ef-f629b6f6502c'), owner=OwnerMeta(userid='f8586a18edcf42cab0a60028135ae401', username='tempest-AttachVolumeMultiAttachTest-89204095-project-member', projectid='938c2829112843edb2054984e80ce7ad', projectname='tempest-AttachVolumeMultiAttachTest-89204095'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "22370d17-1928-456e-af7e-f2c86f0bc253", "address": "fa:16:3e:ab:54:e1", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22370d17-19", "ovs_interfaceid": "22370d17-1928-456e-af7e-f2c86f0bc253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930211.6556082) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:03:31.657289 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:03:31.657999 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:03:31.661568 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:03:31.661568 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:03:31.661568 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:03:31.661568 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:03:31.661568 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:03:31.661568 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:03:31.661568 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:03:31.661568 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:03:31.661568 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:03:31.661568 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:03:31.661568 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:03:31.661568 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:03:31.661568 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:03:31.661568 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:03:31.678773 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:03:31.679260 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff', 'iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'abcd46b2-0a9a-4784-a743-1c36a51133ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:03:31.679540 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:03:32.007983 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:03:32.187708 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:03:32.187878 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:03:32.187878 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] No VIF found with MAC fa:16:3e:29:2a:08, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:03:32.188238 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Using config drive
May 28 01:03:32.295688 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7917c1fa-85f0-46da-9850-fd4b0c02b7b1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "03f1821a-592e-4e02-b609-74f3d7e69b53" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:32.295688 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7917c1fa-85f0-46da-9850-fd4b0c02b7b1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "03f1821a-592e-4e02-b609-74f3d7e69b53" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:32.295688 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7917c1fa-85f0-46da-9850-fd4b0c02b7b1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "03f1821a-592e-4e02-b609-74f3d7e69b53-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:32.295688 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7917c1fa-85f0-46da-9850-fd4b0c02b7b1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "03f1821a-592e-4e02-b609-74f3d7e69b53-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:32.295688 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7917c1fa-85f0-46da-9850-fd4b0c02b7b1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "03f1821a-592e-4e02-b609-74f3d7e69b53-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:32.297307 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7917c1fa-85f0-46da-9850-fd4b0c02b7b1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Terminating instance
May 28 01:03:32.692919 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:32.799664 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7917c1fa-85f0-46da-9850-fd4b0c02b7b1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:03:32.806026 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Creating config drive at /opt/stack/data/nova/instances/27a2f570-fa9f-4f8d-8b04-b485a51b63cb/disk.config
May 28 01:03:32.811324 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/27a2f570-fa9f-4f8d-8b04-b485a51b63cb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpprb4bwls {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:32.829362 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:32.851732 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:32.851732 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:32.877610 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/27a2f570-fa9f-4f8d-8b04-b485a51b63cb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpprb4bwls" returned: 0 in 0.066s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:32.880069 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:32.880658 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:33.024687 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5963d828-507c-4b6a-a2a6-c7636f2763ca req-f8ca7185-cbf9-4692-b0f8-6ffef88f9026 service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Received event network-vif-unplugged-95f81148-2a4e-4ca8-ad05-cb73d6f2951f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:33.024687 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5963d828-507c-4b6a-a2a6-c7636f2763ca req-f8ca7185-cbf9-4692-b0f8-6ffef88f9026 service nova] Acquiring lock "03f1821a-592e-4e02-b609-74f3d7e69b53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:33.024687 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5963d828-507c-4b6a-a2a6-c7636f2763ca req-f8ca7185-cbf9-4692-b0f8-6ffef88f9026 service nova] Lock "03f1821a-592e-4e02-b609-74f3d7e69b53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:33.024687 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5963d828-507c-4b6a-a2a6-c7636f2763ca req-f8ca7185-cbf9-4692-b0f8-6ffef88f9026 service nova] Lock "03f1821a-592e-4e02-b609-74f3d7e69b53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:33.024687 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5963d828-507c-4b6a-a2a6-c7636f2763ca req-f8ca7185-cbf9-4692-b0f8-6ffef88f9026 service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] No waiting events found dispatching network-vif-unplugged-95f81148-2a4e-4ca8-ad05-cb73d6f2951f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:03:33.024687 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5963d828-507c-4b6a-a2a6-c7636f2763ca req-f8ca7185-cbf9-4692-b0f8-6ffef88f9026 service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Received event network-vif-unplugged-95f81148-2a4e-4ca8-ad05-cb73d6f2951f for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:03:33.026652 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Found WWN 33000000069cb9e3a for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:03:33.027001 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:03:33.027414 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] <== connect_volume: return (3792ms) {'type': 'block', 'scsi_wwn': '33000000069cb9e3a', 'path': '/dev/dm-0', 'multipath_id': '33000000069cb9e3a'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:03:33.027541 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000069cb9e3a', 'path': '/dev/dm-0', 'multipath_id': '33000000069cb9e3a'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:03:33.030176 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.351s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:03:33.030431 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff', 'iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'abcd46b2-0a9a-4784-a743-1c36a51133ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:03:33.044686 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:03:33.045260 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:03:33.045723 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:03:33.045923 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:03:33.046290 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:03:33.046458 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:03:33.062201 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:03:33.062201 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:33.075946 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:03:33.075946 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:33.076572 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff] added
May 28 01:03:33.076572 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:03:33.076572 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:03:33.076572 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:03:33.076572 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:03:33.076572 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:03:33.076572 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:33.076572 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:03:33.077242 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0308(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:03:33.077242 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:03:33.091682 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff] added
May 28 01:03:33.091682 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:03:33.091682 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:03:33.091682 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:03:33.091682 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:03:33.091682 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:03:33.091682 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:33.092040 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:03:33.092040 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0455(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:03:33.092217 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:03:33.329643 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999295638000149 future=<Future at 0x7c984c367c20 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:03:33.331376 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Instance destroyed successfully.
May 28 01:03:33.331807 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-7917c1fa-85f0-46da-9850-fd4b0c02b7b1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lazy-loading 'resources' on Instance uuid 03f1821a-592e-4e02-b609-74f3d7e69b53 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:03:33.426897 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:33.440335 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:33.471365 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:33.536136 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:02:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-126410006',display_name='tempest-ServerActionsTestOtherA-server-126410006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001577',hostname='tempest-serveractionstestothera-server-126410006',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOEhInnYH8OIPIS+AoDN91vRrTIl7emQTWVv1MQvwyvOos+qsDslhGKWhjOWQnKEu789RlRl8BiqEdHw4m/ZZapwhCdnQdK7FOovVNbbHnETkK3QhUrm9lcqluHt42QLQ==',key_name='tempest-keypair-1959255291',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:03:10Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001577',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='73ee6b376bb14dffb5664085cca58288',ramdisk_id='',reservation_id='r-m5d9fumv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1279266727',owner_user_name='tempest-ServerActionsTestOtherA-1279266727-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:03:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84e218b589ef4968828db0c740eaa72b',uuid=0ad69caa-c797-4e9d-96e3-7ad63523be49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "address": "fa:16:3e:2e:5f:00", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1876212854-network", "vif_mac": "fa:16:3e:2e:5f:00"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ce3f06-12", "ovs_interfaceid": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:03:33.537210 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Converting VIF {"id": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "address": "fa:16:3e:2e:5f:00", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1876212854-network", "vif_mac": "fa:16:3e:2e:5f:00"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ce3f06-12", "ovs_interfaceid": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:03:33.537922 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:5f:00,bridge_name='br-int',has_traffic_filtering=True,id=99ce3f06-1207-4d71-a43a-4cd61a8ae36c,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99ce3f06-12') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:03:33.539781 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] End _get_guest_xml xml=<domain type="qemu">
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:   <uuid>0ad69caa-c797-4e9d-96e3-7ad63523be49</uuid>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:   <name>instance-00000022</name>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:   <memory>262144</memory>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       <nova:name>tempest-ServerActionsTestOtherA-server-126410006</nova:name>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:03:29</nova:creationTime>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.micro" id="84">
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:         <nova:memory>256</nova:memory>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       <nova:image uuid="">
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:         <nova:user uuid="84e218b589ef4968828db0c740eaa72b">tempest-ServerActionsTestOtherA-1279266727-project-member</nova:user>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:         <nova:project uuid="73ee6b376bb14dffb5664085cca58288">tempest-ServerActionsTestOtherA-1279266727</nova:project>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:         <nova:port uuid="99ce3f06-1207-4d71-a43a-4cd61a8ae36c">
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:     <system>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       <entry name="serial">0ad69caa-c797-4e9d-96e3-7ad63523be49</entry>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       <entry name="uuid">0ad69caa-c797-4e9d-96e3-7ad63523be49</entry>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:     </system>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:   <os>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:   </os>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:   <features>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:   </features>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:   <devices>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/0ad69caa-c797-4e9d-96e3-7ad63523be49/disk.config"/>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:     </disk>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       <alias name="ua-48069396-3383-47de-ba84-d39b106a7dd3"/>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-0"/>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       <serial>48069396-3383-47de-ba84-d39b106a7dd3</serial>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:     </disk>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:2e:5f:00"/>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       <target dev="tap99ce3f06-12"/>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:     </interface>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/0ad69caa-c797-4e9d-96e3-7ad63523be49/console.log" append="off"/>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:     </serial>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:     <video>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:     </video>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:     </rng>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:   </devices>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]: </domain>
May 28 01:03:33.539781 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:03:33.542272 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:02:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-126410006',display_name='tempest-ServerActionsTestOtherA-server-126410006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001577',hostname='tempest-serveractionstestothera-server-126410006',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOEhInnYH8OIPIS+AoDN91vRrTIl7emQTWVv1MQvwyvOos+qsDslhGKWhjOWQnKEu789RlRl8BiqEdHw4m/ZZapwhCdnQdK7FOovVNbbHnETkK3QhUrm9lcqluHt42QLQ==',key_name='tempest-keypair-1959255291',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:03:10Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001577',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='73ee6b376bb14dffb5664085cca58288',ramdisk_id='',reservation_id='r-m5d9fumv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1279266727',owner_user_name='tempest-ServerActionsTestOtherA-1279266727-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:03:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84e218b589ef4968828db0c740eaa72b',uuid=0ad69caa-c797-4e9d-96e3-7ad63523be49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "address": "fa:16:3e:2e:5f:00", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1876212854-network", "vif_mac": "fa:16:3e:2e:5f:00"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ce3f06-12", "ovs_interfaceid": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:03:33.542272 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Converting VIF {"id": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "address": "fa:16:3e:2e:5f:00", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1876212854-network", "vif_mac": "fa:16:3e:2e:5f:00"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ce3f06-12", "ovs_interfaceid": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:03:33.542272 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:5f:00,bridge_name='br-int',has_traffic_filtering=True,id=99ce3f06-1207-4d71-a43a-4cd61a8ae36c,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99ce3f06-12') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:03:33.542272 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:5f:00,bridge_name='br-int',has_traffic_filtering=True,id=99ce3f06-1207-4d71-a43a-4cd61a8ae36c,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99ce3f06-12') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:03:33.542653 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:33.542900 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:33.543037 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:03:33.544223 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:33.544374 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad3ee9de-f931-582c-8f47-06d23fafd404', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:33.545646 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:33.546051 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:03:33.549346 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:33.560472 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:33.569051 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:33.569676 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99ce3f06-12, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:33.569922 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap99ce3f06-12, col_values=(('qos', UUID('08ef182f-2b54-4fca-a162-d61aa7469f03')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:33.570072 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap99ce3f06-12, col_values=(('external_ids', {'iface-id': '99ce3f06-1207-4d71-a43a-4cd61a8ae36c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:5f:00', 'vm-uuid': '0ad69caa-c797-4e9d-96e3-7ad63523be49'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:33.572120 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:33.573485 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:03:33.585146 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:33.585146 np0000001577 nova-compute[98319]: INFO os_vif [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:5f:00,bridge_name='br-int',has_traffic_filtering=True,id=99ce3f06-1207-4d71-a43a-4cd61a8ae36c,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99ce3f06-12')
May 28 01:03:33.806229 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:33.819617 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:33.821831 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:33.834127 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7917c1fa-85f0-46da-9850-fd4b0c02b7b1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T01:01:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-115051965',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumeshelvetestjson-server-115051965',id=28,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJykW7m/TlAU+aCXrHFQnqiLeGirg6DvP6jvEv6WQuNWyEgZM1BR3mEfPcGdFFvRQCbM6rCIAUsPhy5D6TwkP7OO9xbCj+TqMkt88Fpp/YwpAzmqGqGKPLSLEqkOjvz1A==',key_name='tempest-keypair-636601780',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:02:48Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6a7090a79f448f3abe4737bf127df53',ramdisk_id='',reservation_id='r-oad6jyzf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1260503814',owner_user_name='tempest-AttachVolumeShelveTestJSON-1260503814-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:02:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d375089981f8493598b33c4b6f122374',uuid=03f1821a-592e-4e02-b609-74f3d7e69b53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "address": "fa:16:3e:5e:ef:9c", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f81148-2a", "ovs_interfaceid": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:03:33.834350 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7917c1fa-85f0-46da-9850-fd4b0c02b7b1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Converting VIF {"id": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "address": "fa:16:3e:5e:ef:9c", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f81148-2a", "ovs_interfaceid": "95f81148-2a4e-4ca8-ad05-cb73d6f2951f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:03:33.835221 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7917c1fa-85f0-46da-9850-fd4b0c02b7b1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:ef:9c,bridge_name='br-int',has_traffic_filtering=True,id=95f81148-2a4e-4ca8-ad05-cb73d6f2951f,network=Network(e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f81148-2a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:03:33.835221 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-7917c1fa-85f0-46da-9850-fd4b0c02b7b1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:ef:9c,bridge_name='br-int',has_traffic_filtering=True,id=95f81148-2a4e-4ca8-ad05-cb73d6f2951f,network=Network(e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f81148-2a') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:03:33.836331 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:33.836522 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95f81148-2a, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:33.841411 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:33.842329 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:03:33.844843 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:33.854872 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:33.868631 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:33.870784 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:33.871737 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:33.872522 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:33.872889 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6101a069-4aa5-445d-b6aa-9ca52f65f6bc) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:33.873891 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:03:33.878354 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:33.880250 np0000001577 nova-compute[98319]: INFO os_vif [None req-7917c1fa-85f0-46da-9850-fd4b0c02b7b1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:ef:9c,bridge_name='br-int',has_traffic_filtering=True,id=95f81148-2a4e-4ca8-ad05-cb73d6f2951f,network=Network(e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f81148-2a')
May 28 01:03:33.880375 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7917c1fa-85f0-46da-9850-fd4b0c02b7b1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Deleting instance files /opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53_del
May 28 01:03:33.888174 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7917c1fa-85f0-46da-9850-fd4b0c02b7b1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Deletion of /opt/stack/data/nova/instances/03f1821a-592e-4e02-b609-74f3d7e69b53_del complete
May 28 01:03:33.950244 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0003300710000075924 future=<Future at 0x7c98706a45c0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:03:33.950396 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:03:33.950396 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=4.027371370999845 future=<Future at 0x7c987047d640 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:03:33.950479 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=4.027307802999985 future=<Future at 0x7c987047d640 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:03:33.978902 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:03:33.979264 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:03:34.077723 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:03:34.089156 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:03:34.089156 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:34.092728 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:03:34.102022 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:03:34.108802 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:03:34.108802 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:34.123694 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:34.124324 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:34.124324 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:34.124324 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:34.124324 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:34.124324 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:34.124324 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:34.124324 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:34.124324 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:34.124324 np0000001577 nova-compute[98319]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0595ba3-19a8-47b1-bec9-6c6a431e0ff3 (non-flash)
May 28 01:03:34.124324 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:34.124324 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:34.124324 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:34.124324 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:34.124324 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:03:34.124698 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:34.124698 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:34.124698 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:34.124698 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:34.124698 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:34.124698 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:34.124698 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:34.124698 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:34.124698 np0000001577 nova-compute[98319]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0595ba3-19a8-47b1-bec9-6c6a431e0ff3 (non-flash)
May 28 01:03:34.124698 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:34.124698 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:34.124698 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:34.124698 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:34.124698 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:03:34.150370 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:34.150370 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:34.150370 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:34.150370 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:34.150370 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:34.150370 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:34.150370 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:34.150370 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:34.150370 np0000001577 nova-compute[98319]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0595ba3-19a8-47b1-bec9-6c6a431e0ff3 (non-flash)
May 28 01:03:34.150370 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:34.150370 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:34.150370 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:34.150370 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:34.150370 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:03:34.150807 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:34.150807 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:34.150807 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:34.150807 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:34.150807 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:34.150807 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:34.150807 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:34.150807 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:34.150807 np0000001577 nova-compute[98319]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0595ba3-19a8-47b1-bec9-6c6a431e0ff3 (non-flash)
May 28 01:03:34.150807 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:34.150807 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:34.150807 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:34.150807 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:34.150807 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:03:34.184174 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff, portal: 192.168.50.100,3260]
May 28 01:03:34.184174 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff, portal: 192.168.50.100,3260] successful.
May 28 01:03:34.184174 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:34.197314 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:34.207979 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff, portal: 192.168.40.100,3260]
May 28 01:03:34.207979 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff, portal: 192.168.40.100,3260] successful.
May 28 01:03:34.207979 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:34.219089 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:34.224815 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:34.224815 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:34.224815 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:34.224815 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:34.224815 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:34.224815 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:34.224815 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:34.224815 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:34.224815 np0000001577 nova-compute[98319]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0595ba3-19a8-47b1-bec9-6c6a431e0ff3 (non-flash)
May 28 01:03:34.224815 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:34.224815 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:34.224815 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:34.224815 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:34.224815 np0000001577 nova-compute[98319]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff (non-flash)
May 28 01:03:34.224815 np0000001577 nova-compute[98319]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff (non-flash)
May 28 01:03:34.224815 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:03:34.225236 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:34.225236 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:34.225236 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:34.225236 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:34.225236 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:34.225236 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:34.225236 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:34.225236 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:34.225236 np0000001577 nova-compute[98319]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0595ba3-19a8-47b1-bec9-6c6a431e0ff3 (non-flash)
May 28 01:03:34.225236 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:34.225236 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:34.225236 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:34.225236 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:34.225236 np0000001577 nova-compute[98319]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff (non-flash)
May 28 01:03:34.225236 np0000001577 nova-compute[98319]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff (non-flash)
May 28 01:03:34.225236 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:03:34.225236 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.180s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:03:34.225589 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:03:34.226770 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] HCTL ('16', '-', '-', 0) found on session 78 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:03:34.226882 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:03:34.246126 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Searching for a device in session 78 and hctl ['16', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:03:34.246194 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:34.246194 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:34.246194 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:34.246194 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:34.246194 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:34.246194 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:34.246194 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:34.246194 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:34.246194 np0000001577 nova-compute[98319]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0595ba3-19a8-47b1-bec9-6c6a431e0ff3 (non-flash)
May 28 01:03:34.246194 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:34.246194 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:34.246194 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:34.246194 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:34.246194 np0000001577 nova-compute[98319]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff (non-flash)
May 28 01:03:34.246194 np0000001577 nova-compute[98319]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff (non-flash)
May 28 01:03:34.246194 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:03:34.247638 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:34.247638 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:34.247638 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:34.247638 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:34.247638 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:34.247638 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:34.247638 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:34.247638 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:34.247638 np0000001577 nova-compute[98319]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0595ba3-19a8-47b1-bec9-6c6a431e0ff3 (non-flash)
May 28 01:03:34.247638 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:34.247638 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:34.247638 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:34.247638 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:34.247638 np0000001577 nova-compute[98319]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff (non-flash)
May 28 01:03:34.247638 np0000001577 nova-compute[98319]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff (non-flash)
May 28 01:03:34.247638 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:03:34.247638 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.201s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:03:34.247638 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:03:34.248816 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] HCTL ('19', '-', '-', 0) found on session 79 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:03:34.248984 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:03:34.263288 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Searching for a device in session 79 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:03:34.263288 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'abcd46b2-0a9a-4784-a743-1c36a51133ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:03:34.268919 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930214.268236, 27a2f570-fa9f-4f8d-8b04-b485a51b63cb => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:03:34.268919 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] VM Started (Lifecycle Event)
May 28 01:03:34.373990 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:03:34.395930 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7917c1fa-85f0-46da-9850-fd4b0c02b7b1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Took 1.60 seconds to destroy the instance on the hypervisor.
May 28 01:03:34.396250 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-7917c1fa-85f0-46da-9850-fd4b0c02b7b1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:03:34.397914 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:03:34.398225 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:03:34.398787 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:34.517855 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:34.771070 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:34.772614 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930214.7723994, 27a2f570-fa9f-4f8d-8b04-b485a51b63cb => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:03:34.772738 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] VM Paused (Lifecycle Event)
May 28 01:03:34.923698 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b04a4393-6e50-4626-b4ac-088f41035621 req-f6009c9d-eca6-4b86-a6ac-4d3dc1703593 service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Received event network-vif-deleted-95f81148-2a4e-4ca8-ad05-cb73d6f2951f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:34.924224 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-b04a4393-6e50-4626-b4ac-088f41035621 req-f6009c9d-eca6-4b86-a6ac-4d3dc1703593 service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Neutron deleted interface 95f81148-2a4e-4ca8-ad05-cb73d6f2951f; detaching it from the instance and deleting it from the info cache
May 28 01:03:34.927176 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b04a4393-6e50-4626-b4ac-088f41035621 req-f6009c9d-eca6-4b86-a6ac-4d3dc1703593 service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Detach interface failed, port_id=95f81148-2a4e-4ca8-ad05-cb73d6f2951f, reason: Instance 03f1821a-592e-4e02-b609-74f3d7e69b53 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:03:34.940385 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:34.940821 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:34.945584 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:03:34.945584 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Claim successful on node np0000001577
May 28 01:03:34.978266 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:03:34.978584 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 01:03:34.979094 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:03:35.070246 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-974f6917-01a6-4503-b063-5e14a2595797 req-f9cff256-6b4e-4eb5-ae15-dc87fdea288b service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Received event network-vif-unplugged-95f81148-2a4e-4ca8-ad05-cb73d6f2951f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:35.070606 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-974f6917-01a6-4503-b063-5e14a2595797 req-f9cff256-6b4e-4eb5-ae15-dc87fdea288b service nova] Acquiring lock "03f1821a-592e-4e02-b609-74f3d7e69b53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:35.070812 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-974f6917-01a6-4503-b063-5e14a2595797 req-f9cff256-6b4e-4eb5-ae15-dc87fdea288b service nova] Lock "03f1821a-592e-4e02-b609-74f3d7e69b53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:35.070981 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-974f6917-01a6-4503-b063-5e14a2595797 req-f9cff256-6b4e-4eb5-ae15-dc87fdea288b service nova] Lock "03f1821a-592e-4e02-b609-74f3d7e69b53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:35.071177 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-974f6917-01a6-4503-b063-5e14a2595797 req-f9cff256-6b4e-4eb5-ae15-dc87fdea288b service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] No waiting events found dispatching network-vif-unplugged-95f81148-2a4e-4ca8-ad05-cb73d6f2951f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:03:35.071295 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-974f6917-01a6-4503-b063-5e14a2595797 req-f9cff256-6b4e-4eb5-ae15-dc87fdea288b service nova] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Received event network-vif-unplugged-95f81148-2a4e-4ca8-ad05-cb73d6f2951f for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:03:35.071397 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-974f6917-01a6-4503-b063-5e14a2595797 req-f9cff256-6b4e-4eb5-ae15-dc87fdea288b service nova] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Received event network-vif-plugged-a2072e10-c933-4dd6-84e1-43734392b12e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:35.071529 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-974f6917-01a6-4503-b063-5e14a2595797 req-f9cff256-6b4e-4eb5-ae15-dc87fdea288b service nova] Acquiring lock "27a2f570-fa9f-4f8d-8b04-b485a51b63cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:35.071678 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-974f6917-01a6-4503-b063-5e14a2595797 req-f9cff256-6b4e-4eb5-ae15-dc87fdea288b service nova] Lock "27a2f570-fa9f-4f8d-8b04-b485a51b63cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:35.071817 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-974f6917-01a6-4503-b063-5e14a2595797 req-f9cff256-6b4e-4eb5-ae15-dc87fdea288b service nova] Lock "27a2f570-fa9f-4f8d-8b04-b485a51b63cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:35.071935 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-974f6917-01a6-4503-b063-5e14a2595797 req-f9cff256-6b4e-4eb5-ae15-dc87fdea288b service nova] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Processing event network-vif-plugged-a2072e10-c933-4dd6-84e1-43734392b12e {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:03:35.072003 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-974f6917-01a6-4503-b063-5e14a2595797 req-f9cff256-6b4e-4eb5-ae15-dc87fdea288b service nova] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Received event network-vif-plugged-a2072e10-c933-4dd6-84e1-43734392b12e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:35.072112 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-974f6917-01a6-4503-b063-5e14a2595797 req-f9cff256-6b4e-4eb5-ae15-dc87fdea288b service nova] Acquiring lock "27a2f570-fa9f-4f8d-8b04-b485a51b63cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:35.072217 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-974f6917-01a6-4503-b063-5e14a2595797 req-f9cff256-6b4e-4eb5-ae15-dc87fdea288b service nova] Lock "27a2f570-fa9f-4f8d-8b04-b485a51b63cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:35.072300 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-974f6917-01a6-4503-b063-5e14a2595797 req-f9cff256-6b4e-4eb5-ae15-dc87fdea288b service nova] Lock "27a2f570-fa9f-4f8d-8b04-b485a51b63cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:35.072398 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-974f6917-01a6-4503-b063-5e14a2595797 req-f9cff256-6b4e-4eb5-ae15-dc87fdea288b service nova] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] No waiting events found dispatching network-vif-plugged-a2072e10-c933-4dd6-84e1-43734392b12e {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:03:35.072497 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-974f6917-01a6-4503-b063-5e14a2595797 req-f9cff256-6b4e-4eb5-ae15-dc87fdea288b service nova] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Received unexpected event network-vif-plugged-a2072e10-c933-4dd6-84e1-43734392b12e for instance with vm_state building and task_state spawning.
May 28 01:03:35.073934 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:03:35.076149 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:03:35.077811 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Instance spawned successfully.
May 28 01:03:35.078077 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:03:35.106226 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:03:35.106369 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:03:35.106497 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] No VIF found with MAC fa:16:3e:2e:5f:00, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:03:35.106922 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Using config drive
May 28 01:03:35.245451 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Searching for a device in session 78 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:03:35.245597 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'abcd46b2-0a9a-4784-a743-1c36a51133ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:03:35.275176 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:35.278033 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930215.2778516, 27a2f570-fa9f-4f8d-8b04-b485a51b63cb => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:03:35.278173 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] VM Resumed (Lifecycle Event)
May 28 01:03:35.360178 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:03:35.483021 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:35.503642 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:35.530854 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:35.533095 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:35.585869 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:35.587639 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:35.587639 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:35.587639 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:35.587639 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:35.587639 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:35.620212 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:35.688240 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:35.689767 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:35.780329 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:35.782302 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:03:35.863148 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Took 1.46 seconds to deallocate network for instance.
May 28 01:03:36.069728 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Found WWN 330000000b2f9c03a for multipath device dm-12 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:03:36.069728 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:03:36.069728 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] <== connect_volume: return (4387ms) {'type': 'block', 'scsi_wwn': '330000000b2f9c03a', 'path': '/dev/dm-12', 'multipath_id': '330000000b2f9c03a'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:03:36.069728 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b2f9c03a', 'path': '/dev/dm-12', 'multipath_id': '330000000b2f9c03a'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:03:36.092332 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Took 10.53 seconds to spawn the instance on the hypervisor.
May 28 01:03:36.092668 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:36.148442 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:36.285186 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:03:36.328658 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Removed pending STOPPED event for 0ad69caa-c797-4e9d-96e3-7ad63523be49 due to new event <LifecycleEvent: 1779930216.328256, 0ad69caa-c797-4e9d-96e3-7ad63523be49 => Resumed> {{(pid=98319) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 01:03:36.328837 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930216.328256, 0ad69caa-c797-4e9d-96e3-7ad63523be49 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:03:36.328960 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] VM Resumed (Lifecycle Event)
May 28 01:03:36.329964 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Instance event wait completed in 0 seconds for  {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:03:36.333306 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Instance running successfully.
May 28 01:03:36.336043 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Failed to set time: agent not configured {{(pid=98319) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 28 01:03:36.336175 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5d9c1c10-995c-468a-9c9f-485cb8c786cb tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] finish_migration finished successfully. {{(pid=98319) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 28 01:03:36.368859 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7917c1fa-85f0-46da-9850-fd4b0c02b7b1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:36.573489 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:03:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1249093534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumemultiattachtest-server-1249093534',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938c2829112843edb2054984e80ce7ad',ramdisk_id='',reservation_id='r-ui7brn70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-89204095',owner_user_name='tempest-AttachVolumeMultiAttachTest-89204095-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:03:29Z,user_data=None,user_id='f8586a18edcf42cab0a60028135ae401',uuid=6e370bae-b201-42eb-b5ef-f629b6f6502c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22370d17-1928-456e-af7e-f2c86f0bc253", "address": "fa:16:3e:ab:54:e1", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22370d17-19", "ovs_interfaceid": "22370d17-1928-456e-af7e-f2c86f0bc253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:03:36.573956 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converting VIF {"id": "22370d17-1928-456e-af7e-f2c86f0bc253", "address": "fa:16:3e:ab:54:e1", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22370d17-19", "ovs_interfaceid": "22370d17-1928-456e-af7e-f2c86f0bc253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:03:36.574695 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:54:e1,bridge_name='br-int',has_traffic_filtering=True,id=22370d17-1928-456e-af7e-f2c86f0bc253,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22370d17-19') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:03:36.576901 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e370bae-b201-42eb-b5ef-f629b6f6502c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:03:36.603181 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Took 18.26 seconds to build instance.
May 28 01:03:36.831820 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:36.833786 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:03:36.879675 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:03:36.879833 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:03:36.985533 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d4ef7a41-e5de-4630-a06a-3f6575304126 req-243dbf5f-a932-4de4-8fb9-62028c5032e9 service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Received event network-vif-plugged-99ce3f06-1207-4d71-a43a-4cd61a8ae36c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:36.985844 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d4ef7a41-e5de-4630-a06a-3f6575304126 req-243dbf5f-a932-4de4-8fb9-62028c5032e9 service nova] Acquiring lock "0ad69caa-c797-4e9d-96e3-7ad63523be49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:36.986817 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d4ef7a41-e5de-4630-a06a-3f6575304126 req-243dbf5f-a932-4de4-8fb9-62028c5032e9 service nova] Lock "0ad69caa-c797-4e9d-96e3-7ad63523be49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:36.986928 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d4ef7a41-e5de-4630-a06a-3f6575304126 req-243dbf5f-a932-4de4-8fb9-62028c5032e9 service nova] Lock "0ad69caa-c797-4e9d-96e3-7ad63523be49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:36.987031 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d4ef7a41-e5de-4630-a06a-3f6575304126 req-243dbf5f-a932-4de4-8fb9-62028c5032e9 service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] No waiting events found dispatching network-vif-plugged-99ce3f06-1207-4d71-a43a-4cd61a8ae36c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:03:36.987199 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-d4ef7a41-e5de-4630-a06a-3f6575304126 req-243dbf5f-a932-4de4-8fb9-62028c5032e9 service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Received unexpected event network-vif-plugged-99ce3f06-1207-4d71-a43a-4cd61a8ae36c for instance with vm_state resized and task_state None.
May 28 01:03:36.987344 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d4ef7a41-e5de-4630-a06a-3f6575304126 req-243dbf5f-a932-4de4-8fb9-62028c5032e9 service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Received event network-vif-plugged-99ce3f06-1207-4d71-a43a-4cd61a8ae36c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:36.987506 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d4ef7a41-e5de-4630-a06a-3f6575304126 req-243dbf5f-a932-4de4-8fb9-62028c5032e9 service nova] Acquiring lock "0ad69caa-c797-4e9d-96e3-7ad63523be49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:36.987670 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d4ef7a41-e5de-4630-a06a-3f6575304126 req-243dbf5f-a932-4de4-8fb9-62028c5032e9 service nova] Lock "0ad69caa-c797-4e9d-96e3-7ad63523be49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:36.987833 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d4ef7a41-e5de-4630-a06a-3f6575304126 req-243dbf5f-a932-4de4-8fb9-62028c5032e9 service nova] Lock "0ad69caa-c797-4e9d-96e3-7ad63523be49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:36.987944 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d4ef7a41-e5de-4630-a06a-3f6575304126 req-243dbf5f-a932-4de4-8fb9-62028c5032e9 service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] No waiting events found dispatching network-vif-plugged-99ce3f06-1207-4d71-a43a-4cd61a8ae36c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:03:36.988106 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-d4ef7a41-e5de-4630-a06a-3f6575304126 req-243dbf5f-a932-4de4-8fb9-62028c5032e9 service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Received unexpected event network-vif-plugged-99ce3f06-1207-4d71-a43a-4cd61a8ae36c for instance with vm_state resized and task_state None.
May 28 01:03:37.080124 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] End _get_guest_xml xml=<domain type="qemu">
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:   <uuid>6e370bae-b201-42eb-b5ef-f629b6f6502c</uuid>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:   <name>instance-00000025</name>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       <nova:name>tempest-AttachVolumeMultiAttachTest-server-1249093534</nova:name>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:03:31</nova:creationTime>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       <nova:image uuid="">
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:         <nova:user uuid="f8586a18edcf42cab0a60028135ae401">tempest-AttachVolumeMultiAttachTest-89204095-project-member</nova:user>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:         <nova:project uuid="938c2829112843edb2054984e80ce7ad">tempest-AttachVolumeMultiAttachTest-89204095</nova:project>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:         <nova:port uuid="22370d17-1928-456e-af7e-f2c86f0bc253">
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:     <system>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       <entry name="serial">6e370bae-b201-42eb-b5ef-f629b6f6502c</entry>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       <entry name="uuid">6e370bae-b201-42eb-b5ef-f629b6f6502c</entry>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:     </system>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:   <os>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:   </os>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:   <features>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:   </features>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:   <devices>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/6e370bae-b201-42eb-b5ef-f629b6f6502c/disk.config"/>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:     </disk>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       <alias name="ua-abcd46b2-0a9a-4784-a743-1c36a51133ff"/>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-12"/>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       <serial>abcd46b2-0a9a-4784-a743-1c36a51133ff</serial>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       <shareable/>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:     </disk>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:ab:54:e1"/>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       <target dev="tap22370d17-19"/>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:     </interface>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/6e370bae-b201-42eb-b5ef-f629b6f6502c/console.log" append="off"/>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:     </serial>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:     <video>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:     </video>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:     </rng>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:   </devices>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]: </domain>
May 28 01:03:37.080124 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:03:37.082479 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Preparing to wait for external event network-vif-plugged-22370d17-1928-456e-af7e-f2c86f0bc253 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:03:37.082479 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "6e370bae-b201-42eb-b5ef-f629b6f6502c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:37.082479 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "6e370bae-b201-42eb-b5ef-f629b6f6502c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:37.082479 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "6e370bae-b201-42eb-b5ef-f629b6f6502c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:37.082479 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:03:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1249093534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumemultiattachtest-server-1249093534',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938c2829112843edb2054984e80ce7ad',ramdisk_id='',reservation_id='r-ui7brn70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-89204095',owner_user_name='tempest-AttachVolumeMultiAttachTest-89204095-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:03:29Z,user_data=None,user_id='f8586a18edcf42cab0a60028135ae401',uuid=6e370bae-b201-42eb-b5ef-f629b6f6502c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22370d17-1928-456e-af7e-f2c86f0bc253", "address": "fa:16:3e:ab:54:e1", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22370d17-19", "ovs_interfaceid": "22370d17-1928-456e-af7e-f2c86f0bc253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:03:37.082479 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converting VIF {"id": "22370d17-1928-456e-af7e-f2c86f0bc253", "address": "fa:16:3e:ab:54:e1", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22370d17-19", "ovs_interfaceid": "22370d17-1928-456e-af7e-f2c86f0bc253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:03:37.082479 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:54:e1,bridge_name='br-int',has_traffic_filtering=True,id=22370d17-1928-456e-af7e-f2c86f0bc253,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22370d17-19') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:03:37.082479 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:54:e1,bridge_name='br-int',has_traffic_filtering=True,id=22370d17-1928-456e-af7e-f2c86f0bc253,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22370d17-19') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:03:37.082479 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:37.082841 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:37.083259 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:03:37.084101 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:37.084273 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '14be830e-4c87-528e-8d89-99c243e8e3f1', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:37.085067 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:37.085790 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:03:37.086161 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:37.088790 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:37.089128 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22370d17-19, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:37.089505 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22370d17-19, col_values=(('qos', UUID('7bc16096-d930-442c-983f-ef1627077297')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:37.089674 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22370d17-19, col_values=(('external_ids', {'iface-id': '22370d17-1928-456e-af7e-f2c86f0bc253', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:54:e1', 'vm-uuid': '6e370bae-b201-42eb-b5ef-f629b6f6502c'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:37.090359 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:37.092004 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:03:37.096227 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:37.097424 np0000001577 nova-compute[98319]: INFO os_vif [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:54:e1,bridge_name='br-int',has_traffic_filtering=True,id=22370d17-1928-456e-af7e-f2c86f0bc253,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22370d17-19')
May 28 01:03:37.105052 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b250dad6-12f7-4079-b778-7476f2cd5b98 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "27a2f570-fa9f-4f8d-8b04-b485a51b63cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.772s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:37.339716 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 28 01:03:37.339716 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930217.3392227, 0ad69caa-c797-4e9d-96e3-7ad63523be49 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:03:37.339716 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] VM Started (Lifecycle Event)
May 28 01:03:37.382182 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:03:37.845569 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:37.847057 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:03:37.888801 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.947s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:37.889022 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 2.406s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:37.889452 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:03:37.892192 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:37.893975 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Auditing locally available compute resources for np0000001577 (node: np0000001577) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 01:03:37.893975 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7917c1fa-85f0-46da-9850-fd4b0c02b7b1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.523s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:37.981045 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0032407840003543242 future=<Future at 0x7c987047d640 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:03:37.981131 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:03:37.981260 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=10.347683462000077 future=<Future at 0x7c984c367c20 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:03:37.981324 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=10.347616246000143 future=<Future at 0x7c984c367c20 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:03:37.990927 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a1e9b69c-c159-4a4d-aa22-e2853652738a tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "0ad69caa-c797-4e9d-96e3-7ad63523be49" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:37.991188 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a1e9b69c-c159-4a4d-aa22-e2853652738a tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "0ad69caa-c797-4e9d-96e3-7ad63523be49" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:37.991360 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-a1e9b69c-c159-4a4d-aa22-e2853652738a tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Going to confirm migration 4 {{(pid=98319) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 28 01:03:38.149119 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-12674943-c94c-486f-8605-d3690f14b4ee req-570a3fff-281e-49f2-a411-77d215217ab5 service nova] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Received event network-changed-a2072e10-c933-4dd6-84e1-43734392b12e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:38.149567 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-12674943-c94c-486f-8605-d3690f14b4ee req-570a3fff-281e-49f2-a411-77d215217ab5 service nova] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Refreshing instance network info cache due to event network-changed-a2072e10-c933-4dd6-84e1-43734392b12e. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:03:38.149856 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-12674943-c94c-486f-8605-d3690f14b4ee req-570a3fff-281e-49f2-a411-77d215217ab5 service nova] Acquiring lock "refresh_cache-27a2f570-fa9f-4f8d-8b04-b485a51b63cb" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:03:38.149856 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-12674943-c94c-486f-8605-d3690f14b4ee req-570a3fff-281e-49f2-a411-77d215217ab5 service nova] Acquired lock "refresh_cache-27a2f570-fa9f-4f8d-8b04-b485a51b63cb" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:03:38.149947 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-12674943-c94c-486f-8605-d3690f14b4ee req-570a3fff-281e-49f2-a411-77d215217ab5 service nova] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Refreshing network info cache for port a2072e10-c933-4dd6-84e1-43734392b12e {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:03:38.395901 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:03:38.396054 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:03:38.396294 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:38.396497 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:38.492137 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb6c20970bf0401190583f6348e00e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e28acf25c4445ea969bd7bca3eac146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:03:38.498735 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-a1e9b69c-c159-4a4d-aa22-e2853652738a tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:38.610501 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:03:38.611436 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:03:38.611436 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] No VIF found with MAC fa:16:3e:ab:54:e1, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:03:38.611436 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Using config drive
May 28 01:03:38.627502 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-a1e9b69c-c159-4a4d-aa22-e2853652738a tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:38.627909 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a1e9b69c-c159-4a4d-aa22-e2853652738a tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "refresh_cache-0ad69caa-c797-4e9d-96e3-7ad63523be49" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:03:38.628002 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a1e9b69c-c159-4a4d-aa22-e2853652738a tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquired lock "refresh_cache-0ad69caa-c797-4e9d-96e3-7ad63523be49" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:03:38.628115 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-a1e9b69c-c159-4a4d-aa22-e2853652738a tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:03:38.628235 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-a1e9b69c-c159-4a4d-aa22-e2853652738a tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lazy-loading 'info_cache' on Instance uuid 0ad69caa-c797-4e9d-96e3-7ad63523be49 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:03:38.651779 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-12674943-c94c-486f-8605-d3690f14b4ee req-570a3fff-281e-49f2-a411-77d215217ab5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:38.718834 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7917c1fa-85f0-46da-9850-fd4b0c02b7b1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:03:38.718834 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-7917c1fa-85f0-46da-9850-fd4b0c02b7b1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:03:38.904289 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:03:38.923985 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Successfully created port: 79122524-4b9f-46c3-91ad-d723f1829ed6 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:03:38.971324 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:39.063027 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:39.063027 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:39.118733 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:39.131174 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-12674943-c94c-486f-8605-d3690f14b4ee req-570a3fff-281e-49f2-a411-77d215217ab5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:39.148924 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:39.152990 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:03:39.156639 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e410372b-c799-4d0d-879c-4e935f2f2244/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:39.223131 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-7917c1fa-85f0-46da-9850-fd4b0c02b7b1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:03:39.263660 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e410372b-c799-4d0d-879c-4e935f2f2244/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:39.264100 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e410372b-c799-4d0d-879c-4e935f2f2244/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:39.292939 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Creating config drive at /opt/stack/data/nova/instances/6e370bae-b201-42eb-b5ef-f629b6f6502c/disk.config
May 28 01:03:39.297832 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6e370bae-b201-42eb-b5ef-f629b6f6502c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp12d_wtf0 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:39.347383 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e410372b-c799-4d0d-879c-4e935f2f2244/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:39.351385 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:03:39.354050 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9122d01-9c31-48d3-ae6b-e2d6305fe8d7/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:39.370264 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-12674943-c94c-486f-8605-d3690f14b4ee req-570a3fff-281e-49f2-a411-77d215217ab5 service nova] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Updated VIF entry in instance network info cache for port a2072e10-c933-4dd6-84e1-43734392b12e. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:03:39.370868 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-12674943-c94c-486f-8605-d3690f14b4ee req-570a3fff-281e-49f2-a411-77d215217ab5 service nova] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Updating instance_info_cache with network_info: [{"id": "a2072e10-c933-4dd6-84e1-43734392b12e", "address": "fa:16:3e:29:2a:08", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2072e10-c9", "ovs_interfaceid": "a2072e10-c933-4dd6-84e1-43734392b12e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:03:39.373347 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6e370bae-b201-42eb-b5ef-f629b6f6502c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp12d_wtf0" returned: 0 in 0.073s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:39.408598 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:03:39.443698 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9122d01-9c31-48d3-ae6b-e2d6305fe8d7/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:39.444443 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9122d01-9c31-48d3-ae6b-e2d6305fe8d7/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:39.480481 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Successfully updated port: 79122524-4b9f-46c3-91ad-d723f1829ed6 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:03:39.538045 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9122d01-9c31-48d3-ae6b-e2d6305fe8d7/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:39.538448 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:03:39.545819 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:03:39.547637 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:39.638909 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-a1e9b69c-c159-4a4d-aa22-e2853652738a tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:39.641432 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:39.642106 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:39.721617 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:39.724771 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:39.745081 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7917c1fa-85f0-46da-9850-fd4b0c02b7b1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.852s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:39.779984 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:39.815588 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:39.820757 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:39.822391 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-7917c1fa-85f0-46da-9850-fd4b0c02b7b1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Deleted allocations for instance 03f1821a-592e-4e02-b609-74f3d7e69b53
May 28 01:03:39.830298 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:39.830764 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:39.878685 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-12674943-c94c-486f-8605-d3690f14b4ee req-570a3fff-281e-49f2-a411-77d215217ab5 service nova] Releasing lock "refresh_cache-27a2f570-fa9f-4f8d-8b04-b485a51b63cb" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:03:39.906510 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:39.917457 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Booting with volume-backed-image ddb82a83-20d7-4efa-9145-29669d8920b6 at /dev/vda
May 28 01:03:39.920375 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:39.926779 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:39.979307 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:39.985179 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "refresh_cache-8c35bc03-1899-4eb9-aefe-0bd301686dcf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:03:39.985324 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquired lock "refresh_cache-8c35bc03-1899-4eb9-aefe-0bd301686dcf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:03:39.985453 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:03:40.015618 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:40.017291 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:40.101207 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-a1e9b69c-c159-4a4d-aa22-e2853652738a tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:40.128409 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:40.135274 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:40.241229 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f9f7e176-3b1d-4a96-95ee-7ec94a504a4e req-8a3af013-bb48-4aef-8f7b-af483b84456a service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Received event network-changed-79122524-4b9f-46c3-91ad-d723f1829ed6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:40.242344 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f9f7e176-3b1d-4a96-95ee-7ec94a504a4e req-8a3af013-bb48-4aef-8f7b-af483b84456a service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Refreshing instance network info cache due to event network-changed-79122524-4b9f-46c3-91ad-d723f1829ed6. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:03:40.242344 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f9f7e176-3b1d-4a96-95ee-7ec94a504a4e req-8a3af013-bb48-4aef-8f7b-af483b84456a service nova] Acquiring lock "refresh_cache-8c35bc03-1899-4eb9-aefe-0bd301686dcf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:03:40.242562 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:40.243064 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:40.333920 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-a1e9b69c-c159-4a4d-aa22-e2853652738a tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Updating instance_info_cache with network_info: [{"id": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "address": "fa:16:3e:2e:5f:00", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ce3f06-12", "ovs_interfaceid": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:03:40.344375 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:40.357581 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-9 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:03:40.361563 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:40.474567 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:40.475373 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:40.569412 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:40.570780 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:03:40.576296 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-12 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:03:40.578085 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:40.665290 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:40.666230 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:40.728305 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930220.7275796, 6e370bae-b201-42eb-b5ef-f629b6f6502c => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:03:40.728489 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] VM Started (Lifecycle Event)
May 28 01:03:40.756570 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:40.756967 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:03:40.759782 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:03:40.760944 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:40.806172 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:40.810866 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "env LANG=C uptime" returned: 0 in 0.049s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:40.810866 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Hypervisor/Node resource view: name=np0000001577 free_ram=10249MB free_disk=73.8478012084961GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 01:03:40.811078 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:40.811241 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:40.841285 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a1e9b69c-c159-4a4d-aa22-e2853652738a tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Releasing lock "refresh_cache-0ad69caa-c797-4e9d-96e3-7ad63523be49" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:03:40.841689 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-a1e9b69c-c159-4a4d-aa22-e2853652738a tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lazy-loading 'migration_context' on Instance uuid 0ad69caa-c797-4e9d-96e3-7ad63523be49 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:03:40.843361 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7917c1fa-85f0-46da-9850-fd4b0c02b7b1 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "03f1821a-592e-4e02-b609-74f3d7e69b53" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.549s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:40.935726 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Updating instance_info_cache with network_info: [{"id": "79122524-4b9f-46c3-91ad-d723f1829ed6", "address": "fa:16:3e:45:bd:f8", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79122524-4b", "ovs_interfaceid": "79122524-4b9f-46c3-91ad-d723f1829ed6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:03:41.150530 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:41.235067 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:41.239847 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930221.2395346, 6e370bae-b201-42eb-b5ef-f629b6f6502c => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:03:41.239987 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] VM Paused (Lifecycle Event)
May 28 01:03:41.344395 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-a1e9b69c-c159-4a4d-aa22-e2853652738a tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Object Instance<0ad69caa-c797-4e9d-96e3-7ad63523be49> lazy-loaded attributes: info_cache,migration_context {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:03:41.346525 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a1e9b69c-c159-4a4d-aa22-e2853652738a tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:41.437723 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Releasing lock "refresh_cache-8c35bc03-1899-4eb9-aefe-0bd301686dcf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:03:41.437901 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Instance network_info: |[{"id": "79122524-4b9f-46c3-91ad-d723f1829ed6", "address": "fa:16:3e:45:bd:f8", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79122524-4b", "ovs_interfaceid": "79122524-4b9f-46c3-91ad-d723f1829ed6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:03:41.438255 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f9f7e176-3b1d-4a96-95ee-7ec94a504a4e req-8a3af013-bb48-4aef-8f7b-af483b84456a service nova] Acquired lock "refresh_cache-8c35bc03-1899-4eb9-aefe-0bd301686dcf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:03:41.438412 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-f9f7e176-3b1d-4a96-95ee-7ec94a504a4e req-8a3af013-bb48-4aef-8f7b-af483b84456a service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Refreshing network info cache for port 79122524-4b9f-46c3-91ad-d723f1829ed6 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:03:41.742037 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:41.744215 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:03:41.834543 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Applying migration context for instance 0ad69caa-c797-4e9d-96e3-7ad63523be49 as it has an incoming, in-progress migration 6a9d896f-83cd-4713-80ec-6964bae95639. Migration status is confirming {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 28 01:03:41.836043 np0000001577 nova-compute[98319]: INFO nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Updating resource usage from migration 6a9d896f-83cd-4713-80ec-6964bae95639
May 28 01:03:41.882491 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 8bca25d8-071e-4b2d-960c-50582381cc75 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:03:41.882675 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance d09e5674-c5ab-4ace-9952-554361002541 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:03:41.882813 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance d988b526-836d-48b8-a381-1f7679caf41d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:03:41.883239 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance f2b64af8-9a7b-4726-b298-cf9d2cb24498 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:03:41.883386 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance d87bb95b-a1e9-4786-8bee-16f2cfaabf2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:03:41.883505 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:03:41.883628 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 63eb5e59-29a0-4b0c-b731-6d7265f7d91f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:03:41.883732 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance a9122d01-9c31-48d3-ae6b-e2d6305fe8d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:03:41.883792 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 04880ef4-5eee-4221-ad42-29788eb26358 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:03:41.883870 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:03:41.883953 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance e410372b-c799-4d0d-879c-4e935f2f2244 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:03:41.884578 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Migration 6a9d896f-83cd-4713-80ec-6964bae95639 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 28 01:03:41.884578 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 0ad69caa-c797-4e9d-96e3-7ad63523be49 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:03:41.884578 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 27a2f570-fa9f-4f8d-8b04-b485a51b63cb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:03:41.884578 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 6e370bae-b201-42eb-b5ef-f629b6f6502c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:03:41.884578 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 8c35bc03-1899-4eb9-aefe-0bd301686dcf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:03:41.884578 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 01:03:41.885001 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Final resource view: name=np0000001577 phys_ram=24030MB used_ram=3776MB phys_disk=95GB used_disk=9GB total_vcpus=12 used_vcpus=16 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:03:40 up 35 min,  2 users,  load average: 7.62, 6.70, 3.68\n', 'num_instances': '15', 'num_vm_active': '12', 'num_task_None': '13', 'num_os_type_None': '15', 'num_proj_938c2829112843edb2054984e80ce7ad': '6', 'io_workload': '2', 'num_proj_73ee6b376bb14dffb5664085cca58288': '2', 'num_proj_8efd8caac5eb46ae9af16a2452ee0353': '1', 'num_proj_9e28acf25c4445ea969bd7bca3eac146': '4', 'num_proj_6b80759164bf4465b0bd873db74c9c49': '1', 'num_vm_resized': '1', 'num_proj_050f928f1ce449d6a447cd343dc4ff80': '1', 'num_vm_building': '2', 'num_task_spawning': '1', 'num_task_block_device_mapping': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 01:03:41.940580 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-f9f7e176-3b1d-4a96-95ee-7ec94a504a4e req-8a3af013-bb48-4aef-8f7b-af483b84456a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:42.092058 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:42.248000 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:03:42.311387 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-f9f7e176-3b1d-4a96-95ee-7ec94a504a4e req-8a3af013-bb48-4aef-8f7b-af483b84456a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:42.494935 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-f9f7e176-3b1d-4a96-95ee-7ec94a504a4e req-8a3af013-bb48-4aef-8f7b-af483b84456a service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Updated VIF entry in instance network info cache for port 79122524-4b9f-46c3-91ad-d723f1829ed6. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:03:42.495400 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-f9f7e176-3b1d-4a96-95ee-7ec94a504a4e req-8a3af013-bb48-4aef-8f7b-af483b84456a service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Updating instance_info_cache with network_info: [{"id": "79122524-4b9f-46c3-91ad-d723f1829ed6", "address": "fa:16:3e:45:bd:f8", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79122524-4b", "ovs_interfaceid": "79122524-4b9f-46c3-91ad-d723f1829ed6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:03:42.785724 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:03:42.785915 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:03:42.997838 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f9f7e176-3b1d-4a96-95ee-7ec94a504a4e req-8a3af013-bb48-4aef-8f7b-af483b84456a service nova] Releasing lock "refresh_cache-8c35bc03-1899-4eb9-aefe-0bd301686dcf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:03:42.998128 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f9f7e176-3b1d-4a96-95ee-7ec94a504a4e req-8a3af013-bb48-4aef-8f7b-af483b84456a service nova] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Received event network-vif-plugged-22370d17-1928-456e-af7e-f2c86f0bc253 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:42.998211 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f9f7e176-3b1d-4a96-95ee-7ec94a504a4e req-8a3af013-bb48-4aef-8f7b-af483b84456a service nova] Acquiring lock "6e370bae-b201-42eb-b5ef-f629b6f6502c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:42.998346 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f9f7e176-3b1d-4a96-95ee-7ec94a504a4e req-8a3af013-bb48-4aef-8f7b-af483b84456a service nova] Lock "6e370bae-b201-42eb-b5ef-f629b6f6502c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:42.998456 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f9f7e176-3b1d-4a96-95ee-7ec94a504a4e req-8a3af013-bb48-4aef-8f7b-af483b84456a service nova] Lock "6e370bae-b201-42eb-b5ef-f629b6f6502c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:42.998599 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f9f7e176-3b1d-4a96-95ee-7ec94a504a4e req-8a3af013-bb48-4aef-8f7b-af483b84456a service nova] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Processing event network-vif-plugged-22370d17-1928-456e-af7e-f2c86f0bc253 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:03:42.998723 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f9f7e176-3b1d-4a96-95ee-7ec94a504a4e req-8a3af013-bb48-4aef-8f7b-af483b84456a service nova] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Received event network-vif-plugged-22370d17-1928-456e-af7e-f2c86f0bc253 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:42.998838 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f9f7e176-3b1d-4a96-95ee-7ec94a504a4e req-8a3af013-bb48-4aef-8f7b-af483b84456a service nova] Acquiring lock "6e370bae-b201-42eb-b5ef-f629b6f6502c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:42.999200 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f9f7e176-3b1d-4a96-95ee-7ec94a504a4e req-8a3af013-bb48-4aef-8f7b-af483b84456a service nova] Lock "6e370bae-b201-42eb-b5ef-f629b6f6502c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:42.999313 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f9f7e176-3b1d-4a96-95ee-7ec94a504a4e req-8a3af013-bb48-4aef-8f7b-af483b84456a service nova] Lock "6e370bae-b201-42eb-b5ef-f629b6f6502c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:42.999407 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f9f7e176-3b1d-4a96-95ee-7ec94a504a4e req-8a3af013-bb48-4aef-8f7b-af483b84456a service nova] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] No waiting events found dispatching network-vif-plugged-22370d17-1928-456e-af7e-f2c86f0bc253 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:03:42.999510 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-f9f7e176-3b1d-4a96-95ee-7ec94a504a4e req-8a3af013-bb48-4aef-8f7b-af483b84456a service nova] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Received unexpected event network-vif-plugged-22370d17-1928-456e-af7e-f2c86f0bc253 for instance with vm_state building and task_state spawning.
May 28 01:03:42.999955 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:03:43.003435 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930223.0027735, 6e370bae-b201-42eb-b5ef-f629b6f6502c => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:03:43.003435 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] VM Resumed (Lifecycle Event)
May 28 01:03:43.004684 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:03:43.007202 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Instance spawned successfully.
May 28 01:03:43.007483 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:03:43.288822 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:03:43.507305 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:43.514968 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:03:43.516753 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:43.516958 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:43.517862 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:43.517862 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:43.517862 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:43.522881 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:43.651362 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:03:43.662640 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:03:43.689617 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:43.764336 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:03:43.764628 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:03:43.777237 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:03:43.779508 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe75:1c46', 'fe80::8c3:73ff:fe68:9ea1', 'fe80::fc16:3eff:fef0:246e', 'fe80::fc16:3eff:feca:a831', 'fe80::fc16:3eff:fe12:3f51', 'fe80::64e0:a4ff:fe34:ffd6', 'fe80::fc16:3eff:fe28:5665', 'fe80::fc16:3eff:fe11:792b', 'fe80::94c0:c3ff:fe67:958f', 'fe80::fc16:3eff:fe2e:7bc9', 'fe80::3834:39ff:fe20:36ec', 'fe80::fc16:3eff:fee7:febd', 'fe80::fc16:3eff:fe71:990d', 'fe80::fc16:3eff:fe6e:a824', 'fe80::1457:8aff:feb2:8bfb', 'fe80::fc16:3eff:fe21:940', 'fe80::fc16:3eff:fe29:2a08', 'fe80::e873:f8ff:fed0:1522', 'fe80::fc16:3eff:fe2e:5f00', 'fe80::fc16:3eff:feab:54e1'] 
May 28 01:03:43.779789 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:03:43.779952 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:03:43.780524 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:03:43.780848 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Updating existing volume attachment record: 139289c0-8c5a-46ee-a677-46ad244097df {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:03:43.797498 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Compute_service record updated for np0000001577:np0000001577 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 01:03:43.797868 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.987s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:43.798259 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:03:43.798937 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a1e9b69c-c159-4a4d-aa22-e2853652738a tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 2.452s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:44.023125 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:03:44.025929 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Took 12.53 seconds to spawn the instance on the hypervisor.
May 28 01:03:44.026073 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:44.045040 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:44.046888 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:44.543404 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Took 20.63 seconds to build instance.
May 28 01:03:44.554262 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:03:45.044761 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ac689483-1a71-4b92-9815-882701120f82 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "6e370bae-b201-42eb-b5ef-f629b6f6502c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.134s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:45.119740 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:45.258051 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a1e9b69c-c159-4a4d-aa22-e2853652738a tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:03:45.258690 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a1e9b69c-c159-4a4d-aa22-e2853652738a tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:03:45.766771 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a1e9b69c-c159-4a4d-aa22-e2853652738a tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:03:45.798322 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:03:45.799697 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:03:45.799740 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:03:45.799924 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:03:45.800303 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:03:45.800538 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.18 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:03:45.903936 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:03:45.904843 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:03:45.905045 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Creating image(s)
May 28 01:03:45.905371 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:03:45.905534 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Ensure instance console log exists: /opt/stack/data/nova/instances/8c35bc03-1899-4eb9-aefe-0bd301686dcf/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:03:45.905830 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:45.905990 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:45.906094 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:45.906536 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Start _get_guest_xml network_info=[{"id": "79122524-4b9f-46c3-91ad-d723f1829ed6", "address": "fa:16:3e:45:bd:f8", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79122524-4b", "ovs_interfaceid": "79122524-4b9f-46c3-91ad-d723f1829ed6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '8c35bc03-1899-4eb9-aefe-0bd301686dcf', 'attached_at': '', 'detached_at': '', 'volume_id': '5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'serial': '5237f2a6-3d87-4be6-91c4-8adbc4a32fcc'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '139289c0-8c5a-46ee-a677-46ad244097df', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:03:45.908450 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:03:45.909383 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-307356266', uuid='8c35bc03-1899-4eb9-aefe-0bd301686dcf'), owner=OwnerMeta(userid='fb6c20970bf0401190583f6348e00e4b', username='tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member', projectid='9e28acf25c4445ea969bd7bca3eac146', projectname='tempest-ServerBootFromVolumeStableRescueTest-568223226'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "79122524-4b9f-46c3-91ad-d723f1829ed6", "address": "fa:16:3e:45:bd:f8", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79122524-4b", "ovs_interfaceid": "79122524-4b9f-46c3-91ad-d723f1829ed6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930225.9090981) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:03:45.910271 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:03:45.910559 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:03:45.911192 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:03:45.911328 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:03:45.914134 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:03:45.914134 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:03:45.914134 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:03:45.914134 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:03:45.914134 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:03:45.914134 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:03:45.914134 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:03:45.914134 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:03:45.914134 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:03:45.914134 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:03:45.914134 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:03:45.914134 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:03:45.922874 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:03:45.923249 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:03:45.923406 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:03:45.923729 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:03:45.923883 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:03:45.934989 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:03:45.935412 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:03:45.935778 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:03:45.935951 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:03:45.936845 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:03:45.936845 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:03:45.954296 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:03:45.954296 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:45.954936 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:03:45.954936 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:45.975179 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc] added
May 28 01:03:45.975179 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:03:45.975179 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:03:45.975179 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:03:45.975179 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:03:45.975179 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:03:45.975179 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:45.975512 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:03:45.975512 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0395(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:03:45.975684 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:03:45.980328 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc] added
May 28 01:03:45.980328 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:03:45.980328 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:03:45.980328 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:03:45.980328 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:03:45.980328 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:03:45.980328 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:45.980692 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:03:45.980692 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0441(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:03:45.980845 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:03:46.156835 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:46.783756 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a1e9b69c-c159-4a4d-aa22-e2853652738a tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.983s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:46.785238 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.666s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:46.799421 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:03:46.800376 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Claim successful on node np0000001577
May 28 01:03:46.976245 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:03:46.981166 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:03:46.998765 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:03:46.998765 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:47.011614 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:03:47.040574 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff (non-flash)
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff (non-flash)
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e88d36a9-0de3-4d96-97bb-4b96a939022f (non-flash)
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45286ab1-db68-4095-b1c6-a6836f7647ea (non-flash)
May 28 01:03:47.040574 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff (non-flash)
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff (non-flash)
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e88d36a9-0de3-4d96-97bb-4b96a939022f (non-flash)
May 28 01:03:47.040574 np0000001577 nova-compute[98319]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45286ab1-db68-4095-b1c6-a6836f7647ea (non-flash)
May 28 01:03:47.040574 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:03:47.057606 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:47.088070 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:47.088070 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:47.088070 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:47.088070 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:47.088070 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:47.088070 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:47.088070 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:47.088070 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:47.088070 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:47.088070 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:47.088070 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:47.088070 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:47.088070 np0000001577 nova-compute[98319]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff (non-flash)
May 28 01:03:47.088070 np0000001577 nova-compute[98319]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff (non-flash)
May 28 01:03:47.088070 np0000001577 nova-compute[98319]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e88d36a9-0de3-4d96-97bb-4b96a939022f (non-flash)
May 28 01:03:47.088070 np0000001577 nova-compute[98319]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45286ab1-db68-4095-b1c6-a6836f7647ea (non-flash)
May 28 01:03:47.088070 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:03:47.088070 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:47.088070 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:47.088070 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:47.088070 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:47.088070 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:47.088070 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:47.088070 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:47.088070 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:47.088070 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:47.088070 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:47.088070 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:47.088070 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:47.088070 np0000001577 nova-compute[98319]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff (non-flash)
May 28 01:03:47.088070 np0000001577 nova-compute[98319]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff (non-flash)
May 28 01:03:47.088070 np0000001577 nova-compute[98319]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e88d36a9-0de3-4d96-97bb-4b96a939022f (non-flash)
May 28 01:03:47.088070 np0000001577 nova-compute[98319]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45286ab1-db68-4095-b1c6-a6836f7647ea (non-flash)
May 28 01:03:47.088070 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:03:47.093181 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:47.123222 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc, portal: 192.168.50.100,3260]
May 28 01:03:47.123222 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc, portal: 192.168.50.100,3260] successful.
May 28 01:03:47.123222 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:47.142683 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:47.165155 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc, portal: 192.168.40.100,3260]
May 28 01:03:47.165155 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc, portal: 192.168.40.100,3260] successful.
May 28 01:03:47.165155 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e88d36a9-0de3-4d96-97bb-4b96a939022f (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45286ab1-db68-4095-b1c6-a6836f7647ea (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e88d36a9-0de3-4d96-97bb-4b96a939022f (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45286ab1-db68-4095-b1c6-a6836f7647ea (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:03:47.170924 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.232s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] HCTL ('23', '-', '-', 0) found on session 82 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:03:47.170924 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Scanning host 23 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:03:47.181316 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:47.189263 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Searching for a device in session 82 and hctl ['23', '*', '*', 0] yield: sdr {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:03:47.190099 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Connected to sdr using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:03:47.212875 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:47.212875 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:47.212875 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:47.212875 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:47.212875 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:47.212875 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:47.212875 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:47.212875 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:47.212875 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:47.212875 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:47.212875 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:47.212875 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:47.212875 np0000001577 nova-compute[98319]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff (non-flash)
May 28 01:03:47.212875 np0000001577 nova-compute[98319]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff (non-flash)
May 28 01:03:47.212875 np0000001577 nova-compute[98319]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e88d36a9-0de3-4d96-97bb-4b96a939022f (non-flash)
May 28 01:03:47.212875 np0000001577 nova-compute[98319]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45286ab1-db68-4095-b1c6-a6836f7647ea (non-flash)
May 28 01:03:47.212875 np0000001577 nova-compute[98319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:03:47.212875 np0000001577 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:03:47.212875 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:03:47.213649 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:47.213649 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:47.213649 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:47.213649 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:47.213649 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:47.213649 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:47.213649 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:47.213649 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:47.213649 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:47.213649 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:47.213649 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:47.213649 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:47.213649 np0000001577 nova-compute[98319]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff (non-flash)
May 28 01:03:47.213649 np0000001577 nova-compute[98319]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff (non-flash)
May 28 01:03:47.213649 np0000001577 nova-compute[98319]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e88d36a9-0de3-4d96-97bb-4b96a939022f (non-flash)
May 28 01:03:47.213649 np0000001577 nova-compute[98319]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45286ab1-db68-4095-b1c6-a6836f7647ea (non-flash)
May 28 01:03:47.213649 np0000001577 nova-compute[98319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:03:47.213649 np0000001577 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:03:47.213649 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:03:47.213649 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.278s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:03:47.213649 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:03:47.215344 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] HCTL ('24', '-', '-', 0) found on session 83 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:03:47.215471 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Scanning host 24 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:03:47.239500 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Searching for a device in session 83 and hctl ['24', '*', '*', 0] yield: sds {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:03:47.240572 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Connected to sds using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:03:47.441431 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-a1e9b69c-c159-4a4d-aa22-e2853652738a tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Deleted allocation for migration 6a9d896f-83cd-4713-80ec-6964bae95639
May 28 01:03:47.937295 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:03:47.949859 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a1e9b69c-c159-4a4d-aa22-e2853652738a tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "0ad69caa-c797-4e9d-96e3-7ad63523be49" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 9.959s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:48.083068 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-5f1af5e1-d2c1-436e-b9ca-559e02788dd4 tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Get console output
May 28 01:03:48.170441 np0000001577 nova-compute[98319]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
May 28 01:03:48.335440 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.006462128999828565 future=<Future at 0x7c984c367c20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:03:48.335617 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:03:48.341884 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Emitting event <LifecycleEvent: 1779930213.328849, 03f1821a-592e-4e02-b609-74f3d7e69b53 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:03:48.342292 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] VM Stopped (Lifecycle Event)
May 28 01:03:48.851667 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 03f1821a-592e-4e02-b609-74f3d7e69b53] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:48.953331 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Found WWN 330000000742f72bb for multipath device dm-15 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:03:48.953743 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:03:48.953947 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '330000000742f72bb', 'path': '/dev/dm-15', 'multipath_id': '330000000742f72bb'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:03:48.954126 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000742f72bb', 'path': '/dev/dm-15', 'multipath_id': '330000000742f72bb'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:03:49.099576 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:03:49.099752 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:03:49.355350 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "6e370bae-b201-42eb-b5ef-f629b6f6502c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:49.355350 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "6e370bae-b201-42eb-b5ef-f629b6f6502c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:49.355350 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "6e370bae-b201-42eb-b5ef-f629b6f6502c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:49.355350 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "6e370bae-b201-42eb-b5ef-f629b6f6502c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:49.355350 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "6e370bae-b201-42eb-b5ef-f629b6f6502c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:49.356912 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Terminating instance
May 28 01:03:49.464381 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:03:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-307356266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serverbootfromvolumestablerescuetest-server-307356266',id=38,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e28acf25c4445ea969bd7bca3eac146',ramdisk_id='',reservation_id='r-gieq9fco',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-568223226',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:03:39Z,user_data=None,user_id='fb6c20970bf0401190583f6348e00e4b',uuid=8c35bc03-1899-4eb9-aefe-0bd301686dcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79122524-4b9f-46c3-91ad-d723f1829ed6", "address": "fa:16:3e:45:bd:f8", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79122524-4b", "ovs_interfaceid": "79122524-4b9f-46c3-91ad-d723f1829ed6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:03:49.464703 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Converting VIF {"id": "79122524-4b9f-46c3-91ad-d723f1829ed6", "address": "fa:16:3e:45:bd:f8", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79122524-4b", "ovs_interfaceid": "79122524-4b9f-46c3-91ad-d723f1829ed6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:03:49.465597 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:bd:f8,bridge_name='br-int',has_traffic_filtering=True,id=79122524-4b9f-46c3-91ad-d723f1829ed6,network=Network(c25f8563-bd10-4e42-b4ce-fd2164eca324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79122524-4b') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:03:49.466696 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c35bc03-1899-4eb9-aefe-0bd301686dcf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:03:49.603205 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:03:49.863892 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:03:49.887451 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:49.893237 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:49.955841 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:49.979032 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] End _get_guest_xml xml=<domain type="qemu">
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:   <uuid>8c35bc03-1899-4eb9-aefe-0bd301686dcf</uuid>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:   <name>instance-00000026</name>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-307356266</nova:name>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:03:45</nova:creationTime>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:         <nova:user uuid="fb6c20970bf0401190583f6348e00e4b">tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member</nova:user>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:         <nova:project uuid="9e28acf25c4445ea969bd7bca3eac146">tempest-ServerBootFromVolumeStableRescueTest-568223226</nova:project>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:         <nova:port uuid="79122524-4b9f-46c3-91ad-d723f1829ed6">
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:     <system>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       <entry name="serial">8c35bc03-1899-4eb9-aefe-0bd301686dcf</entry>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       <entry name="uuid">8c35bc03-1899-4eb9-aefe-0bd301686dcf</entry>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:     </system>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:   <os>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:   </os>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:   <features>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:   </features>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:   <devices>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/8c35bc03-1899-4eb9-aefe-0bd301686dcf/disk.config"/>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:     </disk>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       <alias name="ua-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc"/>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-15"/>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       <serial>5237f2a6-3d87-4be6-91c4-8adbc4a32fcc</serial>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:     </disk>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:45:bd:f8"/>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       <target dev="tap79122524-4b"/>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:     </interface>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/8c35bc03-1899-4eb9-aefe-0bd301686dcf/console.log" append="off"/>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:     </serial>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:     <video>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:     </video>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:     </rng>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:   </devices>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]: </domain>
May 28 01:03:49.979032 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:03:49.981029 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Preparing to wait for external event network-vif-plugged-79122524-4b9f-46c3-91ad-d723f1829ed6 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:03:49.981029 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:49.981029 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:49.981029 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:49.981029 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:03:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-307356266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serverbootfromvolumestablerescuetest-server-307356266',id=38,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e28acf25c4445ea969bd7bca3eac146',ramdisk_id='',reservation_id='r-gieq9fco',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-568223226',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:03:39Z,user_data=None,user_id='fb6c20970bf0401190583f6348e00e4b',uuid=8c35bc03-1899-4eb9-aefe-0bd301686dcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79122524-4b9f-46c3-91ad-d723f1829ed6", "address": "fa:16:3e:45:bd:f8", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79122524-4b", "ovs_interfaceid": "79122524-4b9f-46c3-91ad-d723f1829ed6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:03:49.981029 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Converting VIF {"id": "79122524-4b9f-46c3-91ad-d723f1829ed6", "address": "fa:16:3e:45:bd:f8", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79122524-4b", "ovs_interfaceid": "79122524-4b9f-46c3-91ad-d723f1829ed6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:03:49.981029 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:bd:f8,bridge_name='br-int',has_traffic_filtering=True,id=79122524-4b9f-46c3-91ad-d723f1829ed6,network=Network(c25f8563-bd10-4e42-b4ce-fd2164eca324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79122524-4b') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:03:49.981336 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:bd:f8,bridge_name='br-int',has_traffic_filtering=True,id=79122524-4b9f-46c3-91ad-d723f1829ed6,network=Network(c25f8563-bd10-4e42-b4ce-fd2164eca324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79122524-4b') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:03:49.982822 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:49.982822 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:49.982822 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:03:49.985864 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:49.986124 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd0823d55-4065-5214-9516-e511cad6fa01', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:49.996055 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:49.997038 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:03:50.002201 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:50.009529 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:50.009798 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79122524-4b, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:50.010235 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap79122524-4b, col_values=(('qos', UUID('45c6f373-91a5-4dce-be43-e515091dfd7f')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:50.010442 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap79122524-4b, col_values=(('external_ids', {'iface-id': '79122524-4b9f-46c3-91ad-d723f1829ed6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:bd:f8', 'vm-uuid': '8c35bc03-1899-4eb9-aefe-0bd301686dcf'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:50.011303 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:50.012842 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:03:50.023572 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:50.024586 np0000001577 nova-compute[98319]: INFO os_vif [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:bd:f8,bridge_name='br-int',has_traffic_filtering=True,id=79122524-4b9f-46c3-91ad-d723f1829ed6,network=Network(c25f8563-bd10-4e42-b4ce-fd2164eca324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79122524-4b')
May 28 01:03:50.057357 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a9fbcabb-4bc6-4258-a2ad-ec542d631139 req-4a299bd6-5c89-4476-a8ff-d86e5720b645 service nova] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Received event network-vif-unplugged-22370d17-1928-456e-af7e-f2c86f0bc253 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:50.057522 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a9fbcabb-4bc6-4258-a2ad-ec542d631139 req-4a299bd6-5c89-4476-a8ff-d86e5720b645 service nova] Acquiring lock "6e370bae-b201-42eb-b5ef-f629b6f6502c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:50.057675 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a9fbcabb-4bc6-4258-a2ad-ec542d631139 req-4a299bd6-5c89-4476-a8ff-d86e5720b645 service nova] Lock "6e370bae-b201-42eb-b5ef-f629b6f6502c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:50.057797 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a9fbcabb-4bc6-4258-a2ad-ec542d631139 req-4a299bd6-5c89-4476-a8ff-d86e5720b645 service nova] Lock "6e370bae-b201-42eb-b5ef-f629b6f6502c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:50.057947 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a9fbcabb-4bc6-4258-a2ad-ec542d631139 req-4a299bd6-5c89-4476-a8ff-d86e5720b645 service nova] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] No waiting events found dispatching network-vif-unplugged-22370d17-1928-456e-af7e-f2c86f0bc253 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:03:50.058039 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a9fbcabb-4bc6-4258-a2ad-ec542d631139 req-4a299bd6-5c89-4476-a8ff-d86e5720b645 service nova] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Received event network-vif-unplugged-22370d17-1928-456e-af7e-f2c86f0bc253 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:03:50.073328 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:50.085989 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:50.112782 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.328s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:50.113114 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:03:50.185793 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.99972326499983 future=<Future at 0x7c98706bc2c0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:03:50.188930 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.995803740000156 future=<Future at 0x7c98706bc2c0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:03:50.190833 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.991720259999965 future=<Future at 0x7c98706bc2c0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:03:50.192336 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Instance destroyed successfully.
May 28 01:03:50.193024 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lazy-loading 'resources' on Instance uuid 6e370bae-b201-42eb-b5ef-f629b6f6502c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:03:50.621157 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:03:50.621157 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:03:50.621157 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:50.621157 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:50.692356 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd375089981f8493598b33c4b6f122374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a7090a79f448f3abe4737bf127df53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:03:50.695731 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:03:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1249093534',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumemultiattachtest-server-1249093534',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:03:44Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='938c2829112843edb2054984e80ce7ad',ramdisk_id='',reservation_id='r-ui7brn70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-89204095',owner_user_name='tempest-AttachVolumeMultiAttachTest-89204095-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:03:44Z,user_data=None,user_id='f8586a18edcf42cab0a60028135ae401',uuid=6e370bae-b201-42eb-b5ef-f629b6f6502c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22370d17-1928-456e-af7e-f2c86f0bc253", "address": "fa:16:3e:ab:54:e1", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22370d17-19", "ovs_interfaceid": "22370d17-1928-456e-af7e-f2c86f0bc253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:03:50.695731 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converting VIF {"id": "22370d17-1928-456e-af7e-f2c86f0bc253", "address": "fa:16:3e:ab:54:e1", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22370d17-19", "ovs_interfaceid": "22370d17-1928-456e-af7e-f2c86f0bc253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:03:50.695891 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:54:e1,bridge_name='br-int',has_traffic_filtering=True,id=22370d17-1928-456e-af7e-f2c86f0bc253,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22370d17-19') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:03:50.696094 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:54:e1,bridge_name='br-int',has_traffic_filtering=True,id=22370d17-1928-456e-af7e-f2c86f0bc253,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22370d17-19') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:03:50.697212 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:50.697430 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22370d17-19, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:50.698612 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:50.699097 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:03:50.707860 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:50.708983 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:50.709160 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7bc16096-d930-442c-983f-ef1627077297) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:50.709726 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:50.710201 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:03:50.716437 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:50.718376 np0000001577 nova-compute[98319]: INFO os_vif [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:54:e1,bridge_name='br-int',has_traffic_filtering=True,id=22370d17-1928-456e-af7e-f2c86f0bc253,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22370d17-19')
May 28 01:03:50.760447 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:03:50.760767 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff', 'iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'abcd46b2-0a9a-4784-a743-1c36a51133ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:03:50.760916 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:03:50.821735 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.061s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:03:50.822039 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff', 'iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'abcd46b2-0a9a-4784-a743-1c36a51133ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:03:50.822227 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:03:50.864713 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:50.864713 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:50.864713 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:50.864713 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:50.864713 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:50.864713 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:50.864713 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:50.864713 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:50.864713 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:50.864713 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:50.864713 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:50.864713 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:50.864713 np0000001577 nova-compute[98319]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff (non-flash)
May 28 01:03:50.864713 np0000001577 nova-compute[98319]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff (non-flash)
May 28 01:03:50.864713 np0000001577 nova-compute[98319]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e88d36a9-0de3-4d96-97bb-4b96a939022f (non-flash)
May 28 01:03:50.864713 np0000001577 nova-compute[98319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:03:50.864713 np0000001577 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:03:50.864713 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:03:50.865138 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:50.865138 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:50.865138 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:50.865138 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:50.865138 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:50.865138 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:50.865138 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:50.865138 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:50.865138 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:50.865138 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:50.865138 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:50.865138 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:50.865138 np0000001577 nova-compute[98319]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff (non-flash)
May 28 01:03:50.865138 np0000001577 nova-compute[98319]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff (non-flash)
May 28 01:03:50.865138 np0000001577 nova-compute[98319]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e88d36a9-0de3-4d96-97bb-4b96a939022f (non-flash)
May 28 01:03:50.865138 np0000001577 nova-compute[98319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:03:50.865138 np0000001577 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:03:50.865138 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:03:50.865138 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', '74'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', '75'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', '77'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff', '78'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff', '79'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e88d36a9-0de3-4d96-97bb-4b96a939022f', '80'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', '83')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:03:50.865505 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff', '79')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:03:50.866415 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff', '78')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:03:50.868375 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c984c56d940>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff'): ({'sdk'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:03:50.868610 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Removing multipathed devices sdk, sdn {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:03:50.868824 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Flush multipath device 330000000b2f9c03a {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:03:50.936352 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:03:50.973760 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:03:51.017076 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Checking to see if SCSI volumes sdk, sdn have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:03:51.017266 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] SCSI volumes sdk, sdn have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:03:51.018870 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Checking to see if device paths {'sdk', 'sdn'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:03:51.032006 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Device paths {'sdk', 'sdn'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:03:51.032211 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:03:51.044967 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:51.093291 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 79, target: iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff, portal: 192.168.40.100,3260]
May 28 01:03:51.093291 np0000001577 nova-compute[98319]: Logout of [sid: 79, target: iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff, portal: 192.168.40.100,3260] successful.
May 28 01:03:51.093291 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:51.118352 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:51.122161 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:03:51.133387 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:51.160019 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:51.172314 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 78, target: iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff, portal: 192.168.50.100,3260]
May 28 01:03:51.172314 np0000001577 nova-compute[98319]: Logout of [sid: 78, target: iqn.2023-03.storpool.com:os--volume-abcd46b2-0a9a-4784-a743-1c36a51133ff, portal: 192.168.50.100,3260] successful.
May 28 01:03:51.172314 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:51.192019 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Successfully created port: 53846e61-8840-490f-a976-3997db8a0f0b {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:03:51.194761 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:51.194950 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:03:51.195058 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] <== disconnect_volume: return (434ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:03:51.195138 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:03:51.195374 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Deleting instance files /opt/stack/data/nova/instances/6e370bae-b201-42eb-b5ef-f629b6f6502c_del
May 28 01:03:51.195866 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Deletion of /opt/stack/data/nova/instances/6e370bae-b201-42eb-b5ef-f629b6f6502c_del complete
May 28 01:03:51.554034 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:03:51.554137 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:03:51.554234 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] No VIF found with MAC fa:16:3e:45:bd:f8, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:03:51.554610 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Using config drive
May 28 01:03:51.626170 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:03:51.701629 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Took 1.84 seconds to destroy the instance on the hypervisor.
May 28 01:03:51.702685 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:03:51.702868 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:03:51.704022 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:03:51.704022 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:51.732166 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Successfully updated port: 53846e61-8840-490f-a976-3997db8a0f0b {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:03:51.769504 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:51.778578 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ef666fb4-af85-460f-9310-dc904c584c33 req-12fcf22b-7aee-412c-bc77-a0e5b4364bf9 service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Received event network-changed-53846e61-8840-490f-a976-3997db8a0f0b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:51.779343 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ef666fb4-af85-460f-9310-dc904c584c33 req-12fcf22b-7aee-412c-bc77-a0e5b4364bf9 service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Refreshing instance network info cache due to event network-changed-53846e61-8840-490f-a976-3997db8a0f0b. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:03:51.779493 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ef666fb4-af85-460f-9310-dc904c584c33 req-12fcf22b-7aee-412c-bc77-a0e5b4364bf9 service nova] Acquiring lock "refresh_cache-2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:03:51.779598 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ef666fb4-af85-460f-9310-dc904c584c33 req-12fcf22b-7aee-412c-bc77-a0e5b4364bf9 service nova] Acquired lock "refresh_cache-2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:03:51.779712 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-ef666fb4-af85-460f-9310-dc904c584c33 req-12fcf22b-7aee-412c-bc77-a0e5b4364bf9 service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Refreshing network info cache for port 53846e61-8840-490f-a976-3997db8a0f0b {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:03:52.059001 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:52.123975 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8af461bd-bb10-4dad-9096-892b44d41550 req-156fa10d-719d-401e-857c-4fcbccdd6fc5 service nova] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Received event network-vif-unplugged-22370d17-1928-456e-af7e-f2c86f0bc253 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:52.124512 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8af461bd-bb10-4dad-9096-892b44d41550 req-156fa10d-719d-401e-857c-4fcbccdd6fc5 service nova] Acquiring lock "6e370bae-b201-42eb-b5ef-f629b6f6502c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:52.124808 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8af461bd-bb10-4dad-9096-892b44d41550 req-156fa10d-719d-401e-857c-4fcbccdd6fc5 service nova] Lock "6e370bae-b201-42eb-b5ef-f629b6f6502c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:52.125031 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8af461bd-bb10-4dad-9096-892b44d41550 req-156fa10d-719d-401e-857c-4fcbccdd6fc5 service nova] Lock "6e370bae-b201-42eb-b5ef-f629b6f6502c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:52.125209 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8af461bd-bb10-4dad-9096-892b44d41550 req-156fa10d-719d-401e-857c-4fcbccdd6fc5 service nova] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] No waiting events found dispatching network-vif-unplugged-22370d17-1928-456e-af7e-f2c86f0bc253 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:03:52.125317 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8af461bd-bb10-4dad-9096-892b44d41550 req-156fa10d-719d-401e-857c-4fcbccdd6fc5 service nova] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Received event network-vif-unplugged-22370d17-1928-456e-af7e-f2c86f0bc253 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:03:52.209536 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Creating config drive at /opt/stack/data/nova/instances/8c35bc03-1899-4eb9-aefe-0bd301686dcf/disk.config
May 28 01:03:52.214406 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8c35bc03-1899-4eb9-aefe-0bd301686dcf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpldxobgap {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:52.235985 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "refresh_cache-2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:03:52.268524 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8c35bc03-1899-4eb9-aefe-0bd301686dcf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpldxobgap" returned: 0 in 0.054s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:52.284573 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-ef666fb4-af85-460f-9310-dc904c584c33 req-12fcf22b-7aee-412c-bc77-a0e5b4364bf9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:52.353670 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-ef666fb4-af85-460f-9310-dc904c584c33 req-12fcf22b-7aee-412c-bc77-a0e5b4364bf9 service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:03:52.498873 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:03:52.503120 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-ef666fb4-af85-460f-9310-dc904c584c33 req-12fcf22b-7aee-412c-bc77-a0e5b4364bf9 service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:03:52.640463 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:03:52.641582 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:03:52.641827 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Creating image(s)
May 28 01:03:52.642310 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:52.642486 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "/opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:52.644465 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "/opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:52.645042 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:03:52.648049 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:03:52.650178 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:52.701313 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:52.729264 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:52.732275 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:52.761679 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.111s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:52.762222 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:52.762783 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:52.763198 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:03:52.766313 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:03:52.766632 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:52.815511 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:52.862388 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.095s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:52.862844 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:52.906460 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:52.913052 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:52.920518 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk 1073741824" returned: 0 in 0.057s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:52.921016 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.158s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:52.921339 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:52.990571 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-de79e243-6bfe-4c22-9f95-746fbf0db353 req-645af72b-e2bb-4f50-ad95-cd470c16aedf service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Received event network-vif-plugged-79122524-4b9f-46c3-91ad-d723f1829ed6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:52.990571 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-de79e243-6bfe-4c22-9f95-746fbf0db353 req-645af72b-e2bb-4f50-ad95-cd470c16aedf service nova] Acquiring lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:52.990571 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-de79e243-6bfe-4c22-9f95-746fbf0db353 req-645af72b-e2bb-4f50-ad95-cd470c16aedf service nova] Lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:52.990571 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-de79e243-6bfe-4c22-9f95-746fbf0db353 req-645af72b-e2bb-4f50-ad95-cd470c16aedf service nova] Lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:52.990973 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-de79e243-6bfe-4c22-9f95-746fbf0db353 req-645af72b-e2bb-4f50-ad95-cd470c16aedf service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Processing event network-vif-plugged-79122524-4b9f-46c3-91ad-d723f1829ed6 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:03:53.003454 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Took 1.30 seconds to deallocate network for instance.
May 28 01:03:53.007040 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ef666fb4-af85-460f-9310-dc904c584c33 req-12fcf22b-7aee-412c-bc77-a0e5b4364bf9 service nova] Releasing lock "refresh_cache-2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:03:53.007768 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:53.008220 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:03:53.009414 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquired lock "refresh_cache-2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:03:53.009590 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:03:53.010500 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:53.080158 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:53.093910 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:53.094255 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Cannot resize image /opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:03:53.094583 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:03:53.094734 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Ensure instance console log exists: /opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:03:53.095161 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:53.095645 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:53.095645 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:53.491667 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930233.4912906, 8c35bc03-1899-4eb9-aefe-0bd301686dcf => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:03:53.492243 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:03:53.492407 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] VM Started (Lifecycle Event)
May 28 01:03:53.494443 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:03:53.496916 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Instance spawned successfully.
May 28 01:03:53.497458 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:03:53.570335 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Took 0.57 seconds to detach 1 volumes for instance.
May 28 01:03:53.586707 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:03:53.732767 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:53.826997 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Acquiring lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:53.827205 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:53.849942 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-38655ef3-719f-4960-b6a6-f4fdf8aa59f0 req-eb2c2bb0-1fbf-4069-8e9a-8ecca094fe62 service nova] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Received event network-vif-deleted-22370d17-1928-456e-af7e-f2c86f0bc253 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:53.868319 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Updating instance_info_cache with network_info: [{"id": "53846e61-8840-490f-a976-3997db8a0f0b", "address": "fa:16:3e:88:07:ca", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53846e61-88", "ovs_interfaceid": "53846e61-8840-490f-a976-3997db8a0f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:03:53.995009 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:53.996502 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:03:54.002945 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:54.003048 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:54.003318 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:54.003564 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:54.003815 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:54.004056 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:54.080907 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:54.081276 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:54.330087 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Detaching volume 37b25d6b-f126-4563-a58f-8b4a23c52397
May 28 01:03:54.370449 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Releasing lock "refresh_cache-2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:03:54.370933 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Instance network_info: |[{"id": "53846e61-8840-490f-a976-3997db8a0f0b", "address": "fa:16:3e:88:07:ca", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53846e61-88", "ovs_interfaceid": "53846e61-8840-490f-a976-3997db8a0f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:03:54.373286 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Start _get_guest_xml network_info=[{"id": "53846e61-8840-490f-a976-3997db8a0f0b", "address": "fa:16:3e:88:07:ca", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53846e61-88", "ovs_interfaceid": "53846e61-8840-490f-a976-3997db8a0f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:03:54.374692 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Attempting to driver detach volume 37b25d6b-f126-4563-a58f-8b4a23c52397 from mountpoint /dev/vdb
May 28 01:03:54.376262 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:03:54.377605 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-1328136978', uuid='2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e'), owner=OwnerMeta(userid='d375089981f8493598b33c4b6f122374', username='tempest-AttachVolumeShelveTestJSON-1260503814-project-member', projectid='f6a7090a79f448f3abe4737bf127df53', projectname='tempest-AttachVolumeShelveTestJSON-1260503814'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "53846e61-8840-490f-a976-3997db8a0f0b", "address": "fa:16:3e:88:07:ca", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53846e61-88", "ovs_interfaceid": "53846e61-8840-490f-a976-3997db8a0f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930234.3771596) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:03:54.380872 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:03:54.381331 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:03:54.384850 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:03:54.385695 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:03:54.386921 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:03:54.387773 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:03:54.388032 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Found disk vdb by alias ua-37b25d6b-f126-4563-a58f-8b4a23c52397 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:03:54.388196 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:03:54.388342 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:03:54.388539 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:03:54.389139 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:03:54.389139 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:03:54.389139 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:03:54.389273 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:03:54.389406 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:03:54.389582 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:03:54.389800 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:03:54.400653 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Found disk vdb by alias ua-37b25d6b-f126-4563-a58f-8b4a23c52397 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:03:54.400915 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Attempting to detach device vdb from instance 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:03:54.401287 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:03:54.401287 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:03:54.401287 np0000001577 nova-compute[98319]:   <alias name="ua-37b25d6b-f126-4563-a58f-8b4a23c52397"/>
May 28 01:03:54.401287 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-5"/>
May 28 01:03:54.401287 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:03:54.401287 np0000001577 nova-compute[98319]:   <serial>37b25d6b-f126-4563-a58f-8b4a23c52397</serial>
May 28 01:03:54.401287 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:03:54.401287 np0000001577 nova-compute[98319]: </disk>
May 28 01:03:54.401287 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:03:54.403927 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1328136978',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumeshelvetestjson-server-1328136978',id=39,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwo7eu98M2lVJQz8v1lXS5seW0IzErKTm9jX0nEiUnke3eatP2nV5nyO/xoWW2Z6G175w5hkAxX1GDoRpaCGgexCFYaPFf5tCq63oY84sMYbDC7Go75ObhV5XSZRVJ03w==',key_name='tempest-keypair-866036055',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6a7090a79f448f3abe4737bf127df53',ramdisk_id='',reservation_id='r-wfzqk2ne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1260503814',owner_user_name='tempest-AttachVolumeShelveTestJSON-1260503814-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:03:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d375089981f8493598b33c4b6f122374',uuid=2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53846e61-8840-490f-a976-3997db8a0f0b", "address": "fa:16:3e:88:07:ca", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53846e61-88", "ovs_interfaceid": "53846e61-8840-490f-a976-3997db8a0f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:03:54.404073 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Converting VIF {"id": "53846e61-8840-490f-a976-3997db8a0f0b", "address": "fa:16:3e:88:07:ca", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53846e61-88", "ovs_interfaceid": "53846e61-8840-490f-a976-3997db8a0f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:03:54.404798 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:07:ca,bridge_name='br-int',has_traffic_filtering=True,id=53846e61-8840-490f-a976-3997db8a0f0b,network=Network(e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53846e61-88') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:03:54.405251 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:03:54.418426 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Successfully detached device vdb from instance 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b from the persistent domain config.
May 28 01:03:54.418654 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] (1/8): Attempting to detach device vdb with device alias ua-37b25d6b-f126-4563-a58f-8b4a23c52397 from instance 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:03:54.419181 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:03:54.419181 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:03:54.419181 np0000001577 nova-compute[98319]:   <alias name="ua-37b25d6b-f126-4563-a58f-8b4a23c52397"/>
May 28 01:03:54.419181 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-5"/>
May 28 01:03:54.419181 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:03:54.419181 np0000001577 nova-compute[98319]:   <serial>37b25d6b-f126-4563-a58f-8b4a23c52397</serial>
May 28 01:03:54.419181 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:03:54.419181 np0000001577 nova-compute[98319]: </disk>
May 28 01:03:54.419181 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:03:54.498445 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:03:54.498685 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930234.4985213, 8c35bc03-1899-4eb9-aefe-0bd301686dcf => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:03:54.498782 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] VM Paused (Lifecycle Event)
May 28 01:03:54.508301 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Took 8.60 seconds to spawn the instance on the hypervisor.
May 28 01:03:54.509399 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:54.874479 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:03:54.874757 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:03:54.915959 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] End _get_guest_xml xml=<domain type="qemu">
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:   <uuid>2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e</uuid>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:   <name>instance-00000027</name>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1328136978</nova:name>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:03:54</nova:creationTime>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:         <nova:user uuid="d375089981f8493598b33c4b6f122374">tempest-AttachVolumeShelveTestJSON-1260503814-project-member</nova:user>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:         <nova:project uuid="f6a7090a79f448f3abe4737bf127df53">tempest-AttachVolumeShelveTestJSON-1260503814</nova:project>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:         <nova:port uuid="53846e61-8840-490f-a976-3997db8a0f0b">
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:     <system>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       <entry name="serial">2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e</entry>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       <entry name="uuid">2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e</entry>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:     </system>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:   <os>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:   </os>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:   <features>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:   </features>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:   <devices>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk"/>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:     </disk>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk.config"/>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:     </disk>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:88:07:ca"/>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       <target dev="tap53846e61-88"/>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:     </interface>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/console.log" append="off"/>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:     </serial>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:     <video>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:     </video>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:     </rng>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:   </devices>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]: </domain>
May 28 01:03:54.915959 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:03:54.915959 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Preparing to wait for external event network-vif-plugged-53846e61-8840-490f-a976-3997db8a0f0b {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:03:54.915959 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:54.915959 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:54.915959 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:54.915959 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1328136978',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumeshelvetestjson-server-1328136978',id=39,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwo7eu98M2lVJQz8v1lXS5seW0IzErKTm9jX0nEiUnke3eatP2nV5nyO/xoWW2Z6G175w5hkAxX1GDoRpaCGgexCFYaPFf5tCq63oY84sMYbDC7Go75ObhV5XSZRVJ03w==',key_name='tempest-keypair-866036055',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6a7090a79f448f3abe4737bf127df53',ramdisk_id='',reservation_id='r-wfzqk2ne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1260503814',owner_user_name='tempest-AttachVolumeShelveTestJSON-1260503814-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:03:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d375089981f8493598b33c4b6f122374',uuid=2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53846e61-8840-490f-a976-3997db8a0f0b", "address": "fa:16:3e:88:07:ca", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53846e61-88", "ovs_interfaceid": "53846e61-8840-490f-a976-3997db8a0f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:03:54.915959 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Converting VIF {"id": "53846e61-8840-490f-a976-3997db8a0f0b", "address": "fa:16:3e:88:07:ca", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53846e61-88", "ovs_interfaceid": "53846e61-8840-490f-a976-3997db8a0f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:03:54.915959 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:07:ca,bridge_name='br-int',has_traffic_filtering=True,id=53846e61-8840-490f-a976-3997db8a0f0b,network=Network(e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53846e61-88') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:03:54.921523 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:07:ca,bridge_name='br-int',has_traffic_filtering=True,id=53846e61-8840-490f-a976-3997db8a0f0b,network=Network(e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53846e61-88') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:03:54.921523 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "a9122d01-9c31-48d3-ae6b-e2d6305fe8d7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:54.921523 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "a9122d01-9c31-48d3-ae6b-e2d6305fe8d7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:54.921523 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:54.921523 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:54.921736 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:03:54.922750 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:54.922899 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '921380f2-9f93-52c3-9f0e-e71e1cf40019', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:54.923486 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:54.924051 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:03:54.924492 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:54.926514 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:54.926514 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53846e61-88, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:54.926514 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53846e61-88, col_values=(('qos', UUID('0e1c932a-8608-4717-a460-7d84bc124ded')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:54.926738 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53846e61-88, col_values=(('external_ids', {'iface-id': '53846e61-8840-490f-a976-3997db8a0f0b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:07:ca', 'vm-uuid': '2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:54.927313 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:54.928137 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:03:54.934139 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:54.934991 np0000001577 nova-compute[98319]: INFO os_vif [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:07:ca,bridge_name='br-int',has_traffic_filtering=True,id=53846e61-8840-490f-a976-3997db8a0f0b,network=Network(e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53846e61-88')
May 28 01:03:54.947436 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-37b25d6b-f126-4563-a58f-8b4a23c52397 for instance 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:03:55.004588 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:55.006298 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930235.0060744, 8c35bc03-1899-4eb9-aefe-0bd301686dcf => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:03:55.006442 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] VM Resumed (Lifecycle Event)
May 28 01:03:55.020232 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Took 20.14 seconds to build instance.
May 28 01:03:55.047699 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2fb599d5-0e71-465d-aa8b-600b8fff1776 req-6d3f82ef-a15b-407e-b0fa-68e5aec8d709 service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Received event network-vif-plugged-79122524-4b9f-46c3-91ad-d723f1829ed6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:55.047699 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2fb599d5-0e71-465d-aa8b-600b8fff1776 req-6d3f82ef-a15b-407e-b0fa-68e5aec8d709 service nova] Acquiring lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:55.047699 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2fb599d5-0e71-465d-aa8b-600b8fff1776 req-6d3f82ef-a15b-407e-b0fa-68e5aec8d709 service nova] Lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:55.047699 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2fb599d5-0e71-465d-aa8b-600b8fff1776 req-6d3f82ef-a15b-407e-b0fa-68e5aec8d709 service nova] Lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:55.047699 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2fb599d5-0e71-465d-aa8b-600b8fff1776 req-6d3f82ef-a15b-407e-b0fa-68e5aec8d709 service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] No waiting events found dispatching network-vif-plugged-79122524-4b9f-46c3-91ad-d723f1829ed6 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:03:55.047699 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-2fb599d5-0e71-465d-aa8b-600b8fff1776 req-6d3f82ef-a15b-407e-b0fa-68e5aec8d709 service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Received unexpected event network-vif-plugged-79122524-4b9f-46c3-91ad-d723f1829ed6 for instance with vm_state active and task_state None.
May 28 01:03:55.378180 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:03:55.423839 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Detaching volume 7d1dca13-bb8b-459a-b99b-e1b6b24118a1
May 28 01:03:55.479460 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Attempting to driver detach volume 7d1dca13-bb8b-459a-b99b-e1b6b24118a1 from mountpoint /dev/vdb
May 28 01:03:55.483783 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Found disk vdb by alias ua-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:03:55.485032 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Found disk vdb by alias ua-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:03:55.485189 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Attempting to detach device vdb from instance a9122d01-9c31-48d3-ae6b-e2d6305fe8d7 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:03:55.485481 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:03:55.485481 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:03:55.485481 np0000001577 nova-compute[98319]:   <alias name="ua-7d1dca13-bb8b-459a-b99b-e1b6b24118a1"/>
May 28 01:03:55.485481 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-7"/>
May 28 01:03:55.485481 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:03:55.485481 np0000001577 nova-compute[98319]:   <serial>7d1dca13-bb8b-459a-b99b-e1b6b24118a1</serial>
May 28 01:03:55.485481 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:03:55.485481 np0000001577 nova-compute[98319]: </disk>
May 28 01:03:55.485481 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:03:55.492503 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Successfully detached device vdb from instance a9122d01-9c31-48d3-ae6b-e2d6305fe8d7 from the persistent domain config.
May 28 01:03:55.492605 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] (1/8): Attempting to detach device vdb with device alias ua-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 from instance a9122d01-9c31-48d3-ae6b-e2d6305fe8d7 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:03:55.493115 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:03:55.493115 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:03:55.493115 np0000001577 nova-compute[98319]:   <alias name="ua-7d1dca13-bb8b-459a-b99b-e1b6b24118a1"/>
May 28 01:03:55.493115 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-7"/>
May 28 01:03:55.493115 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:03:55.493115 np0000001577 nova-compute[98319]:   <serial>7d1dca13-bb8b-459a-b99b-e1b6b24118a1</serial>
May 28 01:03:55.493115 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:03:55.493115 np0000001577 nova-compute[98319]: </disk>
May 28 01:03:55.493115 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:03:55.509172 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:55.511626 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:03:55.521898 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1fc3bb20-f783-4436-af34-10303daaebc4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.651s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:55.883770 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.803s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:55.936218 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Deleted allocations for instance 6e370bae-b201-42eb-b5ef-f629b6f6502c
May 28 01:03:55.992735 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 for instance a9122d01-9c31-48d3-ae6b-e2d6305fe8d7 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:03:56.033874 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930236.03351, 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b => ua-37b25d6b-f126-4563-a58f-8b4a23c52397> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:03:56.034217 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930236.0340152, a9122d01-9c31-48d3-ae6b-e2d6305fe8d7 => ua-7d1dca13-bb8b-459a-b99b-e1b6b24118a1> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:03:56.037527 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Successfully detached device vdb from instance 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b from the live domain config.
May 28 01:03:56.038119 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Successfully detached device vdb from instance a9122d01-9c31-48d3-ae6b-e2d6305fe8d7 from the live domain config.
May 28 01:03:56.038719 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:03:56.038999 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37b25d6b-f126-4563-a58f-8b4a23c52397', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:03:56.039175 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:03:56.041565 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:03:56.041565 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '37b25d6b-f126-4563-a58f-8b4a23c52397', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:03:56.041565 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:03:56.041565 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:03:56.041565 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7d1dca13-bb8b-459a-b99b-e1b6b24118a1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:03:56.041565 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:03:56.075436 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:56.075436 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:56.075436 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:56.075436 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:56.075436 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:56.075436 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:56.075436 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:56.075436 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:56.075436 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:56.075436 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:56.075436 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:56.075436 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:56.075436 np0000001577 nova-compute[98319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:03:56.075436 np0000001577 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:03:56.075436 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:03:56.075436 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:56.075436 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:56.075436 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:56.075436 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:56.075436 np0000001577 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:56.075436 np0000001577 nova-compute[98319]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397 (non-flash)
May 28 01:03:56.075436 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:56.075436 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:56.075436 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:56.075436 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:56.075436 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:56.075436 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:56.075436 np0000001577 nova-compute[98319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:03:56.075436 np0000001577 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:03:56.075436 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:03:56.077526 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', '74'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', '75'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', '77'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', '83')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:03:56.077526 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', '66')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:03:56.077526 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397', '67')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:03:56.077744 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c984c56c7c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397'): ({'sdi'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:03:56.077874 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Removing multipathed devices sdh, sdi {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:03:56.078052 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Flush multipath device 3300000008b2199bb {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:03:56.116252 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:03:56.162430 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:03:56.162430 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:56.215857 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:03:56.216210 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:03:56.217852 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:03:56.228655 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:03:56.228784 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:03:56.239903 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:56.275390 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 66, target: iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397, portal: 192.168.40.100,3260]
May 28 01:03:56.275390 np0000001577 nova-compute[98319]: Logout of [sid: 66, target: iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397, portal: 192.168.40.100,3260] successful.
May 28 01:03:56.275390 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:56.295443 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:56.305887 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:56.338445 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397, portal: 192.168.50.100,3260]
May 28 01:03:56.338445 np0000001577 nova-compute[98319]: Logout of [sid: 67, target: iqn.2023-03.storpool.com:os--volume-37b25d6b-f126-4563-a58f-8b4a23c52397, portal: 192.168.50.100,3260] successful.
May 28 01:03:56.338445 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:56.357301 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:56.357490 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:03:56.357639 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] <== disconnect_volume: return (318ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:03:56.357752 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:03:56.358206 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.317s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:03:56.358526 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7d1dca13-bb8b-459a-b99b-e1b6b24118a1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:03:56.358690 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:03:56.376589 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Rescuing
May 28 01:03:56.376589 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "refresh_cache-8c35bc03-1899-4eb9-aefe-0bd301686dcf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:03:56.376589 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquired lock "refresh_cache-8c35bc03-1899-4eb9-aefe-0bd301686dcf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:03:56.376589 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:03:56.397025 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:56.397025 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:56.397025 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:56.397025 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:56.397025 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:56.397025 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:56.397025 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:56.397025 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:56.397025 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:56.397025 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:56.397025 np0000001577 nova-compute[98319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:03:56.397025 np0000001577 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:03:56.397025 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:03:56.397621 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:56.397621 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:56.397621 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:56.397621 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:56.397621 np0000001577 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:56.397621 np0000001577 nova-compute[98319]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1 (non-flash)
May 28 01:03:56.397621 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:56.397621 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:56.397621 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:56.397621 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:56.397621 np0000001577 nova-compute[98319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:03:56.397621 np0000001577 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:03:56.397621 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:03:56.397621 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', '74'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', '75'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', '77'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', '83')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:03:56.397967 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', '68')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:03:56.399281 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', '69')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:03:56.400647 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c984c508ae0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1'): ({'sdm'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:03:56.401573 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Removing multipathed devices sdm, sdl {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:03:56.402559 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Flush multipath device 33000000004067b4b {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:03:56.438779 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:03:56.460945 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:03:56.460945 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:03:56.460945 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] No VIF found with MAC fa:16:3e:88:07:ca, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:03:56.461658 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Using config drive
May 28 01:03:56.476777 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:03:56.522065 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:03:56.522258 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:03:56.523659 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:03:56.533601 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:03:56.533760 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:03:56.547050 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:56.595681 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1, portal: 192.168.40.100,3260]
May 28 01:03:56.595681 np0000001577 nova-compute[98319]: Logout of [sid: 68, target: iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1, portal: 192.168.40.100,3260] successful.
May 28 01:03:56.595681 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:56.619623 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:56.630841 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:56.666843 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1, portal: 192.168.50.100,3260]
May 28 01:03:56.666843 np0000001577 nova-compute[98319]: Logout of [sid: 69, target: iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1, portal: 192.168.50.100,3260] successful.
May 28 01:03:56.666843 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:56.685724 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:03:56.685964 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:03:56.686104 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] <== disconnect_volume: return (645ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:03:56.686249 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:03:56.877820 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:56.913022 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lazy-loading 'flavor' on Instance uuid 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:03:56.951742 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-646ff04d-4377-45ac-87bd-10420aa47f2b tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "6e370bae-b201-42eb-b5ef-f629b6f6502c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.598s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:56.969975 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:57.110490 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Creating config drive at /opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk.config
May 28 01:03:57.118528 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpt45lo46j {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:03:57.170151 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpt45lo46j" returned: 0 in 0.051s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:03:57.178661 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:03:57.232935 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lazy-loading 'flavor' on Instance uuid a9122d01-9c31-48d3-ae6b-e2d6305fe8d7 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:03:57.325089 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Updating instance_info_cache with network_info: [{"id": "79122524-4b9f-46c3-91ad-d723f1829ed6", "address": "fa:16:3e:45:bd:f8", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79122524-4b", "ovs_interfaceid": "79122524-4b9f-46c3-91ad-d723f1829ed6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:03:57.630561 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:57.661949 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:57.750885 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:57.827021 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Releasing lock "refresh_cache-8c35bc03-1899-4eb9-aefe-0bd301686dcf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:03:57.862398 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6ef746c2-73c5-409e-b629-33d87ef90ac2 req-0d26a28a-8054-4790-92c0-e99f7e7ce846 service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Received event network-vif-plugged-53846e61-8840-490f-a976-3997db8a0f0b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:57.862690 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ef746c2-73c5-409e-b629-33d87ef90ac2 req-0d26a28a-8054-4790-92c0-e99f7e7ce846 service nova] Acquiring lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:57.862885 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ef746c2-73c5-409e-b629-33d87ef90ac2 req-0d26a28a-8054-4790-92c0-e99f7e7ce846 service nova] Lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:57.863006 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ef746c2-73c5-409e-b629-33d87ef90ac2 req-0d26a28a-8054-4790-92c0-e99f7e7ce846 service nova] Lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:57.863578 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6ef746c2-73c5-409e-b629-33d87ef90ac2 req-0d26a28a-8054-4790-92c0-e99f7e7ce846 service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Processing event network-vif-plugged-53846e61-8840-490f-a976-3997db8a0f0b {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:03:57.918829 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-19153ac1-d8ba-48e9-9b60-9391e9be6834 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.091s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:58.034898 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:58.045827 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:58.065379 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:58.159116 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "a9122d01-9c31-48d3-ae6b-e2d6305fe8d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:58.244899 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-65c95616-1cda-4e74-ae38-cb3d81df90e4 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "a9122d01-9c31-48d3-ae6b-e2d6305fe8d7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.325s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:58.245724 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "a9122d01-9c31-48d3-ae6b-e2d6305fe8d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.087s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:58.246116 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "a9122d01-9c31-48d3-ae6b-e2d6305fe8d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:58.246338 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "a9122d01-9c31-48d3-ae6b-e2d6305fe8d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:58.246485 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "a9122d01-9c31-48d3-ae6b-e2d6305fe8d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:58.249456 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Terminating instance
May 28 01:03:58.474648 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:03:58.474648 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930238.4734251, 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:03:58.474648 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] VM Started (Lifecycle Event)
May 28 01:03:58.475673 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:03:58.480305 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Instance spawned successfully.
May 28 01:03:58.480601 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:03:58.670843 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3a11e4ad-b437-4d34-a8e8-00a4c742d618 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Acquiring lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:58.670843 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3a11e4ad-b437-4d34-a8e8-00a4c742d618 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:58.670843 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3a11e4ad-b437-4d34-a8e8-00a4c742d618 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Acquiring lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:58.670843 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3a11e4ad-b437-4d34-a8e8-00a4c742d618 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:58.670843 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3a11e4ad-b437-4d34-a8e8-00a4c742d618 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:58.671906 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-3a11e4ad-b437-4d34-a8e8-00a4c742d618 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Terminating instance
May 28 01:03:58.752853 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:03:58.785637 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:58.787342 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:58.808598 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:58.815043 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:58.834884 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:58.840496 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:58.978865 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:58.982786 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:03:58.991844 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:58.993726 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-32526c46-a05b-494b-97e6-c041592c3e34 req-d87b8cb1-5f68-41ac-8f5b-b13b1f41a6f0 service nova] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Received event network-vif-unplugged-78e03974-3a80-43b7-8198-eb4e28fb8e4f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:58.994286 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:58.994625 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-32526c46-a05b-494b-97e6-c041592c3e34 req-d87b8cb1-5f68-41ac-8f5b-b13b1f41a6f0 service nova] Acquiring lock "a9122d01-9c31-48d3-ae6b-e2d6305fe8d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:58.994764 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:58.995047 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-32526c46-a05b-494b-97e6-c041592c3e34 req-d87b8cb1-5f68-41ac-8f5b-b13b1f41a6f0 service nova] Lock "a9122d01-9c31-48d3-ae6b-e2d6305fe8d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:58.995397 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:58.995827 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-32526c46-a05b-494b-97e6-c041592c3e34 req-d87b8cb1-5f68-41ac-8f5b-b13b1f41a6f0 service nova] Lock "a9122d01-9c31-48d3-ae6b-e2d6305fe8d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:58.995948 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:58.998211 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-32526c46-a05b-494b-97e6-c041592c3e34 req-d87b8cb1-5f68-41ac-8f5b-b13b1f41a6f0 service nova] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] No waiting events found dispatching network-vif-unplugged-78e03974-3a80-43b7-8198-eb4e28fb8e4f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:03:58.998211 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:03:58.999156 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-32526c46-a05b-494b-97e6-c041592c3e34 req-d87b8cb1-5f68-41ac-8f5b-b13b1f41a6f0 service nova] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Received event network-vif-unplugged-78e03974-3a80-43b7-8198-eb4e28fb8e4f for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:03:59.115802 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Instance destroyed successfully.
May 28 01:03:59.116054 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lazy-loading 'resources' on Instance uuid a9122d01-9c31-48d3-ae6b-e2d6305fe8d7 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:03:59.174731 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-3a11e4ad-b437-4d34-a8e8-00a4c742d618 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:03:59.204980 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:59.207463 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:59.230446 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:59.264564 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:59.473448 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:59.489941 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:03:59.490135 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930239.4899924, 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:03:59.490268 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] VM Paused (Lifecycle Event)
May 28 01:03:59.501899 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Took 6.86 seconds to spawn the instance on the hypervisor.
May 28 01:03:59.503652 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:59.504468 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:03:59.530505 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Instance destroyed successfully.
May 28 01:03:59.530934 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-3a11e4ad-b437-4d34-a8e8-00a4c742d618 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lazy-loading 'resources' on Instance uuid 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:03:59.618982 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:01:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1190305643',display_name='tempest-VolumesBackupsTest-instance-1190305643',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumesbackupstest-instance-1190305643',id=32,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTFZAfivaY4B9zu1d49d7nHqJDWRVudFsrX3cS583l58RBZNWCdmhJiz2THSglo2FISlqSPp8PhnVsYs0YBeFmWNYjEiPxt/urUWjGF6XYLDF7qEG3w8J+RTVXX+Feuag==',key_name='tempest-keypair-681468811',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:02:15Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b80759164bf4465b0bd873db74c9c49',ramdisk_id='',reservation_id='r-2z90whge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-2139172395',owner_user_name='tempest-VolumesBackupsTest-2139172395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:02:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f43f6f5427ba4a5b896019555a2ef47a',uuid=a9122d01-9c31-48d3-ae6b-e2d6305fe8d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78e03974-3a80-43b7-8198-eb4e28fb8e4f", "address": "fa:16:3e:2e:7b:c9", "network": {"id": "be63e483-23b8-4753-b2fa-d9fc516b53f9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-518223995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b80759164bf4465b0bd873db74c9c49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78e03974-3a", "ovs_interfaceid": "78e03974-3a80-43b7-8198-eb4e28fb8e4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:03:59.619173 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Converting VIF {"id": "78e03974-3a80-43b7-8198-eb4e28fb8e4f", "address": "fa:16:3e:2e:7b:c9", "network": {"id": "be63e483-23b8-4753-b2fa-d9fc516b53f9", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-518223995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b80759164bf4465b0bd873db74c9c49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78e03974-3a", "ovs_interfaceid": "78e03974-3a80-43b7-8198-eb4e28fb8e4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:03:59.619760 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:7b:c9,bridge_name='br-int',has_traffic_filtering=True,id=78e03974-3a80-43b7-8198-eb4e28fb8e4f,network=Network(be63e483-23b8-4753-b2fa-d9fc516b53f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78e03974-3a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:03:59.619982 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:7b:c9,bridge_name='br-int',has_traffic_filtering=True,id=78e03974-3a80-43b7-8198-eb4e28fb8e4f,network=Network(be63e483-23b8-4753-b2fa-d9fc516b53f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78e03974-3a') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:03:59.621926 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:59.622238 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78e03974-3a, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:59.623314 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:59.625035 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:03:59.634880 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:59.636120 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:59.636331 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd3d00e5-1a03-44ce-8fb9-01979a83f55f) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:03:59.636796 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:59.637402 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:03:59.644852 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:59.654336 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:59.657766 np0000001577 nova-compute[98319]: INFO os_vif [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:7b:c9,bridge_name='br-int',has_traffic_filtering=True,id=78e03974-3a80-43b7-8198-eb4e28fb8e4f,network=Network(be63e483-23b8-4753-b2fa-d9fc516b53f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78e03974-3a')
May 28 01:03:59.662666 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:03:59.662821 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7d1dca13-bb8b-459a-b99b-e1b6b24118a1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:03:59.664320 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:03:59.665287 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:03:59.665614 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7d1dca13-bb8b-459a-b99b-e1b6b24118a1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:03:59.665770 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:03:59.698607 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:59.698607 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:59.698607 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:59.698607 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:59.698607 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:59.698607 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:59.698607 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:59.698607 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:59.698607 np0000001577 nova-compute[98319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:03:59.698607 np0000001577 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:03:59.698607 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:03:59.699185 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:59.699185 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:03:59.699185 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:59.699185 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:03:59.699185 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:59.699185 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:03:59.699185 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:59.699185 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:03:59.699185 np0000001577 nova-compute[98319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:03:59.699185 np0000001577 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:03:59.699185 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:03:59.699185 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', '63'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', '74'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', '75'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', '77'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', '83')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:03:59.699185 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1, 0): [] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:03:59.699185 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1') {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 01:03:59.699185 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1, 0): [] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:03:59.699541 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d1dca13-bb8b-459a-b99b-e1b6b24118a1') {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 01:03:59.699541 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c984c441b20>, {}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:03:59.699541 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Disconnecting from: [] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:03:59.699541 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.034s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:03:59.700148 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] <== disconnect_volume: return (37ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:03:59.700148 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:03:59.700371 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Deleting instance files /opt/stack/data/nova/instances/a9122d01-9c31-48d3-ae6b-e2d6305fe8d7_del
May 28 01:03:59.702030 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Deletion of /opt/stack/data/nova/instances/a9122d01-9c31-48d3-ae6b-e2d6305fe8d7_del complete
May 28 01:03:59.738172 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:59.754635 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:03:59.768426 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Instance destroyed successfully.
May 28 01:03:59.769954 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lazy-loading 'numa_topology' on Instance uuid 8c35bc03-1899-4eb9-aefe-0bd301686dcf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:03:59.931743 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ad9e2a51-5268-4625-88fa-85ddea4e409e req-56e68a03-2218-4868-ae45-ce329c300247 service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Received event network-vif-plugged-53846e61-8840-490f-a976-3997db8a0f0b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:03:59.931916 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ad9e2a51-5268-4625-88fa-85ddea4e409e req-56e68a03-2218-4868-ae45-ce329c300247 service nova] Acquiring lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:03:59.932225 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ad9e2a51-5268-4625-88fa-85ddea4e409e req-56e68a03-2218-4868-ae45-ce329c300247 service nova] Lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:03:59.934009 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ad9e2a51-5268-4625-88fa-85ddea4e409e req-56e68a03-2218-4868-ae45-ce329c300247 service nova] Lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:03:59.934009 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ad9e2a51-5268-4625-88fa-85ddea4e409e req-56e68a03-2218-4868-ae45-ce329c300247 service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] No waiting events found dispatching network-vif-plugged-53846e61-8840-490f-a976-3997db8a0f0b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:03:59.934009 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-ad9e2a51-5268-4625-88fa-85ddea4e409e req-56e68a03-2218-4868-ae45-ce329c300247 service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Received unexpected event network-vif-plugged-53846e61-8840-490f-a976-3997db8a0f0b for instance with vm_state active and task_state None.
May 28 01:03:59.998283 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:00.000640 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930240.0004048, 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:04:00.000786 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] VM Resumed (Lifecycle Event)
May 28 01:04:00.030174 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Took 14.97 seconds to build instance.
May 28 01:04:00.033126 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-3a11e4ad-b437-4d34-a8e8-00a4c742d618 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:01:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1176978347',display_name='tempest-ServerStableDeviceRescueTest-server-1176978347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serverstabledevicerescuetest-server-1176978347',id=29,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPboZm7ws4t1wEvtZdWzsFVGfNAtB4ijiaRXP0ILEOIyDMla/IV8XOeOh4GaCFErFIkUt97cERef0s2ccqsfOs3RN6JctfpcwjL4XjJhAm1ABrtlDHL+kEgJV1JBwPSzbg==',key_name='tempest-keypair-97535522',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:03:15Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8efd8caac5eb46ae9af16a2452ee0353',ramdisk_id='',reservation_id='r-t01ghn10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1831534173',owner_user_name='tempest-ServerStableDeviceRescueTest-1831534173-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:03:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00466e4787894abe9c5b57f909d4bd80',uuid=5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "address": "fa:16:3e:6e:a8:24", "network": {"id": "6403eebe-dcdf-49f8-8196-07e14e099cf4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-219519001-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8efd8caac5eb46ae9af16a2452ee0353", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d66a5a-b3", "ovs_interfaceid": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:04:00.033333 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3a11e4ad-b437-4d34-a8e8-00a4c742d618 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Converting VIF {"id": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "address": "fa:16:3e:6e:a8:24", "network": {"id": "6403eebe-dcdf-49f8-8196-07e14e099cf4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-219519001-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8efd8caac5eb46ae9af16a2452ee0353", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d66a5a-b3", "ovs_interfaceid": "56d66a5a-b38c-4f84-9a46-d0acab5cea53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:04:00.033851 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3a11e4ad-b437-4d34-a8e8-00a4c742d618 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:a8:24,bridge_name='br-int',has_traffic_filtering=True,id=56d66a5a-b38c-4f84-9a46-d0acab5cea53,network=Network(6403eebe-dcdf-49f8-8196-07e14e099cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d66a5a-b3') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:04:00.034057 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-3a11e4ad-b437-4d34-a8e8-00a4c742d618 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:a8:24,bridge_name='br-int',has_traffic_filtering=True,id=56d66a5a-b38c-4f84-9a46-d0acab5cea53,network=Network(6403eebe-dcdf-49f8-8196-07e14e099cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d66a5a-b3') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:04:00.035298 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:00.035473 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56d66a5a-b3, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:00.043823 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:00.044540 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:00.049475 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:00.057768 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:00.057945 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a99a4148-ec53-4d6c-b6ba-e867426f3c88) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:00.058420 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:00.058874 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:00.064117 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:00.066824 np0000001577 nova-compute[98319]: INFO os_vif [None req-3a11e4ad-b437-4d34-a8e8-00a4c742d618 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:a8:24,bridge_name='br-int',has_traffic_filtering=True,id=56d66a5a-b38c-4f84-9a46-d0acab5cea53,network=Network(6403eebe-dcdf-49f8-8196-07e14e099cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d66a5a-b3')
May 28 01:04:00.068287 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3a11e4ad-b437-4d34-a8e8-00a4c742d618 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Deleting instance files /opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b_del
May 28 01:04:00.070393 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3a11e4ad-b437-4d34-a8e8-00a4c742d618 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Deletion of /opt/stack/data/nova/instances/5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b_del complete
May 28 01:04:00.207987 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Took 1.45 seconds to destroy the instance on the hypervisor.
May 28 01:04:00.208731 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:04:00.209041 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:04:00.209041 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:04:00.209297 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:00.217960 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46a2cb52-d1ca-49a7-9074-486b6632a207 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "04880ef4-5eee-4221-ad42-29788eb26358" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:00.218104 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46a2cb52-d1ca-49a7-9074-486b6632a207 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "04880ef4-5eee-4221-ad42-29788eb26358" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:00.218309 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46a2cb52-d1ca-49a7-9074-486b6632a207 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "04880ef4-5eee-4221-ad42-29788eb26358-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:00.218435 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46a2cb52-d1ca-49a7-9074-486b6632a207 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "04880ef4-5eee-4221-ad42-29788eb26358-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:00.218536 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46a2cb52-d1ca-49a7-9074-486b6632a207 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "04880ef4-5eee-4221-ad42-29788eb26358-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:00.220860 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-46a2cb52-d1ca-49a7-9074-486b6632a207 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Terminating instance
May 28 01:04:00.273877 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Attempting a stable device rescue
May 28 01:04:00.291725 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:00.376563 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98319) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 28 01:04:00.387423 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Instance directory exists: not creating {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 01:04:00.387584 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Creating image(s)
May 28 01:04:00.388055 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c35bc03-1899-4eb9-aefe-0bd301686dcf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:00.388230 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "/opt/stack/data/nova/instances/8c35bc03-1899-4eb9-aefe-0bd301686dcf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:00.388663 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "/opt/stack/data/nova/instances/8c35bc03-1899-4eb9-aefe-0bd301686dcf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:00.388813 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8c35bc03-1899-4eb9-aefe-0bd301686dcf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:00.471798 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Acquiring lock "b132a198-b7d3-43ed-9cf1-02b4dc303777" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:00.472047 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Lock "b132a198-b7d3-43ed-9cf1-02b4dc303777" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:00.503062 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:00.505286 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:04:00.532035 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.486s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:00.576584 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-3a11e4ad-b437-4d34-a8e8-00a4c742d618 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Took 1.40 seconds to destroy the instance on the hypervisor.
May 28 01:04:00.576584 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-3a11e4ad-b437-4d34-a8e8-00a4c742d618 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:04:00.576584 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:04:00.576584 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:04:00.576807 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:00.638422 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:00.723761 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-46a2cb52-d1ca-49a7-9074-486b6632a207 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:04:00.745865 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-166f226c-6d4a-4136-b60b-dd44e672f76d req-d97e6430-557e-4397-80ab-c6b10fc5927c service nova] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Received event network-vif-deleted-78e03974-3a80-43b7-8198-eb4e28fb8e4f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:00.746338 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-166f226c-6d4a-4136-b60b-dd44e672f76d req-d97e6430-557e-4397-80ab-c6b10fc5927c service nova] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Neutron deleted interface 78e03974-3a80-43b7-8198-eb4e28fb8e4f; detaching it from the instance and deleting it from the info cache
May 28 01:04:00.749833 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-166f226c-6d4a-4136-b60b-dd44e672f76d req-d97e6430-557e-4397-80ab-c6b10fc5927c service nova] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Detach interface failed, port_id=78e03974-3a80-43b7-8198-eb4e28fb8e4f, reason: Instance a9122d01-9c31-48d3-ae6b-e2d6305fe8d7 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:04:00.755499 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:00.759746 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:00.786675 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:00.895936 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Object Instance<8c35bc03-1899-4eb9-aefe-0bd301686dcf> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:04:00.895936 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "2405e6522a3a68808f0dfa46a10305119b57af3e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:00.895936 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "2405e6522a3a68808f0dfa46a10305119b57af3e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:00.939983 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:00.954093 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:00.975565 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:04:01.008198 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999731450000127 future=<Future at 0x7c984c7c29c0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:01.008602 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.9999029290002 future=<Future at 0x7c987044b230 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:01.008602 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999891226999807 future=<Future at 0x7c984c645cd0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:01.049936 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999777705999804 future=<Future at 0x7c984c60fd10 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:01.052714 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Instance destroyed successfully.
May 28 01:04:01.053439 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-46a2cb52-d1ca-49a7-9074-486b6632a207 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lazy-loading 'resources' on Instance uuid 04880ef4-5eee-4221-ad42-29788eb26358 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:01.146671 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-84cab222-8a4d-47f0-9c61-88d4fb767d6e req-6fda48eb-3ed2-48a3-a670-f434e127308c service nova] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Received event network-vif-unplugged-78e03974-3a80-43b7-8198-eb4e28fb8e4f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:01.146876 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-84cab222-8a4d-47f0-9c61-88d4fb767d6e req-6fda48eb-3ed2-48a3-a670-f434e127308c service nova] Acquiring lock "a9122d01-9c31-48d3-ae6b-e2d6305fe8d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:01.146983 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-84cab222-8a4d-47f0-9c61-88d4fb767d6e req-6fda48eb-3ed2-48a3-a670-f434e127308c service nova] Lock "a9122d01-9c31-48d3-ae6b-e2d6305fe8d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:01.147166 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-84cab222-8a4d-47f0-9c61-88d4fb767d6e req-6fda48eb-3ed2-48a3-a670-f434e127308c service nova] Lock "a9122d01-9c31-48d3-ae6b-e2d6305fe8d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:01.147335 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-84cab222-8a4d-47f0-9c61-88d4fb767d6e req-6fda48eb-3ed2-48a3-a670-f434e127308c service nova] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] No waiting events found dispatching network-vif-unplugged-78e03974-3a80-43b7-8198-eb4e28fb8e4f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:01.148113 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-84cab222-8a4d-47f0-9c61-88d4fb767d6e req-6fda48eb-3ed2-48a3-a670-f434e127308c service nova] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Received event network-vif-unplugged-78e03974-3a80-43b7-8198-eb4e28fb8e4f for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:04:01.148319 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-84cab222-8a4d-47f0-9c61-88d4fb767d6e req-6fda48eb-3ed2-48a3-a670-f434e127308c service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Received event network-vif-unplugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:01.148371 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-84cab222-8a4d-47f0-9c61-88d4fb767d6e req-6fda48eb-3ed2-48a3-a670-f434e127308c service nova] Acquiring lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:01.148485 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-84cab222-8a4d-47f0-9c61-88d4fb767d6e req-6fda48eb-3ed2-48a3-a670-f434e127308c service nova] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:01.148614 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-84cab222-8a4d-47f0-9c61-88d4fb767d6e req-6fda48eb-3ed2-48a3-a670-f434e127308c service nova] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:01.148814 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-84cab222-8a4d-47f0-9c61-88d4fb767d6e req-6fda48eb-3ed2-48a3-a670-f434e127308c service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] No waiting events found dispatching network-vif-unplugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:01.148916 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-84cab222-8a4d-47f0-9c61-88d4fb767d6e req-6fda48eb-3ed2-48a3-a670-f434e127308c service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Received event network-vif-unplugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:04:01.149133 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-84cab222-8a4d-47f0-9c61-88d4fb767d6e req-6fda48eb-3ed2-48a3-a670-f434e127308c service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Received event network-vif-unplugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:01.149309 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-84cab222-8a4d-47f0-9c61-88d4fb767d6e req-6fda48eb-3ed2-48a3-a670-f434e127308c service nova] Acquiring lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:01.149360 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-84cab222-8a4d-47f0-9c61-88d4fb767d6e req-6fda48eb-3ed2-48a3-a670-f434e127308c service nova] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:01.149457 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-84cab222-8a4d-47f0-9c61-88d4fb767d6e req-6fda48eb-3ed2-48a3-a670-f434e127308c service nova] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:01.149574 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-84cab222-8a4d-47f0-9c61-88d4fb767d6e req-6fda48eb-3ed2-48a3-a670-f434e127308c service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] No waiting events found dispatching network-vif-unplugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:01.149723 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-84cab222-8a4d-47f0-9c61-88d4fb767d6e req-6fda48eb-3ed2-48a3-a670-f434e127308c service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Received event network-vif-unplugged-56d66a5a-b38c-4f84-9a46-d0acab5cea53 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:04:01.149785 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-84cab222-8a4d-47f0-9c61-88d4fb767d6e req-6fda48eb-3ed2-48a3-a670-f434e127308c service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Received event network-vif-unplugged-79122524-4b9f-46c3-91ad-d723f1829ed6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:01.149863 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-84cab222-8a4d-47f0-9c61-88d4fb767d6e req-6fda48eb-3ed2-48a3-a670-f434e127308c service nova] Acquiring lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:01.149962 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-84cab222-8a4d-47f0-9c61-88d4fb767d6e req-6fda48eb-3ed2-48a3-a670-f434e127308c service nova] Lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:01.150090 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-84cab222-8a4d-47f0-9c61-88d4fb767d6e req-6fda48eb-3ed2-48a3-a670-f434e127308c service nova] Lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:01.150228 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-84cab222-8a4d-47f0-9c61-88d4fb767d6e req-6fda48eb-3ed2-48a3-a670-f434e127308c service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] No waiting events found dispatching network-vif-unplugged-79122524-4b9f-46c3-91ad-d723f1829ed6 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:01.150339 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-84cab222-8a4d-47f0-9c61-88d4fb767d6e req-6fda48eb-3ed2-48a3-a670-f434e127308c service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Received unexpected event network-vif-unplugged-79122524-4b9f-46c3-91ad-d723f1829ed6 for instance with vm_state active and task_state rescuing.
May 28 01:04:01.150418 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-84cab222-8a4d-47f0-9c61-88d4fb767d6e req-6fda48eb-3ed2-48a3-a670-f434e127308c service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Received event network-vif-unplugged-79122524-4b9f-46c3-91ad-d723f1829ed6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:01.150721 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-84cab222-8a4d-47f0-9c61-88d4fb767d6e req-6fda48eb-3ed2-48a3-a670-f434e127308c service nova] Acquiring lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:01.150889 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-84cab222-8a4d-47f0-9c61-88d4fb767d6e req-6fda48eb-3ed2-48a3-a670-f434e127308c service nova] Lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:01.151060 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-84cab222-8a4d-47f0-9c61-88d4fb767d6e req-6fda48eb-3ed2-48a3-a670-f434e127308c service nova] Lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:01.151213 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-84cab222-8a4d-47f0-9c61-88d4fb767d6e req-6fda48eb-3ed2-48a3-a670-f434e127308c service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] No waiting events found dispatching network-vif-unplugged-79122524-4b9f-46c3-91ad-d723f1829ed6 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:01.151458 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-84cab222-8a4d-47f0-9c61-88d4fb767d6e req-6fda48eb-3ed2-48a3-a670-f434e127308c service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Received unexpected event network-vif-unplugged-79122524-4b9f-46c3-91ad-d723f1829ed6 for instance with vm_state active and task_state rescuing.
May 28 01:04:01.166109 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:01.192771 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:04:01.408861 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:04:01.411693 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:04:01.411986 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2405e6522a3a68808f0dfa46a10305119b57af3e.part --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:04:01.505915 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2405e6522a3a68808f0dfa46a10305119b57af3e.part --force-share --output=json" returned: 0 in 0.094s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:04:01.506270 np0000001577 nova-compute[98319]: DEBUG nova.virt.images [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] 784c7d4c-40ff-421a-aad3-38e83e21e7f2 was qcow2, converting to raw {{(pid=98319) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 01:04:01.506884 np0000001577 nova-compute[98319]: DEBUG nova.privsep.utils [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 01:04:01.507153 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2405e6522a3a68808f0dfa46a10305119b57af3e.part /opt/stack/data/nova/instances/_base/2405e6522a3a68808f0dfa46a10305119b57af3e.converted {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:04:01.544789 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:01.545225 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:01.549862 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:04:01.550013 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Claim successful on node np0000001577
May 28 01:04:01.556867 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-46a2cb52-d1ca-49a7-9074-486b6632a207 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001577',hostname='multiattach-server-1',id=26,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7fHo3fyBWUybZxdNVpYEXXxMYY3ACB7D4odfvDXtuf5uMmk/o2XggiQakoJbwdRCXKjpHaMcmXgSyAS8x+3bDHMUWn1qlznnyXp/nDVRmoqTgLFpV2Do6YlUuA3zZ+mw==',key_name='tempest-keypair-627531643',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:02:40Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='938c2829112843edb2054984e80ce7ad',ramdisk_id='',reservation_id='r-v6qv000f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-89204095',owner_user_name='tempest-AttachVolumeMultiAttachTest-89204095-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:02:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8586a18edcf42cab0a60028135ae401',uuid=04880ef4-5eee-4221-ad42-29788eb26358,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d80f49b7-bd41-46df-9743-8ad514696557", "address": "fa:16:3e:e7:fe:bd", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80f49b7-bd", "ovs_interfaceid": "d80f49b7-bd41-46df-9743-8ad514696557", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:04:01.557104 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-46a2cb52-d1ca-49a7-9074-486b6632a207 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converting VIF {"id": "d80f49b7-bd41-46df-9743-8ad514696557", "address": "fa:16:3e:e7:fe:bd", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd80f49b7-bd", "ovs_interfaceid": "d80f49b7-bd41-46df-9743-8ad514696557", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:04:01.557937 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-46a2cb52-d1ca-49a7-9074-486b6632a207 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:fe:bd,bridge_name='br-int',has_traffic_filtering=True,id=d80f49b7-bd41-46df-9743-8ad514696557,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd80f49b7-bd') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:04:01.558256 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-46a2cb52-d1ca-49a7-9074-486b6632a207 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:fe:bd,bridge_name='br-int',has_traffic_filtering=True,id=d80f49b7-bd41-46df-9743-8ad514696557,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd80f49b7-bd') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:04:01.562710 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:01.563029 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd80f49b7-bd, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:01.564453 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:01.565399 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:01.573315 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:01.576930 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:01.577120 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3ae910e3-0698-4233-a9c6-c535aa668699) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:01.579180 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:01.579862 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:01.585622 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:01.587788 np0000001577 nova-compute[98319]: INFO os_vif [None req-46a2cb52-d1ca-49a7-9074-486b6632a207 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:fe:bd,bridge_name='br-int',has_traffic_filtering=True,id=d80f49b7-bd41-46df-9743-8ad514696557,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd80f49b7-bd')
May 28 01:04:01.589644 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-46a2cb52-d1ca-49a7-9074-486b6632a207 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Deleting instance files /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358_del
May 28 01:04:01.596750 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-46a2cb52-d1ca-49a7-9074-486b6632a207 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Deletion of /opt/stack/data/nova/instances/04880ef4-5eee-4221-ad42-29788eb26358_del complete
May 28 01:04:01.605576 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:04:01.606684 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2405e6522a3a68808f0dfa46a10305119b57af3e.part /opt/stack/data/nova/instances/_base/2405e6522a3a68808f0dfa46a10305119b57af3e.converted" returned: 0 in 0.099s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:04:01.613421 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2405e6522a3a68808f0dfa46a10305119b57af3e.converted --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:04:01.697128 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Took 1.49 seconds to deallocate network for instance.
May 28 01:04:01.700882 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2405e6522a3a68808f0dfa46a10305119b57af3e.converted --force-share --output=json" returned: 0 in 0.087s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:04:01.701710 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "2405e6522a3a68808f0dfa46a10305119b57af3e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.808s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:01.702117 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:04:01.707250 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:04:01.708886 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "2405e6522a3a68808f0dfa46a10305119b57af3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:01.709828 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "2405e6522a3a68808f0dfa46a10305119b57af3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:01.710088 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:04:01.712351 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:04:01.712628 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2405e6522a3a68808f0dfa46a10305119b57af3e --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:04:01.726224 np0000001577 nova-compute[98319]: WARNING nova.volume.cinder [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Attachment 29d30fb6-1d5e-4a14-980b-ca903e0d60d7 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 29d30fb6-1d5e-4a14-980b-ca903e0d60d7. (HTTP 404) (Request-ID: req-da93e77b-153a-4e40-8e86-0493d32b9792)
May 28 01:04:01.727055 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Took 0.03 seconds to detach 1 volumes for instance.
May 28 01:04:01.807286 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2405e6522a3a68808f0dfa46a10305119b57af3e --force-share --output=json" returned: 0 in 0.094s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:04:01.807716 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2405e6522a3a68808f0dfa46a10305119b57af3e,backing_fmt=raw /opt/stack/data/nova/instances/8c35bc03-1899-4eb9-aefe-0bd301686dcf/disk.rescue {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:04:01.855970 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2405e6522a3a68808f0dfa46a10305119b57af3e,backing_fmt=raw /opt/stack/data/nova/instances/8c35bc03-1899-4eb9-aefe-0bd301686dcf/disk.rescue" returned: 0 in 0.048s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:04:01.856440 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "2405e6522a3a68808f0dfa46a10305119b57af3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.147s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:01.856755 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lazy-loading 'migration_context' on Instance uuid 8c35bc03-1899-4eb9-aefe-0bd301686dcf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:01.991109 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f58bcc2c-59e3-4558-afde-c3ede041b6d8 req-1ceb51df-2552-4fe1-ad59-0df28f3e71a7 service nova] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Received event network-vif-deleted-56d66a5a-b38c-4f84-9a46-d0acab5cea53 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:02.103927 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-46a2cb52-d1ca-49a7-9074-486b6632a207 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Took 1.38 seconds to destroy the instance on the hypervisor.
May 28 01:04:02.104643 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-46a2cb52-d1ca-49a7-9074-486b6632a207 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:04:02.105000 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:04:02.105242 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:04:02.105620 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:02.107920 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Took 1.53 seconds to deallocate network for instance.
May 28 01:04:02.231779 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:02.236040 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:02.360401 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Object Instance<8c35bc03-1899-4eb9-aefe-0bd301686dcf> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:04:02.360401 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:04:02.360650 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Start _get_guest_xml network_info=[{"id": "79122524-4b9f-46c3-91ad-d723f1829ed6", "address": "fa:16:3e:45:bd:f8", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "vif_mac": "fa:16:3e:45:bd:f8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79122524-4b", "ovs_interfaceid": "79122524-4b9f-46c3-91ad-d723f1829ed6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '784c7d4c-40ff-421a-aad3-38e83e21e7f2', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-15'}, 'status': 'reserved', 'instance': '8c35bc03-1899-4eb9-aefe-0bd301686dcf', 'attached_at': '', 'detached_at': '', 'volume_id': '5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'serial': '5237f2a6-3d87-4be6-91c4-8adbc4a32fcc'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '139289c0-8c5a-46ee-a677-46ad244097df', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:04:02.360863 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lazy-loading 'resources' on Instance uuid 8c35bc03-1899-4eb9-aefe-0bd301686dcf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:02.617519 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3a11e4ad-b437-4d34-a8e8-00a4c742d618 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:02.804695 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5736b1bd-1354-47a6-957c-48fbf3aa7e6f req-f9cabd37-f19e-4291-9665-1211f137e460 service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Received event network-vif-unplugged-d80f49b7-bd41-46df-9743-8ad514696557 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:02.805025 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5736b1bd-1354-47a6-957c-48fbf3aa7e6f req-f9cabd37-f19e-4291-9665-1211f137e460 service nova] Acquiring lock "04880ef4-5eee-4221-ad42-29788eb26358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:02.805186 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5736b1bd-1354-47a6-957c-48fbf3aa7e6f req-f9cabd37-f19e-4291-9665-1211f137e460 service nova] Lock "04880ef4-5eee-4221-ad42-29788eb26358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:02.805256 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5736b1bd-1354-47a6-957c-48fbf3aa7e6f req-f9cabd37-f19e-4291-9665-1211f137e460 service nova] Lock "04880ef4-5eee-4221-ad42-29788eb26358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:02.805399 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5736b1bd-1354-47a6-957c-48fbf3aa7e6f req-f9cabd37-f19e-4291-9665-1211f137e460 service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] No waiting events found dispatching network-vif-unplugged-d80f49b7-bd41-46df-9743-8ad514696557 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:02.805562 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5736b1bd-1354-47a6-957c-48fbf3aa7e6f req-f9cabd37-f19e-4291-9665-1211f137e460 service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Received event network-vif-unplugged-d80f49b7-bd41-46df-9743-8ad514696557 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:04:02.805692 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5736b1bd-1354-47a6-957c-48fbf3aa7e6f req-f9cabd37-f19e-4291-9665-1211f137e460 service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Received event network-vif-unplugged-d80f49b7-bd41-46df-9743-8ad514696557 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:02.805831 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5736b1bd-1354-47a6-957c-48fbf3aa7e6f req-f9cabd37-f19e-4291-9665-1211f137e460 service nova] Acquiring lock "04880ef4-5eee-4221-ad42-29788eb26358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:02.805976 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5736b1bd-1354-47a6-957c-48fbf3aa7e6f req-f9cabd37-f19e-4291-9665-1211f137e460 service nova] Lock "04880ef4-5eee-4221-ad42-29788eb26358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:02.806093 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5736b1bd-1354-47a6-957c-48fbf3aa7e6f req-f9cabd37-f19e-4291-9665-1211f137e460 service nova] Lock "04880ef4-5eee-4221-ad42-29788eb26358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:02.806226 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5736b1bd-1354-47a6-957c-48fbf3aa7e6f req-f9cabd37-f19e-4291-9665-1211f137e460 service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] No waiting events found dispatching network-vif-unplugged-d80f49b7-bd41-46df-9743-8ad514696557 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:02.806350 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5736b1bd-1354-47a6-957c-48fbf3aa7e6f req-f9cabd37-f19e-4291-9665-1211f137e460 service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Received event network-vif-unplugged-d80f49b7-bd41-46df-9743-8ad514696557 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:04:02.806474 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5736b1bd-1354-47a6-957c-48fbf3aa7e6f req-f9cabd37-f19e-4291-9665-1211f137e460 service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Received event network-vif-deleted-d80f49b7-bd41-46df-9743-8ad514696557 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:02.807259 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-5736b1bd-1354-47a6-957c-48fbf3aa7e6f req-f9cabd37-f19e-4291-9665-1211f137e460 service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Neutron deleted interface d80f49b7-bd41-46df-9743-8ad514696557; detaching it from the instance and deleting it from the info cache
May 28 01:04:02.808721 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5736b1bd-1354-47a6-957c-48fbf3aa7e6f req-f9cabd37-f19e-4291-9665-1211f137e460 service nova] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Detach interface failed, port_id=d80f49b7-bd41-46df-9743-8ad514696557, reason: Instance 04880ef4-5eee-4221-ad42-29788eb26358 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:04:02.862991 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Object Instance<8c35bc03-1899-4eb9-aefe-0bd301686dcf> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:04:02.867258 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:04:02.868435 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-307356266', uuid='8c35bc03-1899-4eb9-aefe-0bd301686dcf'), owner=OwnerMeta(userid='fb6c20970bf0401190583f6348e00e4b', username='tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member', projectid='9e28acf25c4445ea969bd7bca3eac146', projectname='tempest-ServerBootFromVolumeStableRescueTest-568223226'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "79122524-4b9f-46c3-91ad-d723f1829ed6", "address": "fa:16:3e:45:bd:f8", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "vif_mac": "fa:16:3e:45:bd:f8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79122524-4b", "ovs_interfaceid": "79122524-4b9f-46c3-91ad-d723f1829ed6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930242.868104) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:04:02.869449 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:04:02.869759 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:04:02.870758 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:04:02.870917 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:04:02.871716 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:04:02.872000 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:04:02.872165 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:04:02.872260 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:04:02.872372 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:04:02.872450 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:04:02.872535 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:04:02.872701 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:04:02.872806 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:04:02.872909 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:04:02.873021 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:04:02.873127 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:04:02.873268 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8c35bc03-1899-4eb9-aefe-0bd301686dcf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:03.124315 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:04:03.215994 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4cfd34df-1cdd-4c4c-a14d-035fc61d3ead req-634ca94a-08a5-4e18-8243-56213cc39a1a service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Received event network-changed-53846e61-8840-490f-a976-3997db8a0f0b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:03.216138 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4cfd34df-1cdd-4c4c-a14d-035fc61d3ead req-634ca94a-08a5-4e18-8243-56213cc39a1a service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Refreshing instance network info cache due to event network-changed-53846e61-8840-490f-a976-3997db8a0f0b. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:04:03.216327 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4cfd34df-1cdd-4c4c-a14d-035fc61d3ead req-634ca94a-08a5-4e18-8243-56213cc39a1a service nova] Acquiring lock "refresh_cache-2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:04:03.216327 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4cfd34df-1cdd-4c4c-a14d-035fc61d3ead req-634ca94a-08a5-4e18-8243-56213cc39a1a service nova] Acquired lock "refresh_cache-2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:04:03.216481 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-4cfd34df-1cdd-4c4c-a14d-035fc61d3ead req-634ca94a-08a5-4e18-8243-56213cc39a1a service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Refreshing network info cache for port 53846e61-8840-490f-a976-3997db8a0f0b {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:04:03.239436 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:04:03.239648 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:04:03.376042 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Object Instance<8c35bc03-1899-4eb9-aefe-0bd301686dcf> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:04:03.386564 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c35bc03-1899-4eb9-aefe-0bd301686dcf/disk.config --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:04:03.478843 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c35bc03-1899-4eb9-aefe-0bd301686dcf/disk.config --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:04:03.478843 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c35bc03-1899-4eb9-aefe-0bd301686dcf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:03.479117 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "/opt/stack/data/nova/instances/8c35bc03-1899-4eb9-aefe-0bd301686dcf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:03.479608 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "/opt/stack/data/nova/instances/8c35bc03-1899-4eb9-aefe-0bd301686dcf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:03.480643 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:04:03.480643 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-15'}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:04:03.480643 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:04:03.480883 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:04:03.481075 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-15'} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:04:03.491383 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:04:03.491997 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:04:03.492534 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:04:03.492755 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:04:03.493108 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:04:03.493311 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.startup = automatic
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.session.scan = manual
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:04:03.503446 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:04:03.503446 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.startup = automatic
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.session.scan = manual
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:04:03.508097 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:04:03.508097 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:03.516733 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:03.521541 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:03.538347 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:03.538347 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:03.538347 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:03.538347 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:03.538347 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:03.538347 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:03.538347 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:04:03.538347 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:04:03.538347 np0000001577 nova-compute[98319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:04:03.538347 np0000001577 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:04:03.538347 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:04:03.538347 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:03.538347 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:03.538347 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:03.538347 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:03.538347 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:03.538347 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:03.538347 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:04:03.538347 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:04:03.538347 np0000001577 nova-compute[98319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:04:03.538347 np0000001577 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:04:03.538347 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:04:03.538347 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.045s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:04:03.538347 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:04:03.538347 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] HCTL ('24', '0', '0', 0) found on session 83 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:04:03.538347 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Scanning host 24 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:04:03.543377 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:03.543377 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:03.543377 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:03.543377 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:03.543377 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:03.543377 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:03.543377 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:04:03.543377 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:04:03.543377 np0000001577 nova-compute[98319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:04:03.543377 np0000001577 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:04:03.543377 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:04:03.543643 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:03.543643 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:03.543643 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:03.543643 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:03.543643 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:03.543643 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:03.543643 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:04:03.543643 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:04:03.543643 np0000001577 nova-compute[98319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:04:03.543643 np0000001577 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:04:03.543643 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:04:03.543844 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.051s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:04:03.543844 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:04:03.544256 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] HCTL ('23', '0', '0', 0) found on session 82 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:04:03.544349 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Scanning host 23 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:04:03.550826 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Searching for a device in session 83 and hctl ('24', '0', '0', 0) yield: sds {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:04:03.550826 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Connected to sds using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-15'} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:04:03.552114 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Searching for a device in session 82 and hctl ('23', '0', '0', 0) yield: sdr {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:04:03.552252 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Connected to sdr using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-15'} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:04:03.629911 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Took 1.52 seconds to deallocate network for instance.
May 28 01:04:03.721000 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-4cfd34df-1cdd-4c4c-a14d-035fc61d3ead req-634ca94a-08a5-4e18-8243-56213cc39a1a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:03.742513 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:04:03.999048 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-4cfd34df-1cdd-4c4c-a14d-035fc61d3ead req-634ca94a-08a5-4e18-8243-56213cc39a1a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:04.115026 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-4cfd34df-1cdd-4c4c-a14d-035fc61d3ead req-634ca94a-08a5-4e18-8243-56213cc39a1a service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Updated VIF entry in instance network info cache for port 53846e61-8840-490f-a976-3997db8a0f0b. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:04:04.115381 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-4cfd34df-1cdd-4c4c-a14d-035fc61d3ead req-634ca94a-08a5-4e18-8243-56213cc39a1a service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Updating instance_info_cache with network_info: [{"id": "53846e61-8840-490f-a976-3997db8a0f0b", "address": "fa:16:3e:88:07:ca", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53846e61-88", "ovs_interfaceid": "53846e61-8840-490f-a976-3997db8a0f0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:04:04.136118 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46a2cb52-d1ca-49a7-9074-486b6632a207 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:04.249801 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.704s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:04.250864 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.014s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:04.251097 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:04:04.493971 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:04:04.617455 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4cfd34df-1cdd-4c4c-a14d-035fc61d3ead req-634ca94a-08a5-4e18-8243-56213cc39a1a service nova] Releasing lock "refresh_cache-2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:04:04.760140 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:04:04.760324 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:04:04.760590 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:04.760798 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:04.926269 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '37ed4dda77f54e819033eff381c1b724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8fd62d51094eaaa9813f70672aa7da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:04:05.025059 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:04:05.025428 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:04:05.182501 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0004213870001876785 future=<Future at 0x7c98706bc2c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:05.183091 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Emitting event <LifecycleEvent: 1779930230.1819592, 6e370bae-b201-42eb-b5ef-f629b6f6502c => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:04:05.183286 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:05.183515 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] VM Stopped (Lifecycle Event)
May 28 01:04:05.183663 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=10.82422919999999 future=<Future at 0x7c984c7c29c0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:05.184852 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=10.823032929999954 future=<Future at 0x7c984c7c29c0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:05.262950 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:04:05.483632 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Successfully created port: 9186af50-c5dc-44b8-b22d-c328072bf150 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:04:05.508807 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Found WWN 330000000742f72bb for multipath device dm-15 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:04:05.509064 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.028s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:04:05.509241 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] <== connect_volume: return (2028ms) {'type': 'block', 'scsi_wwn': '330000000742f72bb', 'path': '/dev/dm-15', 'multipath_id': '330000000742f72bb'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:04:05.509375 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000742f72bb', 'path': '/dev/dm-15', 'multipath_id': '330000000742f72bb'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:04:05.527681 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:04:05.686375 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 6e370bae-b201-42eb-b5ef-f629b6f6502c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:05.766309 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:04:05.983708 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Successfully updated port: 9186af50-c5dc-44b8-b22d-c328072bf150 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:04:06.014102 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:03:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-307356266',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serverbootfromvolumestablerescuetest-server-307356266',id=38,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:03:54Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e28acf25c4445ea969bd7bca3eac146',ramdisk_id='',reservation_id='r-gieq9fco',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-568223226',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:03:55Z,user_data=None,user_id='fb6c20970bf0401190583f6348e00e4b',uuid=8c35bc03-1899-4eb9-aefe-0bd301686dcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79122524-4b9f-46c3-91ad-d723f1829ed6", "address": "fa:16:3e:45:bd:f8", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "vif_mac": "fa:16:3e:45:bd:f8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79122524-4b", "ovs_interfaceid": "79122524-4b9f-46c3-91ad-d723f1829ed6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:04:06.019002 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Converting VIF {"id": "79122524-4b9f-46c3-91ad-d723f1829ed6", "address": "fa:16:3e:45:bd:f8", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "vif_mac": "fa:16:3e:45:bd:f8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79122524-4b", "ovs_interfaceid": "79122524-4b9f-46c3-91ad-d723f1829ed6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:04:06.019542 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:bd:f8,bridge_name='br-int',has_traffic_filtering=True,id=79122524-4b9f-46c3-91ad-d723f1829ed6,network=Network(c25f8563-bd10-4e42-b4ce-fd2164eca324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79122524-4b') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:04:06.020095 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c35bc03-1899-4eb9-aefe-0bd301686dcf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:06.032788 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-44f543b1-4e54-46d9-b878-529619c038cb req-50c31c2e-2908-4326-bbb4-5e7b6c1ae222 service nova] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Received event network-changed-9186af50-c5dc-44b8-b22d-c328072bf150 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:06.034700 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-44f543b1-4e54-46d9-b878-529619c038cb req-50c31c2e-2908-4326-bbb4-5e7b6c1ae222 service nova] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Refreshing instance network info cache due to event network-changed-9186af50-c5dc-44b8-b22d-c328072bf150. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:04:06.035242 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3a11e4ad-b437-4d34-a8e8-00a4c742d618 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.418s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:06.036871 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.784s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:06.037607 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-44f543b1-4e54-46d9-b878-529619c038cb req-50c31c2e-2908-4326-bbb4-5e7b6c1ae222 service nova] Acquiring lock "refresh_cache-b132a198-b7d3-43ed-9cf1-02b4dc303777" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:04:06.043843 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-44f543b1-4e54-46d9-b878-529619c038cb req-50c31c2e-2908-4326-bbb4-5e7b6c1ae222 service nova] Acquired lock "refresh_cache-b132a198-b7d3-43ed-9cf1-02b4dc303777" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:04:06.043843 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-44f543b1-4e54-46d9-b878-529619c038cb req-50c31c2e-2908-4326-bbb4-5e7b6c1ae222 service nova] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Refreshing network info cache for port 9186af50-c5dc-44b8-b22d-c328072bf150 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:04:06.102205 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Deleted allocations for instance a9122d01-9c31-48d3-ae6b-e2d6305fe8d7
May 28 01:04:06.180817 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:06.485855 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Acquiring lock "refresh_cache-b132a198-b7d3-43ed-9cf1-02b4dc303777" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:04:06.521892 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Object Instance<8c35bc03-1899-4eb9-aefe-0bd301686dcf> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:04:06.523698 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] End _get_guest_xml xml=<domain type="qemu">
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:   <uuid>8c35bc03-1899-4eb9-aefe-0bd301686dcf</uuid>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:   <name>instance-00000026</name>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-307356266</nova:name>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:04:02</nova:creationTime>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:         <nova:user uuid="fb6c20970bf0401190583f6348e00e4b">tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member</nova:user>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:         <nova:project uuid="9e28acf25c4445ea969bd7bca3eac146">tempest-ServerBootFromVolumeStableRescueTest-568223226</nova:project>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:         <nova:port uuid="79122524-4b9f-46c3-91ad-d723f1829ed6">
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:     <system>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <entry name="serial">8c35bc03-1899-4eb9-aefe-0bd301686dcf</entry>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <entry name="uuid">8c35bc03-1899-4eb9-aefe-0bd301686dcf</entry>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:     </system>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:   <os>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:   </os>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:   <features>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:   </features>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:   <devices>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/8c35bc03-1899-4eb9-aefe-0bd301686dcf/disk.config"/>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:     </disk>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <alias name="ua-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc"/>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-15"/>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <serial>5237f2a6-3d87-4be6-91c4-8adbc4a32fcc</serial>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:     </disk>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/8c35bc03-1899-4eb9-aefe-0bd301686dcf/disk.rescue"/>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <boot order="1"/>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:     </disk>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:45:bd:f8"/>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <target dev="tap79122524-4b"/>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:     </interface>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/8c35bc03-1899-4eb9-aefe-0bd301686dcf/console.log" append="off"/>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:     </serial>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:     <video>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:     </video>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:     </rng>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:   </devices>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]: </domain>
May 28 01:04:06.523698 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:04:06.530468 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Instance destroyed successfully.
May 28 01:04:06.547001 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-44f543b1-4e54-46d9-b878-529619c038cb req-50c31c2e-2908-4326-bbb4-5e7b6c1ae222 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:06.581091 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:06.618729 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-44f543b1-4e54-46d9-b878-529619c038cb req-50c31c2e-2908-4326-bbb4-5e7b6c1ae222 service nova] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:04:06.752130 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-44f543b1-4e54-46d9-b878-529619c038cb req-50c31c2e-2908-4326-bbb4-5e7b6c1ae222 service nova] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:04:06.774425 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:04:06.775577 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:04:06.779571 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Creating image(s)
May 28 01:04:06.779571 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Acquiring lock "/opt/stack/data/nova/instances/b132a198-b7d3-43ed-9cf1-02b4dc303777/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:06.779571 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Lock "/opt/stack/data/nova/instances/b132a198-b7d3-43ed-9cf1-02b4dc303777/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:06.779571 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3a11e4ad-b437-4d34-a8e8-00a4c742d618 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:04:06.779571 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-3a11e4ad-b437-4d34-a8e8-00a4c742d618 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:04:06.779571 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Lock "/opt/stack/data/nova/instances/b132a198-b7d3-43ed-9cf1-02b4dc303777/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:06.779571 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:04:06.781757 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:04:06.785566 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:04:06.885983 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.103s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:04:06.886483 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:06.887021 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:06.887508 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:04:06.890143 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:04:06.890445 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:04:06.980825 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:04:06.981319 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/b132a198-b7d3-43ed-9cf1-02b4dc303777/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:04:07.035109 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/b132a198-b7d3-43ed-9cf1-02b4dc303777/disk 1073741824" returned: 0 in 0.054s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:04:07.035648 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.149s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:07.036019 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:04:07.117069 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f5989f26-9e2b-4bdb-b6f7-ff6ab93ed056 tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Lock "a9122d01-9c31-48d3-ae6b-e2d6305fe8d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.870s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:07.135583 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.099s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:04:07.136022 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b132a198-b7d3-43ed-9cf1-02b4dc303777/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:04:07.136623 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b132a198-b7d3-43ed-9cf1-02b4dc303777/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:04:07.236886 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b132a198-b7d3-43ed-9cf1-02b4dc303777/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:04:07.237307 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Cannot resize image /opt/stack/data/nova/instances/b132a198-b7d3-43ed-9cf1-02b4dc303777/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:04:07.237696 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:04:07.237887 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Ensure instance console log exists: /opt/stack/data/nova/instances/b132a198-b7d3-43ed-9cf1-02b4dc303777/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:04:07.238190 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:07.238388 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:07.238528 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:07.254383 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-44f543b1-4e54-46d9-b878-529619c038cb req-50c31c2e-2908-4326-bbb4-5e7b6c1ae222 service nova] Releasing lock "refresh_cache-b132a198-b7d3-43ed-9cf1-02b4dc303777" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:04:07.254884 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Acquired lock "refresh_cache-b132a198-b7d3-43ed-9cf1-02b4dc303777" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:04:07.255207 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:04:07.281379 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-3a11e4ad-b437-4d34-a8e8-00a4c742d618 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:04:07.791070 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3a11e4ad-b437-4d34-a8e8-00a4c742d618 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.756s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:07.793042 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46a2cb52-d1ca-49a7-9074-486b6632a207 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.655s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:07.815647 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:04:07.884416 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-3a11e4ad-b437-4d34-a8e8-00a4c742d618 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Deleted allocations for instance 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b
May 28 01:04:08.017785 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:08.072116 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:04:08.073163 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:04:08.073282 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:04:08.073389 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] No VIF found with MAC fa:16:3e:45:bd:f8, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:04:08.074489 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Using config drive
May 28 01:04:08.191509 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Updating instance_info_cache with network_info: [{"id": "9186af50-c5dc-44b8-b22d-c328072bf150", "address": "fa:16:3e:d3:94:9b", "network": {"id": "691a7343-2e9f-4fcd-b4b0-4acd54dcf670", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93c8070b691d4f708f2391bfb8de6d61", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9186af50-c5", "ovs_interfaceid": "9186af50-c5dc-44b8-b22d-c328072bf150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:04:08.587709 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lazy-loading 'ec2_ids' on Instance uuid 8c35bc03-1899-4eb9-aefe-0bd301686dcf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:08.608487 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46a2cb52-d1ca-49a7-9074-486b6632a207 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:04:08.608814 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-46a2cb52-d1ca-49a7-9074-486b6632a207 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:04:08.693588 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Releasing lock "refresh_cache-b132a198-b7d3-43ed-9cf1-02b4dc303777" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:04:08.693879 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Instance network_info: |[{"id": "9186af50-c5dc-44b8-b22d-c328072bf150", "address": "fa:16:3e:d3:94:9b", "network": {"id": "691a7343-2e9f-4fcd-b4b0-4acd54dcf670", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93c8070b691d4f708f2391bfb8de6d61", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9186af50-c5", "ovs_interfaceid": "9186af50-c5dc-44b8-b22d-c328072bf150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:04:08.697928 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Start _get_guest_xml network_info=[{"id": "9186af50-c5dc-44b8-b22d-c328072bf150", "address": "fa:16:3e:d3:94:9b", "network": {"id": "691a7343-2e9f-4fcd-b4b0-4acd54dcf670", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93c8070b691d4f708f2391bfb8de6d61", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9186af50-c5", "ovs_interfaceid": "9186af50-c5dc-44b8-b22d-c328072bf150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:04:08.700419 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:04:08.701327 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-VolumesNegativeTest-instance-133365162', uuid='b132a198-b7d3-43ed-9cf1-02b4dc303777'), owner=OwnerMeta(userid='37ed4dda77f54e819033eff381c1b724', username='tempest-VolumesNegativeTest-26292438-project-member', projectid='bf8fd62d51094eaaa9813f70672aa7da', projectname='tempest-VolumesNegativeTest-26292438'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9186af50-c5dc-44b8-b22d-c328072bf150", "address": "fa:16:3e:d3:94:9b", "network": {"id": "691a7343-2e9f-4fcd-b4b0-4acd54dcf670", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93c8070b691d4f708f2391bfb8de6d61", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9186af50-c5", "ovs_interfaceid": "9186af50-c5dc-44b8-b22d-c328072bf150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930248.7009523) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:04:08.702300 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:04:08.702992 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:04:08.703605 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:04:08.703605 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:04:08.704695 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:04:08.705122 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:04:08.705336 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:04:08.705481 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:04:08.705700 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:04:08.705860 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:04:08.706014 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:04:08.706217 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:04:08.706375 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:04:08.706538 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:04:08.706729 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:04:08.706902 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:04:08.721976 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:03:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-133365162',display_name='tempest-VolumesNegativeTest-instance-133365162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumesnegativetest-instance-133365162',id=40,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf8fd62d51094eaaa9813f70672aa7da',ramdisk_id='',reservation_id='r-0erp5ixb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-26292438',owner_user_name='tempest-VolumesNegativeTest-26292438-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:04:06Z,user_data=None,user_id='37ed4dda77f54e819033eff381c1b724',uuid=b132a198-b7d3-43ed-9cf1-02b4dc303777,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9186af50-c5dc-44b8-b22d-c328072bf150", "address": "fa:16:3e:d3:94:9b", "network": {"id": "691a7343-2e9f-4fcd-b4b0-4acd54dcf670", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93c8070b691d4f708f2391bfb8de6d61", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9186af50-c5", "ovs_interfaceid": "9186af50-c5dc-44b8-b22d-c328072bf150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:04:08.722246 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Converting VIF {"id": "9186af50-c5dc-44b8-b22d-c328072bf150", "address": "fa:16:3e:d3:94:9b", "network": {"id": "691a7343-2e9f-4fcd-b4b0-4acd54dcf670", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93c8070b691d4f708f2391bfb8de6d61", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9186af50-c5", "ovs_interfaceid": "9186af50-c5dc-44b8-b22d-c328072bf150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:04:08.723800 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:94:9b,bridge_name='br-int',has_traffic_filtering=True,id=9186af50-c5dc-44b8-b22d-c328072bf150,network=Network(691a7343-2e9f-4fcd-b4b0-4acd54dcf670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9186af50-c5') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:04:08.723800 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Lazy-loading 'pci_devices' on Instance uuid b132a198-b7d3-43ed-9cf1-02b4dc303777 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:08.897775 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3a11e4ad-b437-4d34-a8e8-00a4c742d618 tempest-ServerStableDeviceRescueTest-1831534173 tempest-ServerStableDeviceRescueTest-1831534173-project-member] Lock "5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.228s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:09.071028 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "0ad69caa-c797-4e9d-96e3-7ad63523be49" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:09.071282 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "0ad69caa-c797-4e9d-96e3-7ad63523be49" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:09.071520 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "0ad69caa-c797-4e9d-96e3-7ad63523be49-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:09.071667 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "0ad69caa-c797-4e9d-96e3-7ad63523be49-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:09.071774 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "0ad69caa-c797-4e9d-96e3-7ad63523be49-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:09.075390 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Terminating instance
May 28 01:04:09.091337 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Object Instance<8c35bc03-1899-4eb9-aefe-0bd301686dcf> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:04:09.091391 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lazy-loading 'keypairs' on Instance uuid 8c35bc03-1899-4eb9-aefe-0bd301686dcf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:09.114199 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-46a2cb52-d1ca-49a7-9074-486b6632a207 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:04:09.225982 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] End _get_guest_xml xml=<domain type="qemu">
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:   <uuid>b132a198-b7d3-43ed-9cf1-02b4dc303777</uuid>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:   <name>instance-00000028</name>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       <nova:name>tempest-VolumesNegativeTest-instance-133365162</nova:name>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:04:08</nova:creationTime>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:         <nova:user uuid="37ed4dda77f54e819033eff381c1b724">tempest-VolumesNegativeTest-26292438-project-member</nova:user>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:         <nova:project uuid="bf8fd62d51094eaaa9813f70672aa7da">tempest-VolumesNegativeTest-26292438</nova:project>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:         <nova:port uuid="9186af50-c5dc-44b8-b22d-c328072bf150">
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="192.168.233.195" ipVersion="4"/>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:     <system>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       <entry name="serial">b132a198-b7d3-43ed-9cf1-02b4dc303777</entry>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       <entry name="uuid">b132a198-b7d3-43ed-9cf1-02b4dc303777</entry>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:     </system>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:   <os>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:   </os>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:   <features>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:   </features>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:   <devices>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/b132a198-b7d3-43ed-9cf1-02b4dc303777/disk"/>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:     </disk>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/b132a198-b7d3-43ed-9cf1-02b4dc303777/disk.config"/>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:     </disk>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:d3:94:9b"/>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       <target dev="tap9186af50-c5"/>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:     </interface>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/b132a198-b7d3-43ed-9cf1-02b4dc303777/console.log" append="off"/>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:     </serial>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:     <video>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:     </video>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:     </rng>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:   </devices>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]: </domain>
May 28 01:04:09.225982 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:04:09.228641 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Preparing to wait for external event network-vif-plugged-9186af50-c5dc-44b8-b22d-c328072bf150 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:04:09.228641 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Acquiring lock "b132a198-b7d3-43ed-9cf1-02b4dc303777-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:09.228641 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Lock "b132a198-b7d3-43ed-9cf1-02b4dc303777-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:09.228641 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Lock "b132a198-b7d3-43ed-9cf1-02b4dc303777-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:09.228641 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:03:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-133365162',display_name='tempest-VolumesNegativeTest-instance-133365162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumesnegativetest-instance-133365162',id=40,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf8fd62d51094eaaa9813f70672aa7da',ramdisk_id='',reservation_id='r-0erp5ixb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-26292438',owner_user_name='tempest-VolumesNegativeTest-26292438-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:04:06Z,user_data=None,user_id='37ed4dda77f54e819033eff381c1b724',uuid=b132a198-b7d3-43ed-9cf1-02b4dc303777,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9186af50-c5dc-44b8-b22d-c328072bf150", "address": "fa:16:3e:d3:94:9b", "network": {"id": "691a7343-2e9f-4fcd-b4b0-4acd54dcf670", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93c8070b691d4f708f2391bfb8de6d61", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9186af50-c5", "ovs_interfaceid": "9186af50-c5dc-44b8-b22d-c328072bf150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:04:09.228641 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Converting VIF {"id": "9186af50-c5dc-44b8-b22d-c328072bf150", "address": "fa:16:3e:d3:94:9b", "network": {"id": "691a7343-2e9f-4fcd-b4b0-4acd54dcf670", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93c8070b691d4f708f2391bfb8de6d61", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9186af50-c5", "ovs_interfaceid": "9186af50-c5dc-44b8-b22d-c328072bf150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:04:09.228641 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:94:9b,bridge_name='br-int',has_traffic_filtering=True,id=9186af50-c5dc-44b8-b22d-c328072bf150,network=Network(691a7343-2e9f-4fcd-b4b0-4acd54dcf670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9186af50-c5') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:04:09.228641 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:94:9b,bridge_name='br-int',has_traffic_filtering=True,id=9186af50-c5dc-44b8-b22d-c328072bf150,network=Network(691a7343-2e9f-4fcd-b4b0-4acd54dcf670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9186af50-c5') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:04:09.228940 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:09.232119 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:09.232119 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:04:09.232119 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:09.232119 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e635fc51-ce17-5eb5-9738-c300fbc9dcff', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:09.232119 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:09.232825 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:09.237677 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:09.239831 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:09.239974 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9186af50-c5, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:09.240309 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9186af50-c5, col_values=(('qos', UUID('08f91560-d800-4c81-9d9f-506768775ae1')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:09.240458 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9186af50-c5, col_values=(('external_ids', {'iface-id': '9186af50-c5dc-44b8-b22d-c328072bf150', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:94:9b', 'vm-uuid': 'b132a198-b7d3-43ed-9cf1-02b4dc303777'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:09.241149 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:09.242496 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:09.249132 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:09.250393 np0000001577 nova-compute[98319]: INFO os_vif [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:94:9b,bridge_name='br-int',has_traffic_filtering=True,id=9186af50-c5dc-44b8-b22d-c328072bf150,network=Network(691a7343-2e9f-4fcd-b4b0-4acd54dcf670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9186af50-c5')
May 28 01:04:09.580880 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:04:09.594733 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Object Instance<8c35bc03-1899-4eb9-aefe-0bd301686dcf> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:04:09.597074 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:09.613349 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:09.617923 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:09.624957 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46a2cb52-d1ca-49a7-9074-486b6632a207 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.833s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:09.644867 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:09.690586 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-46a2cb52-d1ca-49a7-9074-486b6632a207 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Deleted allocations for instance 04880ef4-5eee-4221-ad42-29788eb26358
May 28 01:04:09.724216 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Creating config drive at /opt/stack/data/nova/instances/8c35bc03-1899-4eb9-aefe-0bd301686dcf/disk.config.rescue
May 28 01:04:09.725438 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8c35bc03-1899-4eb9-aefe-0bd301686dcf/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphtfqhoqp {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:04:09.770357 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:09.776831 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8c35bc03-1899-4eb9-aefe-0bd301686dcf/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphtfqhoqp" returned: 0 in 0.052s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:04:09.784244 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:09.853389 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-867a678e-9ada-41ef-98ef-7fbb55850bff req-e5287ac6-4826-4b2d-a035-533ff7e195ff service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Received event network-vif-unplugged-99ce3f06-1207-4d71-a43a-4cd61a8ae36c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:09.854632 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-867a678e-9ada-41ef-98ef-7fbb55850bff req-e5287ac6-4826-4b2d-a035-533ff7e195ff service nova] Acquiring lock "0ad69caa-c797-4e9d-96e3-7ad63523be49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:09.854886 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-867a678e-9ada-41ef-98ef-7fbb55850bff req-e5287ac6-4826-4b2d-a035-533ff7e195ff service nova] Lock "0ad69caa-c797-4e9d-96e3-7ad63523be49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:09.854999 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-867a678e-9ada-41ef-98ef-7fbb55850bff req-e5287ac6-4826-4b2d-a035-533ff7e195ff service nova] Lock "0ad69caa-c797-4e9d-96e3-7ad63523be49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:09.855139 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-867a678e-9ada-41ef-98ef-7fbb55850bff req-e5287ac6-4826-4b2d-a035-533ff7e195ff service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] No waiting events found dispatching network-vif-unplugged-99ce3f06-1207-4d71-a43a-4cd61a8ae36c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:09.855350 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-867a678e-9ada-41ef-98ef-7fbb55850bff req-e5287ac6-4826-4b2d-a035-533ff7e195ff service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Received event network-vif-unplugged-99ce3f06-1207-4d71-a43a-4cd61a8ae36c for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:04:10.190526 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.99971201399967 future=<Future at 0x7c9870301dc0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:10.196529 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Instance destroyed successfully.
May 28 01:04:10.196999 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lazy-loading 'resources' on Instance uuid 0ad69caa-c797-4e9d-96e3-7ad63523be49 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:10.361882 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:10.381794 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:10.401151 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:10.433361 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:10.532312 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:10.546482 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:10.674308 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-475e5b9a-52fd-4b0b-ba05-c851b48f8fc8 req-cca65ce7-6612-451e-bbe7-efb589657b40 service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Received event network-vif-plugged-79122524-4b9f-46c3-91ad-d723f1829ed6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:10.674447 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-475e5b9a-52fd-4b0b-ba05-c851b48f8fc8 req-cca65ce7-6612-451e-bbe7-efb589657b40 service nova] Acquiring lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:10.674640 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-475e5b9a-52fd-4b0b-ba05-c851b48f8fc8 req-cca65ce7-6612-451e-bbe7-efb589657b40 service nova] Lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:10.674722 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-475e5b9a-52fd-4b0b-ba05-c851b48f8fc8 req-cca65ce7-6612-451e-bbe7-efb589657b40 service nova] Lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:10.674837 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-475e5b9a-52fd-4b0b-ba05-c851b48f8fc8 req-cca65ce7-6612-451e-bbe7-efb589657b40 service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] No waiting events found dispatching network-vif-plugged-79122524-4b9f-46c3-91ad-d723f1829ed6 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:10.674980 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-475e5b9a-52fd-4b0b-ba05-c851b48f8fc8 req-cca65ce7-6612-451e-bbe7-efb589657b40 service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Received unexpected event network-vif-plugged-79122524-4b9f-46c3-91ad-d723f1829ed6 for instance with vm_state active and task_state rescuing.
May 28 01:04:10.700031 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46a2cb52-d1ca-49a7-9074-486b6632a207 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "04880ef4-5eee-4221-ad42-29788eb26358" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.482s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:10.708093 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:02:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-126410006',display_name='tempest-ServerActionsTestOtherA-server-126410006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001577',hostname='tempest-serveractionstestothera-server-126410006',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOEhInnYH8OIPIS+AoDN91vRrTIl7emQTWVv1MQvwyvOos+qsDslhGKWhjOWQnKEu789RlRl8BiqEdHw4m/ZZapwhCdnQdK7FOovVNbbHnETkK3QhUrm9lcqluHt42QLQ==',key_name='tempest-keypair-1959255291',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:03:36Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73ee6b376bb14dffb5664085cca58288',ramdisk_id='',reservation_id='r-m5d9fumv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1279266727',owner_user_name='tempest-ServerActionsTestOtherA-1279266727-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:03:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84e218b589ef4968828db0c740eaa72b',uuid=0ad69caa-c797-4e9d-96e3-7ad63523be49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "address": "fa:16:3e:2e:5f:00", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ce3f06-12", "ovs_interfaceid": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:04:10.708215 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Converting VIF {"id": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "address": "fa:16:3e:2e:5f:00", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ce3f06-12", "ovs_interfaceid": "99ce3f06-1207-4d71-a43a-4cd61a8ae36c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:04:10.709601 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:5f:00,bridge_name='br-int',has_traffic_filtering=True,id=99ce3f06-1207-4d71-a43a-4cd61a8ae36c,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99ce3f06-12') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:04:10.709601 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:5f:00,bridge_name='br-int',has_traffic_filtering=True,id=99ce3f06-1207-4d71-a43a-4cd61a8ae36c,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99ce3f06-12') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:04:10.712403 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:10.712671 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99ce3f06-12, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:10.714680 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:10.715759 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:10.719998 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:10.721124 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:10.721292 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=08ef182f-2b54-4fca-a162-d61aa7469f03) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:10.723404 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:10.724046 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:10.728587 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:10.730352 np0000001577 nova-compute[98319]: INFO os_vif [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:5f:00,bridge_name='br-int',has_traffic_filtering=True,id=99ce3f06-1207-4d71-a43a-4cd61a8ae36c,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99ce3f06-12')
May 28 01:04:10.732683 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:04:10.733008 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '48069396-3383-47de-ba84-d39b106a7dd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:04:10.733173 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:04:10.733563 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:04:10.733869 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '48069396-3383-47de-ba84-d39b106a7dd3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:04:10.734028 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:04:10.774890 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:10.774890 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:10.774890 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:10.774890 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:10.774890 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:10.774890 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:10.774890 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:04:10.774890 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:04:10.774890 np0000001577 nova-compute[98319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:04:10.774890 np0000001577 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:04:10.774890 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:04:10.774890 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:10.774890 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:10.774890 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:10.774890 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:10.774890 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:10.774890 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:10.774890 np0000001577 nova-compute[98319]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:04:10.774890 np0000001577 nova-compute[98319]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3 (non-flash)
May 28 01:04:10.774890 np0000001577 nova-compute[98319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:04:10.774890 np0000001577 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:04:10.774890 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:04:10.774890 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', '63'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', '74'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', '75'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', '77'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', '83')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:04:10.774890 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', '76')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:04:10.776478 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3', '77')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:04:10.776640 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:04:10.776640 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:04:10.777630 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] No VIF found with MAC fa:16:3e:d3:94:9b, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:04:10.777936 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Using config drive
May 28 01:04:10.781126 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c984c508cc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3'): ({'sdf'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:04:10.781390 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Removing multipathed devices sdf, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:04:10.781617 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Flush multipath device 33000000069cb9e3a {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:04:10.838689 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:04:10.849468 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-80cd9fc2-cd36-4f46-a300-9fe4d555ffa3 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:10.849632 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-80cd9fc2-cd36-4f46-a300-9fe4d555ffa3 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:10.849779 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-80cd9fc2-cd36-4f46-a300-9fe4d555ffa3 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:10.849956 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-80cd9fc2-cd36-4f46-a300-9fe4d555ffa3 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:10.849990 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-80cd9fc2-cd36-4f46-a300-9fe4d555ffa3 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:10.851901 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-80cd9fc2-cd36-4f46-a300-9fe4d555ffa3 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Terminating instance
May 28 01:04:10.883949 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:04:10.927939 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Checking to see if SCSI volumes sdf, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:04:10.928085 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] SCSI volumes sdf, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:04:10.930318 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Checking to see if device paths {'sdf', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:04:10.943718 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Device paths {'sdf', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:04:10.944213 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:04:10.959941 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:11.004265 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 76, target: iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3, portal: 192.168.40.100,3260]
May 28 01:04:11.004265 np0000001577 nova-compute[98319]: Logout of [sid: 76, target: iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3, portal: 192.168.40.100,3260] successful.
May 28 01:04:11.004265 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:11.028450 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:11.039131 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:11.075970 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 77, target: iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3, portal: 192.168.50.100,3260]
May 28 01:04:11.075970 np0000001577 nova-compute[98319]: Logout of [sid: 77, target: iqn.2023-03.storpool.com:os--volume-48069396-3383-47de-ba84-d39b106a7dd3, portal: 192.168.50.100,3260] successful.
May 28 01:04:11.075970 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:11.098671 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:11.098929 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:04:11.099088 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] <== disconnect_volume: return (365ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:04:11.099257 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:04:11.099623 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Deleting instance files /opt/stack/data/nova/instances/0ad69caa-c797-4e9d-96e3-7ad63523be49_del
May 28 01:04:11.100274 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Deletion of /opt/stack/data/nova/instances/0ad69caa-c797-4e9d-96e3-7ad63523be49_del complete
May 28 01:04:11.179645 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Removed pending STOPPED event for 8c35bc03-1899-4eb9-aefe-0bd301686dcf due to new event <LifecycleEvent: 1779930251.1792004, 8c35bc03-1899-4eb9-aefe-0bd301686dcf => Resumed> {{(pid=98319) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 01:04:11.179864 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930251.1792004, 8c35bc03-1899-4eb9-aefe-0bd301686dcf => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:04:11.183134 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:11.185431 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4ba7bfa6-8f8c-4b0e-a5d8-340d32cd8b9a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:11.185431 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] VM Resumed (Lifecycle Event)
May 28 01:04:11.282788 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:11.354352 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-80cd9fc2-cd36-4f46-a300-9fe4d555ffa3 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:04:11.382024 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:11.384004 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:11.418884 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:11.456320 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Creating config drive at /opt/stack/data/nova/instances/b132a198-b7d3-43ed-9cf1-02b4dc303777/disk.config
May 28 01:04:11.461659 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b132a198-b7d3-43ed-9cf1-02b4dc303777/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjlpummcf {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:04:11.517121 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b132a198-b7d3-43ed-9cf1-02b4dc303777/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjlpummcf" returned: 0 in 0.055s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:04:11.545906 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:11.557892 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:11.609768 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Took 2.03 seconds to destroy the instance on the hypervisor.
May 28 01:04:11.611874 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:04:11.612218 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:04:11.612369 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:04:11.612815 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:11.688463 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:11.696830 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:11.699505 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:04:11.865781 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Instance destroyed successfully.
May 28 01:04:11.867022 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-80cd9fc2-cd36-4f46-a300-9fe4d555ffa3 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lazy-loading 'resources' on Instance uuid d87bb95b-a1e9-4786-8bee-16f2cfaabf2d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:11.933825 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d4b20dd5-3cc1-4f19-8c06-e109b63ea484 req-c4d6e178-85ac-4750-85fd-778d78096159 service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Received event network-vif-unplugged-99ce3f06-1207-4d71-a43a-4cd61a8ae36c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:11.933825 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d4b20dd5-3cc1-4f19-8c06-e109b63ea484 req-c4d6e178-85ac-4750-85fd-778d78096159 service nova] Acquiring lock "0ad69caa-c797-4e9d-96e3-7ad63523be49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:11.933825 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d4b20dd5-3cc1-4f19-8c06-e109b63ea484 req-c4d6e178-85ac-4750-85fd-778d78096159 service nova] Lock "0ad69caa-c797-4e9d-96e3-7ad63523be49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:11.933825 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d4b20dd5-3cc1-4f19-8c06-e109b63ea484 req-c4d6e178-85ac-4750-85fd-778d78096159 service nova] Lock "0ad69caa-c797-4e9d-96e3-7ad63523be49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:11.933959 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d4b20dd5-3cc1-4f19-8c06-e109b63ea484 req-c4d6e178-85ac-4750-85fd-778d78096159 service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] No waiting events found dispatching network-vif-unplugged-99ce3f06-1207-4d71-a43a-4cd61a8ae36c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:11.934091 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d4b20dd5-3cc1-4f19-8c06-e109b63ea484 req-c4d6e178-85ac-4750-85fd-778d78096159 service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Received event network-vif-unplugged-99ce3f06-1207-4d71-a43a-4cd61a8ae36c for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:04:12.131337 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:12.167902 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:12.206284 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930252.205955, 8c35bc03-1899-4eb9-aefe-0bd301686dcf => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:04:12.206426 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] VM Started (Lifecycle Event)
May 28 01:04:12.209830 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:12.226931 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:12.369486 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-80cd9fc2-cd36-4f46-a300-9fe4d555ffa3 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001577',hostname='multiattach-server-0',id=21,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7fHo3fyBWUybZxdNVpYEXXxMYY3ACB7D4odfvDXtuf5uMmk/o2XggiQakoJbwdRCXKjpHaMcmXgSyAS8x+3bDHMUWn1qlznnyXp/nDVRmoqTgLFpV2Do6YlUuA3zZ+mw==',key_name='tempest-keypair-627531643',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:01:38Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='938c2829112843edb2054984e80ce7ad',ramdisk_id='',reservation_id='r-vg7s0e6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-89204095',owner_user_name='tempest-AttachVolumeMultiAttachTest-89204095-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:01:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8586a18edcf42cab0a60028135ae401',uuid=d87bb95b-a1e9-4786-8bee-16f2cfaabf2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "address": "fa:16:3e:28:56:65", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3d348-6b", "ovs_interfaceid": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:04:12.370565 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-80cd9fc2-cd36-4f46-a300-9fe4d555ffa3 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converting VIF {"id": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "address": "fa:16:3e:28:56:65", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3d348-6b", "ovs_interfaceid": "3ed3d348-6b93-4492-9c18-7b0eecc6454a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:04:12.371757 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-80cd9fc2-cd36-4f46-a300-9fe4d555ffa3 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:56:65,bridge_name='br-int',has_traffic_filtering=True,id=3ed3d348-6b93-4492-9c18-7b0eecc6454a,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed3d348-6b') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:04:12.372126 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-80cd9fc2-cd36-4f46-a300-9fe4d555ffa3 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:56:65,bridge_name='br-int',has_traffic_filtering=True,id=3ed3d348-6b93-4492-9c18-7b0eecc6454a,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed3d348-6b') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:04:12.377004 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:12.377241 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ed3d348-6b, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:12.379783 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:12.381699 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:12.386656 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:12.386845 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=83e0dc28-f972-4282-bea3-eee73cf0f65b) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:12.387751 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:12.388285 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:12.388677 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:12.391872 np0000001577 nova-compute[98319]: INFO os_vif [None req-80cd9fc2-cd36-4f46-a300-9fe4d555ffa3 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:56:65,bridge_name='br-int',has_traffic_filtering=True,id=3ed3d348-6b93-4492-9c18-7b0eecc6454a,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed3d348-6b')
May 28 01:04:12.392590 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-80cd9fc2-cd36-4f46-a300-9fe4d555ffa3 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Deleting instance files /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d_del
May 28 01:04:12.408482 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-80cd9fc2-cd36-4f46-a300-9fe4d555ffa3 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Deletion of /opt/stack/data/nova/instances/d87bb95b-a1e9-4786-8bee-16f2cfaabf2d_del complete
May 28 01:04:12.466208 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-bb064a78-7ab5-4a6b-a3c0-6734c99d5d27 req-44a4118e-62d4-49a3-bacf-3e73332ebfea service nova] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Received event network-vif-plugged-9186af50-c5dc-44b8-b22d-c328072bf150 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:12.466208 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bb064a78-7ab5-4a6b-a3c0-6734c99d5d27 req-44a4118e-62d4-49a3-bacf-3e73332ebfea service nova] Acquiring lock "b132a198-b7d3-43ed-9cf1-02b4dc303777-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:12.466385 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bb064a78-7ab5-4a6b-a3c0-6734c99d5d27 req-44a4118e-62d4-49a3-bacf-3e73332ebfea service nova] Lock "b132a198-b7d3-43ed-9cf1-02b4dc303777-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:12.466455 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bb064a78-7ab5-4a6b-a3c0-6734c99d5d27 req-44a4118e-62d4-49a3-bacf-3e73332ebfea service nova] Lock "b132a198-b7d3-43ed-9cf1-02b4dc303777-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:12.466598 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-bb064a78-7ab5-4a6b-a3c0-6734c99d5d27 req-44a4118e-62d4-49a3-bacf-3e73332ebfea service nova] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Processing event network-vif-plugged-9186af50-c5dc-44b8-b22d-c328072bf150 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:04:12.523609 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:12.526725 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:12.530679 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:12.532034 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:12.552152 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:12.686903 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:04:12.713615 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:12.720895 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:04:12.772674 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b71e3c7d-9700-4d87-828f-b242e8a40928 req-3238af08-6dc5-47e8-a391-afb9091c3380 service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Received event network-vif-plugged-79122524-4b9f-46c3-91ad-d723f1829ed6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:12.772674 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b71e3c7d-9700-4d87-828f-b242e8a40928 req-3238af08-6dc5-47e8-a391-afb9091c3380 service nova] Acquiring lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:12.772674 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b71e3c7d-9700-4d87-828f-b242e8a40928 req-3238af08-6dc5-47e8-a391-afb9091c3380 service nova] Lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:12.772674 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b71e3c7d-9700-4d87-828f-b242e8a40928 req-3238af08-6dc5-47e8-a391-afb9091c3380 service nova] Lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:12.772674 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b71e3c7d-9700-4d87-828f-b242e8a40928 req-3238af08-6dc5-47e8-a391-afb9091c3380 service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] No waiting events found dispatching network-vif-plugged-79122524-4b9f-46c3-91ad-d723f1829ed6 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:12.772674 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-b71e3c7d-9700-4d87-828f-b242e8a40928 req-3238af08-6dc5-47e8-a391-afb9091c3380 service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Received unexpected event network-vif-plugged-79122524-4b9f-46c3-91ad-d723f1829ed6 for instance with vm_state rescued and task_state unrescuing.
May 28 01:04:12.772674 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b71e3c7d-9700-4d87-828f-b242e8a40928 req-3238af08-6dc5-47e8-a391-afb9091c3380 service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Received event network-vif-unplugged-3ed3d348-6b93-4492-9c18-7b0eecc6454a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:12.772674 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b71e3c7d-9700-4d87-828f-b242e8a40928 req-3238af08-6dc5-47e8-a391-afb9091c3380 service nova] Acquiring lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:12.773020 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b71e3c7d-9700-4d87-828f-b242e8a40928 req-3238af08-6dc5-47e8-a391-afb9091c3380 service nova] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:12.773331 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b71e3c7d-9700-4d87-828f-b242e8a40928 req-3238af08-6dc5-47e8-a391-afb9091c3380 service nova] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:12.773531 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b71e3c7d-9700-4d87-828f-b242e8a40928 req-3238af08-6dc5-47e8-a391-afb9091c3380 service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] No waiting events found dispatching network-vif-unplugged-3ed3d348-6b93-4492-9c18-7b0eecc6454a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:12.773746 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b71e3c7d-9700-4d87-828f-b242e8a40928 req-3238af08-6dc5-47e8-a391-afb9091c3380 service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Received event network-vif-unplugged-3ed3d348-6b93-4492-9c18-7b0eecc6454a for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:04:12.773912 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b71e3c7d-9700-4d87-828f-b242e8a40928 req-3238af08-6dc5-47e8-a391-afb9091c3380 service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Received event network-vif-unplugged-3ed3d348-6b93-4492-9c18-7b0eecc6454a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:12.774207 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b71e3c7d-9700-4d87-828f-b242e8a40928 req-3238af08-6dc5-47e8-a391-afb9091c3380 service nova] Acquiring lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:12.775118 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b71e3c7d-9700-4d87-828f-b242e8a40928 req-3238af08-6dc5-47e8-a391-afb9091c3380 service nova] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:12.775321 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b71e3c7d-9700-4d87-828f-b242e8a40928 req-3238af08-6dc5-47e8-a391-afb9091c3380 service nova] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:12.775605 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b71e3c7d-9700-4d87-828f-b242e8a40928 req-3238af08-6dc5-47e8-a391-afb9091c3380 service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] No waiting events found dispatching network-vif-unplugged-3ed3d348-6b93-4492-9c18-7b0eecc6454a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:12.776117 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b71e3c7d-9700-4d87-828f-b242e8a40928 req-3238af08-6dc5-47e8-a391-afb9091c3380 service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Received event network-vif-unplugged-3ed3d348-6b93-4492-9c18-7b0eecc6454a for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:04:12.776302 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b71e3c7d-9700-4d87-828f-b242e8a40928 req-3238af08-6dc5-47e8-a391-afb9091c3380 service nova] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Received event network-vif-deleted-99ce3f06-1207-4d71-a43a-4cd61a8ae36c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:12.917373 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-80cd9fc2-cd36-4f46-a300-9fe4d555ffa3 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Took 1.56 seconds to destroy the instance on the hypervisor.
May 28 01:04:12.917818 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-80cd9fc2-cd36-4f46-a300-9fe4d555ffa3 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:04:12.918127 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:04:12.918216 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:04:12.918431 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:12.954058 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:04:12.956383 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:04:12.958488 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Instance spawned successfully.
May 28 01:04:12.958802 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:04:12.984511 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:12.997847 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-08380ab7-be96-4f1e-966b-4edc781542b5 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Unrescuing
May 28 01:04:12.998066 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-08380ab7-be96-4f1e-966b-4edc781542b5 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "refresh_cache-8c35bc03-1899-4eb9-aefe-0bd301686dcf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:04:12.998186 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-08380ab7-be96-4f1e-966b-4edc781542b5 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquired lock "refresh_cache-8c35bc03-1899-4eb9-aefe-0bd301686dcf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:04:12.998691 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-08380ab7-be96-4f1e-966b-4edc781542b5 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:04:13.189761 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Took 1.58 seconds to deallocate network for instance.
May 28 01:04:13.223321 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 28 01:04:13.223702 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999771434000195 future=<Future at 0x7c988416a000 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:13.223938 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930253.2237566, b132a198-b7d3-43ed-9cf1-02b4dc303777 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:04:13.224065 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] VM Started (Lifecycle Event)
May 28 01:04:13.469914 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:04:13.470357 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:04:13.470684 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:04:13.470893 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:04:13.471118 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:04:13.471350 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:04:13.503090 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-08380ab7-be96-4f1e-966b-4edc781542b5 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:13.697642 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:04:13.727854 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:13.734428 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:04:13.758600 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Took 0.57 seconds to detach 1 volumes for instance.
May 28 01:04:13.761985 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Deleting volume: 48069396-3383-47de-ba84-d39b106a7dd3 {{(pid=98319) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 01:04:13.832724 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-08380ab7-be96-4f1e-966b-4edc781542b5 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:13.982567 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Took 7.21 seconds to spawn the instance on the hypervisor.
May 28 01:04:13.982790 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:13.998226 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-00e446eb-a066-43a3-9b57-5deeebddd6bb req-47e1883f-7fc7-40a5-aa2c-853f5ee42304 service nova] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Received event network-vif-deleted-3ed3d348-6b93-4492-9c18-7b0eecc6454a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:14.026202 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-08380ab7-be96-4f1e-966b-4edc781542b5 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Updating instance_info_cache with network_info: [{"id": "79122524-4b9f-46c3-91ad-d723f1829ed6", "address": "fa:16:3e:45:bd:f8", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79122524-4b", "ovs_interfaceid": "79122524-4b9f-46c3-91ad-d723f1829ed6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:04:14.200313 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Took 1.28 seconds to deallocate network for instance.
May 28 01:04:14.238099 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:04:14.238099 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930254.2367854, b132a198-b7d3-43ed-9cf1-02b4dc303777 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:04:14.238099 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] VM Paused (Lifecycle Event)
May 28 01:04:14.242756 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:14.324292 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:14.324292 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:14.325425 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:14.394874 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Deleted allocations for instance 0ad69caa-c797-4e9d-96e3-7ad63523be49
May 28 01:04:14.495939 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Took 13.01 seconds to build instance.
May 28 01:04:14.528596 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-08380ab7-be96-4f1e-966b-4edc781542b5 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Releasing lock "refresh_cache-8c35bc03-1899-4eb9-aefe-0bd301686dcf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:04:14.528704 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-08380ab7-be96-4f1e-966b-4edc781542b5 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lazy-loading 'flavor' on Instance uuid 8c35bc03-1899-4eb9-aefe-0bd301686dcf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:14.584942 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-854c1dba-7120-43d4-99aa-c1112be4b043 req-b63aefff-ac93-41d7-b311-2dca60dc5dae service nova] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Received event network-vif-plugged-9186af50-c5dc-44b8-b22d-c328072bf150 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:14.584942 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-854c1dba-7120-43d4-99aa-c1112be4b043 req-b63aefff-ac93-41d7-b311-2dca60dc5dae service nova] Acquiring lock "b132a198-b7d3-43ed-9cf1-02b4dc303777-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:14.584942 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-854c1dba-7120-43d4-99aa-c1112be4b043 req-b63aefff-ac93-41d7-b311-2dca60dc5dae service nova] Lock "b132a198-b7d3-43ed-9cf1-02b4dc303777-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:14.585226 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-854c1dba-7120-43d4-99aa-c1112be4b043 req-b63aefff-ac93-41d7-b311-2dca60dc5dae service nova] Lock "b132a198-b7d3-43ed-9cf1-02b4dc303777-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:14.585258 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-854c1dba-7120-43d4-99aa-c1112be4b043 req-b63aefff-ac93-41d7-b311-2dca60dc5dae service nova] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] No waiting events found dispatching network-vif-plugged-9186af50-c5dc-44b8-b22d-c328072bf150 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:14.585403 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-854c1dba-7120-43d4-99aa-c1112be4b043 req-b63aefff-ac93-41d7-b311-2dca60dc5dae service nova] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Received unexpected event network-vif-plugged-9186af50-c5dc-44b8-b22d-c328072bf150 for instance with vm_state active and task_state None.
May 28 01:04:14.714420 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-80cd9fc2-cd36-4f46-a300-9fe4d555ffa3 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:14.714420 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-80cd9fc2-cd36-4f46-a300-9fe4d555ffa3 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:14.739540 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:14.742699 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930254.7422483, b132a198-b7d3-43ed-9cf1-02b4dc303777 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:04:14.742699 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] VM Resumed (Lifecycle Event)
May 28 01:04:14.999983 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Lock "b132a198-b7d3-43ed-9cf1-02b4dc303777" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.528s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:15.060539 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:15.064844 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ff09616c-50fc-4c17-a58f-ebe7773a5bfb tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "27a2f570-fa9f-4f8d-8b04-b485a51b63cb" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:15.064844 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ff09616c-50fc-4c17-a58f-ebe7773a5bfb tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "27a2f570-fa9f-4f8d-8b04-b485a51b63cb" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:15.064844 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ff09616c-50fc-4c17-a58f-ebe7773a5bfb tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:15.064844 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:15.076289 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ff09616c-50fc-4c17-a58f-ebe7773a5bfb tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98319) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 28 01:04:15.076812 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ff09616c-50fc-4c17-a58f-ebe7773a5bfb tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lazy-loading 'flavor' on Instance uuid 27a2f570-fa9f-4f8d-8b04-b485a51b63cb {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:15.090291 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:15.237089 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:15.245940 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:15.246490 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:15.251503 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: deleting, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:04:15.266371 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-977893ec-e02f-4d31-9350-390e5542ce02 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Acquiring lock "b132a198-b7d3-43ed-9cf1-02b4dc303777" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:15.266614 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-977893ec-e02f-4d31-9350-390e5542ce02 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Lock "b132a198-b7d3-43ed-9cf1-02b4dc303777" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:15.266839 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-977893ec-e02f-4d31-9350-390e5542ce02 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Acquiring lock "b132a198-b7d3-43ed-9cf1-02b4dc303777-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:15.267033 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-977893ec-e02f-4d31-9350-390e5542ce02 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Lock "b132a198-b7d3-43ed-9cf1-02b4dc303777-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:15.267204 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-977893ec-e02f-4d31-9350-390e5542ce02 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Lock "b132a198-b7d3-43ed-9cf1-02b4dc303777-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:15.275012 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-977893ec-e02f-4d31-9350-390e5542ce02 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Terminating instance
May 28 01:04:15.298627 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1548952e-1f26-4bcd-9f05-9305460858ee req-8f86dc99-b9f9-4d00-90e3-6a073a5f110d service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Received event network-vif-unplugged-79122524-4b9f-46c3-91ad-d723f1829ed6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:15.301368 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1548952e-1f26-4bcd-9f05-9305460858ee req-8f86dc99-b9f9-4d00-90e3-6a073a5f110d service nova] Acquiring lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:15.301620 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1548952e-1f26-4bcd-9f05-9305460858ee req-8f86dc99-b9f9-4d00-90e3-6a073a5f110d service nova] Lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:15.301806 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1548952e-1f26-4bcd-9f05-9305460858ee req-8f86dc99-b9f9-4d00-90e3-6a073a5f110d service nova] Lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:15.301923 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1548952e-1f26-4bcd-9f05-9305460858ee req-8f86dc99-b9f9-4d00-90e3-6a073a5f110d service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] No waiting events found dispatching network-vif-unplugged-79122524-4b9f-46c3-91ad-d723f1829ed6 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:15.302159 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-1548952e-1f26-4bcd-9f05-9305460858ee req-8f86dc99-b9f9-4d00-90e3-6a073a5f110d service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Received unexpected event network-vif-unplugged-79122524-4b9f-46c3-91ad-d723f1829ed6 for instance with vm_state rescued and task_state unrescuing.
May 28 01:04:15.302942 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-80cd9fc2-cd36-4f46-a300-9fe4d555ffa3 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:04:15.303150 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-80cd9fc2-cd36-4f46-a300-9fe4d555ffa3 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:04:15.345728 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:15.381704 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:15.388712 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:15.397048 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Instance destroyed successfully.
May 28 01:04:15.397242 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-08380ab7-be96-4f1e-966b-4edc781542b5 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lazy-loading 'numa_topology' on Instance uuid 8c35bc03-1899-4eb9-aefe-0bd301686dcf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:15.404399 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bdfe4560-411b-441a-98c8-865f2dc7a2ce tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "0ad69caa-c797-4e9d-96e3-7ad63523be49" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.333s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:15.416956 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:15.499203 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:15.504348 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:15.629020 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:15.634714 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:15.752776 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] During sync_power_state the instance has a pending task (deleting). Skip.
May 28 01:04:15.753040 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999878152999827 future=<Future at 0x7c98704aebd0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:15.780052 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-977893ec-e02f-4d31-9350-390e5542ce02 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:04:15.805676 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-80cd9fc2-cd36-4f46-a300-9fe4d555ffa3 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:04:15.811904 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:15.826316 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:15.836870 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-08380ab7-be96-4f1e-966b-4edc781542b5 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Object Instance<8c35bc03-1899-4eb9-aefe-0bd301686dcf> lazy-loaded attributes: flavor,numa_topology {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0003654229999483505 future=<Future at 0x7c984c7c29c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0001666429998294916 future=<Future at 0x7c987044b230 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00027351199969416484 future=<Future at 0x7c987044b230 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0005186490002415667 future=<Future at 0x7c984c645cd0 state=cancelled>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0005966749999970489 future=<Future at 0x7c984c645cd0 state=cancelled>) was cancelled while queued, skipping {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Emitting event <LifecycleEvent: 1779930241.00781, a9122d01-9c31-48d3-ae6b-e2d6305fe8d7 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Emitting event <LifecycleEvent: 1779930241.0082064, 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=0.039643271999921126 future=<Future at 0x7c984c60fd10 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] VM Stopped (Lifecycle Event)
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] VM Stopped (Lifecycle Event)
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=0.03652732599994124 future=<Future at 0x7c984c60fd10 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0003049380002266844 future=<Future at 0x7c984c60fd10 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Emitting event <LifecycleEvent: 1779930241.0490086, 04880ef4-5eee-4221-ad42-29788eb26358 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] VM Stopped (Lifecycle Event)
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=9.138199045999954 future=<Future at 0x7c9870301dc0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=9.138104239999848 future=<Future at 0x7c9870301dc0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999557234999884 future=<Future at 0x7c987047d550 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Instance destroyed successfully.
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-977893ec-e02f-4d31-9350-390e5542ce02 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Lazy-loading 'resources' on Instance uuid b132a198-b7d3-43ed-9cf1-02b4dc303777 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-80cd9fc2-cd36-4f46-a300-9fe4d555ffa3 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.602s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-80cd9fc2-cd36-4f46-a300-9fe4d555ffa3 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Deleted allocations for instance d87bb95b-a1e9-4786-8bee-16f2cfaabf2d
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 5fdc5f38-de42-4fc0-adfe-fbbf9f967c2b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: a9122d01-9c31-48d3-ae6b-e2d6305fe8d7] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999732802999915 future=<Future at 0x7c984c436870 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Instance destroyed successfully.
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ff09616c-50fc-4c17-a58f-ebe7773a5bfb tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lazy-loading 'numa_topology' on Instance uuid 27a2f570-fa9f-4f8d-8b04-b485a51b63cb {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 04880ef4-5eee-4221-ad42-29788eb26358] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:16.694812 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:16.731356 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:16.733727 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-977893ec-e02f-4d31-9350-390e5542ce02 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:03:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-133365162',display_name='tempest-VolumesNegativeTest-instance-133365162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumesnegativetest-instance-133365162',id=40,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:04:13Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf8fd62d51094eaaa9813f70672aa7da',ramdisk_id='',reservation_id='r-0erp5ixb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-26292438',owner_user_name='tempest-VolumesNegativeTest-26292438-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:04:14Z,user_data=None,user_id='37ed4dda77f54e819033eff381c1b724',uuid=b132a198-b7d3-43ed-9cf1-02b4dc303777,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9186af50-c5dc-44b8-b22d-c328072bf150", "address": "fa:16:3e:d3:94:9b", "network": {"id": "691a7343-2e9f-4fcd-b4b0-4acd54dcf670", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93c8070b691d4f708f2391bfb8de6d61", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9186af50-c5", "ovs_interfaceid": "9186af50-c5dc-44b8-b22d-c328072bf150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:04:16.733867 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-977893ec-e02f-4d31-9350-390e5542ce02 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Converting VIF {"id": "9186af50-c5dc-44b8-b22d-c328072bf150", "address": "fa:16:3e:d3:94:9b", "network": {"id": "691a7343-2e9f-4fcd-b4b0-4acd54dcf670", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93c8070b691d4f708f2391bfb8de6d61", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9186af50-c5", "ovs_interfaceid": "9186af50-c5dc-44b8-b22d-c328072bf150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:04:16.734356 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-977893ec-e02f-4d31-9350-390e5542ce02 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:94:9b,bridge_name='br-int',has_traffic_filtering=True,id=9186af50-c5dc-44b8-b22d-c328072bf150,network=Network(691a7343-2e9f-4fcd-b4b0-4acd54dcf670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9186af50-c5') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:04:16.734535 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-977893ec-e02f-4d31-9350-390e5542ce02 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:94:9b,bridge_name='br-int',has_traffic_filtering=True,id=9186af50-c5dc-44b8-b22d-c328072bf150,network=Network(691a7343-2e9f-4fcd-b4b0-4acd54dcf670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9186af50-c5') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:04:16.735257 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:16.735404 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9186af50-c5, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:16.736216 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:16.736977 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:16.750510 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:16.751391 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:16.751557 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=08f91560-d800-4c81-9d9f-506768775ae1) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:16.752305 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:16.752613 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:16.760870 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:16.762495 np0000001577 nova-compute[98319]: INFO os_vif [None req-977893ec-e02f-4d31-9350-390e5542ce02 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:94:9b,bridge_name='br-int',has_traffic_filtering=True,id=9186af50-c5dc-44b8-b22d-c328072bf150,network=Network(691a7343-2e9f-4fcd-b4b0-4acd54dcf670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9186af50-c5')
May 28 01:04:16.762816 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-977893ec-e02f-4d31-9350-390e5542ce02 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Deleting instance files /opt/stack/data/nova/instances/b132a198-b7d3-43ed-9cf1-02b4dc303777_del
May 28 01:04:16.763470 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-977893ec-e02f-4d31-9350-390e5542ce02 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Deletion of /opt/stack/data/nova/instances/b132a198-b7d3-43ed-9cf1-02b4dc303777_del complete
May 28 01:04:16.906932 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-470642e3-a50b-4ef3-b20d-13bcbef60834 req-3df9f1c1-3f16-45a5-9df6-f793f82913ea service nova] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Received event network-vif-unplugged-9186af50-c5dc-44b8-b22d-c328072bf150 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:16.907096 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-470642e3-a50b-4ef3-b20d-13bcbef60834 req-3df9f1c1-3f16-45a5-9df6-f793f82913ea service nova] Acquiring lock "b132a198-b7d3-43ed-9cf1-02b4dc303777-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:16.907867 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-470642e3-a50b-4ef3-b20d-13bcbef60834 req-3df9f1c1-3f16-45a5-9df6-f793f82913ea service nova] Lock "b132a198-b7d3-43ed-9cf1-02b4dc303777-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:16.908049 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-470642e3-a50b-4ef3-b20d-13bcbef60834 req-3df9f1c1-3f16-45a5-9df6-f793f82913ea service nova] Lock "b132a198-b7d3-43ed-9cf1-02b4dc303777-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:16.908049 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-470642e3-a50b-4ef3-b20d-13bcbef60834 req-3df9f1c1-3f16-45a5-9df6-f793f82913ea service nova] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] No waiting events found dispatching network-vif-unplugged-9186af50-c5dc-44b8-b22d-c328072bf150 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:16.908265 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-470642e3-a50b-4ef3-b20d-13bcbef60834 req-3df9f1c1-3f16-45a5-9df6-f793f82913ea service nova] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Received event network-vif-unplugged-9186af50-c5dc-44b8-b22d-c328072bf150 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:04:17.041336 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:17.054368 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-ff09616c-50fc-4c17-a58f-ebe7773a5bfb tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Object Instance<27a2f570-fa9f-4f8d-8b04-b485a51b63cb> lazy-loaded attributes: flavor,numa_topology {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:04:17.054570 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ff09616c-50fc-4c17-a58f-ebe7773a5bfb tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:17.271586 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-977893ec-e02f-4d31-9350-390e5542ce02 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Took 1.49 seconds to destroy the instance on the hypervisor.
May 28 01:04:17.271662 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-977893ec-e02f-4d31-9350-390e5542ce02 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:04:17.271944 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:04:17.272043 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:04:17.272267 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:17.301702 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-08380ab7-be96-4f1e-966b-4edc781542b5 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:17.303258 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Removed pending STOPPED event for 8c35bc03-1899-4eb9-aefe-0bd301686dcf due to new event <LifecycleEvent: 1779930257.3023286, 8c35bc03-1899-4eb9-aefe-0bd301686dcf => Resumed> {{(pid=98319) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 01:04:17.303737 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930257.3023286, 8c35bc03-1899-4eb9-aefe-0bd301686dcf => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:04:17.303935 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] VM Resumed (Lifecycle Event)
May 28 01:04:17.339155 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:17.368516 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-80cd9fc2-cd36-4f46-a300-9fe4d555ffa3 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d87bb95b-a1e9-4786-8bee-16f2cfaabf2d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.519s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:17.398237 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f393408d-bd69-4956-8703-ac9c1f7d05d7 req-8f7eaca2-e6bb-4d55-ba40-0e69f8a547de service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Received event network-vif-unplugged-79122524-4b9f-46c3-91ad-d723f1829ed6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:17.398378 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f393408d-bd69-4956-8703-ac9c1f7d05d7 req-8f7eaca2-e6bb-4d55-ba40-0e69f8a547de service nova] Acquiring lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:17.398534 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f393408d-bd69-4956-8703-ac9c1f7d05d7 req-8f7eaca2-e6bb-4d55-ba40-0e69f8a547de service nova] Lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:17.398641 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f393408d-bd69-4956-8703-ac9c1f7d05d7 req-8f7eaca2-e6bb-4d55-ba40-0e69f8a547de service nova] Lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:17.398752 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f393408d-bd69-4956-8703-ac9c1f7d05d7 req-8f7eaca2-e6bb-4d55-ba40-0e69f8a547de service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] No waiting events found dispatching network-vif-unplugged-79122524-4b9f-46c3-91ad-d723f1829ed6 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:17.399116 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-f393408d-bd69-4956-8703-ac9c1f7d05d7 req-8f7eaca2-e6bb-4d55-ba40-0e69f8a547de service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Received unexpected event network-vif-unplugged-79122524-4b9f-46c3-91ad-d723f1829ed6 for instance with vm_state active and task_state None.
May 28 01:04:17.399235 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f393408d-bd69-4956-8703-ac9c1f7d05d7 req-8f7eaca2-e6bb-4d55-ba40-0e69f8a547de service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Received event network-vif-plugged-79122524-4b9f-46c3-91ad-d723f1829ed6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:17.399366 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f393408d-bd69-4956-8703-ac9c1f7d05d7 req-8f7eaca2-e6bb-4d55-ba40-0e69f8a547de service nova] Acquiring lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:17.399488 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f393408d-bd69-4956-8703-ac9c1f7d05d7 req-8f7eaca2-e6bb-4d55-ba40-0e69f8a547de service nova] Lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:17.399616 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f393408d-bd69-4956-8703-ac9c1f7d05d7 req-8f7eaca2-e6bb-4d55-ba40-0e69f8a547de service nova] Lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:17.399714 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f393408d-bd69-4956-8703-ac9c1f7d05d7 req-8f7eaca2-e6bb-4d55-ba40-0e69f8a547de service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] No waiting events found dispatching network-vif-plugged-79122524-4b9f-46c3-91ad-d723f1829ed6 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:17.399808 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-f393408d-bd69-4956-8703-ac9c1f7d05d7 req-8f7eaca2-e6bb-4d55-ba40-0e69f8a547de service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Received unexpected event network-vif-plugged-79122524-4b9f-46c3-91ad-d723f1829ed6 for instance with vm_state active and task_state None.
May 28 01:04:17.399927 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f393408d-bd69-4956-8703-ac9c1f7d05d7 req-8f7eaca2-e6bb-4d55-ba40-0e69f8a547de service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Received event network-vif-plugged-79122524-4b9f-46c3-91ad-d723f1829ed6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:17.400001 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f393408d-bd69-4956-8703-ac9c1f7d05d7 req-8f7eaca2-e6bb-4d55-ba40-0e69f8a547de service nova] Acquiring lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:17.400162 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f393408d-bd69-4956-8703-ac9c1f7d05d7 req-8f7eaca2-e6bb-4d55-ba40-0e69f8a547de service nova] Lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:17.400211 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f393408d-bd69-4956-8703-ac9c1f7d05d7 req-8f7eaca2-e6bb-4d55-ba40-0e69f8a547de service nova] Lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:17.400304 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f393408d-bd69-4956-8703-ac9c1f7d05d7 req-8f7eaca2-e6bb-4d55-ba40-0e69f8a547de service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] No waiting events found dispatching network-vif-plugged-79122524-4b9f-46c3-91ad-d723f1829ed6 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:17.400451 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-f393408d-bd69-4956-8703-ac9c1f7d05d7 req-8f7eaca2-e6bb-4d55-ba40-0e69f8a547de service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Received unexpected event network-vif-plugged-79122524-4b9f-46c3-91ad-d723f1829ed6 for instance with vm_state active and task_state None.
May 28 01:04:17.400613 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f393408d-bd69-4956-8703-ac9c1f7d05d7 req-8f7eaca2-e6bb-4d55-ba40-0e69f8a547de service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Received event network-vif-unplugged-79122524-4b9f-46c3-91ad-d723f1829ed6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:17.400613 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f393408d-bd69-4956-8703-ac9c1f7d05d7 req-8f7eaca2-e6bb-4d55-ba40-0e69f8a547de service nova] Acquiring lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:17.400711 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f393408d-bd69-4956-8703-ac9c1f7d05d7 req-8f7eaca2-e6bb-4d55-ba40-0e69f8a547de service nova] Lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:17.400797 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f393408d-bd69-4956-8703-ac9c1f7d05d7 req-8f7eaca2-e6bb-4d55-ba40-0e69f8a547de service nova] Lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:17.400886 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f393408d-bd69-4956-8703-ac9c1f7d05d7 req-8f7eaca2-e6bb-4d55-ba40-0e69f8a547de service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] No waiting events found dispatching network-vif-unplugged-79122524-4b9f-46c3-91ad-d723f1829ed6 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:17.400993 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-f393408d-bd69-4956-8703-ac9c1f7d05d7 req-8f7eaca2-e6bb-4d55-ba40-0e69f8a547de service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Received unexpected event network-vif-unplugged-79122524-4b9f-46c3-91ad-d723f1829ed6 for instance with vm_state active and task_state None.
May 28 01:04:17.401078 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f393408d-bd69-4956-8703-ac9c1f7d05d7 req-8f7eaca2-e6bb-4d55-ba40-0e69f8a547de service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Received event network-vif-unplugged-79122524-4b9f-46c3-91ad-d723f1829ed6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:17.401190 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f393408d-bd69-4956-8703-ac9c1f7d05d7 req-8f7eaca2-e6bb-4d55-ba40-0e69f8a547de service nova] Acquiring lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:17.401308 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f393408d-bd69-4956-8703-ac9c1f7d05d7 req-8f7eaca2-e6bb-4d55-ba40-0e69f8a547de service nova] Lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:17.401399 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f393408d-bd69-4956-8703-ac9c1f7d05d7 req-8f7eaca2-e6bb-4d55-ba40-0e69f8a547de service nova] Lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:17.401486 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f393408d-bd69-4956-8703-ac9c1f7d05d7 req-8f7eaca2-e6bb-4d55-ba40-0e69f8a547de service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] No waiting events found dispatching network-vif-unplugged-79122524-4b9f-46c3-91ad-d723f1829ed6 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:17.401614 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-f393408d-bd69-4956-8703-ac9c1f7d05d7 req-8f7eaca2-e6bb-4d55-ba40-0e69f8a547de service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Received unexpected event network-vif-unplugged-79122524-4b9f-46c3-91ad-d723f1829ed6 for instance with vm_state active and task_state None.
May 28 01:04:17.480342 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-76790590-1799-4c4a-aaae-3ae2c4adfaed tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "f2b64af8-9a7b-4726-b298-cf9d2cb24498" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:17.480342 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-76790590-1799-4c4a-aaae-3ae2c4adfaed tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "f2b64af8-9a7b-4726-b298-cf9d2cb24498" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:17.480342 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-76790590-1799-4c4a-aaae-3ae2c4adfaed tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "f2b64af8-9a7b-4726-b298-cf9d2cb24498-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:17.480342 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-76790590-1799-4c4a-aaae-3ae2c4adfaed tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "f2b64af8-9a7b-4726-b298-cf9d2cb24498-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:17.480342 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-76790590-1799-4c4a-aaae-3ae2c4adfaed tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "f2b64af8-9a7b-4726-b298-cf9d2cb24498-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:17.484243 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-76790590-1799-4c4a-aaae-3ae2c4adfaed tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Terminating instance
May 28 01:04:17.565773 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ff09616c-50fc-4c17-a58f-ebe7773a5bfb tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "27a2f570-fa9f-4f8d-8b04-b485a51b63cb" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.504s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:17.806098 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:17.808156 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:04:17.988189 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-76790590-1799-4c4a-aaae-3ae2c4adfaed tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:04:18.019007 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:18.034597 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:18.041188 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:18.060243 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:18.068557 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:18.103638 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:04:18.163972 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:18.164142 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:18.164299 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:18.164408 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:18.164526 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:18.166613 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Terminating instance
May 28 01:04:18.305127 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:18.315008 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] During sync_power_state the instance has a pending task (deleting). Skip.
May 28 01:04:18.315008 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930258.3134065, 8c35bc03-1899-4eb9-aefe-0bd301686dcf => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:04:18.315008 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] VM Started (Lifecycle Event)
May 28 01:04:18.326491 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Instance destroyed successfully.
May 28 01:04:18.328882 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-76790590-1799-4c4a-aaae-3ae2c4adfaed tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lazy-loading 'resources' on Instance uuid f2b64af8-9a7b-4726-b298-cf9d2cb24498 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:18.606084 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Took 1.33 seconds to deallocate network for instance.
May 28 01:04:18.671304 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:04:18.684327 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:18.699505 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:18.701634 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:18.724011 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:18.816091 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:18.831360 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-76790590-1799-4c4a-aaae-3ae2c4adfaed tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2083714749',display_name='tempest-ServerActionsTestOtherA-server-2083714749',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serveractionstestothera-server-2083714749',id=18,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOEhInnYH8OIPIS+AoDN91vRrTIl7emQTWVv1MQvwyvOos+qsDslhGKWhjOWQnKEu789RlRl8BiqEdHw4m/ZZapwhCdnQdK7FOovVNbbHnETkK3QhUrm9lcqluHt42QLQ==',key_name='tempest-keypair-1959255291',keypairs=<?>,launch_index=0,launched_at=2026-05-28T00:59:41Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73ee6b376bb14dffb5664085cca58288',ramdisk_id='',reservation_id='r-y1a0eolr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1279266727',owner_user_name='tempest-ServerActionsTestOtherA-1279266727-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T00:59:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84e218b589ef4968828db0c740eaa72b',uuid=f2b64af8-9a7b-4726-b298-cf9d2cb24498,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4bd7989d-5591-41bb-a6e4-29c3a6aa27de", "address": "fa:16:3e:12:3f:51", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bd7989d-55", "ovs_interfaceid": "4bd7989d-5591-41bb-a6e4-29c3a6aa27de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:04:18.831517 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-76790590-1799-4c4a-aaae-3ae2c4adfaed tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Converting VIF {"id": "4bd7989d-5591-41bb-a6e4-29c3a6aa27de", "address": "fa:16:3e:12:3f:51", "network": {"id": "1012e082-bfb1-4637-a516-004f5ee1ec1a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1876212854-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73ee6b376bb14dffb5664085cca58288", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bd7989d-55", "ovs_interfaceid": "4bd7989d-5591-41bb-a6e4-29c3a6aa27de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:04:18.831972 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-76790590-1799-4c4a-aaae-3ae2c4adfaed tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:3f:51,bridge_name='br-int',has_traffic_filtering=True,id=4bd7989d-5591-41bb-a6e4-29c3a6aa27de,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bd7989d-55') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:04:18.832180 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-76790590-1799-4c4a-aaae-3ae2c4adfaed tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:3f:51,bridge_name='br-int',has_traffic_filtering=True,id=4bd7989d-5591-41bb-a6e4-29c3a6aa27de,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bd7989d-55') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:04:18.833044 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:18.833333 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4bd7989d-55, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:18.834321 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:18.835030 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:18.835497 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:18.843040 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:18.843766 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:18.843894 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=34320d3e-590d-440b-be54-4ad2e460d443) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:18.844281 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:18.844710 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:18.850741 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:18.859383 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:18.861096 np0000001577 nova-compute[98319]: INFO os_vif [None req-76790590-1799-4c4a-aaae-3ae2c4adfaed tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:3f:51,bridge_name='br-int',has_traffic_filtering=True,id=4bd7989d-5591-41bb-a6e4-29c3a6aa27de,network=Network(1012e082-bfb1-4637-a516-004f5ee1ec1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bd7989d-55')
May 28 01:04:18.861366 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-76790590-1799-4c4a-aaae-3ae2c4adfaed tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Deleting instance files /opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498_del
May 28 01:04:18.862021 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-76790590-1799-4c4a-aaae-3ae2c4adfaed tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Deletion of /opt/stack/data/nova/instances/f2b64af8-9a7b-4726-b298-cf9d2cb24498_del complete
May 28 01:04:18.877109 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999786362000123 future=<Future at 0x7c988c034440 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:18.961106 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4cefa215-caca-4f77-92c8-78dcd292e809 req-af89d5c2-8a85-4774-bad2-d866c25819dd service nova] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Received event network-vif-unplugged-9186af50-c5dc-44b8-b22d-c328072bf150 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:18.961956 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4cefa215-caca-4f77-92c8-78dcd292e809 req-af89d5c2-8a85-4774-bad2-d866c25819dd service nova] Acquiring lock "b132a198-b7d3-43ed-9cf1-02b4dc303777-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:18.961956 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4cefa215-caca-4f77-92c8-78dcd292e809 req-af89d5c2-8a85-4774-bad2-d866c25819dd service nova] Lock "b132a198-b7d3-43ed-9cf1-02b4dc303777-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:18.961956 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4cefa215-caca-4f77-92c8-78dcd292e809 req-af89d5c2-8a85-4774-bad2-d866c25819dd service nova] Lock "b132a198-b7d3-43ed-9cf1-02b4dc303777-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:18.961956 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4cefa215-caca-4f77-92c8-78dcd292e809 req-af89d5c2-8a85-4774-bad2-d866c25819dd service nova] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] No waiting events found dispatching network-vif-unplugged-9186af50-c5dc-44b8-b22d-c328072bf150 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:18.962248 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-4cefa215-caca-4f77-92c8-78dcd292e809 req-af89d5c2-8a85-4774-bad2-d866c25819dd service nova] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Received unexpected event network-vif-unplugged-9186af50-c5dc-44b8-b22d-c328072bf150 for instance with vm_state deleted and task_state None.
May 28 01:04:18.962248 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4cefa215-caca-4f77-92c8-78dcd292e809 req-af89d5c2-8a85-4774-bad2-d866c25819dd service nova] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Received event network-vif-unplugged-a2072e10-c933-4dd6-84e1-43734392b12e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:18.962437 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4cefa215-caca-4f77-92c8-78dcd292e809 req-af89d5c2-8a85-4774-bad2-d866c25819dd service nova] Acquiring lock "27a2f570-fa9f-4f8d-8b04-b485a51b63cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:18.962563 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4cefa215-caca-4f77-92c8-78dcd292e809 req-af89d5c2-8a85-4774-bad2-d866c25819dd service nova] Lock "27a2f570-fa9f-4f8d-8b04-b485a51b63cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:18.962706 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4cefa215-caca-4f77-92c8-78dcd292e809 req-af89d5c2-8a85-4774-bad2-d866c25819dd service nova] Lock "27a2f570-fa9f-4f8d-8b04-b485a51b63cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:18.962951 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4cefa215-caca-4f77-92c8-78dcd292e809 req-af89d5c2-8a85-4774-bad2-d866c25819dd service nova] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] No waiting events found dispatching network-vif-unplugged-a2072e10-c933-4dd6-84e1-43734392b12e {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:18.963045 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-4cefa215-caca-4f77-92c8-78dcd292e809 req-af89d5c2-8a85-4774-bad2-d866c25819dd service nova] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Received unexpected event network-vif-unplugged-a2072e10-c933-4dd6-84e1-43734392b12e for instance with vm_state stopped and task_state powering-on.
May 28 01:04:18.963115 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4cefa215-caca-4f77-92c8-78dcd292e809 req-af89d5c2-8a85-4774-bad2-d866c25819dd service nova] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Received event network-vif-unplugged-a2072e10-c933-4dd6-84e1-43734392b12e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:18.963286 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4cefa215-caca-4f77-92c8-78dcd292e809 req-af89d5c2-8a85-4774-bad2-d866c25819dd service nova] Acquiring lock "27a2f570-fa9f-4f8d-8b04-b485a51b63cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:18.963437 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4cefa215-caca-4f77-92c8-78dcd292e809 req-af89d5c2-8a85-4774-bad2-d866c25819dd service nova] Lock "27a2f570-fa9f-4f8d-8b04-b485a51b63cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:18.963589 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4cefa215-caca-4f77-92c8-78dcd292e809 req-af89d5c2-8a85-4774-bad2-d866c25819dd service nova] Lock "27a2f570-fa9f-4f8d-8b04-b485a51b63cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:18.963724 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4cefa215-caca-4f77-92c8-78dcd292e809 req-af89d5c2-8a85-4774-bad2-d866c25819dd service nova] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] No waiting events found dispatching network-vif-unplugged-a2072e10-c933-4dd6-84e1-43734392b12e {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:18.963875 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-4cefa215-caca-4f77-92c8-78dcd292e809 req-af89d5c2-8a85-4774-bad2-d866c25819dd service nova] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Received unexpected event network-vif-unplugged-a2072e10-c933-4dd6-84e1-43734392b12e for instance with vm_state stopped and task_state powering-on.
May 28 01:04:18.964027 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4cefa215-caca-4f77-92c8-78dcd292e809 req-af89d5c2-8a85-4774-bad2-d866c25819dd service nova] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Received event network-vif-deleted-9186af50-c5dc-44b8-b22d-c328072bf150 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:18.986906 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999762417999591 future=<Future at 0x7c984c468c20 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:18.989532 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Instance destroyed successfully.
May 28 01:04:18.989797 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lazy-loading 'resources' on Instance uuid 8c35bc03-1899-4eb9-aefe-0bd301686dcf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:19.008602 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lazy-loading 'flavor' on Instance uuid 27a2f570-fa9f-4f8d-8b04-b485a51b63cb {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:19.113858 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-977893ec-e02f-4d31-9350-390e5542ce02 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:19.113858 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-977893ec-e02f-4d31-9350-390e5542ce02 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:19.370542 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-76790590-1799-4c4a-aaae-3ae2c4adfaed tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Took 1.38 seconds to destroy the instance on the hypervisor.
May 28 01:04:19.371148 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-76790590-1799-4c4a-aaae-3ae2c4adfaed tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:04:19.371526 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:04:19.371588 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:04:19.371774 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:19.440763 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:19.493898 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:03:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-307356266',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serverbootfromvolumestablerescuetest-server-307356266',id=38,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:04:11Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e28acf25c4445ea969bd7bca3eac146',ramdisk_id='',reservation_id='r-gieq9fco',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-568223226',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:04:17Z,user_data=None,user_id='fb6c20970bf0401190583f6348e00e4b',uuid=8c35bc03-1899-4eb9-aefe-0bd301686dcf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79122524-4b9f-46c3-91ad-d723f1829ed6", "address": "fa:16:3e:45:bd:f8", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79122524-4b", "ovs_interfaceid": "79122524-4b9f-46c3-91ad-d723f1829ed6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:04:19.493898 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Converting VIF {"id": "79122524-4b9f-46c3-91ad-d723f1829ed6", "address": "fa:16:3e:45:bd:f8", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap79122524-4b", "ovs_interfaceid": "79122524-4b9f-46c3-91ad-d723f1829ed6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:04:19.493898 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:bd:f8,bridge_name='br-int',has_traffic_filtering=True,id=79122524-4b9f-46c3-91ad-d723f1829ed6,network=Network(c25f8563-bd10-4e42-b4ce-fd2164eca324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79122524-4b') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:04:19.493898 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:bd:f8,bridge_name='br-int',has_traffic_filtering=True,id=79122524-4b9f-46c3-91ad-d723f1829ed6,network=Network(c25f8563-bd10-4e42-b4ce-fd2164eca324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79122524-4b') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:04:19.494294 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:19.494517 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79122524-4b, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:19.512444 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "refresh_cache-27a2f570-fa9f-4f8d-8b04-b485a51b63cb" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:04:19.512785 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:19.513596 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquired lock "refresh_cache-27a2f570-fa9f-4f8d-8b04-b485a51b63cb" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:04:19.513596 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:04:19.513596 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lazy-loading 'info_cache' on Instance uuid 27a2f570-fa9f-4f8d-8b04-b485a51b63cb {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:19.514990 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:19.518036 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:19.518036 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:19.518036 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=45c6f373-91a5-4dce-be43-e515091dfd7f) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:19.518036 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:19.518218 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:19.522905 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:19.525929 np0000001577 nova-compute[98319]: INFO os_vif [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:bd:f8,bridge_name='br-int',has_traffic_filtering=True,id=79122524-4b9f-46c3-91ad-d723f1829ed6,network=Network(c25f8563-bd10-4e42-b4ce-fd2164eca324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79122524-4b')
May 28 01:04:19.530208 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:04:19.530791 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-15'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:04:19.531136 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:04:19.531513 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:04:19.532578 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-15'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:04:19.533059 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:04:19.553851 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d03db1c7-62ec-41c8-8350-080115a7889f tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "d988b526-836d-48b8-a381-1f7679caf41d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:19.554028 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d03db1c7-62ec-41c8-8350-080115a7889f tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d988b526-836d-48b8-a381-1f7679caf41d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:19.554215 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d03db1c7-62ec-41c8-8350-080115a7889f tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "d988b526-836d-48b8-a381-1f7679caf41d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:19.554376 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d03db1c7-62ec-41c8-8350-080115a7889f tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d988b526-836d-48b8-a381-1f7679caf41d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:19.554514 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d03db1c7-62ec-41c8-8350-080115a7889f tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d988b526-836d-48b8-a381-1f7679caf41d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:19.556401 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-d03db1c7-62ec-41c8-8350-080115a7889f tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Terminating instance
May 28 01:04:19.564859 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:19.564859 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:19.564859 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:19.564859 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:19.564859 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:19.564859 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:19.564859 np0000001577 nova-compute[98319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:04:19.564859 np0000001577 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:04:19.564859 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:04:19.565203 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:19.565203 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:19.565203 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:19.565203 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:19.565203 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:19.565203 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:19.565203 np0000001577 nova-compute[98319]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:04:19.565203 np0000001577 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc (non-flash)
May 28 01:04:19.565203 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:04:19.565203 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', '63'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', '74'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', '75'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', '83')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:04:19.565578 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', '83')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:04:19.567873 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc', '82')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:04:19.568978 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c984c7771a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc'): ({'sds'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc'): ({'sdr'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:04:19.569291 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Removing multipathed devices sds, sdr {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:04:19.569530 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Flush multipath device 330000000742f72bb {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:04:19.639322 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Remove SCSI device /dev/sds with /sys/block/sds/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:04:19.695747 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Remove SCSI device /dev/sdr with /sys/block/sdr/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:04:19.696337 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-977893ec-e02f-4d31-9350-390e5542ce02 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:04:19.696637 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-977893ec-e02f-4d31-9350-390e5542ce02 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:04:19.745842 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Checking to see if SCSI volumes sds, sdr have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:04:19.745842 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] SCSI volumes sds, sdr have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:04:19.746691 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Checking to see if device paths {'sds', 'sdr'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:04:19.757184 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Device paths {'sds', 'sdr'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:04:19.757666 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:04:19.768941 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:19.806727 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 83, target: iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc, portal: 192.168.40.100,3260]
May 28 01:04:19.806727 np0000001577 nova-compute[98319]: Logout of [sid: 83, target: iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc, portal: 192.168.40.100,3260] successful.
May 28 01:04:19.806727 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:19.823354 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:19.833467 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:19.838432 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-3f76192b-fc10-4f8e-9507-bcf420bc7429 req-307b011c-fa1f-4553-a2a5-12eaf5951e56 service nova] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Received event network-vif-deleted-4bd7989d-5591-41bb-a6e4-29c3a6aa27de {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:19.838591 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-3f76192b-fc10-4f8e-9507-bcf420bc7429 req-307b011c-fa1f-4553-a2a5-12eaf5951e56 service nova] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Neutron deleted interface 4bd7989d-5591-41bb-a6e4-29c3a6aa27de; detaching it from the instance and deleting it from the info cache
May 28 01:04:19.839845 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-3f76192b-fc10-4f8e-9507-bcf420bc7429 req-307b011c-fa1f-4553-a2a5-12eaf5951e56 service nova] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Detach interface failed, port_id=4bd7989d-5591-41bb-a6e4-29c3a6aa27de, reason: Instance f2b64af8-9a7b-4726-b298-cf9d2cb24498 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:04:19.869366 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 82, target: iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc, portal: 192.168.50.100,3260]
May 28 01:04:19.869366 np0000001577 nova-compute[98319]: Logout of [sid: 82, target: iqn.2023-03.storpool.com:os--volume-5237f2a6-3d87-4be6-91c4-8adbc4a32fcc, portal: 192.168.50.100,3260] successful.
May 28 01:04:19.869366 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:19.884927 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:19.885168 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:04:19.885372 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] <== disconnect_volume: return (354ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:04:19.885434 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:04:19.885782 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Deleting instance files /opt/stack/data/nova/instances/8c35bc03-1899-4eb9-aefe-0bd301686dcf_del
May 28 01:04:19.886340 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Deletion of /opt/stack/data/nova/instances/8c35bc03-1899-4eb9-aefe-0bd301686dcf_del complete
May 28 01:04:19.965576 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:20.016492 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Object Instance<27a2f570-fa9f-4f8d-8b04-b485a51b63cb> lazy-loaded attributes: flavor,info_cache {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:04:20.060327 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-d03db1c7-62ec-41c8-8350-080115a7889f tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:04:20.083125 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:20.085088 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:20.106337 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:20.205298 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-977893ec-e02f-4d31-9350-390e5542ce02 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:04:20.241800 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:20.247443 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6617d8b8-b28b-4359-868b-e8b164bbc193 req-3abdbbe0-0b4c-4965-a85b-a0b895d4e29a service nova] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Received event network-vif-unplugged-d540d8c6-c40d-45db-a88e-e9b062d033fb {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:20.247654 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6617d8b8-b28b-4359-868b-e8b164bbc193 req-3abdbbe0-0b4c-4965-a85b-a0b895d4e29a service nova] Acquiring lock "d988b526-836d-48b8-a381-1f7679caf41d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:20.247741 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6617d8b8-b28b-4359-868b-e8b164bbc193 req-3abdbbe0-0b4c-4965-a85b-a0b895d4e29a service nova] Lock "d988b526-836d-48b8-a381-1f7679caf41d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:20.247835 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6617d8b8-b28b-4359-868b-e8b164bbc193 req-3abdbbe0-0b4c-4965-a85b-a0b895d4e29a service nova] Lock "d988b526-836d-48b8-a381-1f7679caf41d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:20.247979 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6617d8b8-b28b-4359-868b-e8b164bbc193 req-3abdbbe0-0b4c-4965-a85b-a0b895d4e29a service nova] [instance: d988b526-836d-48b8-a381-1f7679caf41d] No waiting events found dispatching network-vif-unplugged-d540d8c6-c40d-45db-a88e-e9b062d033fb {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:20.248112 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6617d8b8-b28b-4359-868b-e8b164bbc193 req-3abdbbe0-0b4c-4965-a85b-a0b895d4e29a service nova] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Received event network-vif-unplugged-d540d8c6-c40d-45db-a88e-e9b062d033fb for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:04:20.252754 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:20.279694 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:04:20.383009 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999723364999682 future=<Future at 0x7c98704ac4d0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:20.384896 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Instance destroyed successfully.
May 28 01:04:20.385248 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-d03db1c7-62ec-41c8-8350-080115a7889f tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lazy-loading 'resources' on Instance uuid d988b526-836d-48b8-a381-1f7679caf41d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:20.393663 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Took 1.72 seconds to destroy the instance on the hypervisor.
May 28 01:04:20.394369 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:04:20.394709 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:04:20.394821 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:04:20.395248 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:20.515188 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:20.519137 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:20.713514 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-977893ec-e02f-4d31-9350-390e5542ce02 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.600s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:20.775724 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-977893ec-e02f-4d31-9350-390e5542ce02 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Deleted allocations for instance b132a198-b7d3-43ed-9cf1-02b4dc303777
May 28 01:04:20.781632 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Took 1.41 seconds to deallocate network for instance.
May 28 01:04:20.887649 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-d03db1c7-62ec-41c8-8350-080115a7889f tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:59:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='multiattach-server-1',id=14,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7fHo3fyBWUybZxdNVpYEXXxMYY3ACB7D4odfvDXtuf5uMmk/o2XggiQakoJbwdRCXKjpHaMcmXgSyAS8x+3bDHMUWn1qlznnyXp/nDVRmoqTgLFpV2Do6YlUuA3zZ+mw==',key_name='tempest-keypair-627531643',keypairs=<?>,launch_index=0,launched_at=2026-05-28T00:59:25Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='938c2829112843edb2054984e80ce7ad',ramdisk_id='',reservation_id='r-i9lqjheh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-89204095',owner_user_name='tempest-AttachVolumeMultiAttachTest-89204095-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T00:59:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8586a18edcf42cab0a60028135ae401',uuid=d988b526-836d-48b8-a381-1f7679caf41d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d540d8c6-c40d-45db-a88e-e9b062d033fb", "address": "fa:16:3e:ca:a8:31", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd540d8c6-c4", "ovs_interfaceid": "d540d8c6-c40d-45db-a88e-e9b062d033fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:04:20.888245 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-d03db1c7-62ec-41c8-8350-080115a7889f tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converting VIF {"id": "d540d8c6-c40d-45db-a88e-e9b062d033fb", "address": "fa:16:3e:ca:a8:31", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd540d8c6-c4", "ovs_interfaceid": "d540d8c6-c40d-45db-a88e-e9b062d033fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:04:20.888391 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-d03db1c7-62ec-41c8-8350-080115a7889f tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:a8:31,bridge_name='br-int',has_traffic_filtering=True,id=d540d8c6-c40d-45db-a88e-e9b062d033fb,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd540d8c6-c4') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:04:20.888681 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-d03db1c7-62ec-41c8-8350-080115a7889f tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:a8:31,bridge_name='br-int',has_traffic_filtering=True,id=d540d8c6-c40d-45db-a88e-e9b062d033fb,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd540d8c6-c4') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:04:20.890304 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:20.890304 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd540d8c6-c4, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:20.894501 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:20.895480 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:20.902891 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:20.903168 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:20.903347 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7ef08e59-1e12-416c-ade9-60cf8dce3763) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:20.905120 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:20.905805 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:20.911167 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:20.913130 np0000001577 nova-compute[98319]: INFO os_vif [None req-d03db1c7-62ec-41c8-8350-080115a7889f tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:a8:31,bridge_name='br-int',has_traffic_filtering=True,id=d540d8c6-c40d-45db-a88e-e9b062d033fb,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd540d8c6-c4')
May 28 01:04:20.913558 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d03db1c7-62ec-41c8-8350-080115a7889f tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Deleting instance files /opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d_del
May 28 01:04:20.914330 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d03db1c7-62ec-41c8-8350-080115a7889f tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Deletion of /opt/stack/data/nova/instances/d988b526-836d-48b8-a381-1f7679caf41d_del complete
May 28 01:04:20.968249 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:21.159535 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Updating instance_info_cache with network_info: [{"id": "a2072e10-c933-4dd6-84e1-43734392b12e", "address": "fa:16:3e:29:2a:08", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2072e10-c9", "ovs_interfaceid": "a2072e10-c933-4dd6-84e1-43734392b12e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:04:21.243009 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:21.251344 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:04:21.291373 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-76790590-1799-4c4a-aaae-3ae2c4adfaed tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:21.291980 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-76790590-1799-4c4a-aaae-3ae2c4adfaed tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:21.420301 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-d03db1c7-62ec-41c8-8350-080115a7889f tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Took 1.36 seconds to destroy the instance on the hypervisor.
May 28 01:04:21.421370 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-d03db1c7-62ec-41c8-8350-080115a7889f tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:04:21.421787 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:04:21.421947 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: d988b526-836d-48b8-a381-1f7679caf41d] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:04:21.422500 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:21.549751 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:21.551185 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:21.661444 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Releasing lock "refresh_cache-27a2f570-fa9f-4f8d-8b04-b485a51b63cb" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:04:21.753230 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Took 1.36 seconds to deallocate network for instance.
May 28 01:04:21.787105 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-977893ec-e02f-4d31-9350-390e5542ce02 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Lock "b132a198-b7d3-43ed-9cf1-02b4dc303777" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.520s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:21.788602 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-76790590-1799-4c4a-aaae-3ae2c4adfaed tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:04:21.790056 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-76790590-1799-4c4a-aaae-3ae2c4adfaed tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:04:22.292317 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-76790590-1799-4c4a-aaae-3ae2c4adfaed tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:04:22.326427 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d23fa9b7-4aa1-43bb-8ff9-a84d077a4d0a req-5ec7814a-5f22-4c87-9e34-f3f3d032427c service nova] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Received event network-vif-unplugged-d540d8c6-c40d-45db-a88e-e9b062d033fb {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:22.328249 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d23fa9b7-4aa1-43bb-8ff9-a84d077a4d0a req-5ec7814a-5f22-4c87-9e34-f3f3d032427c service nova] Acquiring lock "d988b526-836d-48b8-a381-1f7679caf41d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:22.328603 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d23fa9b7-4aa1-43bb-8ff9-a84d077a4d0a req-5ec7814a-5f22-4c87-9e34-f3f3d032427c service nova] Lock "d988b526-836d-48b8-a381-1f7679caf41d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:22.328886 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d23fa9b7-4aa1-43bb-8ff9-a84d077a4d0a req-5ec7814a-5f22-4c87-9e34-f3f3d032427c service nova] Lock "d988b526-836d-48b8-a381-1f7679caf41d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:22.330204 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d23fa9b7-4aa1-43bb-8ff9-a84d077a4d0a req-5ec7814a-5f22-4c87-9e34-f3f3d032427c service nova] [instance: d988b526-836d-48b8-a381-1f7679caf41d] No waiting events found dispatching network-vif-unplugged-d540d8c6-c40d-45db-a88e-e9b062d033fb {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:22.330204 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d23fa9b7-4aa1-43bb-8ff9-a84d077a4d0a req-5ec7814a-5f22-4c87-9e34-f3f3d032427c service nova] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Received event network-vif-unplugged-d540d8c6-c40d-45db-a88e-e9b062d033fb for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:04:22.330204 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d23fa9b7-4aa1-43bb-8ff9-a84d077a4d0a req-5ec7814a-5f22-4c87-9e34-f3f3d032427c service nova] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Received event network-vif-deleted-79122524-4b9f-46c3-91ad-d723f1829ed6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:22.330204 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d23fa9b7-4aa1-43bb-8ff9-a84d077a4d0a req-5ec7814a-5f22-4c87-9e34-f3f3d032427c service nova] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Received event network-vif-deleted-d540d8c6-c40d-45db-a88e-e9b062d033fb {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:22.330204 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-d23fa9b7-4aa1-43bb-8ff9-a84d077a4d0a req-5ec7814a-5f22-4c87-9e34-f3f3d032427c service nova] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Neutron deleted interface d540d8c6-c40d-45db-a88e-e9b062d033fb; detaching it from the instance and deleting it from the info cache
May 28 01:04:22.330204 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:04:22.333071 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d23fa9b7-4aa1-43bb-8ff9-a84d077a4d0a req-5ec7814a-5f22-4c87-9e34-f3f3d032427c service nova] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Detach interface failed, port_id=d540d8c6-c40d-45db-a88e-e9b062d033fb, reason: Instance d988b526-836d-48b8-a381-1f7679caf41d could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:04:22.338405 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Took 0.58 seconds to detach 1 volumes for instance.
May 28 01:04:22.340091 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Deleting volume: 5237f2a6-3d87-4be6-91c4-8adbc4a32fcc {{(pid=98319) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 01:04:22.674158 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Instance destroyed successfully.
May 28 01:04:22.674611 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lazy-loading 'numa_topology' on Instance uuid 27a2f570-fa9f-4f8d-8b04-b485a51b63cb {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:22.799022 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-76790590-1799-4c4a-aaae-3ae2c4adfaed tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.507s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:22.833333 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Took 1.41 seconds to deallocate network for instance.
May 28 01:04:22.881666 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-76790590-1799-4c4a-aaae-3ae2c4adfaed tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Deleted allocations for instance f2b64af8-9a7b-4726-b298-cf9d2cb24498
May 28 01:04:22.886291 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:22.886470 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:23.177773 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Object Instance<27a2f570-fa9f-4f8d-8b04-b485a51b63cb> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:04:23.178089 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lazy-loading 'resources' on Instance uuid 27a2f570-fa9f-4f8d-8b04-b485a51b63cb {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:23.306732 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:04:23.307078 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:04:23.337394 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d03db1c7-62ec-41c8-8350-080115a7889f tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:23.681124 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Object Instance<27a2f570-fa9f-4f8d-8b04-b485a51b63cb> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:04:23.682931 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:03:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1503492322',display_name='tempest-TestVolumeBootPattern-server-1503492322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpattern-server-1503492322',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8QzN7WIM/7r+FXfxp48vv6ACDZyOEQjp19a7p1UcygauFxHFUkfzlUA3gFyPYoEyNZ3UhngJ8gsxkE2OmPRYuT7eZJnm0MUNhRjsZz5nqxS6AcX7i+n2BWwU1Ts1LTnw==',key_name='tempest-keypair-145839747',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:03:36Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='050f928f1ce449d6a447cd343dc4ff80',ramdisk_id='',reservation_id='r-m1wnmyaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1449742411',owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:04:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c803ddeaf4f4b3db07587419087b3b2',uuid=27a2f570-fa9f-4f8d-8b04-b485a51b63cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a2072e10-c933-4dd6-84e1-43734392b12e", "address": "fa:16:3e:29:2a:08", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2072e10-c9", "ovs_interfaceid": "a2072e10-c933-4dd6-84e1-43734392b12e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:04:23.683031 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converting VIF {"id": "a2072e10-c933-4dd6-84e1-43734392b12e", "address": "fa:16:3e:29:2a:08", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2072e10-c9", "ovs_interfaceid": "a2072e10-c933-4dd6-84e1-43734392b12e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:04:23.687361 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:2a:08,bridge_name='br-int',has_traffic_filtering=True,id=a2072e10-c933-4dd6-84e1-43734392b12e,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2072e10-c9') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:04:23.688568 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:2a:08,bridge_name='br-int',has_traffic_filtering=True,id=a2072e10-c933-4dd6-84e1-43734392b12e,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2072e10-c9') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:04:23.691674 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:23.691864 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2072e10-c9, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:23.694064 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:23.694411 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:23.695702 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:23.695863 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=741b95e3-3843-4802-846f-befb94904114) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:23.696655 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:23.697200 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:23.704077 np0000001577 nova-compute[98319]: INFO os_vif [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:2a:08,bridge_name='br-int',has_traffic_filtering=True,id=a2072e10-c933-4dd6-84e1-43734392b12e,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2072e10-c9')
May 28 01:04:23.707961 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:04:23.707961 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70941468-6e8f-4715-abc0-bd620ed1bb5d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:04:23.707961 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:04:23.708351 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:04:23.708698 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70941468-6e8f-4715-abc0-bd620ed1bb5d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:04:23.708908 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:04:23.740581 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:23.740581 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:23.740581 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:23.740581 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:23.740581 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:23.740581 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:23.740581 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:04:23.740581 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:23.740581 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:23.740581 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:23.740581 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:23.740581 np0000001577 nova-compute[98319]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:23.740581 np0000001577 nova-compute[98319]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:23.740581 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:04:23.740581 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', '63'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', '74'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', '75')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:04:23.740581 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', '75')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:04:23.740581 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', '74')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:04:23.740581 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c98705e8860>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d'): ({'sdg'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:04:23.740581 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Removing multipathed devices sdj, sdg {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:04:23.740581 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Flush multipath device 3300000002b367c70 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:04:23.799738 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:04:23.810363 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:04:23.845906 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:04:23.888995 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-76790590-1799-4c4a-aaae-3ae2c4adfaed tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Lock "f2b64af8-9a7b-4726-b298-cf9d2cb24498" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.409s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:23.897853 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Checking to see if SCSI volumes sdj, sdg have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:04:23.898041 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] SCSI volumes sdj, sdg have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:04:23.901130 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Checking to see if device paths {'sdj', 'sdg'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:04:23.914366 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Device paths {'sdj', 'sdg'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:04:23.914575 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:04:23.928083 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:23.958295 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 75, target: iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d, portal: 192.168.40.100,3260]
May 28 01:04:23.958295 np0000001577 nova-compute[98319]: Logout of [sid: 75, target: iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d, portal: 192.168.40.100,3260] successful.
May 28 01:04:23.958295 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:23.975277 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:23.985309 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:24.010385 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 74, target: iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d, portal: 192.168.50.100,3260]
May 28 01:04:24.010385 np0000001577 nova-compute[98319]: Logout of [sid: 74, target: iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d, portal: 192.168.50.100,3260] successful.
May 28 01:04:24.010385 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:24.026891 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:24.027095 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:04:24.027224 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] <== disconnect_volume: return (319ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:04:24.027329 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:04:24.031242 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Start _get_guest_xml network_info=[{"id": "a2072e10-c933-4dd6-84e1-43734392b12e", "address": "fa:16:3e:29:2a:08", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2072e10-c9", "ovs_interfaceid": "a2072e10-c933-4dd6-84e1-43734392b12e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70941468-6e8f-4715-abc0-bd620ed1bb5d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, 'status': 'reserved', 'instance': '27a2f570-fa9f-4f8d-8b04-b485a51b63cb', 'attached_at': '', 'detached_at': '', 'volume_id': '70941468-6e8f-4715-abc0-bd620ed1bb5d', 'serial': '70941468-6e8f-4715-abc0-bd620ed1bb5d'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '60d9fef2-b1d6-4b3c-9501-b76873c4e4ca', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:04:24.033711 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:04:24.034724 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1503492322', uuid='27a2f570-fa9f-4f8d-8b04-b485a51b63cb'), owner=OwnerMeta(userid='0c803ddeaf4f4b3db07587419087b3b2', username='tempest-TestVolumeBootPattern-1449742411-project-member', projectid='050f928f1ce449d6a447cd343dc4ff80', projectname='tempest-TestVolumeBootPattern-1449742411'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a2072e10-c933-4dd6-84e1-43734392b12e", "address": "fa:16:3e:29:2a:08", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2072e10-c9", "ovs_interfaceid": "a2072e10-c933-4dd6-84e1-43734392b12e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930264.034418) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:04:24.035731 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:04:24.036040 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:04:24.036801 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:04:24.036952 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:04:24.038634 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:04:24.038893 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:04:24.039028 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:04:24.039130 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:04:24.039269 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:04:24.039358 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:04:24.039453 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:04:24.039632 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:04:24.039726 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:04:24.041024 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:04:24.041151 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:04:24.041297 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:04:24.041438 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lazy-loading 'vcpu_model' on Instance uuid 27a2f570-fa9f-4f8d-8b04-b485a51b63cb {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:24.291485 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "f4d80e03-89cd-4c85-93c4-442da626393e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:24.291891 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "f4d80e03-89cd-4c85-93c4-442da626393e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:24.318644 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.431s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:24.319456 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d03db1c7-62ec-41c8-8350-080115a7889f tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.982s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:24.390501 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Deleted allocations for instance 8c35bc03-1899-4eb9-aefe-0bd301686dcf
May 28 01:04:24.543745 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Object Instance<27a2f570-fa9f-4f8d-8b04-b485a51b63cb> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:04:24.555934 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a2f570-fa9f-4f8d-8b04-b485a51b63cb/disk.config --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:04:24.649639 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27a2f570-fa9f-4f8d-8b04-b485a51b63cb/disk.config --force-share --output=json" returned: 0 in 0.093s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:04:24.649639 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "/opt/stack/data/nova/instances/27a2f570-fa9f-4f8d-8b04-b485a51b63cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:24.649776 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "/opt/stack/data/nova/instances/27a2f570-fa9f-4f8d-8b04-b485a51b63cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:24.650149 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "/opt/stack/data/nova/instances/27a2f570-fa9f-4f8d-8b04-b485a51b63cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:24.653651 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:04:24.653651 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70941468-6e8f-4715-abc0-bd620ed1bb5d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:04:24.653651 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:04:24.659090 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.006s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:04:24.659508 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70941468-6e8f-4715-abc0-bd620ed1bb5d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:04:24.671371 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:04:24.671936 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:04:24.672403 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:04:24.672642 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:04:24.673190 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:04:24.673397 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:04:24.684751 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:04:24.684751 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:24.690132 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:04:24.690132 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:24.700142 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d] added
May 28 01:04:24.700142 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:04:24.700142 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:04:24.700142 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:04:24.700142 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:04:24.700142 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:04:24.700142 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:24.702154 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:04:24.702387 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0297(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:04:24.702534 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:04:24.702907 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d] added
May 28 01:04:24.702907 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:04:24.702907 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:04:24.702907 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:04:24.702907 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:04:24.702907 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:04:24.702907 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:24.703132 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:04:24.703291 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0299(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:04:24.703436 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:04:24.794951 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:04:24.877390 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d03db1c7-62ec-41c8-8350-080115a7889f tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:04:24.877622 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-d03db1c7-62ec-41c8-8350-080115a7889f tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:04:25.190645 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0003983870001320611 future=<Future at 0x7c9870301dc0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:25.190998 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Emitting event <LifecycleEvent: 1779930250.1901255, 0ad69caa-c797-4e9d-96e3-7ad63523be49 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:04:25.191120 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:25.191270 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] VM Stopped (Lifecycle Event)
May 28 01:04:25.192316 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=3.0311596340002325 future=<Future at 0x7c988416a000 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:25.192370 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=3.0310625219999565 future=<Future at 0x7c988416a000 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:25.362462 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:25.381409 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-d03db1c7-62ec-41c8-8350-080115a7889f tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:04:25.399282 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b95770a5-ad2c-49f1-ad38-d6841776626a tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "8c35bc03-1899-4eb9-aefe-0bd301686dcf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.235s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:25.693501 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 0ad69caa-c797-4e9d-96e3-7ad63523be49] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:25.703000 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:04:25.703759 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:04:25.715590 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:04:25.715590 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:04:25.718133 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:04:25.718133 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:25.727322 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:25.731560 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:25.739710 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:25.739710 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:25.739710 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:25.739710 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:25.739710 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:04:25.739857 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:25.739857 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:25.739857 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:25.739857 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:25.739857 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:04:25.744769 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:25.744769 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:25.744769 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:25.744769 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:25.744769 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:04:25.744932 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:25.744932 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:25.744932 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:25.744932 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:25.744932 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:04:25.771505 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d, portal: 192.168.40.100,3260]
May 28 01:04:25.771505 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d, portal: 192.168.40.100,3260] successful.
May 28 01:04:25.771505 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:25.782749 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:25.784273 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d, portal: 192.168.50.100,3260]
May 28 01:04:25.784273 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d, portal: 192.168.50.100,3260] successful.
May 28 01:04:25.784273 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:25.799443 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:25.799443 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:25.799443 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:25.799443 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:25.799443 np0000001577 nova-compute[98319]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:25.799443 np0000001577 nova-compute[98319]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:25.799443 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:04:25.799443 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:25.799443 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:25.799443 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:25.799443 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:25.799443 np0000001577 nova-compute[98319]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:25.799443 np0000001577 nova-compute[98319]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:25.799443 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:04:25.799443 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.127s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:04:25.799443 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:04:25.800137 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:25.801280 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] HCTL ('7', '-', '-', 0) found on session 84 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:04:25.801388 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:04:25.819994 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:25.819994 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:25.819994 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:25.819994 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:25.819994 np0000001577 nova-compute[98319]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:25.819994 np0000001577 nova-compute[98319]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:25.819994 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:04:25.819994 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:25.819994 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:25.819994 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:25.819994 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:25.819994 np0000001577 nova-compute[98319]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:25.819994 np0000001577 nova-compute[98319]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:25.819994 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:04:25.819994 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.146s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:04:25.819994 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:04:25.821141 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching for a device in session 84 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:04:25.821141 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70941468-6e8f-4715-abc0-bd620ed1bb5d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:04:25.821895 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] HCTL ('8', '-', '-', 0) found on session 85 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:04:25.822063 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:04:25.834591 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching for a device in session 85 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:04:25.834591 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '70941468-6e8f-4715-abc0-bd620ed1bb5d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:04:25.889640 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d03db1c7-62ec-41c8-8350-080115a7889f tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.568s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:25.889640 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.527s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:25.900013 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:04:25.900263 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Claim successful on node np0000001577
May 28 01:04:25.951959 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-d03db1c7-62ec-41c8-8350-080115a7889f tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Deleted allocations for instance d988b526-836d-48b8-a381-1f7679caf41d
May 28 01:04:26.244282 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:26.658817 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:26.673242 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:04:26.848272 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-87bd4e43-bca6-4da9-a5ee-978325037eb1 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "e410372b-c799-4d0d-879c-4e935f2f2244" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:26.848455 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-87bd4e43-bca6-4da9-a5ee-978325037eb1 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "e410372b-c799-4d0d-879c-4e935f2f2244" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:26.848659 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-87bd4e43-bca6-4da9-a5ee-978325037eb1 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "e410372b-c799-4d0d-879c-4e935f2f2244-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:26.848789 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-87bd4e43-bca6-4da9-a5ee-978325037eb1 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "e410372b-c799-4d0d-879c-4e935f2f2244-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:26.848899 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-87bd4e43-bca6-4da9-a5ee-978325037eb1 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "e410372b-c799-4d0d-879c-4e935f2f2244-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:26.850765 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-87bd4e43-bca6-4da9-a5ee-978325037eb1 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Terminating instance
May 28 01:04:26.963306 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d03db1c7-62ec-41c8-8350-080115a7889f tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d988b526-836d-48b8-a381-1f7679caf41d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.409s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:27.276957 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:04:27.277134 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:04:27.354270 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-87bd4e43-bca6-4da9-a5ee-978325037eb1 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:04:27.383059 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:27.389118 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:27.415802 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:27.566970 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:27.572889 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:27.607141 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d839d764-fb02-46c4-a8c2-d236010c4f30 req-9e0f2170-a0c0-44bb-b52d-d5e555f393d6 service nova] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Received event network-vif-unplugged-1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:27.609372 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d839d764-fb02-46c4-a8c2-d236010c4f30 req-9e0f2170-a0c0-44bb-b52d-d5e555f393d6 service nova] Acquiring lock "e410372b-c799-4d0d-879c-4e935f2f2244-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:27.609372 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d839d764-fb02-46c4-a8c2-d236010c4f30 req-9e0f2170-a0c0-44bb-b52d-d5e555f393d6 service nova] Lock "e410372b-c799-4d0d-879c-4e935f2f2244-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:27.609372 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d839d764-fb02-46c4-a8c2-d236010c4f30 req-9e0f2170-a0c0-44bb-b52d-d5e555f393d6 service nova] Lock "e410372b-c799-4d0d-879c-4e935f2f2244-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:27.609372 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d839d764-fb02-46c4-a8c2-d236010c4f30 req-9e0f2170-a0c0-44bb-b52d-d5e555f393d6 service nova] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] No waiting events found dispatching network-vif-unplugged-1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:27.609372 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d839d764-fb02-46c4-a8c2-d236010c4f30 req-9e0f2170-a0c0-44bb-b52d-d5e555f393d6 service nova] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Received event network-vif-unplugged-1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:04:27.691135 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Found WWN 3300000002b367c70 for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:04:27.692475 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:04:27.692475 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '3300000002b367c70', 'path': '/dev/dm-0', 'multipath_id': '3300000002b367c70'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:04:27.692475 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002b367c70', 'path': '/dev/dm-0', 'multipath_id': '3300000002b367c70'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:04:27.705409 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.99973937499999 future=<Future at 0x7c984c7d7680 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:27.708323 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Instance destroyed successfully.
May 28 01:04:27.708323 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-87bd4e43-bca6-4da9-a5ee-978325037eb1 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lazy-loading 'resources' on Instance uuid e410372b-c799-4d0d-879c-4e935f2f2244 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:27.779520 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:04:27.830686 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dfdaf73e-c4bc-4305-9150-56ab32b69e5a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "d09e5674-c5ab-4ace-9952-554361002541" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:27.831283 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dfdaf73e-c4bc-4305-9150-56ab32b69e5a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d09e5674-c5ab-4ace-9952-554361002541" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:27.831283 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dfdaf73e-c4bc-4305-9150-56ab32b69e5a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "d09e5674-c5ab-4ace-9952-554361002541-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:27.831283 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dfdaf73e-c4bc-4305-9150-56ab32b69e5a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d09e5674-c5ab-4ace-9952-554361002541-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:27.831395 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dfdaf73e-c4bc-4305-9150-56ab32b69e5a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d09e5674-c5ab-4ace-9952-554361002541-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:27.834272 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-dfdaf73e-c4bc-4305-9150-56ab32b69e5a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Terminating instance
May 28 01:04:28.206713 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:03:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1503492322',display_name='tempest-TestVolumeBootPattern-server-1503492322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpattern-server-1503492322',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8QzN7WIM/7r+FXfxp48vv6ACDZyOEQjp19a7p1UcygauFxHFUkfzlUA3gFyPYoEyNZ3UhngJ8gsxkE2OmPRYuT7eZJnm0MUNhRjsZz5nqxS6AcX7i+n2BWwU1Ts1LTnw==',key_name='tempest-keypair-145839747',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:03:36Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='050f928f1ce449d6a447cd343dc4ff80',ramdisk_id='',reservation_id='r-m1wnmyaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1449742411',owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:04:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c803ddeaf4f4b3db07587419087b3b2',uuid=27a2f570-fa9f-4f8d-8b04-b485a51b63cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a2072e10-c933-4dd6-84e1-43734392b12e", "address": "fa:16:3e:29:2a:08", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2072e10-c9", "ovs_interfaceid": "a2072e10-c933-4dd6-84e1-43734392b12e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:04:28.206915 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converting VIF {"id": "a2072e10-c933-4dd6-84e1-43734392b12e", "address": "fa:16:3e:29:2a:08", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2072e10-c9", "ovs_interfaceid": "a2072e10-c933-4dd6-84e1-43734392b12e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:04:28.207555 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:2a:08,bridge_name='br-int',has_traffic_filtering=True,id=a2072e10-c933-4dd6-84e1-43734392b12e,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2072e10-c9') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:04:28.208147 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lazy-loading 'pci_devices' on Instance uuid 27a2f570-fa9f-4f8d-8b04-b485a51b63cb {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:28.210201 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-87bd4e43-bca6-4da9-a5ee-978325037eb1 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:03:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-969032899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serverbootfromvolumestablerescuetest-server-969032899',id=35,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:03:23Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e28acf25c4445ea969bd7bca3eac146',ramdisk_id='',reservation_id='r-s9rj8vpe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-568223226',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:03:31Z,user_data=None,user_id='fb6c20970bf0401190583f6348e00e4b',uuid=e410372b-c799-4d0d-879c-4e935f2f2244,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e", "address": "fa:16:3e:21:09:40", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fbc12c7-4e", "ovs_interfaceid": "1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:04:28.210508 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-87bd4e43-bca6-4da9-a5ee-978325037eb1 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Converting VIF {"id": "1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e", "address": "fa:16:3e:21:09:40", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fbc12c7-4e", "ovs_interfaceid": "1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:04:28.210975 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-87bd4e43-bca6-4da9-a5ee-978325037eb1 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:09:40,bridge_name='br-int',has_traffic_filtering=True,id=1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e,network=Network(c25f8563-bd10-4e42-b4ce-fd2164eca324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fbc12c7-4e') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:04:28.211208 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-87bd4e43-bca6-4da9-a5ee-978325037eb1 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:09:40,bridge_name='br-int',has_traffic_filtering=True,id=1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e,network=Network(c25f8563-bd10-4e42-b4ce-fd2164eca324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fbc12c7-4e') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:04:28.212925 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:28.213134 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1fbc12c7-4e, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:28.215434 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:28.216502 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:28.219057 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:28.219245 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b4c2945-1807-4b5b-b454-6765027666dd) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:28.219965 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:28.220586 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:28.221453 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:28.223835 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0003625829999691632 future=<Future at 0x7c988416a000 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:28.223887 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:28.223966 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=2.5289410780001162 future=<Future at 0x7c98704aebd0 state=cancelled>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:28.224017 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=2.52888009399976 future=<Future at 0x7c98704aebd0 state=cancelled>) was cancelled while queued, skipping {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:28.224073 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:28.224130 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=2.9987676639998426 future=<Future at 0x7c987047d550 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:28.224228 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=2.9987023319999935 future=<Future at 0x7c987047d550 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:28.224625 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Emitting event <LifecycleEvent: 1779930253.2233677, d87bb95b-a1e9-4786-8bee-16f2cfaabf2d => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:04:28.225813 np0000001577 nova-compute[98319]: INFO os_vif [None req-87bd4e43-bca6-4da9-a5ee-978325037eb1 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:09:40,bridge_name='br-int',has_traffic_filtering=True,id=1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e,network=Network(c25f8563-bd10-4e42-b4ce-fd2164eca324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fbc12c7-4e')
May 28 01:04:28.226088 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] VM Stopped (Lifecycle Event)
May 28 01:04:28.227834 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-87bd4e43-bca6-4da9-a5ee-978325037eb1 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Deleting instance files /opt/stack/data/nova/instances/e410372b-c799-4d0d-879c-4e935f2f2244_del
May 28 01:04:28.229828 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-87bd4e43-bca6-4da9-a5ee-978325037eb1 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Deletion of /opt/stack/data/nova/instances/e410372b-c799-4d0d-879c-4e935f2f2244_del complete
May 28 01:04:28.286082 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.397s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:28.286512 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:04:28.335614 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-dfdaf73e-c4bc-4305-9150-56ab32b69e5a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:04:28.352302 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:28.354304 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:28.377397 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:28.484043 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-345ee2ba-963a-4aff-ad3d-043c15247ddc req-9e2d674e-ba0e-49f5-bde6-85921d9318be service nova] [instance: d09e5674-c5ab-4ace-9952-554361002541] Received event network-vif-unplugged-27b0856b-fab8-4285-8856-b3cabb6c5437 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:28.484043 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-345ee2ba-963a-4aff-ad3d-043c15247ddc req-9e2d674e-ba0e-49f5-bde6-85921d9318be service nova] Acquiring lock "d09e5674-c5ab-4ace-9952-554361002541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:28.484599 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-345ee2ba-963a-4aff-ad3d-043c15247ddc req-9e2d674e-ba0e-49f5-bde6-85921d9318be service nova] Lock "d09e5674-c5ab-4ace-9952-554361002541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:28.484701 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-345ee2ba-963a-4aff-ad3d-043c15247ddc req-9e2d674e-ba0e-49f5-bde6-85921d9318be service nova] Lock "d09e5674-c5ab-4ace-9952-554361002541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:28.484805 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-345ee2ba-963a-4aff-ad3d-043c15247ddc req-9e2d674e-ba0e-49f5-bde6-85921d9318be service nova] [instance: d09e5674-c5ab-4ace-9952-554361002541] No waiting events found dispatching network-vif-unplugged-27b0856b-fab8-4285-8856-b3cabb6c5437 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:28.484906 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-345ee2ba-963a-4aff-ad3d-043c15247ddc req-9e2d674e-ba0e-49f5-bde6-85921d9318be service nova] [instance: d09e5674-c5ab-4ace-9952-554361002541] Received event network-vif-unplugged-27b0856b-fab8-4285-8856-b3cabb6c5437 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:04:28.504635 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:28.512343 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:28.646766 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999725487999967 future=<Future at 0x7c988c08bbc0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:28.649096 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: d09e5674-c5ab-4ace-9952-554361002541] Instance destroyed successfully.
May 28 01:04:28.649461 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-dfdaf73e-c4bc-4305-9150-56ab32b69e5a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lazy-loading 'resources' on Instance uuid d09e5674-c5ab-4ace-9952-554361002541 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:28.712162 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Object Instance<27a2f570-fa9f-4f8d-8b04-b485a51b63cb> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:04:28.713158 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] End _get_guest_xml xml=<domain type="qemu">
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:   <uuid>27a2f570-fa9f-4f8d-8b04-b485a51b63cb</uuid>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:   <name>instance-00000024</name>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestVolumeBootPattern-server-1503492322</nova:name>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:04:24</nova:creationTime>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       <nova:image uuid="">
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:         <nova:user uuid="0c803ddeaf4f4b3db07587419087b3b2">tempest-TestVolumeBootPattern-1449742411-project-member</nova:user>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:         <nova:project uuid="050f928f1ce449d6a447cd343dc4ff80">tempest-TestVolumeBootPattern-1449742411</nova:project>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:         <nova:port uuid="a2072e10-c933-4dd6-84e1-43734392b12e">
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:     <system>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       <entry name="serial">27a2f570-fa9f-4f8d-8b04-b485a51b63cb</entry>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       <entry name="uuid">27a2f570-fa9f-4f8d-8b04-b485a51b63cb</entry>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:     </system>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:   <os>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:   </os>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:   <features>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:   </features>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:   <devices>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/27a2f570-fa9f-4f8d-8b04-b485a51b63cb/disk.config"/>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:     </disk>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       <alias name="ua-70941468-6e8f-4715-abc0-bd620ed1bb5d"/>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-0"/>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       <serial>70941468-6e8f-4715-abc0-bd620ed1bb5d</serial>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:     </disk>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:29:2a:08"/>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       <target dev="tapa2072e10-c9"/>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:     </interface>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/27a2f570-fa9f-4f8d-8b04-b485a51b63cb/console.log" append="off"/>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:     </serial>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:     <video>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:     </video>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:     </rng>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:   </devices>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]: </domain>
May 28 01:04:28.713158 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:04:28.715216 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:04:28.715216 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:03:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1503492322',display_name='tempest-TestVolumeBootPattern-server-1503492322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpattern-server-1503492322',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8QzN7WIM/7r+FXfxp48vv6ACDZyOEQjp19a7p1UcygauFxHFUkfzlUA3gFyPYoEyNZ3UhngJ8gsxkE2OmPRYuT7eZJnm0MUNhRjsZz5nqxS6AcX7i+n2BWwU1Ts1LTnw==',key_name='tempest-keypair-145839747',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:03:36Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='050f928f1ce449d6a447cd343dc4ff80',ramdisk_id='',reservation_id='r-m1wnmyaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1449742411',owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:04:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c803ddeaf4f4b3db07587419087b3b2',uuid=27a2f570-fa9f-4f8d-8b04-b485a51b63cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a2072e10-c933-4dd6-84e1-43734392b12e", "address": "fa:16:3e:29:2a:08", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2072e10-c9", "ovs_interfaceid": "a2072e10-c933-4dd6-84e1-43734392b12e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:04:28.715216 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converting VIF {"id": "a2072e10-c933-4dd6-84e1-43734392b12e", "address": "fa:16:3e:29:2a:08", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2072e10-c9", "ovs_interfaceid": "a2072e10-c933-4dd6-84e1-43734392b12e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:04:28.715216 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:2a:08,bridge_name='br-int',has_traffic_filtering=True,id=a2072e10-c933-4dd6-84e1-43734392b12e,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2072e10-c9') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:04:28.715216 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:2a:08,bridge_name='br-int',has_traffic_filtering=True,id=a2072e10-c933-4dd6-84e1-43734392b12e,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2072e10-c9') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:04:28.715436 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:28.715567 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:28.715855 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:04:28.716274 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:28.716422 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2fc4e3de-bc33-5daa-be22-b1b834c90775', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:28.717138 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:28.717685 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:28.723399 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:28.726233 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:28.726233 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2072e10-c9, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:28.726233 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2072e10-c9, col_values=(('qos', UUID('99c4e70f-88dc-42b0-92bc-0fa7bc2725a5')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:28.726426 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2072e10-c9, col_values=(('external_ids', {'iface-id': 'a2072e10-c933-4dd6-84e1-43734392b12e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:2a:08', 'vm-uuid': '27a2f570-fa9f-4f8d-8b04-b485a51b63cb'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:28.727734 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:28.730240 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:28.732904 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: d87bb95b-a1e9-4786-8bee-16f2cfaabf2d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:28.738892 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:28.740162 np0000001577 nova-compute[98319]: INFO os_vif [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:2a:08,bridge_name='br-int',has_traffic_filtering=True,id=a2072e10-c933-4dd6-84e1-43734392b12e,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2072e10-c9')
May 28 01:04:28.740752 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-87bd4e43-bca6-4da9-a5ee-978325037eb1 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Took 1.39 seconds to destroy the instance on the hypervisor.
May 28 01:04:28.741450 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-87bd4e43-bca6-4da9-a5ee-978325037eb1 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:04:28.741724 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:04:28.741822 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:04:28.742060 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:28.791397 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:04:28.791669 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:04:28.792008 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:28.792311 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:28.819613 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:28.873531 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fbae7974478d45b3908aaaa5b4408e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a430f0d6bcc84a29bc3e96514422896b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:04:29.150142 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:29.153163 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-dfdaf73e-c4bc-4305-9150-56ab32b69e5a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:58:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='multiattach-server-0',id=12,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7fHo3fyBWUybZxdNVpYEXXxMYY3ACB7D4odfvDXtuf5uMmk/o2XggiQakoJbwdRCXKjpHaMcmXgSyAS8x+3bDHMUWn1qlznnyXp/nDVRmoqTgLFpV2Do6YlUuA3zZ+mw==',key_name='tempest-keypair-627531643',keypairs=<?>,launch_index=0,launched_at=2026-05-28T00:59:04Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='938c2829112843edb2054984e80ce7ad',ramdisk_id='',reservation_id='r-sx3wo073',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-89204095',owner_user_name='tempest-AttachVolumeMultiAttachTest-89204095-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T00:59:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8586a18edcf42cab0a60028135ae401',uuid=d09e5674-c5ab-4ace-9952-554361002541,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27b0856b-fab8-4285-8856-b3cabb6c5437", "address": "fa:16:3e:f0:24:6e", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b0856b-fa", "ovs_interfaceid": "27b0856b-fab8-4285-8856-b3cabb6c5437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:04:29.153163 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-dfdaf73e-c4bc-4305-9150-56ab32b69e5a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converting VIF {"id": "27b0856b-fab8-4285-8856-b3cabb6c5437", "address": "fa:16:3e:f0:24:6e", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b0856b-fa", "ovs_interfaceid": "27b0856b-fab8-4285-8856-b3cabb6c5437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:04:29.153638 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-dfdaf73e-c4bc-4305-9150-56ab32b69e5a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:24:6e,bridge_name='br-int',has_traffic_filtering=True,id=27b0856b-fab8-4285-8856-b3cabb6c5437,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b0856b-fa') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:04:29.154560 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-dfdaf73e-c4bc-4305-9150-56ab32b69e5a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:24:6e,bridge_name='br-int',has_traffic_filtering=True,id=27b0856b-fab8-4285-8856-b3cabb6c5437,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b0856b-fa') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:04:29.155159 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:29.155159 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27b0856b-fa, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:29.158047 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:29.158979 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:29.184216 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:29.184216 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:29.185455 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:29.185581 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7ca0ef1d-754b-4563-9df3-084fb3dbb04a) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:29.186969 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:29.188246 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:29.188246 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:29.190409 np0000001577 nova-compute[98319]: INFO os_vif [None req-dfdaf73e-c4bc-4305-9150-56ab32b69e5a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:24:6e,bridge_name='br-int',has_traffic_filtering=True,id=27b0856b-fab8-4285-8856-b3cabb6c5437,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b0856b-fa')
May 28 01:04:29.190859 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-dfdaf73e-c4bc-4305-9150-56ab32b69e5a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Deleting instance files /opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541_del
May 28 01:04:29.191633 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-dfdaf73e-c4bc-4305-9150-56ab32b69e5a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Deletion of /opt/stack/data/nova/instances/d09e5674-c5ab-4ace-9952-554361002541_del complete
May 28 01:04:29.268572 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:29.297940 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:04:29.469668 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:29.470976 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:29.474686 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:29.499714 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:29.500619 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:29.587765 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Successfully created port: 525eac81-fbc6-4dcc-b574-fca50bcfc9c9 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:04:29.591528 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:04:29.699693 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-dfdaf73e-c4bc-4305-9150-56ab32b69e5a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Took 1.36 seconds to destroy the instance on the hypervisor.
May 28 01:04:29.700318 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-dfdaf73e-c4bc-4305-9150-56ab32b69e5a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:04:29.700490 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: d09e5674-c5ab-4ace-9952-554361002541] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:04:29.700490 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: d09e5674-c5ab-4ace-9952-554361002541] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:04:29.701579 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:29.711623 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2cfccbfe-a95a-47f8-89ae-d758c67caafd req-c355229b-32e3-49bd-8c07-ef2debdb7258 service nova] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Received event network-vif-unplugged-1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:29.711700 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2cfccbfe-a95a-47f8-89ae-d758c67caafd req-c355229b-32e3-49bd-8c07-ef2debdb7258 service nova] Acquiring lock "e410372b-c799-4d0d-879c-4e935f2f2244-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:29.711824 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2cfccbfe-a95a-47f8-89ae-d758c67caafd req-c355229b-32e3-49bd-8c07-ef2debdb7258 service nova] Lock "e410372b-c799-4d0d-879c-4e935f2f2244-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:29.711923 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2cfccbfe-a95a-47f8-89ae-d758c67caafd req-c355229b-32e3-49bd-8c07-ef2debdb7258 service nova] Lock "e410372b-c799-4d0d-879c-4e935f2f2244-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:29.712794 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2cfccbfe-a95a-47f8-89ae-d758c67caafd req-c355229b-32e3-49bd-8c07-ef2debdb7258 service nova] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] No waiting events found dispatching network-vif-unplugged-1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:29.713132 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2cfccbfe-a95a-47f8-89ae-d758c67caafd req-c355229b-32e3-49bd-8c07-ef2debdb7258 service nova] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Received event network-vif-unplugged-1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:04:29.713132 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2cfccbfe-a95a-47f8-89ae-d758c67caafd req-c355229b-32e3-49bd-8c07-ef2debdb7258 service nova] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Received event network-vif-plugged-a2072e10-c933-4dd6-84e1-43734392b12e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:29.713132 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2cfccbfe-a95a-47f8-89ae-d758c67caafd req-c355229b-32e3-49bd-8c07-ef2debdb7258 service nova] Acquiring lock "27a2f570-fa9f-4f8d-8b04-b485a51b63cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:29.713281 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2cfccbfe-a95a-47f8-89ae-d758c67caafd req-c355229b-32e3-49bd-8c07-ef2debdb7258 service nova] Lock "27a2f570-fa9f-4f8d-8b04-b485a51b63cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:29.713452 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2cfccbfe-a95a-47f8-89ae-d758c67caafd req-c355229b-32e3-49bd-8c07-ef2debdb7258 service nova] Lock "27a2f570-fa9f-4f8d-8b04-b485a51b63cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:29.713452 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2cfccbfe-a95a-47f8-89ae-d758c67caafd req-c355229b-32e3-49bd-8c07-ef2debdb7258 service nova] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] No waiting events found dispatching network-vif-plugged-a2072e10-c933-4dd6-84e1-43734392b12e {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:29.714496 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-2cfccbfe-a95a-47f8-89ae-d758c67caafd req-c355229b-32e3-49bd-8c07-ef2debdb7258 service nova] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Received unexpected event network-vif-plugged-a2072e10-c933-4dd6-84e1-43734392b12e for instance with vm_state stopped and task_state powering-on.
May 28 01:04:29.800829 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:04:29.904687 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Removed pending STOPPED event for 27a2f570-fa9f-4f8d-8b04-b485a51b63cb due to new event <LifecycleEvent: 1779930269.9039555, 27a2f570-fa9f-4f8d-8b04-b485a51b63cb => Resumed> {{(pid=98319) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 01:04:29.904687 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930269.9039555, 27a2f570-fa9f-4f8d-8b04-b485a51b63cb => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:04:29.904687 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] VM Resumed (Lifecycle Event)
May 28 01:04:29.908025 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Instance event wait completed in 0 seconds for  {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:04:29.914363 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Instance rebooted successfully.
May 28 01:04:30.059086 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Successfully updated port: 525eac81-fbc6-4dcc-b574-fca50bcfc9c9 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:04:30.096283 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Took 1.35 seconds to deallocate network for instance.
May 28 01:04:30.126104 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:30.130530 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1eba4ad9-59a1-4aa9-b272-691f13111bbe req-939f9ff5-269d-4daa-b9d7-1feded69f16d service nova] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Received event network-changed-525eac81-fbc6-4dcc-b574-fca50bcfc9c9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:30.130891 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1eba4ad9-59a1-4aa9-b272-691f13111bbe req-939f9ff5-269d-4daa-b9d7-1feded69f16d service nova] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Refreshing instance network info cache due to event network-changed-525eac81-fbc6-4dcc-b574-fca50bcfc9c9. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:04:30.131061 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1eba4ad9-59a1-4aa9-b272-691f13111bbe req-939f9ff5-269d-4daa-b9d7-1feded69f16d service nova] Acquiring lock "refresh_cache-f4d80e03-89cd-4c85-93c4-442da626393e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:04:30.131192 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1eba4ad9-59a1-4aa9-b272-691f13111bbe req-939f9ff5-269d-4daa-b9d7-1feded69f16d service nova] Acquired lock "refresh_cache-f4d80e03-89cd-4c85-93c4-442da626393e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:04:30.131331 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-1eba4ad9-59a1-4aa9-b272-691f13111bbe req-939f9ff5-269d-4daa-b9d7-1feded69f16d service nova] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Refreshing network info cache for port 525eac81-fbc6-4dcc-b574-fca50bcfc9c9 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:04:30.330634 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:30.406883 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:30.408739 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:04:30.561906 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-075416ee-defc-4419-a072-0205c0928104 req-38d3e3b0-09d1-4f0a-bae9-e87813395b16 service nova] [instance: d09e5674-c5ab-4ace-9952-554361002541] Received event network-vif-unplugged-27b0856b-fab8-4285-8856-b3cabb6c5437 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:30.562067 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-075416ee-defc-4419-a072-0205c0928104 req-38d3e3b0-09d1-4f0a-bae9-e87813395b16 service nova] Acquiring lock "d09e5674-c5ab-4ace-9952-554361002541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:30.562221 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-075416ee-defc-4419-a072-0205c0928104 req-38d3e3b0-09d1-4f0a-bae9-e87813395b16 service nova] Lock "d09e5674-c5ab-4ace-9952-554361002541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:30.562361 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-075416ee-defc-4419-a072-0205c0928104 req-38d3e3b0-09d1-4f0a-bae9-e87813395b16 service nova] Lock "d09e5674-c5ab-4ace-9952-554361002541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:30.562817 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "refresh_cache-f4d80e03-89cd-4c85-93c4-442da626393e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:04:30.562919 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-075416ee-defc-4419-a072-0205c0928104 req-38d3e3b0-09d1-4f0a-bae9-e87813395b16 service nova] [instance: d09e5674-c5ab-4ace-9952-554361002541] No waiting events found dispatching network-vif-unplugged-27b0856b-fab8-4285-8856-b3cabb6c5437 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:30.563053 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-075416ee-defc-4419-a072-0205c0928104 req-38d3e3b0-09d1-4f0a-bae9-e87813395b16 service nova] [instance: d09e5674-c5ab-4ace-9952-554361002541] Received event network-vif-unplugged-27b0856b-fab8-4285-8856-b3cabb6c5437 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:04:30.563155 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-075416ee-defc-4419-a072-0205c0928104 req-38d3e3b0-09d1-4f0a-bae9-e87813395b16 service nova] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Received event network-vif-deleted-1fbc12c7-4e37-4c51-b8b5-0154d22f8d3e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:30.602635 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-87bd4e43-bca6-4da9-a5ee-978325037eb1 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:30.602931 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-87bd4e43-bca6-4da9-a5ee-978325037eb1 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:30.636241 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-1eba4ad9-59a1-4aa9-b272-691f13111bbe req-939f9ff5-269d-4daa-b9d7-1feded69f16d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:30.700353 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-1eba4ad9-59a1-4aa9-b272-691f13111bbe req-939f9ff5-269d-4daa-b9d7-1feded69f16d service nova] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:04:30.810353 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:04:30.811620 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:04:30.811957 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Creating image(s)
May 28 01:04:30.813053 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4d80e03-89cd-4c85-93c4-442da626393e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:30.813313 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "/opt/stack/data/nova/instances/f4d80e03-89cd-4c85-93c4-442da626393e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:30.813911 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "/opt/stack/data/nova/instances/f4d80e03-89cd-4c85-93c4-442da626393e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:30.814558 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:04:30.818879 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:04:30.821463 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:04:30.912660 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] During sync_power_state the instance has a pending task (powering-on). Skip.
May 28 01:04:30.913921 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930270.9132643, 27a2f570-fa9f-4f8d-8b04-b485a51b63cb => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:04:30.914161 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] VM Started (Lifecycle Event)
May 28 01:04:30.926538 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-1eba4ad9-59a1-4aa9-b272-691f13111bbe req-939f9ff5-269d-4daa-b9d7-1feded69f16d service nova] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:04:30.944575 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.121s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:04:30.944575 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:30.944575 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:30.944575 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:04:30.950688 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:04:30.951242 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:04:30.972572 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: d09e5674-c5ab-4ace-9952-554361002541] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:04:30.979644 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:04:30.981318 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98319) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 28 01:04:31.055093 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.104s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:04:31.059161 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/f4d80e03-89cd-4c85-93c4-442da626393e/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:04:31.107483 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/f4d80e03-89cd-4c85-93c4-442da626393e/disk 1073741824" returned: 0 in 0.052s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:04:31.108826 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.164s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:31.108826 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:04:31.186278 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.078s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:04:31.186645 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4d80e03-89cd-4c85-93c4-442da626393e/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:04:31.186853 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4d80e03-89cd-4c85-93c4-442da626393e/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:04:31.204672 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-87bd4e43-bca6-4da9-a5ee-978325037eb1 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:04:31.205121 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-87bd4e43-bca6-4da9-a5ee-978325037eb1 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:04:31.224985 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.002027670000188664 future=<Future at 0x7c987047d550 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:31.226288 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Emitting event <LifecycleEvent: 1779930256.2228577, b132a198-b7d3-43ed-9cf1-02b4dc303777 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:04:31.226288 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:31.226405 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] VM Stopped (Lifecycle Event)
May 28 01:04:31.227110 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=0.3177412220002225 future=<Future at 0x7c984c436870 state=cancelled>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:31.227235 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=0.3176239340000393 future=<Future at 0x7c984c436870 state=cancelled>) was cancelled while queued, skipping {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:31.227304 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:31.227401 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=2.6494729189998907 future=<Future at 0x7c988c034440 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:31.228633 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=2.64878995700019 future=<Future at 0x7c988c034440 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:31.244946 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:31.268967 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4d80e03-89cd-4c85-93c4-442da626393e/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:04:31.269284 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Cannot resize image /opt/stack/data/nova/instances/f4d80e03-89cd-4c85-93c4-442da626393e/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:04:31.269648 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:04:31.269796 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Ensure instance console log exists: /opt/stack/data/nova/instances/f4d80e03-89cd-4c85-93c4-442da626393e/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:04:31.270023 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:31.270182 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:31.270311 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:31.421779 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:31.430981 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:04:31.433238 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1eba4ad9-59a1-4aa9-b272-691f13111bbe req-939f9ff5-269d-4daa-b9d7-1feded69f16d service nova] Releasing lock "refresh_cache-f4d80e03-89cd-4c85-93c4-442da626393e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:04:31.433832 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquired lock "refresh_cache-f4d80e03-89cd-4c85-93c4-442da626393e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:04:31.434272 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:04:31.436786 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:04:31.437654 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:04:31.437857 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] No VIF found with MAC fa:16:3e:29:2a:08, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:04:31.438305 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-3b4e255c-554a-46dd-80ec-16f9f5fc4714 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:31.470990 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:31.477402 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: d09e5674-c5ab-4ace-9952-554361002541] Took 1.78 seconds to deallocate network for instance.
May 28 01:04:31.485387 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:04:31.710560 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-87bd4e43-bca6-4da9-a5ee-978325037eb1 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:04:31.730117 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: b132a198-b7d3-43ed-9cf1-02b4dc303777] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:31.936092 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] During sync_power_state the instance has a pending task (powering-on). Skip.
May 28 01:04:31.979510 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:04:31.986905 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dfdaf73e-c4bc-4305-9150-56ab32b69e5a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:32.006484 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:04:32.075005 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6eee797b-aeaa-482d-9195-c6ec7dbf78e2 req-6255e1f4-f932-479b-aeed-c554f853161e service nova] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Received event network-vif-plugged-a2072e10-c933-4dd6-84e1-43734392b12e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:32.075565 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6eee797b-aeaa-482d-9195-c6ec7dbf78e2 req-6255e1f4-f932-479b-aeed-c554f853161e service nova] Acquiring lock "27a2f570-fa9f-4f8d-8b04-b485a51b63cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:32.075773 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6eee797b-aeaa-482d-9195-c6ec7dbf78e2 req-6255e1f4-f932-479b-aeed-c554f853161e service nova] Lock "27a2f570-fa9f-4f8d-8b04-b485a51b63cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:32.075935 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6eee797b-aeaa-482d-9195-c6ec7dbf78e2 req-6255e1f4-f932-479b-aeed-c554f853161e service nova] Lock "27a2f570-fa9f-4f8d-8b04-b485a51b63cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:32.076107 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6eee797b-aeaa-482d-9195-c6ec7dbf78e2 req-6255e1f4-f932-479b-aeed-c554f853161e service nova] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] No waiting events found dispatching network-vif-plugged-a2072e10-c933-4dd6-84e1-43734392b12e {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:32.076319 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-6eee797b-aeaa-482d-9195-c6ec7dbf78e2 req-6255e1f4-f932-479b-aeed-c554f853161e service nova] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Received unexpected event network-vif-plugged-a2072e10-c933-4dd6-84e1-43734392b12e for instance with vm_state active and task_state None.
May 28 01:04:32.076561 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6eee797b-aeaa-482d-9195-c6ec7dbf78e2 req-6255e1f4-f932-479b-aeed-c554f853161e service nova] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Received event network-vif-unplugged-525eac81-fbc6-4dcc-b574-fca50bcfc9c9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:32.076735 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6eee797b-aeaa-482d-9195-c6ec7dbf78e2 req-6255e1f4-f932-479b-aeed-c554f853161e service nova] Acquiring lock "f4d80e03-89cd-4c85-93c4-442da626393e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:32.076911 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6eee797b-aeaa-482d-9195-c6ec7dbf78e2 req-6255e1f4-f932-479b-aeed-c554f853161e service nova] Lock "f4d80e03-89cd-4c85-93c4-442da626393e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:32.077082 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6eee797b-aeaa-482d-9195-c6ec7dbf78e2 req-6255e1f4-f932-479b-aeed-c554f853161e service nova] Lock "f4d80e03-89cd-4c85-93c4-442da626393e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:32.077264 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6eee797b-aeaa-482d-9195-c6ec7dbf78e2 req-6255e1f4-f932-479b-aeed-c554f853161e service nova] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] No waiting events found dispatching network-vif-unplugged-525eac81-fbc6-4dcc-b574-fca50bcfc9c9 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:32.078591 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-6eee797b-aeaa-482d-9195-c6ec7dbf78e2 req-6255e1f4-f932-479b-aeed-c554f853161e service nova] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Received unexpected event network-vif-unplugged-525eac81-fbc6-4dcc-b574-fca50bcfc9c9 for instance with vm_state building and task_state spawning.
May 28 01:04:32.218924 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-87bd4e43-bca6-4da9-a5ee-978325037eb1 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.616s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:32.221207 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dfdaf73e-c4bc-4305-9150-56ab32b69e5a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.232s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:32.224566 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6cd259eb-8f5a-41c1-bcc8-044e97518d29 req-d2ec3a7f-d642-4490-8b2e-ad11e41f8215 service nova] [instance: d09e5674-c5ab-4ace-9952-554361002541] Received event network-vif-deleted-27b0856b-fab8-4285-8856-b3cabb6c5437 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:32.230079 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:32.332943 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-a6c2b7ae-855e-4ce5-bbd9-5fca973db8c8 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Get console output
May 28 01:04:32.335568 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-87bd4e43-bca6-4da9-a5ee-978325037eb1 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Deleted allocations for instance e410372b-c799-4d0d-879c-4e935f2f2244
May 28 01:04:32.343917 np0000001577 nova-compute[98319]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
May 28 01:04:32.407134 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Updating instance_info_cache with network_info: [{"id": "525eac81-fbc6-4dcc-b574-fca50bcfc9c9", "address": "fa:16:3e:d1:bb:a5", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap525eac81-fb", "ovs_interfaceid": "525eac81-fbc6-4dcc-b574-fca50bcfc9c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:04:32.482126 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:04:32.720097 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dfdaf73e-c4bc-4305-9150-56ab32b69e5a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:04:32.720252 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-dfdaf73e-c4bc-4305-9150-56ab32b69e5a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:04:32.909012 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Releasing lock "refresh_cache-f4d80e03-89cd-4c85-93c4-442da626393e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:04:32.909310 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Instance network_info: |[{"id": "525eac81-fbc6-4dcc-b574-fca50bcfc9c9", "address": "fa:16:3e:d1:bb:a5", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap525eac81-fb", "ovs_interfaceid": "525eac81-fbc6-4dcc-b574-fca50bcfc9c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:04:32.911023 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Start _get_guest_xml network_info=[{"id": "525eac81-fbc6-4dcc-b574-fca50bcfc9c9", "address": "fa:16:3e:d1:bb:a5", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap525eac81-fb", "ovs_interfaceid": "525eac81-fbc6-4dcc-b574-fca50bcfc9c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:04:32.915728 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:04:32.917424 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1977446406', uuid='f4d80e03-89cd-4c85-93c4-442da626393e'), owner=OwnerMeta(userid='fbae7974478d45b3908aaaa5b4408e26', username='tempest-TestEncryptedCinderVolumes-2086871542-project-member', projectid='a430f0d6bcc84a29bc3e96514422896b', projectname='tempest-TestEncryptedCinderVolumes-2086871542'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "525eac81-fbc6-4dcc-b574-fca50bcfc9c9", "address": "fa:16:3e:d1:bb:a5", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap525eac81-fb", "ovs_interfaceid": "525eac81-fbc6-4dcc-b574-fca50bcfc9c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930272.9168956) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:04:32.918867 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:04:32.919299 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:04:32.923949 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:04:32.924165 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:04:32.925071 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:04:32.925400 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:04:32.925559 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:04:32.925652 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:04:32.925774 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:04:32.925872 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:04:32.925973 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:04:32.926112 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:04:32.926214 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:04:32.926321 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:04:32.926449 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:04:32.926734 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:04:32.937672 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:04:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1977446406',display_name='tempest-TestEncryptedCinderVolumes-server-1977446406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testencryptedcindervolumes-server-1977446406',id=41,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGRPTJ6ejodf1Q3L0IjNVvQeFNLABSt5TAusszMgR3N3vr9IKTWFitsNJvMbnbr6GoZTcfmVR4BzCvUWM5nVC8QlDhk4nJ7EaCV62OH2oOoTXuJZCjWBkiGxAktquYgRA==',key_name='tempest-keypair-1974424304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a430f0d6bcc84a29bc3e96514422896b',ramdisk_id='',reservation_id='r-cmse21k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-2086871542',owner_user_name='tempest-TestEncryptedCinderVolumes-2086871542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:04:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbae7974478d45b3908aaaa5b4408e26',uuid=f4d80e03-89cd-4c85-93c4-442da626393e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "525eac81-fbc6-4dcc-b574-fca50bcfc9c9", "address": "fa:16:3e:d1:bb:a5", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap525eac81-fb", "ovs_interfaceid": "525eac81-fbc6-4dcc-b574-fca50bcfc9c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:04:32.938031 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converting VIF {"id": "525eac81-fbc6-4dcc-b574-fca50bcfc9c9", "address": "fa:16:3e:d1:bb:a5", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap525eac81-fb", "ovs_interfaceid": "525eac81-fbc6-4dcc-b574-fca50bcfc9c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:04:32.938387 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:bb:a5,bridge_name='br-int',has_traffic_filtering=True,id=525eac81-fbc6-4dcc-b574-fca50bcfc9c9,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525eac81-fb') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:04:32.938933 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lazy-loading 'pci_devices' on Instance uuid f4d80e03-89cd-4c85-93c4-442da626393e {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:33.039514 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:33.223189 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-dfdaf73e-c4bc-4305-9150-56ab32b69e5a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:04:33.344306 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-87bd4e43-bca6-4da9-a5ee-978325037eb1 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "e410372b-c799-4d0d-879c-4e935f2f2244" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.496s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:33.441328 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] End _get_guest_xml xml=<domain type="qemu">
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:   <uuid>f4d80e03-89cd-4c85-93c4-442da626393e</uuid>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:   <name>instance-00000029</name>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1977446406</nova:name>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:04:32</nova:creationTime>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:         <nova:user uuid="fbae7974478d45b3908aaaa5b4408e26">tempest-TestEncryptedCinderVolumes-2086871542-project-member</nova:user>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:         <nova:project uuid="a430f0d6bcc84a29bc3e96514422896b">tempest-TestEncryptedCinderVolumes-2086871542</nova:project>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:         <nova:port uuid="525eac81-fbc6-4dcc-b574-fca50bcfc9c9">
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:     <system>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       <entry name="serial">f4d80e03-89cd-4c85-93c4-442da626393e</entry>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       <entry name="uuid">f4d80e03-89cd-4c85-93c4-442da626393e</entry>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:     </system>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:   <os>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:   </os>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:   <features>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:   </features>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:   <devices>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/f4d80e03-89cd-4c85-93c4-442da626393e/disk"/>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:     </disk>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/f4d80e03-89cd-4c85-93c4-442da626393e/disk.config"/>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:     </disk>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:d1:bb:a5"/>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       <target dev="tap525eac81-fb"/>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:     </interface>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/f4d80e03-89cd-4c85-93c4-442da626393e/console.log" append="off"/>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:     </serial>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:     <video>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:     </video>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:     </rng>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:   </devices>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]: </domain>
May 28 01:04:33.441328 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:04:33.443610 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Preparing to wait for external event network-vif-plugged-525eac81-fbc6-4dcc-b574-fca50bcfc9c9 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:04:33.443610 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "f4d80e03-89cd-4c85-93c4-442da626393e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:33.443610 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "f4d80e03-89cd-4c85-93c4-442da626393e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:33.443610 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "f4d80e03-89cd-4c85-93c4-442da626393e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:33.443610 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:04:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1977446406',display_name='tempest-TestEncryptedCinderVolumes-server-1977446406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testencryptedcindervolumes-server-1977446406',id=41,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGRPTJ6ejodf1Q3L0IjNVvQeFNLABSt5TAusszMgR3N3vr9IKTWFitsNJvMbnbr6GoZTcfmVR4BzCvUWM5nVC8QlDhk4nJ7EaCV62OH2oOoTXuJZCjWBkiGxAktquYgRA==',key_name='tempest-keypair-1974424304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a430f0d6bcc84a29bc3e96514422896b',ramdisk_id='',reservation_id='r-cmse21k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-2086871542',owner_user_name='tempest-TestEncryptedCinderVolumes-2086871542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:04:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbae7974478d45b3908aaaa5b4408e26',uuid=f4d80e03-89cd-4c85-93c4-442da626393e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "525eac81-fbc6-4dcc-b574-fca50bcfc9c9", "address": "fa:16:3e:d1:bb:a5", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap525eac81-fb", "ovs_interfaceid": "525eac81-fbc6-4dcc-b574-fca50bcfc9c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:04:33.443610 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converting VIF {"id": "525eac81-fbc6-4dcc-b574-fca50bcfc9c9", "address": "fa:16:3e:d1:bb:a5", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap525eac81-fb", "ovs_interfaceid": "525eac81-fbc6-4dcc-b574-fca50bcfc9c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:04:33.443610 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:bb:a5,bridge_name='br-int',has_traffic_filtering=True,id=525eac81-fbc6-4dcc-b574-fca50bcfc9c9,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525eac81-fb') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:04:33.443610 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:bb:a5,bridge_name='br-int',has_traffic_filtering=True,id=525eac81-fbc6-4dcc-b574-fca50bcfc9c9,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525eac81-fb') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:04:33.444027 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:33.444366 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:33.444463 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:04:33.445504 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:33.445673 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9051c87d-8fff-5d64-9809-9599afef7c17', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:33.446388 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:33.447578 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:33.448378 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:33.451603 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:33.451603 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap525eac81-fb, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:33.451603 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap525eac81-fb, col_values=(('qos', UUID('0c0005ab-e8b5-428d-83ea-ea058f6b1c3a')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:33.451603 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap525eac81-fb, col_values=(('external_ids', {'iface-id': '525eac81-fbc6-4dcc-b574-fca50bcfc9c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:bb:a5', 'vm-uuid': 'f4d80e03-89cd-4c85-93c4-442da626393e'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:33.453781 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:33.453781 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:33.459648 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:33.459648 np0000001577 nova-compute[98319]: INFO os_vif [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:bb:a5,bridge_name='br-int',has_traffic_filtering=True,id=525eac81-fbc6-4dcc-b574-fca50bcfc9c9,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525eac81-fb')
May 28 01:04:33.731399 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dfdaf73e-c4bc-4305-9150-56ab32b69e5a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.512s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:33.810025 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-dfdaf73e-c4bc-4305-9150-56ab32b69e5a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Deleted allocations for instance d09e5674-c5ab-4ace-9952-554361002541
May 28 01:04:33.877423 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0003137929998047184 future=<Future at 0x7c988c034440 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:33.877593 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:33.877708 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=0.10894463899967377 future=<Future at 0x7c984c468c20 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:33.877794 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=0.10885759699976916 future=<Future at 0x7c984c468c20 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:33.878114 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Emitting event <LifecycleEvent: 1779930258.8768237, f2b64af8-9a7b-4726-b298-cf9d2cb24498 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:04:33.878982 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] VM Stopped (Lifecycle Event)
May 28 01:04:33.899250 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:33.988955 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.002272973000344791 future=<Future at 0x7c984c468c20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:33.991074 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Emitting event <LifecycleEvent: 1779930258.986599, 8c35bc03-1899-4eb9-aefe-0bd301686dcf => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:04:33.991717 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:33.991926 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] VM Stopped (Lifecycle Event)
May 28 01:04:33.992782 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=1.3899596159999419 future=<Future at 0x7c98704ac4d0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:33.992894 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=1.3898206469998513 future=<Future at 0x7c98704ac4d0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:34.381708 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f2b64af8-9a7b-4726-b298-cf9d2cb24498] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:34.449484 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:34.449686 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:34.449927 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:34.450128 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:34.450270 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:34.452332 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Terminating instance
May 28 01:04:34.494931 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: 8c35bc03-1899-4eb9-aefe-0bd301686dcf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:34.509973 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "27a2f570-fa9f-4f8d-8b04-b485a51b63cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:34.510166 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "27a2f570-fa9f-4f8d-8b04-b485a51b63cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:34.510384 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "27a2f570-fa9f-4f8d-8b04-b485a51b63cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:34.510430 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "27a2f570-fa9f-4f8d-8b04-b485a51b63cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:34.510555 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "27a2f570-fa9f-4f8d-8b04-b485a51b63cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:34.513356 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Terminating instance
May 28 01:04:34.822109 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dfdaf73e-c4bc-4305-9150-56ab32b69e5a tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "d09e5674-c5ab-4ace-9952-554361002541" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.991s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:34.956962 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:04:34.984506 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:04:34.984639 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:04:34.984771 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] No VIF found with MAC fa:16:3e:d1:bb:a5, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:04:34.985269 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Using config drive
May 28 01:04:34.989228 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:34.995561 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:35.018466 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:04:35.025039 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:35.055301 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:35.057703 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:35.083804 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:35.163006 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-86356ab5-f249-45d4-bedf-f44c5c7e40e5 req-50835b6a-b078-4077-a188-d73f5bc425be service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Received event network-vif-unplugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:35.164523 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:35.165258 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-86356ab5-f249-45d4-bedf-f44c5c7e40e5 req-50835b6a-b078-4077-a188-d73f5bc425be service nova] Acquiring lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:35.165258 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-86356ab5-f249-45d4-bedf-f44c5c7e40e5 req-50835b6a-b078-4077-a188-d73f5bc425be service nova] Lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:35.165258 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-86356ab5-f249-45d4-bedf-f44c5c7e40e5 req-50835b6a-b078-4077-a188-d73f5bc425be service nova] Lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:35.165488 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-86356ab5-f249-45d4-bedf-f44c5c7e40e5 req-50835b6a-b078-4077-a188-d73f5bc425be service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] No waiting events found dispatching network-vif-unplugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:35.165488 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-86356ab5-f249-45d4-bedf-f44c5c7e40e5 req-50835b6a-b078-4077-a188-d73f5bc425be service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Received event network-vif-unplugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:04:35.178893 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:35.201313 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:35.245518 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:35.249844 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:35.383581 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0008291110002573987 future=<Future at 0x7c98704ac4d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:35.383728 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:35.383773 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=7.321332386999984 future=<Future at 0x7c984c7d7680 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:35.383849 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=7.321266062000177 future=<Future at 0x7c984c7d7680 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:35.385965 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Emitting event <LifecycleEvent: 1779930260.382649, d988b526-836d-48b8-a381-1f7679caf41d => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:04:35.386616 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] VM Stopped (Lifecycle Event)
May 28 01:04:35.403711 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999755123999876 future=<Future at 0x7c98705373b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:35.419940 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Instance destroyed successfully.
May 28 01:04:35.420913 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lazy-loading 'resources' on Instance uuid 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:35.425682 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999697266000112 future=<Future at 0x7c984c7d6c00 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:35.427525 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Instance destroyed successfully.
May 28 01:04:35.428622 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lazy-loading 'resources' on Instance uuid 27a2f570-fa9f-4f8d-8b04-b485a51b63cb {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:35.481727 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:04:35.482046 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:04:35.493746 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:35.612981 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Creating config drive at /opt/stack/data/nova/instances/f4d80e03-89cd-4c85-93c4-442da626393e/disk.config
May 28 01:04:35.616485 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f4d80e03-89cd-4c85-93c4-442da626393e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzanw777i {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:04:35.666040 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f4d80e03-89cd-4c85-93c4-442da626393e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzanw777i" returned: 0 in 0.049s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:04:35.893416 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: d988b526-836d-48b8-a381-1f7679caf41d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:35.923191 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:02:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-694763940',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serverbootfromvolumestablerescuetest-server-694763940',id=33,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:03:01Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e28acf25c4445ea969bd7bca3eac146',ramdisk_id='',reservation_id='r-c0ydlb5a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-568223226',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:03:07Z,user_data=None,user_id='fb6c20970bf0401190583f6348e00e4b',uuid=0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "165b2ee7-8c11-422b-ad45-9cc83cfea68c", "address": "fa:16:3e:71:99:0d", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap165b2ee7-8c", "ovs_interfaceid": "165b2ee7-8c11-422b-ad45-9cc83cfea68c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:04:35.923382 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Converting VIF {"id": "165b2ee7-8c11-422b-ad45-9cc83cfea68c", "address": "fa:16:3e:71:99:0d", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap165b2ee7-8c", "ovs_interfaceid": "165b2ee7-8c11-422b-ad45-9cc83cfea68c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:04:35.924131 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:99:0d,bridge_name='br-int',has_traffic_filtering=True,id=165b2ee7-8c11-422b-ad45-9cc83cfea68c,network=Network(c25f8563-bd10-4e42-b4ce-fd2164eca324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap165b2ee7-8c') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:04:35.924372 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:99:0d,bridge_name='br-int',has_traffic_filtering=True,id=165b2ee7-8c11-422b-ad45-9cc83cfea68c,network=Network(c25f8563-bd10-4e42-b4ce-fd2164eca324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap165b2ee7-8c') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:04:35.925929 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:35.926275 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap165b2ee7-8c, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:35.930406 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:03:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1503492322',display_name='tempest-TestVolumeBootPattern-server-1503492322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpattern-server-1503492322',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8QzN7WIM/7r+FXfxp48vv6ACDZyOEQjp19a7p1UcygauFxHFUkfzlUA3gFyPYoEyNZ3UhngJ8gsxkE2OmPRYuT7eZJnm0MUNhRjsZz5nqxS6AcX7i+n2BWwU1Ts1LTnw==',key_name='tempest-keypair-145839747',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:03:36Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='050f928f1ce449d6a447cd343dc4ff80',ramdisk_id='',reservation_id='r-m1wnmyaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1449742411',owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:04:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c803ddeaf4f4b3db07587419087b3b2',uuid=27a2f570-fa9f-4f8d-8b04-b485a51b63cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2072e10-c933-4dd6-84e1-43734392b12e", "address": "fa:16:3e:29:2a:08", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2072e10-c9", "ovs_interfaceid": "a2072e10-c933-4dd6-84e1-43734392b12e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:04:35.930559 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converting VIF {"id": "a2072e10-c933-4dd6-84e1-43734392b12e", "address": "fa:16:3e:29:2a:08", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2072e10-c9", "ovs_interfaceid": "a2072e10-c933-4dd6-84e1-43734392b12e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:04:35.930955 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:2a:08,bridge_name='br-int',has_traffic_filtering=True,id=a2072e10-c933-4dd6-84e1-43734392b12e,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2072e10-c9') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:04:35.931134 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:2a:08,bridge_name='br-int',has_traffic_filtering=True,id=a2072e10-c933-4dd6-84e1-43734392b12e,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2072e10-c9') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:04:35.937886 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:35.939078 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:35.947454 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:35.948442 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:35.948442 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2072e10-c9, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:35.949896 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:35.950656 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:35.955028 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:35.956219 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:35.956590 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d9be23a-e8fc-40a8-b76e-fdf2185ebf65) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:35.957065 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:35.957581 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:35.961773 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:35.962119 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:35.962270 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=99c4e70f-88dc-42b0-92bc-0fa7bc2725a5) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:35.963083 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:35.964389 np0000001577 nova-compute[98319]: INFO os_vif [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:99:0d,bridge_name='br-int',has_traffic_filtering=True,id=165b2ee7-8c11-422b-ad45-9cc83cfea68c,network=Network(c25f8563-bd10-4e42-b4ce-fd2164eca324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap165b2ee7-8c')
May 28 01:04:35.966716 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:04:35.967358 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:35.967818 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '773fdc14-869d-4cd3-b671-b799bcc94e1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:04:35.967978 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:04:35.968400 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:04:35.968763 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '773fdc14-869d-4cd3-b671-b799bcc94e1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:04:35.968913 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:04:35.971039 np0000001577 nova-compute[98319]: INFO os_vif [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:2a:08,bridge_name='br-int',has_traffic_filtering=True,id=a2072e10-c933-4dd6-84e1-43734392b12e,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2072e10-c9')
May 28 01:04:35.973011 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:04:35.973298 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70941468-6e8f-4715-abc0-bd620ed1bb5d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:04:35.973406 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:04:35.992711 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:35.992711 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:35.992711 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:35.992711 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:35.992711 np0000001577 nova-compute[98319]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:35.992711 np0000001577 nova-compute[98319]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:35.992711 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:04:35.993227 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:35.993227 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:35.993227 np0000001577 nova-compute[98319]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:35.993227 np0000001577 nova-compute[98319]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f (non-flash)
May 28 01:04:35.993227 np0000001577 nova-compute[98319]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:35.993227 np0000001577 nova-compute[98319]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:35.993227 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:04:35.993227 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', '84'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', '85')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:04:35.993227 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', '63')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:04:35.993909 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f', '62')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:04:35.994567 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c988c02c9a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f'): ({'sdd'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:04:35.994775 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Removing multipathed devices sde, sdd {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:04:35.994993 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Flush multipath device 3300000006800a6c7 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:04:35.996537 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:35.997538 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:35.997538 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:35.997538 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Auditing locally available compute resources for np0000001577 (node: np0000001577) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 01:04:36.026000 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:04:36.049450 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:36.067162 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "8bca25d8-071e-4b2d-960c-50582381cc75" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:36.067413 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "8bca25d8-071e-4b2d-960c-50582381cc75" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:36.067660 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "8bca25d8-071e-4b2d-960c-50582381cc75-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:36.067818 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "8bca25d8-071e-4b2d-960c-50582381cc75-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:36.067970 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "8bca25d8-071e-4b2d-960c-50582381cc75-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:36.070984 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Terminating instance
May 28 01:04:36.074262 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:36.076732 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:36.079332 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:04:36.135677 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:04:36.135814 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:04:36.136840 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:04:36.153678 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:04:36.154762 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:04:36.167278 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:36.168077 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:36.203954 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f, portal: 192.168.40.100,3260]
May 28 01:04:36.203954 np0000001577 nova-compute[98319]: Logout of [sid: 63, target: iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f, portal: 192.168.40.100,3260] successful.
May 28 01:04:36.203954 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:36.223020 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:36.237042 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:36.247264 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:36.269131 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f, portal: 192.168.50.100,3260]
May 28 01:04:36.269131 np0000001577 nova-compute[98319]: Logout of [sid: 62, target: iqn.2023-03.storpool.com:os--volume-773fdc14-869d-4cd3-b671-b799bcc94e1f, portal: 192.168.50.100,3260] successful.
May 28 01:04:36.269131 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:36.282754 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:36.283106 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:04:36.283273 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] <== disconnect_volume: return (315ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:04:36.283399 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:04:36.283848 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Deleting instance files /opt/stack/data/nova/instances/0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c_del
May 28 01:04:36.284435 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.311s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:04:36.284735 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70941468-6e8f-4715-abc0-bd620ed1bb5d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:04:36.284893 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:04:36.285098 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Deletion of /opt/stack/data/nova/instances/0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c_del complete
May 28 01:04:36.309563 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:36.309563 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:36.309563 np0000001577 nova-compute[98319]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:36.309563 np0000001577 nova-compute[98319]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:36.309563 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:04:36.309967 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:36.309967 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:36.309967 np0000001577 nova-compute[98319]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:36.309967 np0000001577 nova-compute[98319]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d (non-flash)
May 28 01:04:36.309967 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:04:36.309967 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', '84'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', '85')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:04:36.312472 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', '84')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:04:36.312472 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d', '85')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:04:36.312472 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c9870465800>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d'): ({'sdc'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:04:36.312472 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:04:36.312472 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Flush multipath device 3300000002b367c70 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:04:36.365993 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:04:36.400694 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:36.402824 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:36.405319 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:36.407718 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:04:36.427080 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:36.453406 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:04:36.453586 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:04:36.454359 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:04:36.466246 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:04:36.466953 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:04:36.478173 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:36.509707 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 84, target: iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d, portal: 192.168.40.100,3260]
May 28 01:04:36.509707 np0000001577 nova-compute[98319]: Logout of [sid: 84, target: iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d, portal: 192.168.40.100,3260] successful.
May 28 01:04:36.509707 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:36.530513 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:36.541300 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:36.578382 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 85, target: iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d, portal: 192.168.50.100,3260]
May 28 01:04:36.578382 np0000001577 nova-compute[98319]: Logout of [sid: 85, target: iqn.2023-03.storpool.com:os--volume-70941468-6e8f-4715-abc0-bd620ed1bb5d, portal: 192.168.50.100,3260] successful.
May 28 01:04:36.578382 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:36.578852 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:04:36.592530 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:36.593126 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:04:36.593294 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] <== disconnect_volume: return (619ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:04:36.593437 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:04:36.593734 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Deleting instance files /opt/stack/data/nova/instances/27a2f570-fa9f-4f8d-8b04-b485a51b63cb_del
May 28 01:04:36.594334 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Deletion of /opt/stack/data/nova/instances/27a2f570-fa9f-4f8d-8b04-b485a51b63cb_del complete
May 28 01:04:36.598845 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:36.602793 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:36.623638 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:36.626269 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:36.659795 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:36.772153 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:36.794062 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Took 1.84 seconds to destroy the instance on the hypervisor.
May 28 01:04:36.795715 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:04:36.795868 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:04:36.795955 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:04:36.796200 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:36.876478 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:36.899124 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.99964206300001 future=<Future at 0x7c98704486e0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:36.908343 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Instance destroyed successfully.
May 28 01:04:36.908889 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lazy-loading 'resources' on Instance uuid 8bca25d8-071e-4b2d-960c-50582381cc75 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:36.917220 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930276.916805, f4d80e03-89cd-4c85-93c4-442da626393e => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:04:36.917377 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] VM Started (Lifecycle Event)
May 28 01:04:37.101822 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Took 2.08 seconds to destroy the instance on the hypervisor.
May 28 01:04:37.102351 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:04:37.102523 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:04:37.102616 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:04:37.102835 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:37.197130 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:37.247867 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-be9c72af-576f-4b55-9616-fcecf1874929 req-254c5507-1f10-4573-ab8d-19eec2c4ebf8 service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Received event network-vif-unplugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:37.248068 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-be9c72af-576f-4b55-9616-fcecf1874929 req-254c5507-1f10-4573-ab8d-19eec2c4ebf8 service nova] Acquiring lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:37.248254 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-be9c72af-576f-4b55-9616-fcecf1874929 req-254c5507-1f10-4573-ab8d-19eec2c4ebf8 service nova] Lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:37.248666 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-be9c72af-576f-4b55-9616-fcecf1874929 req-254c5507-1f10-4573-ab8d-19eec2c4ebf8 service nova] Lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:37.248863 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-be9c72af-576f-4b55-9616-fcecf1874929 req-254c5507-1f10-4573-ab8d-19eec2c4ebf8 service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] No waiting events found dispatching network-vif-unplugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:37.248982 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-be9c72af-576f-4b55-9616-fcecf1874929 req-254c5507-1f10-4573-ab8d-19eec2c4ebf8 service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Received event network-vif-unplugged-165b2ee7-8c11-422b-ad45-9cc83cfea68c for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:04:37.264858 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Error from libvirt while getting description of instance-00000021: [Error Code 42] Domain not found: no domain with matching uuid '0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c' (instance-00000021): libvirt.libvirtError: Domain not found: no domain with matching uuid '0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c' (instance-00000021)
May 28 01:04:37.266990 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-9 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:04:37.267850 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Error from libvirt while getting description of instance-00000024: [Error Code 42] Domain not found: no domain with matching uuid '27a2f570-fa9f-4f8d-8b04-b485a51b63cb' (instance-00000024): libvirt.libvirtError: Domain not found: no domain with matching uuid '27a2f570-fa9f-4f8d-8b04-b485a51b63cb' (instance-00000024)
May 28 01:04:37.269438 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4d80e03-89cd-4c85-93c4-442da626393e/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:04:37.295382 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-142e3fa0-c0e1-4b0d-9e33-3eb8d80b1f2b req-296bb859-7189-4eb6-b148-90cb8ad6ae5d service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Received event network-vif-deleted-165b2ee7-8c11-422b-ad45-9cc83cfea68c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:37.295980 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-142e3fa0-c0e1-4b0d-9e33-3eb8d80b1f2b req-296bb859-7189-4eb6-b148-90cb8ad6ae5d service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Neutron deleted interface 165b2ee7-8c11-422b-ad45-9cc83cfea68c; detaching it from the instance and deleting it from the info cache
May 28 01:04:37.304573 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-142e3fa0-c0e1-4b0d-9e33-3eb8d80b1f2b req-296bb859-7189-4eb6-b148-90cb8ad6ae5d service nova] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Detach interface failed, port_id=165b2ee7-8c11-422b-ad45-9cc83cfea68c, reason: Instance 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:04:37.368561 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4d80e03-89cd-4c85-93c4-442da626393e/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:04:37.369030 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4d80e03-89cd-4c85-93c4-442da626393e/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:04:37.411934 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T00:58:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-21773514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumemultiattachtest-server-21773514',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T00:58:45Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='938c2829112843edb2054984e80ce7ad',ramdisk_id='',reservation_id='r-ub9dilir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-89204095',owner_user_name='tempest-AttachVolumeMultiAttachTest-89204095-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T00:58:46Z,user_data=None,user_id='f8586a18edcf42cab0a60028135ae401',uuid=8bca25d8-071e-4b2d-960c-50582381cc75,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed09134a-777e-4b64-a80d-4d4e00e3b25a", "address": "fa:16:3e:75:1c:46", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped09134a-77", "ovs_interfaceid": "ed09134a-777e-4b64-a80d-4d4e00e3b25a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:04:37.412242 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converting VIF {"id": "ed09134a-777e-4b64-a80d-4d4e00e3b25a", "address": "fa:16:3e:75:1c:46", "network": {"id": "7181f668-b940-4bf1-bc3e-306092e27e85", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1653400883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "938c2829112843edb2054984e80ce7ad", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped09134a-77", "ovs_interfaceid": "ed09134a-777e-4b64-a80d-4d4e00e3b25a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:04:37.413882 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:1c:46,bridge_name='br-int',has_traffic_filtering=True,id=ed09134a-777e-4b64-a80d-4d4e00e3b25a,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped09134a-77') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:04:37.413882 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:1c:46,bridge_name='br-int',has_traffic_filtering=True,id=ed09134a-777e-4b64-a80d-4d4e00e3b25a,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped09134a-77') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:04:37.414790 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:37.415209 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped09134a-77, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:37.416806 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:37.419715 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:37.421435 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:37.421666 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:37.421840 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7583ef48-7551-4a24-993f-3cde0219dcbd) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:37.422459 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:37.423179 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:37.425290 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:37.428093 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930277.4274547, f4d80e03-89cd-4c85-93c4-442da626393e => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:04:37.428093 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] VM Paused (Lifecycle Event)
May 28 01:04:37.430170 np0000001577 nova-compute[98319]: INFO os_vif [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:1c:46,bridge_name='br-int',has_traffic_filtering=True,id=ed09134a-777e-4b64-a80d-4d4e00e3b25a,network=Network(7181f668-b940-4bf1-bc3e-306092e27e85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped09134a-77')
May 28 01:04:37.465178 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4d80e03-89cd-4c85-93c4-442da626393e/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:04:37.467975 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:04:37.492279 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:04:37.493258 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '16418261-7c75-4055-8eaf-81fc4861a35c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:04:37.493751 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:04:37.494512 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:04:37.494976 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '16418261-7c75-4055-8eaf-81fc4861a35c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:04:37.495230 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:04:37.515087 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Acquiring lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:37.516049 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:37.519137 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:37.519137 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:37.519137 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:04:37.519335 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:37.519335 np0000001577 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c (non-flash)
May 28 01:04:37.519335 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:04:37.519509 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:04:37.520013 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '19')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:04:37.521958 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c', '20')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:04:37.523919 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c987058c400>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c'): ({'sdp'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c'): ({'sdq'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:04:37.524415 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Removing multipathed devices sdp, sdq {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:04:37.525664 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Flush multipath device 3300000007ca69e9f {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:04:37.571594 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:04:37.579341 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:04:37.579982 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:04:37.629267 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Remove SCSI device /dev/sdq with /sys/block/sdq/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:04:37.663346 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:04:37.672717 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:04:37.686752 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Checking to see if SCSI volumes sdp, sdq have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:04:37.687082 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] SCSI volumes sdp, sdq have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:04:37.688955 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Checking to see if device paths {'sdp', 'sdq'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:04:37.700366 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Device paths {'sdp', 'sdq'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:04:37.700366 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:04:37.710047 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-34594848-6241-4498-8cf7-478c3f28f956 req-02dbccc6-5a36-45eb-a585-263699e4b06c service nova] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Received event network-vif-deleted-a2072e10-c933-4dd6-84e1-43734392b12e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:37.711045 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-34594848-6241-4498-8cf7-478c3f28f956 req-02dbccc6-5a36-45eb-a585-263699e4b06c service nova] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Neutron deleted interface a2072e10-c933-4dd6-84e1-43734392b12e; detaching it from the instance and deleting it from the info cache
May 28 01:04:37.711727 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:37.715430 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-34594848-6241-4498-8cf7-478c3f28f956 req-02dbccc6-5a36-45eb-a585-263699e4b06c service nova] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Detach interface failed, port_id=a2072e10-c933-4dd6-84e1-43734392b12e, reason: Instance 27a2f570-fa9f-4f8d-8b04-b485a51b63cb could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:04:37.737863 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c, portal: 192.168.40.100,3260]
May 28 01:04:37.737863 np0000001577 nova-compute[98319]: Logout of [sid: 19, target: iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c, portal: 192.168.40.100,3260] successful.
May 28 01:04:37.737863 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:37.739312 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:04:37.752860 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:37.764241 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:37.773990 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:04:37.774417 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:04:37.794716 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c, portal: 192.168.50.100,3260]
May 28 01:04:37.794716 np0000001577 nova-compute[98319]: Logout of [sid: 20, target: iqn.2023-03.storpool.com:os--volume-16418261-7c75-4055-8eaf-81fc4861a35c, portal: 192.168.50.100,3260] successful.
May 28 01:04:37.794716 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:37.804100 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:37.804723 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:04:37.804884 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] <== disconnect_volume: return (311ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:04:37.805084 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:04:37.805506 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Deleting instance files /opt/stack/data/nova/instances/8bca25d8-071e-4b2d-960c-50582381cc75_del
May 28 01:04:37.806286 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Deletion of /opt/stack/data/nova/instances/8bca25d8-071e-4b2d-960c-50582381cc75_del complete
May 28 01:04:37.862102 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:04:37.865968 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:04:37.866812 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:04:37.916353 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "env LANG=C uptime" returned: 0 in 0.049s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:04:37.917173 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Hypervisor/Node resource view: name=np0000001577 free_ram=12897MB free_disk=74.01557159423828GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 01:04:37.917332 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:37.917583 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:37.931723 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:37.933530 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:04:38.018559 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:04:38.153235 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:04:38.241667 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Took 1.45 seconds to deallocate network for instance.
May 28 01:04:38.282252 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:38.312706 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Took 1.73 seconds to destroy the instance on the hypervisor.
May 28 01:04:38.313244 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:04:38.313416 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:04:38.313494 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:04:38.314266 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:38.396502 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:38.438144 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:04:38.568222 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:38.656053 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Took 1.55 seconds to deallocate network for instance.
May 28 01:04:38.793176 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Took 0.55 seconds to detach 1 volumes for instance.
May 28 01:04:38.794907 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Deleting volume: 773fdc14-869d-4cd3-b671-b799bcc94e1f {{(pid=98319) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 01:04:38.977176 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 8bca25d8-071e-4b2d-960c-50582381cc75 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:04:38.977305 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 63eb5e59-29a0-4b0c-b731-6d7265f7d91f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:04:38.977410 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:04:38.977490 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 27a2f570-fa9f-4f8d-8b04-b485a51b63cb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:04:38.977599 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:04:38.977677 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance f4d80e03-89cd-4c85-93c4-442da626393e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:04:39.071573 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:04:39.212274 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Took 0.56 seconds to detach 1 volumes for instance.
May 28 01:04:39.336719 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:39.356242 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a19895e7-1053-44d4-b412-b8b84db3f5b2 req-ae11b5a7-629f-4168-85e8-b6966f820726 service nova] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Received event network-vif-deleted-ed09134a-777e-4b64-a80d-4d4e00e3b25a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:39.356982 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a19895e7-1053-44d4-b412-b8b84db3f5b2 req-ae11b5a7-629f-4168-85e8-b6966f820726 service nova] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Received event network-vif-plugged-525eac81-fbc6-4dcc-b574-fca50bcfc9c9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:39.356982 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a19895e7-1053-44d4-b412-b8b84db3f5b2 req-ae11b5a7-629f-4168-85e8-b6966f820726 service nova] Acquiring lock "f4d80e03-89cd-4c85-93c4-442da626393e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:39.357182 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a19895e7-1053-44d4-b412-b8b84db3f5b2 req-ae11b5a7-629f-4168-85e8-b6966f820726 service nova] Lock "f4d80e03-89cd-4c85-93c4-442da626393e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:39.357182 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a19895e7-1053-44d4-b412-b8b84db3f5b2 req-ae11b5a7-629f-4168-85e8-b6966f820726 service nova] Lock "f4d80e03-89cd-4c85-93c4-442da626393e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:39.357373 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a19895e7-1053-44d4-b412-b8b84db3f5b2 req-ae11b5a7-629f-4168-85e8-b6966f820726 service nova] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Processing event network-vif-plugged-525eac81-fbc6-4dcc-b574-fca50bcfc9c9 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:04:39.357682 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a19895e7-1053-44d4-b412-b8b84db3f5b2 req-ae11b5a7-629f-4168-85e8-b6966f820726 service nova] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Received event network-vif-plugged-525eac81-fbc6-4dcc-b574-fca50bcfc9c9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:39.357804 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a19895e7-1053-44d4-b412-b8b84db3f5b2 req-ae11b5a7-629f-4168-85e8-b6966f820726 service nova] Acquiring lock "f4d80e03-89cd-4c85-93c4-442da626393e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:39.358127 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a19895e7-1053-44d4-b412-b8b84db3f5b2 req-ae11b5a7-629f-4168-85e8-b6966f820726 service nova] Lock "f4d80e03-89cd-4c85-93c4-442da626393e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:39.358797 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a19895e7-1053-44d4-b412-b8b84db3f5b2 req-ae11b5a7-629f-4168-85e8-b6966f820726 service nova] Lock "f4d80e03-89cd-4c85-93c4-442da626393e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:39.358797 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a19895e7-1053-44d4-b412-b8b84db3f5b2 req-ae11b5a7-629f-4168-85e8-b6966f820726 service nova] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] No waiting events found dispatching network-vif-plugged-525eac81-fbc6-4dcc-b574-fca50bcfc9c9 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:39.358797 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-a19895e7-1053-44d4-b412-b8b84db3f5b2 req-ae11b5a7-629f-4168-85e8-b6966f820726 service nova] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Received unexpected event network-vif-plugged-525eac81-fbc6-4dcc-b574-fca50bcfc9c9 for instance with vm_state building and task_state spawning.
May 28 01:04:39.360137 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:04:39.363238 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930279.3628647, f4d80e03-89cd-4c85-93c4-442da626393e => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:04:39.363352 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] VM Resumed (Lifecycle Event)
May 28 01:04:39.366134 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:04:39.368683 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Instance spawned successfully.
May 28 01:04:39.368799 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:04:39.480132 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance d5aa4bd8-07f0-4329-88d3-63aa5a2be798 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 28 01:04:39.480434 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 01:04:39.480632 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Final resource view: name=np0000001577 phys_ram=24030MB used_ram=1664MB phys_disk=95GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:04:37 up 36 min,  2 users,  load average: 6.35, 6.55, 3.81\n', 'num_instances': '6', 'num_vm_active': '5', 'num_task_deleting': '3', 'num_os_type_None': '6', 'num_proj_938c2829112843edb2054984e80ce7ad': '1', 'io_workload': '1', 'num_task_None': '2', 'num_proj_9e28acf25c4445ea969bd7bca3eac146': '2', 'num_proj_050f928f1ce449d6a447cd343dc4ff80': '1', 'num_proj_f6a7090a79f448f3abe4737bf127df53': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_a430f0d6bcc84a29bc3e96514422896b': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 01:04:39.573197 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Took 1.26 seconds to deallocate network for instance.
May 28 01:04:39.718886 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:39.867336 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:39.872998 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:04:39.875600 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:04:39.877160 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:04:39.877516 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:04:39.878608 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:04:39.880469 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:04:39.881565 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:04:39.882361 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:04:39.882680 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:04:40.088120 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:40.088311 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:40.088451 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Shelving
May 28 01:04:40.147043 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Took 0.57 seconds to detach 1 volumes for instance.
May 28 01:04:40.377445 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:04:40.387349 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Took 9.58 seconds to spawn the instance on the hypervisor.
May 28 01:04:40.388408 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:04:40.393662 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:40.653927 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:40.896688 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Compute_service record updated for np0000001577:np0000001577 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 01:04:40.896894 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.979s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:40.897219 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.329s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:40.897607 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:04:40.897769 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Cleaning up deleted instances {{(pid=98319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 28 01:04:40.903947 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:04:40.904144 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Claim successful on node np0000001577
May 28 01:04:40.914822 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Took 15.61 seconds to build instance.
May 28 01:04:41.121151 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:41.125272 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:41.150348 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:41.154429 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:41.190037 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:41.249382 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:41.400686 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] There are 0 instances to clean {{(pid=98319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 28 01:04:41.401366 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:04:41.418214 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a677648-09ad-462c-9565-8d840718610c tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "f4d80e03-89cd-4c85-93c4-442da626393e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.126s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:41.434088 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999758128999929 future=<Future at 0x7c984c49e1b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:41.435532 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Instance destroyed successfully.
May 28 01:04:41.436142 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lazy-loading 'numa_topology' on Instance uuid 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:41.525885 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-415af847-610e-4dbf-a698-edba9d04db7c req-f9cf9f28-d148-40d7-9ef5-5d04eb22d302 service nova] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Received event network-changed-525eac81-fbc6-4dcc-b574-fca50bcfc9c9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:41.525885 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-415af847-610e-4dbf-a698-edba9d04db7c req-f9cf9f28-d148-40d7-9ef5-5d04eb22d302 service nova] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Refreshing instance network info cache due to event network-changed-525eac81-fbc6-4dcc-b574-fca50bcfc9c9. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:04:41.525885 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-415af847-610e-4dbf-a698-edba9d04db7c req-f9cf9f28-d148-40d7-9ef5-5d04eb22d302 service nova] Acquiring lock "refresh_cache-f4d80e03-89cd-4c85-93c4-442da626393e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:04:41.525885 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-415af847-610e-4dbf-a698-edba9d04db7c req-f9cf9f28-d148-40d7-9ef5-5d04eb22d302 service nova] Acquired lock "refresh_cache-f4d80e03-89cd-4c85-93c4-442da626393e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:04:41.525885 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-415af847-610e-4dbf-a698-edba9d04db7c req-f9cf9f28-d148-40d7-9ef5-5d04eb22d302 service nova] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Refreshing network info cache for port 525eac81-fbc6-4dcc-b574-fca50bcfc9c9 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:04:41.897283 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:04:41.897504 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:04:41.897706 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:04:41.897941 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:04:41.898184 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:04:41.898357 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:04:41.898557 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:04:41.898684 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 01:04:41.898925 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 23.75 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:04:42.030963 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-415af847-610e-4dbf-a698-edba9d04db7c req-f9cf9f28-d148-40d7-9ef5-5d04eb22d302 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:42.067665 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Beginning cold snapshot process
May 28 01:04:42.341186 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:04:42.341241 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:04:42.423033 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:42.424775 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-415af847-610e-4dbf-a698-edba9d04db7c req-f9cf9f28-d148-40d7-9ef5-5d04eb22d302 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:42.556084 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-415af847-610e-4dbf-a698-edba9d04db7c req-f9cf9f28-d148-40d7-9ef5-5d04eb22d302 service nova] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Updated VIF entry in instance network info cache for port 525eac81-fbc6-4dcc-b574-fca50bcfc9c9. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:04:42.557107 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-415af847-610e-4dbf-a698-edba9d04db7c req-f9cf9f28-d148-40d7-9ef5-5d04eb22d302 service nova] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Updating instance_info_cache with network_info: [{"id": "525eac81-fbc6-4dcc-b574-fca50bcfc9c9", "address": "fa:16:3e:d1:bb:a5", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap525eac81-fb", "ovs_interfaceid": "525eac81-fbc6-4dcc-b574-fca50bcfc9c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:04:42.705580 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00033237599973290344 future=<Future at 0x7c984c7d7680 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:42.705879 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Emitting event <LifecycleEvent: 1779930267.705069, e410372b-c799-4d0d-879c-4e935f2f2244 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:04:42.705992 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:42.706132 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] VM Stopped (Lifecycle Event)
May 28 01:04:42.707556 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=0.9389358809999067 future=<Future at 0x7c988c08bbc0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:42.708138 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=0.9383245730000453 future=<Future at 0x7c988c08bbc0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:42.846275 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:04:43.058714 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-415af847-610e-4dbf-a698-edba9d04db7c req-f9cf9f28-d148-40d7-9ef5-5d04eb22d302 service nova] Releasing lock "refresh_cache-f4d80e03-89cd-4c85-93c4-442da626393e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:04:43.209933 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: e410372b-c799-4d0d-879c-4e935f2f2244] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:43.351481 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.454s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:43.351733 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:04:43.354488 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 4.018s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:43.578850 np0000001577 nova-compute[98319]: DEBUG nova.privsep.utils [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 01:04:43.579173 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk /opt/stack/data/nova/instances/snapshots/tmpi50dt2ov/a8ce65fb279a48e89c96278bf3b792d8 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:04:43.647212 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0006776770001124532 future=<Future at 0x7c988c08bbc0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:43.651138 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:43.651870 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Emitting event <LifecycleEvent: 1779930268.6464028, d09e5674-c5ab-4ace-9952-554361002541 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:04:43.652005 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=6.750890167999842 future=<Future at 0x7c98705373b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:43.652307 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] VM Stopped (Lifecycle Event)
May 28 01:04:43.655017 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=6.748373619999711 future=<Future at 0x7c98705373b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:43.732786 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:04:43.733010 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:04:43.763513 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk /opt/stack/data/nova/instances/snapshots/tmpi50dt2ov/a8ce65fb279a48e89c96278bf3b792d8" returned: 0 in 0.184s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:04:43.763789 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Snapshot extracted, beginning image upload
May 28 01:04:43.861193 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:04:43.861347 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:04:43.861655 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:43.861871 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:43.920006 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5211ae90fcf1476b917822f860021f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed67ebc30b04fe5895f2b2ddd66e9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:04:44.155185 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7903f36b-0187-45f0-ae25-244f356826a2 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: d09e5674-c5ab-4ace-9952-554361002541] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:44.235555 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:04:44.306490 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Successfully created port: 0fe5497e-7f98-48c5-89d4-5168815ab9c1 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:04:44.369947 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:04:44.741734 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.387s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:44.742713 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 5.024s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:44.828263 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Deleted allocations for instance 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c
May 28 01:04:44.873047 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:04:44.888586 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Successfully updated port: 0fe5497e-7f98-48c5-89d4-5168815ab9c1 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:04:44.930904 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-83ab490a-7ef5-4826-832a-de626afc6bc8 req-fe23c298-5e45-4df3-bf0a-38be8c81e891 service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Received event network-changed-0fe5497e-7f98-48c5-89d4-5168815ab9c1 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:44.931014 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-83ab490a-7ef5-4826-832a-de626afc6bc8 req-fe23c298-5e45-4df3-bf0a-38be8c81e891 service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Refreshing instance network info cache due to event network-changed-0fe5497e-7f98-48c5-89d4-5168815ab9c1. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:04:44.931179 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-83ab490a-7ef5-4826-832a-de626afc6bc8 req-fe23c298-5e45-4df3-bf0a-38be8c81e891 service nova] Acquiring lock "refresh_cache-d5aa4bd8-07f0-4329-88d3-63aa5a2be798" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:04:44.931271 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-83ab490a-7ef5-4826-832a-de626afc6bc8 req-fe23c298-5e45-4df3-bf0a-38be8c81e891 service nova] Acquired lock "refresh_cache-d5aa4bd8-07f0-4329-88d3-63aa5a2be798" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:04:44.931396 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-83ab490a-7ef5-4826-832a-de626afc6bc8 req-fe23c298-5e45-4df3-bf0a-38be8c81e891 service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Refreshing network info cache for port 0fe5497e-7f98-48c5-89d4-5168815ab9c1 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:04:45.131492 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:04:45.131723 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:04:45.379954 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Booting with volume b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 at /dev/vda
May 28 01:04:45.391084 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Acquiring lock "refresh_cache-d5aa4bd8-07f0-4329-88d3-63aa5a2be798" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:04:45.422931 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:04:45.433519 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-83ab490a-7ef5-4826-832a-de626afc6bc8 req-fe23c298-5e45-4df3-bf0a-38be8c81e891 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:45.435362 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:04:45.460748 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:04:45.509354 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:04:45.509740 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:04:45.519651 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:04:45.520616 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe11:792b', 'fe80::94c0:c3ff:fe67:958f', 'fe80::fc16:3eff:fed1:bba5', 'fe80::49a:a7ff:fef7:c9e8'] 
May 28 01:04:45.520736 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:04:45.520871 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:04:45.521099 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:04:45.521311 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Updating existing volume attachment record: 978c90a8-4e7f-4f43-9a44-e039ea2a6a79 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:04:45.526164 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-83ab490a-7ef5-4826-832a-de626afc6bc8 req-fe23c298-5e45-4df3-bf0a-38be8c81e891 service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:04:45.593695 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4e2543f8-8245-4d07-8f3b-7e9556e106fa req-be82b3e5-0412-44b6-aab2-dca3580d0130 service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Received event network-vif-unplugged-53846e61-8840-490f-a976-3997db8a0f0b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:45.593972 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4e2543f8-8245-4d07-8f3b-7e9556e106fa req-be82b3e5-0412-44b6-aab2-dca3580d0130 service nova] Acquiring lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:45.594331 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4e2543f8-8245-4d07-8f3b-7e9556e106fa req-be82b3e5-0412-44b6-aab2-dca3580d0130 service nova] Lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:45.594476 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4e2543f8-8245-4d07-8f3b-7e9556e106fa req-be82b3e5-0412-44b6-aab2-dca3580d0130 service nova] Lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:45.594772 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4e2543f8-8245-4d07-8f3b-7e9556e106fa req-be82b3e5-0412-44b6-aab2-dca3580d0130 service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] No waiting events found dispatching network-vif-unplugged-53846e61-8840-490f-a976-3997db8a0f0b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:45.594941 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-4e2543f8-8245-4d07-8f3b-7e9556e106fa req-be82b3e5-0412-44b6-aab2-dca3580d0130 service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Received unexpected event network-vif-unplugged-53846e61-8840-490f-a976-3997db8a0f0b for instance with vm_state active and task_state shelving_image_uploading.
May 28 01:04:45.635117 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:04:45.727842 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-83ab490a-7ef5-4826-832a-de626afc6bc8 req-fe23c298-5e45-4df3-bf0a-38be8c81e891 service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:04:45.840821 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-931c222a-827a-4b25-b7a5-37017ac2f3b4 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.391s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:46.141890 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.399s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:46.146065 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 5.492s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:46.223595 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Deleted allocations for instance 27a2f570-fa9f-4f8d-8b04-b485a51b63cb
May 28 01:04:46.229991 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-83ab490a-7ef5-4826-832a-de626afc6bc8 req-fe23c298-5e45-4df3-bf0a-38be8c81e891 service nova] Releasing lock "refresh_cache-d5aa4bd8-07f0-4329-88d3-63aa5a2be798" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:04:46.230369 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Acquired lock "refresh_cache-d5aa4bd8-07f0-4329-88d3-63aa5a2be798" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:04:46.230508 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:04:46.250672 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:46.385720 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Snapshot image upload complete
May 28 01:04:46.386033 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:46.466317 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:04:46.466531 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:04:46.695265 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-acc91297-3bf3-4668-9d48-ccad9c26e914 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "63eb5e59-29a0-4b0c-b731-6d7265f7d91f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:46.695473 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-acc91297-3bf3-4668-9d48-ccad9c26e914 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "63eb5e59-29a0-4b0c-b731-6d7265f7d91f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:46.695622 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-acc91297-3bf3-4668-9d48-ccad9c26e914 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "63eb5e59-29a0-4b0c-b731-6d7265f7d91f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:46.695749 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-acc91297-3bf3-4668-9d48-ccad9c26e914 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "63eb5e59-29a0-4b0c-b731-6d7265f7d91f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:46.695842 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-acc91297-3bf3-4668-9d48-ccad9c26e914 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "63eb5e59-29a0-4b0c-b731-6d7265f7d91f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:46.698148 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-acc91297-3bf3-4668-9d48-ccad9c26e914 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Terminating instance
May 28 01:04:46.810663 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:04:46.893035 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Shelve offloading
May 28 01:04:46.970667 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:04:46.978638 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:47.116589 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Updating instance_info_cache with network_info: [{"id": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "address": "fa:16:3e:a0:66:8f", "network": {"id": "330f1ba8-b51a-4cb7-8596-73705ae8eecd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-493364840-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed67ebc30b04fe5895f2b2ddd66e9c3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe5497e-7f", "ovs_interfaceid": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:04:47.201737 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-acc91297-3bf3-4668-9d48-ccad9c26e914 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:04:47.235321 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:47.239506 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cafa8c35-bb0e-4e22-ab77-1d7bbcdd8ea4 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "27a2f570-fa9f-4f8d-8b04-b485a51b63cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.728s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:47.265284 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:47.299660 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:47.387814 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-27ffca04-5b7b-484f-b5c2-bec7a5d6ca61 req-48f42d27-1d88-4469-b037-44073779055e service nova] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Received event network-vif-unplugged-3fc659a4-8cd1-453e-96ac-75c50cf7a85a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:47.388099 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-27ffca04-5b7b-484f-b5c2-bec7a5d6ca61 req-48f42d27-1d88-4469-b037-44073779055e service nova] Acquiring lock "63eb5e59-29a0-4b0c-b731-6d7265f7d91f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:47.388261 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-27ffca04-5b7b-484f-b5c2-bec7a5d6ca61 req-48f42d27-1d88-4469-b037-44073779055e service nova] Lock "63eb5e59-29a0-4b0c-b731-6d7265f7d91f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:47.388367 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-27ffca04-5b7b-484f-b5c2-bec7a5d6ca61 req-48f42d27-1d88-4469-b037-44073779055e service nova] Lock "63eb5e59-29a0-4b0c-b731-6d7265f7d91f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:47.388473 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-27ffca04-5b7b-484f-b5c2-bec7a5d6ca61 req-48f42d27-1d88-4469-b037-44073779055e service nova] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] No waiting events found dispatching network-vif-unplugged-3fc659a4-8cd1-453e-96ac-75c50cf7a85a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:47.388605 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-27ffca04-5b7b-484f-b5c2-bec7a5d6ca61 req-48f42d27-1d88-4469-b037-44073779055e service nova] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Received event network-vif-unplugged-3fc659a4-8cd1-453e-96ac-75c50cf7a85a for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:04:47.405355 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Instance destroyed successfully.
May 28 01:04:47.405355 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:47.409614 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "refresh_cache-2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:04:47.409689 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquired lock "refresh_cache-2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:04:47.409730 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:04:47.426017 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:47.482132 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.336s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:47.539428 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999700602000303 future=<Future at 0x7c984c6dda90 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:47.542410 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Instance destroyed successfully.
May 28 01:04:47.542803 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-acc91297-3bf3-4668-9d48-ccad9c26e914 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lazy-loading 'resources' on Instance uuid 63eb5e59-29a0-4b0c-b731-6d7265f7d91f {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:47.549382 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Deleted allocations for instance 8bca25d8-071e-4b2d-960c-50582381cc75
May 28 01:04:47.618362 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Releasing lock "refresh_cache-d5aa4bd8-07f0-4329-88d3-63aa5a2be798" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:04:47.618691 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Instance network_info: |[{"id": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "address": "fa:16:3e:a0:66:8f", "network": {"id": "330f1ba8-b51a-4cb7-8596-73705ae8eecd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-493364840-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed67ebc30b04fe5895f2b2ddd66e9c3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe5497e-7f", "ovs_interfaceid": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:04:47.640183 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:04:47.641973 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:04:47.643991 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Creating image(s)
May 28 01:04:47.645957 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:04:47.646101 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Ensure instance console log exists: /opt/stack/data/nova/instances/d5aa4bd8-07f0-4329-88d3-63aa5a2be798/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:04:47.646340 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:47.646493 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:47.646847 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:47.647314 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Start _get_guest_xml network_info=[{"id": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "address": "fa:16:3e:a0:66:8f", "network": {"id": "330f1ba8-b51a-4cb7-8596-73705ae8eecd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-493364840-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed67ebc30b04fe5895f2b2ddd66e9c3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe5497e-7f", "ovs_interfaceid": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'd5aa4bd8-07f0-4329-88d3-63aa5a2be798', 'attached_at': '', 'detached_at': '', 'volume_id': 'b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'serial': 'b5c97cc4-39c3-49cb-a29f-3e7350d6fc46'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '978c90a8-4e7f-4f43-9a44-e039ea2a6a79', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:04:47.653925 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:04:47.655064 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-417111260', uuid='d5aa4bd8-07f0-4329-88d3-63aa5a2be798'), owner=OwnerMeta(userid='5211ae90fcf1476b917822f860021f1b', username='tempest-ServerActionsV293TestJSON-1502319923-project-member', projectid='8ed67ebc30b04fe5895f2b2ddd66e9c3', projectname='tempest-ServerActionsV293TestJSON-1502319923'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "address": "fa:16:3e:a0:66:8f", "network": {"id": "330f1ba8-b51a-4cb7-8596-73705ae8eecd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-493364840-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed67ebc30b04fe5895f2b2ddd66e9c3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe5497e-7f", "ovs_interfaceid": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930287.654714) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:04:47.656243 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:04:47.656536 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:04:47.658031 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:04:47.658643 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:04:47.659421 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:04:47.659649 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:04:47.659821 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:04:47.659915 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:04:47.660037 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:04:47.661145 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:04:47.661145 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:04:47.661145 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:04:47.661145 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:04:47.661145 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:04:47.661145 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:04:47.661145 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:04:47.679986 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:04:47.680282 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:04:47.680532 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:04:47.681449 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:04:47.681640 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:04:47.683823 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9d0388e4-1b97-42be-8a5b-1b8b43c06422 req-5df7c866-ce1c-4e53-81da-e40b756dbab9 service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Received event network-vif-unplugged-53846e61-8840-490f-a976-3997db8a0f0b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:47.683960 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9d0388e4-1b97-42be-8a5b-1b8b43c06422 req-5df7c866-ce1c-4e53-81da-e40b756dbab9 service nova] Acquiring lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:47.684191 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9d0388e4-1b97-42be-8a5b-1b8b43c06422 req-5df7c866-ce1c-4e53-81da-e40b756dbab9 service nova] Lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:47.684267 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9d0388e4-1b97-42be-8a5b-1b8b43c06422 req-5df7c866-ce1c-4e53-81da-e40b756dbab9 service nova] Lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:47.684406 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9d0388e4-1b97-42be-8a5b-1b8b43c06422 req-5df7c866-ce1c-4e53-81da-e40b756dbab9 service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] No waiting events found dispatching network-vif-unplugged-53846e61-8840-490f-a976-3997db8a0f0b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:47.684511 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-9d0388e4-1b97-42be-8a5b-1b8b43c06422 req-5df7c866-ce1c-4e53-81da-e40b756dbab9 service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Received unexpected event network-vif-unplugged-53846e61-8840-490f-a976-3997db8a0f0b for instance with vm_state shelved and task_state shelving_offloading.
May 28 01:04:47.688366 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9d0388e4-1b97-42be-8a5b-1b8b43c06422 req-5df7c866-ce1c-4e53-81da-e40b756dbab9 service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Received event network-vif-unplugged-0fe5497e-7f98-48c5-89d4-5168815ab9c1 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:47.688558 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9d0388e4-1b97-42be-8a5b-1b8b43c06422 req-5df7c866-ce1c-4e53-81da-e40b756dbab9 service nova] Acquiring lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:47.688806 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9d0388e4-1b97-42be-8a5b-1b8b43c06422 req-5df7c866-ce1c-4e53-81da-e40b756dbab9 service nova] Lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:47.688930 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9d0388e4-1b97-42be-8a5b-1b8b43c06422 req-5df7c866-ce1c-4e53-81da-e40b756dbab9 service nova] Lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:47.689587 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9d0388e4-1b97-42be-8a5b-1b8b43c06422 req-5df7c866-ce1c-4e53-81da-e40b756dbab9 service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] No waiting events found dispatching network-vif-unplugged-0fe5497e-7f98-48c5-89d4-5168815ab9c1 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:47.689759 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-9d0388e4-1b97-42be-8a5b-1b8b43c06422 req-5df7c866-ce1c-4e53-81da-e40b756dbab9 service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Received unexpected event network-vif-unplugged-0fe5497e-7f98-48c5-89d4-5168815ab9c1 for instance with vm_state building and task_state spawning.
May 28 01:04:47.702020 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:04:47.702720 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:04:47.703661 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:04:47.703952 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:04:47.704465 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:04:47.704670 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:04:47.714834 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:04:47.714834 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:47.723716 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:04:47.723716 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:47.732648 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46] added
May 28 01:04:47.732648 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:04:47.732648 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:04:47.732648 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:04:47.732648 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:04:47.732648 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:04:47.732648 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:47.732648 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:04:47.732849 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0287(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:04:47.732954 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:04:47.735940 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46] added
May 28 01:04:47.735940 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:04:47.735940 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:04:47.735940 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:04:47.735940 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:04:47.735940 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:04:47.735940 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:47.736583 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:04:47.736583 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0316(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:04:47.736583 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:04:47.913269 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:48.045511 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-acc91297-3bf3-4668-9d48-ccad9c26e914 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:01:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-731729782',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serverbootfromvolumestablerescuetest-server-731729782',id=30,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:02:04Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e28acf25c4445ea969bd7bca3eac146',ramdisk_id='',reservation_id='r-s7uatqrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-568223226',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:02:12Z,user_data=None,user_id='fb6c20970bf0401190583f6348e00e4b',uuid=63eb5e59-29a0-4b0c-b731-6d7265f7d91f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3fc659a4-8cd1-453e-96ac-75c50cf7a85a", "address": "fa:16:3e:11:79:2b", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc659a4-8c", "ovs_interfaceid": "3fc659a4-8cd1-453e-96ac-75c50cf7a85a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:04:48.045746 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-acc91297-3bf3-4668-9d48-ccad9c26e914 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Converting VIF {"id": "3fc659a4-8cd1-453e-96ac-75c50cf7a85a", "address": "fa:16:3e:11:79:2b", "network": {"id": "c25f8563-bd10-4e42-b4ce-fd2164eca324", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-213603998-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9e28acf25c4445ea969bd7bca3eac146", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fc659a4-8c", "ovs_interfaceid": "3fc659a4-8cd1-453e-96ac-75c50cf7a85a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:04:48.046222 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-acc91297-3bf3-4668-9d48-ccad9c26e914 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:79:2b,bridge_name='br-int',has_traffic_filtering=True,id=3fc659a4-8cd1-453e-96ac-75c50cf7a85a,network=Network(c25f8563-bd10-4e42-b4ce-fd2164eca324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fc659a4-8c') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:04:48.046427 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-acc91297-3bf3-4668-9d48-ccad9c26e914 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:79:2b,bridge_name='br-int',has_traffic_filtering=True,id=3fc659a4-8cd1-453e-96ac-75c50cf7a85a,network=Network(c25f8563-bd10-4e42-b4ce-fd2164eca324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fc659a4-8c') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:04:48.047496 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:48.047724 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3fc659a4-8c, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:48.048640 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:48.050289 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:48.055232 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:48.060383 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:48.063135 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b572aa51-5730-4399-8a03-afd171218f69) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:48.067316 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:48.067943 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:48.074104 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:48.080351 np0000001577 nova-compute[98319]: INFO os_vif [None req-acc91297-3bf3-4668-9d48-ccad9c26e914 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:79:2b,bridge_name='br-int',has_traffic_filtering=True,id=3fc659a4-8cd1-453e-96ac-75c50cf7a85a,network=Network(c25f8563-bd10-4e42-b4ce-fd2164eca324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fc659a4-8c')
May 28 01:04:48.080639 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-acc91297-3bf3-4668-9d48-ccad9c26e914 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Deleting instance files /opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f_del
May 28 01:04:48.081320 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-acc91297-3bf3-4668-9d48-ccad9c26e914 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Deletion of /opt/stack/data/nova/instances/63eb5e59-29a0-4b0c-b731-6d7265f7d91f_del complete
May 28 01:04:48.303347 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:48.496562 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Updating instance_info_cache with network_info: [{"id": "53846e61-8840-490f-a976-3997db8a0f0b", "address": "fa:16:3e:88:07:ca", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53846e61-88", "ovs_interfaceid": "53846e61-8840-490f-a976-3997db8a0f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:04:48.562398 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b7810b4-afc3-40de-894a-e23fa45f3ebc tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Lock "8bca25d8-071e-4b2d-960c-50582381cc75" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.495s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:48.593184 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-acc91297-3bf3-4668-9d48-ccad9c26e914 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Took 1.39 seconds to destroy the instance on the hypervisor.
May 28 01:04:48.593952 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-acc91297-3bf3-4668-9d48-ccad9c26e914 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:04:48.594184 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:04:48.594346 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:04:48.595041 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:48.655180 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:48.733424 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:04:48.736864 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:04:48.746308 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:04:48.746308 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:04:48.753004 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:04:48.753004 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:48.761955 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:48.767501 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:48.779856 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:04:48.779856 np0000001577 nova-compute[98319]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:04:48.779856 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:04:48.780008 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsi session list stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:04:48.780008 np0000001577 nova-compute[98319]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:04:48.780008 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:04:48.785677 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:04:48.785677 np0000001577 nova-compute[98319]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:04:48.785677 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:04:48.785677 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsi session list stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:04:48.785677 np0000001577 nova-compute[98319]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:04:48.785677 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:04:48.823899 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46, portal: 192.168.40.100,3260]
May 28 01:04:48.823899 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46, portal: 192.168.40.100,3260] successful.
May 28 01:04:48.823899 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:48.828657 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46, portal: 192.168.50.100,3260]
May 28 01:04:48.828657 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46, portal: 192.168.50.100,3260] successful.
May 28 01:04:48.828657 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:48.836137 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:48.843175 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:04:48.850188 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:04:48.850188 np0000001577 nova-compute[98319]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:04:48.850188 np0000001577 nova-compute[98319]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:04:48.850188 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:04:48.850188 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:04:48.850341 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsi session list stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:04:48.850341 np0000001577 nova-compute[98319]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:04:48.850341 np0000001577 nova-compute[98319]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:04:48.850341 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:04:48.850341 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:04:48.850590 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.148s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:04:48.850704 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:04:48.851638 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] HCTL ('9', '-', '-', 0) found on session 88 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:04:48.851638 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:04:48.860757 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:04:48.860757 np0000001577 nova-compute[98319]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:04:48.860757 np0000001577 nova-compute[98319]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:04:48.860757 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:04:48.860757 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:04:48.860938 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsi session list stdout=tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:04:48.860938 np0000001577 nova-compute[98319]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:04:48.860938 np0000001577 nova-compute[98319]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:04:48.860938 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:04:48.860938 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:04:48.861327 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:04:48.861418 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:04:48.862076 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] HCTL ('10', '-', '-', 0) found on session 89 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:04:48.862332 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:04:48.868035 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Searching for a device in session 88 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:04:48.868035 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:04:48.877293 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Searching for a device in session 89 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:04:48.877293 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:04:48.999201 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Releasing lock "refresh_cache-2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:04:48.999744 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:49.000306 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:49.432582 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:04:49.458241 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a47114ff-6695-472f-8cc7-df53df0799e0 req-d8fb638d-d71b-4586-9804-98f86489d220 service nova] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Received event network-vif-unplugged-3fc659a4-8cd1-453e-96ac-75c50cf7a85a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:49.458627 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a47114ff-6695-472f-8cc7-df53df0799e0 req-d8fb638d-d71b-4586-9804-98f86489d220 service nova] Acquiring lock "63eb5e59-29a0-4b0c-b731-6d7265f7d91f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:49.460130 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a47114ff-6695-472f-8cc7-df53df0799e0 req-d8fb638d-d71b-4586-9804-98f86489d220 service nova] Lock "63eb5e59-29a0-4b0c-b731-6d7265f7d91f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:49.460242 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a47114ff-6695-472f-8cc7-df53df0799e0 req-d8fb638d-d71b-4586-9804-98f86489d220 service nova] Lock "63eb5e59-29a0-4b0c-b731-6d7265f7d91f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:49.460365 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a47114ff-6695-472f-8cc7-df53df0799e0 req-d8fb638d-d71b-4586-9804-98f86489d220 service nova] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] No waiting events found dispatching network-vif-unplugged-3fc659a4-8cd1-453e-96ac-75c50cf7a85a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:49.461536 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a47114ff-6695-472f-8cc7-df53df0799e0 req-d8fb638d-d71b-4586-9804-98f86489d220 service nova] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Received event network-vif-unplugged-3fc659a4-8cd1-453e-96ac-75c50cf7a85a for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:04:49.461536 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a47114ff-6695-472f-8cc7-df53df0799e0 req-d8fb638d-d71b-4586-9804-98f86489d220 service nova] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Received event network-vif-deleted-3fc659a4-8cd1-453e-96ac-75c50cf7a85a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:49.461536 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-a47114ff-6695-472f-8cc7-df53df0799e0 req-d8fb638d-d71b-4586-9804-98f86489d220 service nova] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Neutron deleted interface 3fc659a4-8cd1-453e-96ac-75c50cf7a85a; detaching it from the instance and deleting it from the info cache
May 28 01:04:49.462024 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a47114ff-6695-472f-8cc7-df53df0799e0 req-d8fb638d-d71b-4586-9804-98f86489d220 service nova] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Detach interface failed, port_id=3fc659a4-8cd1-453e-96ac-75c50cf7a85a, reason: Instance 63eb5e59-29a0-4b0c-b731-6d7265f7d91f could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:04:49.485427 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Instance destroyed successfully.
May 28 01:04:49.485737 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lazy-loading 'resources' on Instance uuid 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:49.703665 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:04:49.934569 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Took 1.34 seconds to deallocate network for instance.
May 28 01:04:49.988137 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Object Instance<2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e> lazy-loaded attributes: numa_topology,resources {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:04:49.988723 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1328136978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumeshelvetestjson-server-1328136978',id=39,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwo7eu98M2lVJQz8v1lXS5seW0IzErKTm9jX0nEiUnke3eatP2nV5nyO/xoWW2Z6G175w5hkAxX1GDoRpaCGgexCFYaPFf5tCq63oY84sMYbDC7Go75ObhV5XSZRVJ03w==',key_name='tempest-keypair-866036055',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:03:59Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f6a7090a79f448f3abe4737bf127df53',ramdisk_id='',reservation_id='r-wfzqk2ne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1260503814',owner_user_name='tempest-AttachVolumeShelveTestJSON-1260503814-project-member',shelved_at='2026-05-28T01:04:46.385860',shelved_host='np0000001577',shelved_image_id='b6697061-199b-4661-aba2-c05e22f942c6'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:04:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d375089981f8493598b33c4b6f122374',uuid=2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "53846e61-8840-490f-a976-3997db8a0f0b", "address": "fa:16:3e:88:07:ca", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53846e61-88", "ovs_interfaceid": "53846e61-8840-490f-a976-3997db8a0f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:04:49.988864 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Converting VIF {"id": "53846e61-8840-490f-a976-3997db8a0f0b", "address": "fa:16:3e:88:07:ca", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53846e61-88", "ovs_interfaceid": "53846e61-8840-490f-a976-3997db8a0f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:04:49.989317 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:07:ca,bridge_name='br-int',has_traffic_filtering=True,id=53846e61-8840-490f-a976-3997db8a0f0b,network=Network(e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53846e61-88') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:04:49.989493 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:07:ca,bridge_name='br-int',has_traffic_filtering=True,id=53846e61-8840-490f-a976-3997db8a0f0b,network=Network(e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53846e61-88') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:04:49.990310 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:49.990515 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53846e61-88, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:50.005306 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:50.006453 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:50.006832 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:50.006948 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e1c932a-8608-4717-a460-7d84bc124ded) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:50.008141 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:50.009395 np0000001577 nova-compute[98319]: INFO os_vif [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:07:ca,bridge_name='br-int',has_traffic_filtering=True,id=53846e61-8840-490f-a976-3997db8a0f0b,network=Network(e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53846e61-88')
May 28 01:04:50.009649 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Deleting instance files /opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e_del
May 28 01:04:50.014382 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Deletion of /opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e_del complete
May 28 01:04:50.403233 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0003285490001871949 future=<Future at 0x7c98705373b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:50.405862 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:50.405862 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=0.021637960000134626 future=<Future at 0x7c984c7d6c00 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:50.405862 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=0.02156770999999935 future=<Future at 0x7c984c7d6c00 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:50.405862 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Emitting event <LifecycleEvent: 1779930275.4028058, 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:04:50.405862 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] VM Stopped (Lifecycle Event)
May 28 01:04:50.425459 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00036185599992677453 future=<Future at 0x7c984c7d6c00 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:50.425641 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:50.425732 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=1.4729937460001565 future=<Future at 0x7c98704486e0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:50.425849 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=1.472875846000079 future=<Future at 0x7c98704486e0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:50.426328 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Emitting event <LifecycleEvent: 1779930275.424998, 27a2f570-fa9f-4f8d-8b04-b485a51b63cb => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:04:50.426535 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] VM Stopped (Lifecycle Event)
May 28 01:04:50.439941 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-acc91297-3bf3-4668-9d48-ccad9c26e914 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:50.440476 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-acc91297-3bf3-4668-9d48-ccad9c26e914 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:50.575752 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Deleted allocations for instance 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e
May 28 01:04:50.674558 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-acc91297-3bf3-4668-9d48-ccad9c26e914 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:04:50.674768 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-acc91297-3bf3-4668-9d48-ccad9c26e914 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:04:50.720285 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Found WWN 33000000034067dfc for multipath device dm-3 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:04:50.720285 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:04:50.720285 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '33000000034067dfc', 'path': '/dev/dm-3', 'multipath_id': '33000000034067dfc'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:04:50.720285 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000034067dfc', 'path': '/dev/dm-3', 'multipath_id': '33000000034067dfc'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:04:50.841820 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:50.907727 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: 0fbae6fa-0e7b-424e-a528-7c8e4dcabd5c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:50.931118 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7acbd6bf-dc48-43fc-ab1b-b32d77840466 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] [instance: 27a2f570-fa9f-4f8d-8b04-b485a51b63cb] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:51.086447 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:51.177279 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-acc91297-3bf3-4668-9d48-ccad9c26e914 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:04:51.224672 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:04:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-417111260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serveractionsv293testjson-server-417111260',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZCISJi6nlA4mDzDOiuCg9487tvddGj6j0Jn9d1BsbnnHFEGFqQb7Xhz7pIcCKtGhPE7XNyy3CeMbSPQsZu+OlSGdWSFk970ycf5MTngHfj4cd5ACI067WxxJTu4s1avA==',key_name='tempest-keypair-1686283236',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ed67ebc30b04fe5895f2b2ddd66e9c3',ramdisk_id='',reservation_id='r-ue5gqdd9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1502319923',owner_user_name='tempest-ServerActionsV293TestJSON-1502319923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:04:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5211ae90fcf1476b917822f860021f1b',uuid=d5aa4bd8-07f0-4329-88d3-63aa5a2be798,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "address": "fa:16:3e:a0:66:8f", "network": {"id": "330f1ba8-b51a-4cb7-8596-73705ae8eecd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-493364840-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed67ebc30b04fe5895f2b2ddd66e9c3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe5497e-7f", "ovs_interfaceid": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:04:51.225021 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Converting VIF {"id": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "address": "fa:16:3e:a0:66:8f", "network": {"id": "330f1ba8-b51a-4cb7-8596-73705ae8eecd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-493364840-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed67ebc30b04fe5895f2b2ddd66e9c3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe5497e-7f", "ovs_interfaceid": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:04:51.225657 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:66:8f,bridge_name='br-int',has_traffic_filtering=True,id=0fe5497e-7f98-48c5-89d4-5168815ab9c1,network=Network(330f1ba8-b51a-4cb7-8596-73705ae8eecd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe5497e-7f') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:04:51.226564 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lazy-loading 'pci_devices' on Instance uuid d5aa4bd8-07f0-4329-88d3-63aa5a2be798 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:51.251439 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:51.522893 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a7530982-4773-4437-a19d-3d92d32e3a49 req-e0a3db0f-5518-45bf-bc56-674c7707c2fb service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Received event network-changed-53846e61-8840-490f-a976-3997db8a0f0b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:51.523049 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a7530982-4773-4437-a19d-3d92d32e3a49 req-e0a3db0f-5518-45bf-bc56-674c7707c2fb service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Refreshing instance network info cache due to event network-changed-53846e61-8840-490f-a976-3997db8a0f0b. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:04:51.523241 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a7530982-4773-4437-a19d-3d92d32e3a49 req-e0a3db0f-5518-45bf-bc56-674c7707c2fb service nova] Acquiring lock "refresh_cache-2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:04:51.523329 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a7530982-4773-4437-a19d-3d92d32e3a49 req-e0a3db0f-5518-45bf-bc56-674c7707c2fb service nova] Acquired lock "refresh_cache-2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:04:51.523638 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-a7530982-4773-4437-a19d-3d92d32e3a49 req-e0a3db0f-5518-45bf-bc56-674c7707c2fb service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Refreshing network info cache for port 53846e61-8840-490f-a976-3997db8a0f0b {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:04:51.683915 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-acc91297-3bf3-4668-9d48-ccad9c26e914 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.243s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:51.685561 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.598s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:51.732334 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] End _get_guest_xml xml=<domain type="qemu">
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:   <uuid>d5aa4bd8-07f0-4329-88d3-63aa5a2be798</uuid>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:   <name>instance-0000002a</name>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       <nova:name>tempest-ServerActionsV293TestJSON-server-417111260</nova:name>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:04:47</nova:creationTime>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       <nova:image uuid="">
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:         <nova:user uuid="5211ae90fcf1476b917822f860021f1b">tempest-ServerActionsV293TestJSON-1502319923-project-member</nova:user>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:         <nova:project uuid="8ed67ebc30b04fe5895f2b2ddd66e9c3">tempest-ServerActionsV293TestJSON-1502319923</nova:project>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:         <nova:port uuid="0fe5497e-7f98-48c5-89d4-5168815ab9c1">
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:     <system>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       <entry name="serial">d5aa4bd8-07f0-4329-88d3-63aa5a2be798</entry>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       <entry name="uuid">d5aa4bd8-07f0-4329-88d3-63aa5a2be798</entry>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:     </system>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:   <os>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:   </os>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:   <features>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:   </features>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:   <devices>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/d5aa4bd8-07f0-4329-88d3-63aa5a2be798/disk.config"/>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:     </disk>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       <alias name="ua-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46"/>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-3"/>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       <serial>b5c97cc4-39c3-49cb-a29f-3e7350d6fc46</serial>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:     </disk>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:a0:66:8f"/>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       <target dev="tap0fe5497e-7f"/>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:     </interface>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/d5aa4bd8-07f0-4329-88d3-63aa5a2be798/console.log" append="off"/>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:     </serial>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:     <video>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:     </video>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:     </rng>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:   </devices>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]: </domain>
May 28 01:04:51.732334 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:04:51.736017 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Preparing to wait for external event network-vif-plugged-0fe5497e-7f98-48c5-89d4-5168815ab9c1 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:04:51.736017 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Acquiring lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:51.736017 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:51.736017 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:51.736017 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:04:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-417111260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serveractionsv293testjson-server-417111260',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZCISJi6nlA4mDzDOiuCg9487tvddGj6j0Jn9d1BsbnnHFEGFqQb7Xhz7pIcCKtGhPE7XNyy3CeMbSPQsZu+OlSGdWSFk970ycf5MTngHfj4cd5ACI067WxxJTu4s1avA==',key_name='tempest-keypair-1686283236',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ed67ebc30b04fe5895f2b2ddd66e9c3',ramdisk_id='',reservation_id='r-ue5gqdd9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1502319923',owner_user_name='tempest-ServerActionsV293TestJSON-1502319923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:04:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5211ae90fcf1476b917822f860021f1b',uuid=d5aa4bd8-07f0-4329-88d3-63aa5a2be798,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "address": "fa:16:3e:a0:66:8f", "network": {"id": "330f1ba8-b51a-4cb7-8596-73705ae8eecd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-493364840-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed67ebc30b04fe5895f2b2ddd66e9c3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe5497e-7f", "ovs_interfaceid": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:04:51.736017 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Converting VIF {"id": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "address": "fa:16:3e:a0:66:8f", "network": {"id": "330f1ba8-b51a-4cb7-8596-73705ae8eecd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-493364840-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed67ebc30b04fe5895f2b2ddd66e9c3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe5497e-7f", "ovs_interfaceid": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:04:51.736017 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:66:8f,bridge_name='br-int',has_traffic_filtering=True,id=0fe5497e-7f98-48c5-89d4-5168815ab9c1,network=Network(330f1ba8-b51a-4cb7-8596-73705ae8eecd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe5497e-7f') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:04:51.736017 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:66:8f,bridge_name='br-int',has_traffic_filtering=True,id=0fe5497e-7f98-48c5-89d4-5168815ab9c1,network=Network(330f1ba8-b51a-4cb7-8596-73705ae8eecd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe5497e-7f') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:04:51.736017 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:51.736017 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:51.736017 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:04:51.736017 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:51.736017 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '267793bf-96ea-558d-a838-4def5ff4a369', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:51.737838 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:51.740630 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:51.740674 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0fe5497e-7f, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:51.740965 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0fe5497e-7f, col_values=(('qos', UUID('2dbe0f1d-5c52-4fd2-9e0a-a5c6a2254f85')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:51.741879 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0fe5497e-7f, col_values=(('external_ids', {'iface-id': '0fe5497e-7f98-48c5-89d4-5168815ab9c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:66:8f', 'vm-uuid': 'd5aa4bd8-07f0-4329-88d3-63aa5a2be798'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:04:51.744059 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:04:51.747868 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:51.748920 np0000001577 nova-compute[98319]: INFO os_vif [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:66:8f,bridge_name='br-int',has_traffic_filtering=True,id=0fe5497e-7f98-48c5-89d4-5168815ab9c1,network=Network(330f1ba8-b51a-4cb7-8596-73705ae8eecd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe5497e-7f')
May 28 01:04:51.899102 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0003197279997948499 future=<Future at 0x7c98704486e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:51.899625 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:51.899625 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=4.534515799000019 future=<Future at 0x7c984c49e1b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:51.899625 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=4.534440988999904 future=<Future at 0x7c984c49e1b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:51.900040 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] Emitting event <LifecycleEvent: 1779930276.8986483, 8bca25d8-071e-4b2d-960c-50582381cc75 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:04:51.900176 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] VM Stopped (Lifecycle Event)
May 28 01:04:51.980632 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-acc91297-3bf3-4668-9d48-ccad9c26e914 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Deleted allocations for instance 63eb5e59-29a0-4b0c-b731-6d7265f7d91f
May 28 01:04:52.026905 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-a7530982-4773-4437-a19d-3d92d32e3a49 req-e0a3db0f-5518-45bf-bc56-674c7707c2fb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:52.128341 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:04:52.128760 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:04:52.406842 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-abe167fc-0521-4e6a-aa2c-713ad862039e tempest-VolumesBackupsTest-2139172395 tempest-VolumesBackupsTest-2139172395-project-member] [instance: 8bca25d8-071e-4b2d-960c-50582381cc75] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:52.418276 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-a7530982-4773-4437-a19d-3d92d32e3a49 req-e0a3db0f-5518-45bf-bc56-674c7707c2fb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:52.566093 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-a7530982-4773-4437-a19d-3d92d32e3a49 req-e0a3db0f-5518-45bf-bc56-674c7707c2fb service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Updated VIF entry in instance network info cache for port 53846e61-8840-490f-a976-3997db8a0f0b. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:04:52.566926 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-a7530982-4773-4437-a19d-3d92d32e3a49 req-e0a3db0f-5518-45bf-bc56-674c7707c2fb service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Updating instance_info_cache with network_info: [{"id": "53846e61-8840-490f-a976-3997db8a0f0b", "address": "fa:16:3e:88:07:ca", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap53846e61-88", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:04:52.631981 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:04:52.753928 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Acquiring lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:52.754080 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:52.987650 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-acc91297-3bf3-4668-9d48-ccad9c26e914 tempest-ServerBootFromVolumeStableRescueTest-568223226 tempest-ServerBootFromVolumeStableRescueTest-568223226-project-member] Lock "63eb5e59-29a0-4b0c-b731-6d7265f7d91f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.292s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:53.069229 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a7530982-4773-4437-a19d-3d92d32e3a49 req-e0a3db0f-5518-45bf-bc56-674c7707c2fb service nova] Releasing lock "refresh_cache-2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:04:53.138848 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.455s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:53.190112 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "4db5d5f2-e263-41af-a833-642afe41d66d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:53.190337 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "4db5d5f2-e263-41af-a833-642afe41d66d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:53.255684 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:04:53.274012 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:04:53.274168 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:04:53.274269 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] No VIF found with MAC fa:16:3e:a0:66:8f, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:04:53.274619 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Using config drive
May 28 01:04:53.413114 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:53.644319 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9e994f7a-eb53-4839-a944-e65d153744c8 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 13.556s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:53.645004 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.232s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:53.645145 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Unshelving
May 28 01:04:53.691856 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:04:53.779406 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:53.815205 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:53.815406 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:53.819897 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:04:53.820097 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Claim successful on node np0000001577
May 28 01:04:53.855619 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:53.914582 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Creating config drive at /opt/stack/data/nova/instances/d5aa4bd8-07f0-4329-88d3-63aa5a2be798/disk.config
May 28 01:04:53.919578 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d5aa4bd8-07f0-4329-88d3-63aa5a2be798/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1qhrj029 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:04:53.974914 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d5aa4bd8-07f0-4329-88d3-63aa5a2be798/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1qhrj029" returned: 0 in 0.056s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:04:54.248769 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:54.441289 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:54.478438 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:54.478652 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:54.564984 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:54.716334 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:54.742256 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1893b0ed-412d-4858-9b55-5aa4b58ecb55 req-4f7993df-b7ee-4c51-96d1-93411d098058 service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Received event network-vif-plugged-0fe5497e-7f98-48c5-89d4-5168815ab9c1 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:54.742791 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1893b0ed-412d-4858-9b55-5aa4b58ecb55 req-4f7993df-b7ee-4c51-96d1-93411d098058 service nova] Acquiring lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:54.742979 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1893b0ed-412d-4858-9b55-5aa4b58ecb55 req-4f7993df-b7ee-4c51-96d1-93411d098058 service nova] Lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:54.743109 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1893b0ed-412d-4858-9b55-5aa4b58ecb55 req-4f7993df-b7ee-4c51-96d1-93411d098058 service nova] Lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:54.743292 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1893b0ed-412d-4858-9b55-5aa4b58ecb55 req-4f7993df-b7ee-4c51-96d1-93411d098058 service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Processing event network-vif-plugged-0fe5497e-7f98-48c5-89d4-5168815ab9c1 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:04:54.801137 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:54.803481 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:54.815893 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:54.836918 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:54.882104 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Refreshing inventories for resource provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 28 01:04:54.930830 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Updating ProviderTree inventory for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 28 01:04:54.930966 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Updating inventory in ProviderTree for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 01:04:54.966979 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Refreshing aggregate associations for resource provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2, aggregates: None {{(pid=98319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 28 01:04:55.008472 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Refreshing trait associations for resource provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ARCH_PPC64LE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,HW_ARCH_X86_64,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOUND_MODEL_AC97,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ARCH_X86_64,COMPUTE_ARCH_S390X,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_SOUND_MODEL_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ARCH_MIPSEL,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOUND_MODEL_SB16,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ARCH_RISCV64,HW_CPU_X86_SSE2,COMPUTE_ARCH_AARCH64,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_IGB {{(pid=98319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 28 01:04:55.168312 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:55.269424 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930295.2690525, d5aa4bd8-07f0-4329-88d3-63aa5a2be798 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:04:55.269852 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] VM Started (Lifecycle Event)
May 28 01:04:55.270727 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:04:55.274241 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:04:55.276609 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Instance spawned successfully.
May 28 01:04:55.277121 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:04:55.297638 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:04:55.297770 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:04:55.773144 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:55.777959 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:04:55.784249 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:04:55.784425 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:04:55.785639 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:04:55.785639 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:04:55.785639 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:04:55.786392 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:04:55.800878 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:04:56.170727 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:04:56.264133 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:56.282537 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:04:56.283020 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930296.2826757, d5aa4bd8-07f0-4329-88d3-63aa5a2be798 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:04:56.283020 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] VM Paused (Lifecycle Event)
May 28 01:04:56.292036 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Took 8.65 seconds to spawn the instance on the hypervisor.
May 28 01:04:56.292342 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:56.313155 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.498s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:56.313640 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:04:56.316503 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.068s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:56.321577 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:04:56.321762 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Claim successful on node np0000001577
May 28 01:04:56.434272 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0003954499998144456 future=<Future at 0x7c984c49e1b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:56.435914 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] Emitting event <LifecycleEvent: 1779930281.4337397, 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:04:56.437221 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:56.438284 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] VM Stopped (Lifecycle Event)
May 28 01:04:56.438868 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=6.100237076000212 future=<Future at 0x7c984c6dda90 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:56.438988 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=6.100104398999974 future=<Future at 0x7c984c6dda90 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:04:56.741404 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:04:56.785577 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:56.787081 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930296.7869146, d5aa4bd8-07f0-4329-88d3-63aa5a2be798 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:04:56.787199 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] VM Resumed (Lifecycle Event)
May 28 01:04:56.805135 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Took 18.28 seconds to build instance.
May 28 01:04:56.807665 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-db0098e4-fe36-43cd-ac7f-3bf03a05c5ab req-9f683d4a-50b6-4659-b38b-b58d5cb91f28 service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Received event network-vif-plugged-0fe5497e-7f98-48c5-89d4-5168815ab9c1 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:56.808025 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-db0098e4-fe36-43cd-ac7f-3bf03a05c5ab req-9f683d4a-50b6-4659-b38b-b58d5cb91f28 service nova] Acquiring lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:04:56.808277 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-db0098e4-fe36-43cd-ac7f-3bf03a05c5ab req-9f683d4a-50b6-4659-b38b-b58d5cb91f28 service nova] Lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:56.808532 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-db0098e4-fe36-43cd-ac7f-3bf03a05c5ab req-9f683d4a-50b6-4659-b38b-b58d5cb91f28 service nova] Lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:56.808746 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-db0098e4-fe36-43cd-ac7f-3bf03a05c5ab req-9f683d4a-50b6-4659-b38b-b58d5cb91f28 service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] No waiting events found dispatching network-vif-plugged-0fe5497e-7f98-48c5-89d4-5168815ab9c1 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:04:56.808951 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-db0098e4-fe36-43cd-ac7f-3bf03a05c5ab req-9f683d4a-50b6-4659-b38b-b58d5cb91f28 service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Received unexpected event network-vif-plugged-0fe5497e-7f98-48c5-89d4-5168815ab9c1 for instance with vm_state active and task_state None.
May 28 01:04:56.822364 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:04:56.822540 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:04:56.822823 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:56.823057 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:56.901569 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '91e7f4b4eca54b6198bbaea3ce953850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15fc68900185447586ee6ff0817087fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:04:56.942006 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-346b8ad4-c1a0-4a2f-894f-567adf03846e tempest-ServerActionsTestOtherA-1279266727 tempest-ServerActionsTestOtherA-1279266727-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:57.292109 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:04:57.298058 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Successfully created port: cf12ff4e-41ad-46b1-bece-7d46af7ad869 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:04:57.301045 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:04:57.309328 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.794s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:57.335564 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:04:57.593434 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:04:57.593718 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:04:57.821522 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Successfully updated port: cf12ff4e-41ad-46b1-bece-7d46af7ad869 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:04:57.838751 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:04:57.890250 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5d29c0f6-9b01-4ce7-8f2e-b57504baa51f req-067d46d9-381c-4d5a-b3ec-7ebe9b909596 service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Received event network-changed-cf12ff4e-41ad-46b1-bece-7d46af7ad869 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:57.890250 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5d29c0f6-9b01-4ce7-8f2e-b57504baa51f req-067d46d9-381c-4d5a-b3ec-7ebe9b909596 service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Refreshing instance network info cache due to event network-changed-cf12ff4e-41ad-46b1-bece-7d46af7ad869. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:04:57.890250 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5d29c0f6-9b01-4ce7-8f2e-b57504baa51f req-067d46d9-381c-4d5a-b3ec-7ebe9b909596 service nova] Acquiring lock "refresh_cache-4fb6dc75-4a06-45ea-a050-4ddcd55e8559" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:04:57.890250 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5d29c0f6-9b01-4ce7-8f2e-b57504baa51f req-067d46d9-381c-4d5a-b3ec-7ebe9b909596 service nova] Acquired lock "refresh_cache-4fb6dc75-4a06-45ea-a050-4ddcd55e8559" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:04:57.890250 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-5d29c0f6-9b01-4ce7-8f2e-b57504baa51f req-067d46d9-381c-4d5a-b3ec-7ebe9b909596 service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Refreshing network info cache for port cf12ff4e-41ad-46b1-bece-7d46af7ad869 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:04:58.079532 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-dff06d13-6b90-4d33-b1d4-cabc08f246e1 req-b851048d-cc9c-4dd4-ba00-dad83cb4267e service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Received event network-changed-0fe5497e-7f98-48c5-89d4-5168815ab9c1 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:04:58.079667 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-dff06d13-6b90-4d33-b1d4-cabc08f246e1 req-b851048d-cc9c-4dd4-ba00-dad83cb4267e service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Refreshing instance network info cache due to event network-changed-0fe5497e-7f98-48c5-89d4-5168815ab9c1. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:04:58.079845 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dff06d13-6b90-4d33-b1d4-cabc08f246e1 req-b851048d-cc9c-4dd4-ba00-dad83cb4267e service nova] Acquiring lock "refresh_cache-d5aa4bd8-07f0-4329-88d3-63aa5a2be798" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:04:58.083671 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dff06d13-6b90-4d33-b1d4-cabc08f246e1 req-b851048d-cc9c-4dd4-ba00-dad83cb4267e service nova] Acquired lock "refresh_cache-d5aa4bd8-07f0-4329-88d3-63aa5a2be798" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:04:58.083671 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-dff06d13-6b90-4d33-b1d4-cabc08f246e1 req-b851048d-cc9c-4dd4-ba00-dad83cb4267e service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Refreshing network info cache for port 0fe5497e-7f98-48c5-89d4-5168815ab9c1 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:04:58.096879 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:04:58.326962 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Acquiring lock "refresh_cache-4fb6dc75-4a06-45ea-a050-4ddcd55e8559" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:04:58.343369 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Booting with volume 1a631603-68c5-4259-80bc-36cc022416c6 at /dev/vda
May 28 01:04:58.396622 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:04:58.399335 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-5d29c0f6-9b01-4ce7-8f2e-b57504baa51f req-067d46d9-381c-4d5a-b3ec-7ebe9b909596 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:58.415144 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:04:58.440935 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:04:58.483494 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-5d29c0f6-9b01-4ce7-8f2e-b57504baa51f req-067d46d9-381c-4d5a-b3ec-7ebe9b909596 service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:04:58.487007 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:04:58.487265 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:04:58.494942 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:04:58.495890 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fed1:bba5', 'fe80::49a:a7ff:fef7:c9e8', 'fe80::fc16:3eff:fea0:668f', 'fe80::843d:f9ff:fe8b:2ddd'] 
May 28 01:04:58.496014 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:04:58.496113 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:04:58.496382 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:04:58.496661 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Updating existing volume attachment record: 0fa0f4a4-e009-4ca8-bbda-454bcb69a516 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:04:58.585935 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-dff06d13-6b90-4d33-b1d4-cabc08f246e1 req-b851048d-cc9c-4dd4-ba00-dad83cb4267e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:58.603078 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.287s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:04:58.604341 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.887s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:04:58.604341 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:04:58.611084 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lazy-loading 'pci_requests' on Instance uuid 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:58.628770 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-5d29c0f6-9b01-4ce7-8f2e-b57504baa51f req-067d46d9-381c-4d5a-b3ec-7ebe9b909596 service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:04:58.913243 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-dff06d13-6b90-4d33-b1d4-cabc08f246e1 req-b851048d-cc9c-4dd4-ba00-dad83cb4267e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:59.053827 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-dff06d13-6b90-4d33-b1d4-cabc08f246e1 req-b851048d-cc9c-4dd4-ba00-dad83cb4267e service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Updated VIF entry in instance network info cache for port 0fe5497e-7f98-48c5-89d4-5168815ab9c1. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:04:59.054137 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-dff06d13-6b90-4d33-b1d4-cabc08f246e1 req-b851048d-cc9c-4dd4-ba00-dad83cb4267e service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Updating instance_info_cache with network_info: [{"id": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "address": "fa:16:3e:a0:66:8f", "network": {"id": "330f1ba8-b51a-4cb7-8596-73705ae8eecd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-493364840-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed67ebc30b04fe5895f2b2ddd66e9c3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe5497e-7f", "ovs_interfaceid": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:04:59.117707 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lazy-loading 'numa_topology' on Instance uuid 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:04:59.120348 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:04:59.120483 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:04:59.121015 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:59.121191 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:04:59.132113 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5d29c0f6-9b01-4ce7-8f2e-b57504baa51f req-067d46d9-381c-4d5a-b3ec-7ebe9b909596 service nova] Releasing lock "refresh_cache-4fb6dc75-4a06-45ea-a050-4ddcd55e8559" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:04:59.132558 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Acquired lock "refresh_cache-4fb6dc75-4a06-45ea-a050-4ddcd55e8559" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:04:59.132689 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:04:59.188909 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c803ddeaf4f4b3db07587419087b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050f928f1ce449d6a447cd343dc4ff80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:04:59.556370 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dff06d13-6b90-4d33-b1d4-cabc08f246e1 req-b851048d-cc9c-4dd4-ba00-dad83cb4267e service nova] Releasing lock "refresh_cache-d5aa4bd8-07f0-4329-88d3-63aa5a2be798" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:04:59.621432 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:04:59.624682 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:04:59.624843 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Claim successful on node np0000001577
May 28 01:04:59.742966 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Successfully created port: bd7b5ac7-f021-4ebe-9700-73daf0464312 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:04:59.763770 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:05:00.128284 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:05:00.237841 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:00.349845 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Successfully updated port: bd7b5ac7-f021-4ebe-9700-73daf0464312 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:05:00.395598 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Updating instance_info_cache with network_info: [{"id": "cf12ff4e-41ad-46b1-bece-7d46af7ad869", "address": "fa:16:3e:6d:b1:ae", "network": {"id": "328b8eaa-8fae-4e90-ac01-2f9b4e619fe8", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1060228276-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15fc68900185447586ee6ff0817087fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf12ff4e-41", "ovs_interfaceid": "cf12ff4e-41ad-46b1-bece-7d46af7ad869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:05:00.406979 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-56840a55-af02-433d-8786-96252639fe5b req-ae8a2bab-9756-4333-b40e-3a78fe5bd4ea service nova] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Received event network-changed-bd7b5ac7-f021-4ebe-9700-73daf0464312 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:00.407491 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-56840a55-af02-433d-8786-96252639fe5b req-ae8a2bab-9756-4333-b40e-3a78fe5bd4ea service nova] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Refreshing instance network info cache due to event network-changed-bd7b5ac7-f021-4ebe-9700-73daf0464312. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:05:00.407491 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-56840a55-af02-433d-8786-96252639fe5b req-ae8a2bab-9756-4333-b40e-3a78fe5bd4ea service nova] Acquiring lock "refresh_cache-4db5d5f2-e263-41af-a833-642afe41d66d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:05:00.407491 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-56840a55-af02-433d-8786-96252639fe5b req-ae8a2bab-9756-4333-b40e-3a78fe5bd4ea service nova] Acquired lock "refresh_cache-4db5d5f2-e263-41af-a833-642afe41d66d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:05:00.407638 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-56840a55-af02-433d-8786-96252639fe5b req-ae8a2bab-9756-4333-b40e-3a78fe5bd4ea service nova] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Refreshing network info cache for port bd7b5ac7-f021-4ebe-9700-73daf0464312 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:05:00.626132 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:05:00.629190 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:05:00.629190 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Creating image(s)
May 28 01:05:00.629190 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:05:00.629190 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Ensure instance console log exists: /opt/stack/data/nova/instances/4fb6dc75-4a06-45ea-a050-4ddcd55e8559/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:05:00.629190 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:00.629190 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:00.629190 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:00.633713 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Booting with volume snapshot 36eff648-7eef-431f-9d56-1fe5fbb54695 at /dev/vda
May 28 01:05:00.854049 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "refresh_cache-4db5d5f2-e263-41af-a833-642afe41d66d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:05:00.897605 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Releasing lock "refresh_cache-4fb6dc75-4a06-45ea-a050-4ddcd55e8559" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:05:00.897605 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Instance network_info: |[{"id": "cf12ff4e-41ad-46b1-bece-7d46af7ad869", "address": "fa:16:3e:6d:b1:ae", "network": {"id": "328b8eaa-8fae-4e90-ac01-2f9b4e619fe8", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1060228276-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15fc68900185447586ee6ff0817087fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf12ff4e-41", "ovs_interfaceid": "cf12ff4e-41ad-46b1-bece-7d46af7ad869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:05:00.900250 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Start _get_guest_xml network_info=[{"id": "cf12ff4e-41ad-46b1-bece-7d46af7ad869", "address": "fa:16:3e:6d:b1:ae", "network": {"id": "328b8eaa-8fae-4e90-ac01-2f9b4e619fe8", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1060228276-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15fc68900185447586ee6ff0817087fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf12ff4e-41", "ovs_interfaceid": "cf12ff4e-41ad-46b1-bece-7d46af7ad869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6', 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1a631603-68c5-4259-80bc-36cc022416c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '4fb6dc75-4a06-45ea-a050-4ddcd55e8559', 'attached_at': '', 'detached_at': '', 'volume_id': '1a631603-68c5-4259-80bc-36cc022416c6', 'serial': '1a631603-68c5-4259-80bc-36cc022416c6'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '0fa0f4a4-e009-4ca8-bbda-454bcb69a516', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:05:00.905821 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:05:00.906858 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestInstancesWithCinderVolumes-server-1806060241', uuid='4fb6dc75-4a06-45ea-a050-4ddcd55e8559'), owner=OwnerMeta(userid='91e7f4b4eca54b6198bbaea3ce953850', username='tempest-TestInstancesWithCinderVolumes-513545111-project-member', projectid='15fc68900185447586ee6ff0817087fb', projectname='tempest-TestInstancesWithCinderVolumes-513545111'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cf12ff4e-41ad-46b1-bece-7d46af7ad869", "address": "fa:16:3e:6d:b1:ae", "network": {"id": "328b8eaa-8fae-4e90-ac01-2f9b4e619fe8", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1060228276-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15fc68900185447586ee6ff0817087fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf12ff4e-41", "ovs_interfaceid": "cf12ff4e-41ad-46b1-bece-7d46af7ad869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930300.9064975) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:05:00.909872 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-56840a55-af02-433d-8786-96252639fe5b req-ae8a2bab-9756-4333-b40e-3a78fe5bd4ea service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:00.913816 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:05:00.914275 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:05:00.915189 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:05:00.915279 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:05:00.916117 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:05:00.916378 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:05:00.916509 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:05:00.916612 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:05:00.916731 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:05:00.916839 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:05:00.916927 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:05:00.917069 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:05:00.917176 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:05:00.917296 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:05:00.917392 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:05:00.917510 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:05:00.926382 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:05:00.926576 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6', 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1a631603-68c5-4259-80bc-36cc022416c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:05:00.926730 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:05:00.927772 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:05:00.927772 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6', 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1a631603-68c5-4259-80bc-36cc022416c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:05:00.936041 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:05:00.938939 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:05:00.942590 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:05:00.943606 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:05:00.944922 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:05:00.944922 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:05:00.944922 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:05:00.945130 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:05:00.957834 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:05:00.957834 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:00.970571 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:05:00.970571 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:00.979134 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6] added
May 28 01:05:00.979134 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:05:00.979134 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:05:00.979134 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:05:00.979134 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:05:00.979134 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:05:00.979134 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:00.979349 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:05:00.980562 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0351(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:05:00.980562 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:05:00.983287 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6] added
May 28 01:05:00.983287 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:05:00.983287 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:05:00.983287 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:05:00.983287 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:05:00.983287 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:05:00.983287 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:00.983287 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:05:00.983467 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0384(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:05:00.984818 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:05:00.999757 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-56840a55-af02-433d-8786-96252639fe5b req-ae8a2bab-9756-4333-b40e-3a78fe5bd4ea service nova] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:05:01.161966 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-56840a55-af02-433d-8786-96252639fe5b req-ae8a2bab-9756-4333-b40e-3a78fe5bd4ea service nova] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:05:01.266440 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:01.446370 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:05:01.664313 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-56840a55-af02-433d-8786-96252639fe5b req-ae8a2bab-9756-4333-b40e-3a78fe5bd4ea service nova] Releasing lock "refresh_cache-4db5d5f2-e263-41af-a833-642afe41d66d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:05:01.664313 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquired lock "refresh_cache-4db5d5f2-e263-41af-a833-642afe41d66d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:05:01.664651 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:05:01.752110 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:01.956963 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.352s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:01.956963 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:01.980475 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:05:01.984311 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:05:01.996505 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:05:01.996505 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:05:02.007166 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:05:02.007166 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:02.017139 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:02.018272 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:02.025824 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:02.041814 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:02.041814 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:02.041814 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:05:02.044407 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:02.044407 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:02.044407 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:05:02.044895 np0000001577 nova-compute[98319]: INFO nova.network.neutron [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Updating port 53846e61-8840-490f-a976-3997db8a0f0b with attributes {'binding:host_id': 'np0000001577', 'device_owner': 'compute:nova'}
May 28 01:05:02.046783 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:02.046783 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:02.046783 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:05:02.048738 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:02.048738 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:02.048738 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:05:02.085074 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6, portal: 192.168.50.100,3260]
May 28 01:05:02.085074 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6, portal: 192.168.50.100,3260] successful.
May 28 01:05:02.085074 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:02.103014 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:02.105493 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6, portal: 192.168.40.100,3260]
May 28 01:05:02.105493 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6, portal: 192.168.40.100,3260] successful.
May 28 01:05:02.105493 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:02.122741 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:02.122741 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:02.122741 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:02.122741 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:02.122741 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:05:02.122741 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:02.122741 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:02.122741 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:02.122741 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:02.122741 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:05:02.122741 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:05:02.122741 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:05:02.122741 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] HCTL ('7', '-', '-', 0) found on session 90 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:05:02.122741 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:05:02.123491 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:02.138196 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Searching for a device in session 90 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:05:02.138387 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1a631603-68c5-4259-80bc-36cc022416c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:05:02.143595 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:02.143595 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:02.143595 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:02.143595 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:02.143595 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:05:02.143595 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:02.143595 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:02.143595 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:02.143595 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:02.143595 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:05:02.143595 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.199s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:05:02.143595 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:05:02.144035 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] HCTL ('8', '-', '-', 0) found on session 91 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:05:02.144035 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:05:02.162491 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Searching for a device in session 91 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:05:02.162639 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1a631603-68c5-4259-80bc-36cc022416c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:05:02.261624 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:05:02.540051 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0008727009999347501 future=<Future at 0x7c984c6dda90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:05:02.540624 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Emitting event <LifecycleEvent: 1779930287.5390284, 63eb5e59-29a0-4b0c-b731-6d7265f7d91f => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:05:02.540817 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:05:02.540954 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] VM Stopped (Lifecycle Event)
May 28 01:05:02.766210 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:02.946708 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:05:03.002169 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Updating instance_info_cache with network_info: [{"id": "bd7b5ac7-f021-4ebe-9700-73daf0464312", "address": "fa:16:3e:6c:97:54", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7b5ac7-f0", "ovs_interfaceid": "bd7b5ac7-f021-4ebe-9700-73daf0464312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:05:03.044639 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-a7833ac9-df38-46eb-9dfb-225a02d78f83 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: 63eb5e59-29a0-4b0c-b731-6d7265f7d91f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:03.071909 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "refresh_cache-2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:05:03.072967 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquired lock "refresh_cache-2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:05:03.072967 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:05:03.136063 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-aa4950cc-db7d-4e35-8679-06abdfbce8d3 req-4199065f-e25a-4fa2-8d7e-5cd95735ce88 service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Received event network-changed-53846e61-8840-490f-a976-3997db8a0f0b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:03.137993 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-aa4950cc-db7d-4e35-8679-06abdfbce8d3 req-4199065f-e25a-4fa2-8d7e-5cd95735ce88 service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Refreshing instance network info cache due to event network-changed-53846e61-8840-490f-a976-3997db8a0f0b. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:05:03.138121 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-aa4950cc-db7d-4e35-8679-06abdfbce8d3 req-4199065f-e25a-4fa2-8d7e-5cd95735ce88 service nova] Acquiring lock "refresh_cache-2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:05:03.506017 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Releasing lock "refresh_cache-4db5d5f2-e263-41af-a833-642afe41d66d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:05:03.506259 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Instance network_info: |[{"id": "bd7b5ac7-f021-4ebe-9700-73daf0464312", "address": "fa:16:3e:6c:97:54", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7b5ac7-f0", "ovs_interfaceid": "bd7b5ac7-f021-4ebe-9700-73daf0464312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:05:03.574884 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:03.870834 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:03.965349 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Found WWN 330000000cd2a6fbc for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:05:03.965619 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:05:03.965779 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '330000000cd2a6fbc', 'path': '/dev/dm-0', 'multipath_id': '330000000cd2a6fbc'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:05:03.965918 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cd2a6fbc', 'path': '/dev/dm-0', 'multipath_id': '330000000cd2a6fbc'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:05:03.996195 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Updating instance_info_cache with network_info: [{"id": "53846e61-8840-490f-a976-3997db8a0f0b", "address": "fa:16:3e:88:07:ca", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53846e61-88", "ovs_interfaceid": "53846e61-8840-490f-a976-3997db8a0f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:05:04.104284 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:05:04.117134 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:05:04.140606 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:04.181292 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:05:04.184616 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:05:04.192873 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:05:04.193718 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fed1:bba5', 'fe80::49a:a7ff:fef7:c9e8', 'fe80::fc16:3eff:fea0:668f', 'fe80::843d:f9ff:fe8b:2ddd'] 
May 28 01:05:04.193849 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:05:04.194593 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:05:04.194593 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:05:04.194593 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Updating existing volume attachment record: 98568ebc-f14c-4688-a7e9-9310c0540ccc {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:05:04.472264 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:04:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-1806060241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testinstanceswithcindervolumes-server-1806060241',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAe8gEcGEQ/stc3fEgwIW65M0AVq3AHTtqALSUztyu0nDHvzM5q0XODHSIjQcrLzlTNzjXRCsZgBdykHaRcNFL5BPyhoQLiM/TCxeJVQwmG3kEXtnF/FP5ATsgrgHp/YJg==',key_name='tempest-TestInstancesWithCinderVolumes-1357887979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15fc68900185447586ee6ff0817087fb',ramdisk_id='',reservation_id='r-waombbhh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestInstancesWithCinderVolumes-513545111',owner_user_name='tempest-TestInstancesWithCinderVolumes-513545111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:04:58Z,user_data=None,user_id='91e7f4b4eca54b6198bbaea3ce953850',uuid=4fb6dc75-4a06-45ea-a050-4ddcd55e8559,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf12ff4e-41ad-46b1-bece-7d46af7ad869", "address": "fa:16:3e:6d:b1:ae", "network": {"id": "328b8eaa-8fae-4e90-ac01-2f9b4e619fe8", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1060228276-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15fc68900185447586ee6ff0817087fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf12ff4e-41", "ovs_interfaceid": "cf12ff4e-41ad-46b1-bece-7d46af7ad869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:05:04.472514 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Converting VIF {"id": "cf12ff4e-41ad-46b1-bece-7d46af7ad869", "address": "fa:16:3e:6d:b1:ae", "network": {"id": "328b8eaa-8fae-4e90-ac01-2f9b4e619fe8", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1060228276-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15fc68900185447586ee6ff0817087fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf12ff4e-41", "ovs_interfaceid": "cf12ff4e-41ad-46b1-bece-7d46af7ad869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:05:04.473395 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b1:ae,bridge_name='br-int',has_traffic_filtering=True,id=cf12ff4e-41ad-46b1-bece-7d46af7ad869,network=Network(328b8eaa-8fae-4e90-ac01-2f9b4e619fe8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf12ff4e-41') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:05:04.474555 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lazy-loading 'pci_devices' on Instance uuid 4fb6dc75-4a06-45ea-a050-4ddcd55e8559 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:05:04.498099 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Releasing lock "refresh_cache-2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:05:04.499177 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:05:04.499569 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-aa4950cc-db7d-4e35-8679-06abdfbce8d3 req-4199065f-e25a-4fa2-8d7e-5cd95735ce88 service nova] Acquired lock "refresh_cache-2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:05:04.500837 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-aa4950cc-db7d-4e35-8679-06abdfbce8d3 req-4199065f-e25a-4fa2-8d7e-5cd95735ce88 service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Refreshing network info cache for port 53846e61-8840-490f-a976-3997db8a0f0b {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:05:04.502525 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Creating image(s)
May 28 01:05:04.503310 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:04.503822 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "/opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:04.505089 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "/opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:04.505262 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:05:04.652420 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:04.979189 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] End _get_guest_xml xml=<domain type="qemu">
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:   <uuid>4fb6dc75-4a06-45ea-a050-4ddcd55e8559</uuid>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:   <name>instance-0000002b</name>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestInstancesWithCinderVolumes-server-1806060241</nova:name>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:05:00</nova:creationTime>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       <nova:image uuid="">
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:         <nova:properties/>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:         <nova:user uuid="91e7f4b4eca54b6198bbaea3ce953850">tempest-TestInstancesWithCinderVolumes-513545111-project-member</nova:user>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:         <nova:project uuid="15fc68900185447586ee6ff0817087fb">tempest-TestInstancesWithCinderVolumes-513545111</nova:project>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:         <nova:port uuid="cf12ff4e-41ad-46b1-bece-7d46af7ad869">
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:     <system>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       <entry name="serial">4fb6dc75-4a06-45ea-a050-4ddcd55e8559</entry>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       <entry name="uuid">4fb6dc75-4a06-45ea-a050-4ddcd55e8559</entry>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:     </system>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:   <os>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:   </os>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:   <features>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:   </features>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:   <devices>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/4fb6dc75-4a06-45ea-a050-4ddcd55e8559/disk.config"/>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:     </disk>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       <alias name="ua-1a631603-68c5-4259-80bc-36cc022416c6"/>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-0"/>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       <serial>1a631603-68c5-4259-80bc-36cc022416c6</serial>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:     </disk>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:6d:b1:ae"/>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       <target dev="tapcf12ff4e-41"/>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:     </interface>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/4fb6dc75-4a06-45ea-a050-4ddcd55e8559/console.log" append="off"/>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:     </serial>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:     <video>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:     </video>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:     </rng>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:   </devices>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]: </domain>
May 28 01:05:04.979189 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:05:04.979189 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Preparing to wait for external event network-vif-plugged-cf12ff4e-41ad-46b1-bece-7d46af7ad869 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:05:04.979189 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Acquiring lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:04.979189 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:04.986073 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:04.986073 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:04:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-1806060241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testinstanceswithcindervolumes-server-1806060241',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAe8gEcGEQ/stc3fEgwIW65M0AVq3AHTtqALSUztyu0nDHvzM5q0XODHSIjQcrLzlTNzjXRCsZgBdykHaRcNFL5BPyhoQLiM/TCxeJVQwmG3kEXtnF/FP5ATsgrgHp/YJg==',key_name='tempest-TestInstancesWithCinderVolumes-1357887979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15fc68900185447586ee6ff0817087fb',ramdisk_id='',reservation_id='r-waombbhh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestInstancesWithCinderVolumes-513545111',owner_user_name='tempest-TestInstancesWithCinderVolumes-513545111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:04:58Z,user_data=None,user_id='91e7f4b4eca54b6198bbaea3ce953850',uuid=4fb6dc75-4a06-45ea-a050-4ddcd55e8559,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf12ff4e-41ad-46b1-bece-7d46af7ad869", "address": "fa:16:3e:6d:b1:ae", "network": {"id": "328b8eaa-8fae-4e90-ac01-2f9b4e619fe8", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1060228276-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15fc68900185447586ee6ff0817087fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf12ff4e-41", "ovs_interfaceid": "cf12ff4e-41ad-46b1-bece-7d46af7ad869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:05:04.986073 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Converting VIF {"id": "cf12ff4e-41ad-46b1-bece-7d46af7ad869", "address": "fa:16:3e:6d:b1:ae", "network": {"id": "328b8eaa-8fae-4e90-ac01-2f9b4e619fe8", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1060228276-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15fc68900185447586ee6ff0817087fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf12ff4e-41", "ovs_interfaceid": "cf12ff4e-41ad-46b1-bece-7d46af7ad869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:05:04.986073 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b1:ae,bridge_name='br-int',has_traffic_filtering=True,id=cf12ff4e-41ad-46b1-bece-7d46af7ad869,network=Network(328b8eaa-8fae-4e90-ac01-2f9b4e619fe8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf12ff4e-41') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:05:04.986073 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b1:ae,bridge_name='br-int',has_traffic_filtering=True,id=cf12ff4e-41ad-46b1-bece-7d46af7ad869,network=Network(328b8eaa-8fae-4e90-ac01-2f9b4e619fe8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf12ff4e-41') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:05:04.986073 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:04.986073 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:04.986073 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:05:04.986073 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:04.986073 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c37b56dd-065c-5042-a042-bb847c230913', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:04.986073 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:04.986073 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:05:04.986073 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:04.988067 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:04.988067 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf12ff4e-41, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:04.988067 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcf12ff4e-41, col_values=(('qos', UUID('a4573bce-7766-4bad-9e94-c4ace8f0a8f3')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:04.988067 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcf12ff4e-41, col_values=(('external_ids', {'iface-id': 'cf12ff4e-41ad-46b1-bece-7d46af7ad869', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:b1:ae', 'vm-uuid': '4fb6dc75-4a06-45ea-a050-4ddcd55e8559'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:04.988467 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:04.989684 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:05:04.996188 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:04.997093 np0000001577 nova-compute[98319]: INFO os_vif [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b1:ae,bridge_name='br-int',has_traffic_filtering=True,id=cf12ff4e-41ad-46b1-bece-7d46af7ad869,network=Network(328b8eaa-8fae-4e90-ac01-2f9b4e619fe8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf12ff4e-41')
May 28 01:05:05.005353 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-aa4950cc-db7d-4e35-8679-06abdfbce8d3 req-4199065f-e25a-4fa2-8d7e-5cd95735ce88 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:05.008135 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Object Instance<2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:05:05.008495 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "d2d65fccf1ac0514f836f7000d81ee7b0d67b209" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:05.009877 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "d2d65fccf1ac0514f836f7000d81ee7b0d67b209" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:05.372188 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-aa4950cc-db7d-4e35-8679-06abdfbce8d3 req-4199065f-e25a-4fa2-8d7e-5cd95735ce88 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:05.542657 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-aa4950cc-db7d-4e35-8679-06abdfbce8d3 req-4199065f-e25a-4fa2-8d7e-5cd95735ce88 service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Updated VIF entry in instance network info cache for port 53846e61-8840-490f-a976-3997db8a0f0b. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:05:05.542942 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-aa4950cc-db7d-4e35-8679-06abdfbce8d3 req-4199065f-e25a-4fa2-8d7e-5cd95735ce88 service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Updating instance_info_cache with network_info: [{"id": "53846e61-8840-490f-a976-3997db8a0f0b", "address": "fa:16:3e:88:07:ca", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53846e61-88", "ovs_interfaceid": "53846e61-8840-490f-a976-3997db8a0f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:05:05.652694 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:05:05.882515 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:05:05.885037 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:05:05.885325 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2d65fccf1ac0514f836f7000d81ee7b0d67b209.part --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:05.968342 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2d65fccf1ac0514f836f7000d81ee7b0d67b209.part --force-share --output=json" returned: 0 in 0.083s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:05.968824 np0000001577 nova-compute[98319]: DEBUG nova.virt.images [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] b6697061-199b-4661-aba2-c05e22f942c6 was qcow2, converting to raw {{(pid=98319) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 01:05:05.969411 np0000001577 nova-compute[98319]: DEBUG nova.privsep.utils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 01:05:05.969738 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d2d65fccf1ac0514f836f7000d81ee7b0d67b209.part /opt/stack/data/nova/instances/_base/d2d65fccf1ac0514f836f7000d81ee7b0d67b209.converted {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:06.045333 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-aa4950cc-db7d-4e35-8679-06abdfbce8d3 req-4199065f-e25a-4fa2-8d7e-5cd95735ce88 service nova] Releasing lock "refresh_cache-2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:05:06.117520 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d2d65fccf1ac0514f836f7000d81ee7b0d67b209.part /opt/stack/data/nova/instances/_base/d2d65fccf1ac0514f836f7000d81ee7b0d67b209.converted" returned: 0 in 0.148s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:06.128785 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2d65fccf1ac0514f836f7000d81ee7b0d67b209.converted --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:06.164430 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] While synchronizing instance power states, found 5 instances in the database and 3 instances on the hypervisor.
May 28 01:05:06.164629 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Triggering sync for uuid 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e {{(pid=98319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 01:05:06.165470 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Triggering sync for uuid f4d80e03-89cd-4c85-93c4-442da626393e {{(pid=98319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 01:05:06.166150 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:06.166743 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Triggering sync for uuid d5aa4bd8-07f0-4329-88d3-63aa5a2be798 {{(pid=98319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 01:05:06.167290 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "f4d80e03-89cd-4c85-93c4-442da626393e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:06.167489 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "f4d80e03-89cd-4c85-93c4-442da626393e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:06.167882 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Triggering sync for uuid 4fb6dc75-4a06-45ea-a050-4ddcd55e8559 {{(pid=98319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 01:05:06.168399 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:06.170177 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Triggering sync for uuid 4db5d5f2-e263-41af-a833-642afe41d66d {{(pid=98319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 01:05:06.170590 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:06.171563 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:06.173241 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "4db5d5f2-e263-41af-a833-642afe41d66d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:06.173862 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 28.81 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:05:06.218907 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2d65fccf1ac0514f836f7000d81ee7b0d67b209.converted --force-share --output=json" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:06.219472 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "d2d65fccf1ac0514f836f7000d81ee7b0d67b209" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.211s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:06.219935 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:05:06.222906 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:05:06.223958 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2d65fccf1ac0514f836f7000d81ee7b0d67b209 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:06.268477 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:06.307595 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2d65fccf1ac0514f836f7000d81ee7b0d67b209 --force-share --output=json" returned: 0 in 0.083s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:06.307976 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "d2d65fccf1ac0514f836f7000d81ee7b0d67b209" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:06.308399 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "d2d65fccf1ac0514f836f7000d81ee7b0d67b209" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:06.308778 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:05:06.312370 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:05:06.315029 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:05:06.315364 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2d65fccf1ac0514f836f7000d81ee7b0d67b209 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:06.315631 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:05:06.315885 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Creating image(s)
May 28 01:05:06.316216 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:05:06.316365 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Ensure instance console log exists: /opt/stack/data/nova/instances/4db5d5f2-e263-41af-a833-642afe41d66d/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:05:06.316720 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:06.316881 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:06.317008 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:06.317556 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Start _get_guest_xml network_info=[{"id": "bd7b5ac7-f021-4ebe-9700-73daf0464312", "address": "fa:16:3e:6c:97:54", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7b5ac7-f0", "ovs_interfaceid": "bd7b5ac7-f021-4ebe-9700-73daf0464312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa', 'iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '72808bd3-3842-48c6-9c29-e6cd146637aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '4db5d5f2-e263-41af-a833-642afe41d66d', 'attached_at': '', 'detached_at': '', 'volume_id': '72808bd3-3842-48c6-9c29-e6cd146637aa', 'serial': '72808bd3-3842-48c6-9c29-e6cd146637aa'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '98568ebc-f14c-4688-a7e9-9310c0540ccc', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:05:06.334579 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:05:06.338287 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-295326890', uuid='4db5d5f2-e263-41af-a833-642afe41d66d'), owner=OwnerMeta(userid='0c803ddeaf4f4b3db07587419087b3b2', username='tempest-TestVolumeBootPattern-1449742411-project-member', projectid='050f928f1ce449d6a447cd343dc4ff80', projectname='tempest-TestVolumeBootPattern-1449742411'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "bd7b5ac7-f021-4ebe-9700-73daf0464312", "address": "fa:16:3e:6c:97:54", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7b5ac7-f0", "ovs_interfaceid": "bd7b5ac7-f021-4ebe-9700-73daf0464312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930306.3375227) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:05:06.339993 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:05:06.340469 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:05:06.341277 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:05:06.341467 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:05:06.342906 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:05:06.343345 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:05:06.343503 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:05:06.343609 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:05:06.343734 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:05:06.343802 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:05:06.343910 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:05:06.344094 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:05:06.344188 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:05:06.344317 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:05:06.344426 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:05:06.344602 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:05:06.354917 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:05:06.355409 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa', 'iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '72808bd3-3842-48c6-9c29-e6cd146637aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:05:06.355584 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:05:06.400413 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2d65fccf1ac0514f836f7000d81ee7b0d67b209 --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:06.401351 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2d65fccf1ac0514f836f7000d81ee7b0d67b209,backing_fmt=raw /opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:06.452974 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2d65fccf1ac0514f836f7000d81ee7b0d67b209,backing_fmt=raw /opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk 1073741824" returned: 0 in 0.052s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:06.453466 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "d2d65fccf1ac0514f836f7000d81ee7b0d67b209" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.145s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:06.453853 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2d65fccf1ac0514f836f7000d81ee7b0d67b209 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:06.527107 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:05:06.527278 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:05:06.527370 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] No VIF found with MAC fa:16:3e:6d:b1:ae, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:05:06.527821 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Using config drive
May 28 01:05:06.537812 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2d65fccf1ac0514f836f7000d81ee7b0d67b209 --force-share --output=json" returned: 0 in 0.084s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:06.538302 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lazy-loading 'migration_context' on Instance uuid 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:05:06.674328 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "f4d80e03-89cd-4c85-93c4-442da626393e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.507s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:06.677337 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.507s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:07.034125 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:07.041100 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Object Instance<2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:05:07.041494 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Rebasing disk image.
May 28 01:05:07.041718 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:07.115791 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.760s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:05:07.117018 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa', 'iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '72808bd3-3842-48c6-9c29-e6cd146637aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:05:07.132795 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:05:07.133492 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:05:07.134082 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:05:07.134505 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:05:07.134750 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:05:07.134937 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:05:07.142606 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.101s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:07.143042 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 -F raw /opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:07.156832 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:05:07.156832 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:07.157841 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:05:07.157841 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:07.169755 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa] added
May 28 01:05:07.169755 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:05:07.169755 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:05:07.169755 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:05:07.169755 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:05:07.169755 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:05:07.169755 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:07.170047 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:05:07.170294 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0358(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:05:07.170573 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:05:07.173304 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa] added
May 28 01:05:07.173304 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:05:07.173304 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:05:07.173304 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:05:07.173304 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:05:07.173304 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:05:07.173304 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:07.173518 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:05:07.173670 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0387(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:05:07.173831 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:05:07.199792 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Creating config drive at /opt/stack/data/nova/instances/4fb6dc75-4a06-45ea-a050-4ddcd55e8559/disk.config
May 28 01:05:07.203045 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4fb6dc75-4a06-45ea-a050-4ddcd55e8559/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpq81x1ik9 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:07.262432 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4fb6dc75-4a06-45ea-a050-4ddcd55e8559/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpq81x1ik9" returned: 0 in 0.059s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:07.292362 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Acquiring lock "5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:07.292493 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:07.721975 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:07.755961 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:07.794836 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:05:07.838635 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:07.928057 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2786de33-9538-4ef0-bf0a-a669ea1af285 req-155d11ee-2ab8-4ae2-a692-0475b61fc936 service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Received event network-vif-plugged-cf12ff4e-41ad-46b1-bece-7d46af7ad869 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:07.928884 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2786de33-9538-4ef0-bf0a-a669ea1af285 req-155d11ee-2ab8-4ae2-a692-0475b61fc936 service nova] Acquiring lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:07.928884 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2786de33-9538-4ef0-bf0a-a669ea1af285 req-155d11ee-2ab8-4ae2-a692-0475b61fc936 service nova] Lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:07.928884 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2786de33-9538-4ef0-bf0a-a669ea1af285 req-155d11ee-2ab8-4ae2-a692-0475b61fc936 service nova] Lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:07.928884 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2786de33-9538-4ef0-bf0a-a669ea1af285 req-155d11ee-2ab8-4ae2-a692-0475b61fc936 service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Processing event network-vif-plugged-cf12ff4e-41ad-46b1-bece-7d46af7ad869 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:05:08.010964 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 -F raw /opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk" returned: 0 in 0.867s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:08.011431 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:05:08.011642 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Ensure instance console log exists: /opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:05:08.013935 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:08.013935 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:08.013935 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:08.015047 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Start _get_guest_xml network_info=[{"id": "53846e61-8840-490f-a976-3997db8a0f0b", "address": "fa:16:3e:88:07:ca", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53846e61-88", "ovs_interfaceid": "53846e61-8840-490f-a976-3997db8a0f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b75621e1ba45b8e655afaad5776cfc91',container_format='bare',created_at=2026-05-28T01:04:40Z,direct_url=<?>,disk_format='qcow2',id=b6697061-199b-4661-aba2-c05e22f942c6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1328136978-shelved',owner='f6a7090a79f448f3abe4737bf127df53',properties=ImageMetaProps,protected=<?>,size=53542912,status='active',tags=<?>,updated_at=2026-05-28T01:04:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:05:08.019420 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:05:08.020939 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-1328136978', uuid='2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e'), owner=OwnerMeta(userid='d375089981f8493598b33c4b6f122374', username='tempest-AttachVolumeShelveTestJSON-1260503814-project-member', projectid='f6a7090a79f448f3abe4737bf127df53', projectname='tempest-AttachVolumeShelveTestJSON-1260503814'), image=ImageMeta(id='b6697061-199b-4661-aba2-c05e22f942c6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "53846e61-8840-490f-a976-3997db8a0f0b", "address": "fa:16:3e:88:07:ca", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53846e61-88", "ovs_interfaceid": "53846e61-8840-490f-a976-3997db8a0f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930308.0204964) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:05:08.025833 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:05:08.026364 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:05:08.027813 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:05:08.028035 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:05:08.029189 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:05:08.029607 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b75621e1ba45b8e655afaad5776cfc91',container_format='bare',created_at=2026-05-28T01:04:40Z,direct_url=<?>,disk_format='qcow2',id=b6697061-199b-4661-aba2-c05e22f942c6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1328136978-shelved',owner='f6a7090a79f448f3abe4737bf127df53',properties=ImageMetaProps,protected=<?>,size=53542912,status='active',tags=<?>,updated_at=2026-05-28T01:04:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:05:08.029776 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:05:08.029871 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:05:08.030000 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:05:08.030098 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:05:08.030337 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:05:08.030493 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:05:08.030925 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:05:08.031094 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:05:08.031266 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:05:08.031437 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:05:08.031661 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:05:08.125187 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:08.127742 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:08.132425 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:08.161437 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:08.170926 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:05:08.174858 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:05:08.185124 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:05:08.185124 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:05:08.190151 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:05:08.190151 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:08.202041 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:08.212264 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:08.226570 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:08.226570 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:08.226570 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:08.226570 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:08.226570 np0000001577 nova-compute[98319]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:08.226570 np0000001577 nova-compute[98319]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:08.226570 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:05:08.226570 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:08.226570 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:08.226570 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:08.226570 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:08.226570 np0000001577 nova-compute[98319]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:08.226570 np0000001577 nova-compute[98319]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:08.226570 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:05:08.235637 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:08.235637 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:08.235637 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:08.235637 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:08.235637 np0000001577 nova-compute[98319]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:08.235637 np0000001577 nova-compute[98319]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:08.235637 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:05:08.235886 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:08.235886 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:08.235886 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:08.235886 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:08.235886 np0000001577 nova-compute[98319]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:08.235886 np0000001577 nova-compute[98319]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:08.235886 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:05:08.265615 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa, portal: 192.168.50.100,3260]
May 28 01:05:08.265615 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa, portal: 192.168.50.100,3260] successful.
May 28 01:05:08.265615 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:08.279289 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:08.285722 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa, portal: 192.168.40.100,3260]
May 28 01:05:08.285722 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa, portal: 192.168.40.100,3260] successful.
May 28 01:05:08.285722 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:08.298145 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:08.298145 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:08.298145 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:08.298145 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:08.298145 np0000001577 nova-compute[98319]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:08.298145 np0000001577 nova-compute[98319]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:08.298145 np0000001577 nova-compute[98319]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa (non-flash)
May 28 01:05:08.298145 np0000001577 nova-compute[98319]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa (non-flash)
May 28 01:05:08.298145 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:05:08.304569 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:08.304569 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:08.304569 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:08.304569 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:08.304569 np0000001577 nova-compute[98319]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:08.304569 np0000001577 nova-compute[98319]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:08.304569 np0000001577 nova-compute[98319]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa (non-flash)
May 28 01:05:08.304569 np0000001577 nova-compute[98319]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa (non-flash)
May 28 01:05:08.304569 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:05:08.304569 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:05:08.304569 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:05:08.305052 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:08.306456 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] HCTL ('13', '-', '-', 0) found on session 94 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:05:08.308858 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:05:08.327107 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:08.327107 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:08.327107 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:08.327107 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:08.327107 np0000001577 nova-compute[98319]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:08.327107 np0000001577 nova-compute[98319]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:08.327107 np0000001577 nova-compute[98319]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa (non-flash)
May 28 01:05:08.327107 np0000001577 nova-compute[98319]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa (non-flash)
May 28 01:05:08.327107 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:05:08.327107 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:08.327107 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:08.327107 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:08.327107 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:08.327107 np0000001577 nova-compute[98319]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:08.327107 np0000001577 nova-compute[98319]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:08.327107 np0000001577 nova-compute[98319]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa (non-flash)
May 28 01:05:08.327107 np0000001577 nova-compute[98319]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa (non-flash)
May 28 01:05:08.327107 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:05:08.327107 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.189s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:05:08.327107 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:05:08.327107 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching for a device in session 94 and hctl ['13', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:05:08.329644 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] HCTL ('14', '-', '-', 0) found on session 95 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:05:08.329644 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:05:08.346593 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching for a device in session 95 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:05:08.346765 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '72808bd3-3842-48c6-9c29-e6cd146637aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:05:08.363353 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:08.365610 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:08.367845 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:05:08.368114 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Claim successful on node np0000001577
May 28 01:05:08.533936 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Object Instance<2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:05:08.549859 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T01:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1328136978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumeshelvetestjson-server-1328136978',id=39,image_ref='b6697061-199b-4661-aba2-c05e22f942c6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-866036055',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:03:59Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f6a7090a79f448f3abe4737bf127df53',ramdisk_id='',reservation_id='r-wfzqk2ne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1260503814',owner_user_name='tempest-AttachVolumeShelveTestJSON-1260503814-project-member',shelved_at='2026-05-28T01:04:46.385860',shelved_host='np0000001577',shelved_image_id='b6697061-199b-4661-aba2-c05e22f942c6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:04:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d375089981f8493598b33c4b6f122374',uuid=2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "53846e61-8840-490f-a976-3997db8a0f0b", "address": "fa:16:3e:88:07:ca", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53846e61-88", "ovs_interfaceid": "53846e61-8840-490f-a976-3997db8a0f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:05:08.550253 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Converting VIF {"id": "53846e61-8840-490f-a976-3997db8a0f0b", "address": "fa:16:3e:88:07:ca", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53846e61-88", "ovs_interfaceid": "53846e61-8840-490f-a976-3997db8a0f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:05:08.551312 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:07:ca,bridge_name='br-int',has_traffic_filtering=True,id=53846e61-8840-490f-a976-3997db8a0f0b,network=Network(e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53846e61-88') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:05:08.552267 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:05:08.665766 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:05:08.666373 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930308.6660051, 4fb6dc75-4a06-45ea-a050-4ddcd55e8559 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:05:08.666516 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] VM Started (Lifecycle Event)
May 28 01:05:08.672838 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:05:08.677033 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Instance spawned successfully.
May 28 01:05:08.678503 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:05:09.054336 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Object Instance<2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:05:09.055245 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] End _get_guest_xml xml=<domain type="qemu">
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:   <uuid>2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e</uuid>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:   <name>instance-00000027</name>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1328136978</nova:name>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:05:08</nova:creationTime>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:         <nova:user uuid="d375089981f8493598b33c4b6f122374">tempest-AttachVolumeShelveTestJSON-1260503814-project-member</nova:user>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:         <nova:project uuid="f6a7090a79f448f3abe4737bf127df53">tempest-AttachVolumeShelveTestJSON-1260503814</nova:project>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:         <nova:port uuid="53846e61-8840-490f-a976-3997db8a0f0b">
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:     <system>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       <entry name="serial">2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e</entry>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       <entry name="uuid">2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e</entry>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:     </system>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:   <os>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:   </os>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:   <features>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:   </features>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:   <devices>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk"/>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:     </disk>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk.config"/>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:     </disk>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:88:07:ca"/>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       <target dev="tap53846e61-88"/>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:     </interface>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/console.log" append="off"/>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:     </serial>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:     <video>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:     </video>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:     </rng>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:   </devices>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]: </domain>
May 28 01:05:09.055245 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:05:09.057009 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Preparing to wait for external event network-vif-plugged-53846e61-8840-490f-a976-3997db8a0f0b {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:05:09.057009 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:09.057009 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:09.057009 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:09.057009 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T01:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1328136978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumeshelvetestjson-server-1328136978',id=39,image_ref='b6697061-199b-4661-aba2-c05e22f942c6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-866036055',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:03:59Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f6a7090a79f448f3abe4737bf127df53',ramdisk_id='',reservation_id='r-wfzqk2ne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1260503814',owner_user_name='tempest-AttachVolumeShelveTestJSON-1260503814-project-member',shelved_at='2026-05-28T01:04:46.385860',shelved_host='np0000001577',shelved_image_id='b6697061-199b-4661-aba2-c05e22f942c6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:04:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d375089981f8493598b33c4b6f122374',uuid=2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "53846e61-8840-490f-a976-3997db8a0f0b", "address": "fa:16:3e:88:07:ca", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53846e61-88", "ovs_interfaceid": "53846e61-8840-490f-a976-3997db8a0f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:05:09.057009 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Converting VIF {"id": "53846e61-8840-490f-a976-3997db8a0f0b", "address": "fa:16:3e:88:07:ca", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53846e61-88", "ovs_interfaceid": "53846e61-8840-490f-a976-3997db8a0f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:05:09.057291 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:07:ca,bridge_name='br-int',has_traffic_filtering=True,id=53846e61-8840-490f-a976-3997db8a0f0b,network=Network(e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53846e61-88') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:05:09.057291 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:07:ca,bridge_name='br-int',has_traffic_filtering=True,id=53846e61-8840-490f-a976-3997db8a0f0b,network=Network(e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53846e61-88') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:05:09.057672 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:09.057966 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:09.058206 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:05:09.058855 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:09.059029 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '921380f2-9f93-52c3-9f0e-e71e1cf40019', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:09.067951 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:09.069022 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:05:09.069794 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:09.071855 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:09.072029 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53846e61-88, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:09.072338 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53846e61-88, col_values=(('qos', UUID('f43709ba-455f-4f52-8fe5-fd1e6f408a18')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:09.072489 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53846e61-88, col_values=(('external_ids', {'iface-id': '53846e61-8840-490f-a976-3997db8a0f0b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:07:ca', 'vm-uuid': '2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:09.073370 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:09.074993 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:05:09.079171 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:09.080620 np0000001577 nova-compute[98319]: INFO os_vif [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:07:ca,bridge_name='br-int',has_traffic_filtering=True,id=53846e61-8840-490f-a976-3997db8a0f0b,network=Network(e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53846e61-88')
May 28 01:05:09.172136 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:09.174178 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:05:09.185068 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:09.185289 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:09.185505 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:09.185656 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:09.185874 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:09.186035 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:09.325428 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching for a device in session 94 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:05:09.326886 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '72808bd3-3842-48c6-9c29-e6cd146637aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:05:09.677699 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:05:09.678617 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930309.6779215, 4fb6dc75-4a06-45ea-a050-4ddcd55e8559 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:05:09.678775 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] VM Paused (Lifecycle Event)
May 28 01:05:09.692314 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Took 9.07 seconds to spawn the instance on the hypervisor.
May 28 01:05:09.692716 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:09.723439 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:05:09.723735 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:05:09.987946 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1c6e21c7-ca65-43a2-852e-bc9963562662 req-577c1128-f94c-41bf-8c4e-c3fe9ebe9bea service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Received event network-vif-plugged-cf12ff4e-41ad-46b1-bece-7d46af7ad869 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:09.990924 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1c6e21c7-ca65-43a2-852e-bc9963562662 req-577c1128-f94c-41bf-8c4e-c3fe9ebe9bea service nova] Acquiring lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:09.990924 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1c6e21c7-ca65-43a2-852e-bc9963562662 req-577c1128-f94c-41bf-8c4e-c3fe9ebe9bea service nova] Lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:09.990924 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1c6e21c7-ca65-43a2-852e-bc9963562662 req-577c1128-f94c-41bf-8c4e-c3fe9ebe9bea service nova] Lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:09.991149 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1c6e21c7-ca65-43a2-852e-bc9963562662 req-577c1128-f94c-41bf-8c4e-c3fe9ebe9bea service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] No waiting events found dispatching network-vif-plugged-cf12ff4e-41ad-46b1-bece-7d46af7ad869 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:05:09.991331 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-1c6e21c7-ca65-43a2-852e-bc9963562662 req-577c1128-f94c-41bf-8c4e-c3fe9ebe9bea service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Received unexpected event network-vif-plugged-cf12ff4e-41ad-46b1-bece-7d46af7ad869 for instance with vm_state active and task_state None.
May 28 01:05:10.151439 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Found WWN 3300000007a1118b4 for multipath device dm-7 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:05:10.155567 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:05:10.155567 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] <== connect_volume: return (3796ms) {'type': 'block', 'scsi_wwn': '3300000007a1118b4', 'path': '/dev/dm-7', 'multipath_id': '3300000007a1118b4'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:05:10.155567 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007a1118b4', 'path': '/dev/dm-7', 'multipath_id': '3300000007a1118b4'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:05:10.180814 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:10.182658 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930310.1824512, 4fb6dc75-4a06-45ea-a050-4ddcd55e8559 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:05:10.183320 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] VM Resumed (Lifecycle Event)
May 28 01:05:10.200676 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Took 16.44 seconds to build instance.
May 28 01:05:10.227201 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:05:10.598867 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:05:10.598979 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:05:10.599098 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] No VIF found with MAC fa:16:3e:88:07:ca, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:05:10.599700 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Using config drive
May 28 01:05:10.669276 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:04:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-295326890',display_name='tempest-TestVolumeBootPattern-server-295326890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpattern-server-295326890',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='050f928f1ce449d6a447cd343dc4ff80',ramdisk_id='',reservation_id='r-rl5r4bgq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1449742411',owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:05:00Z,user_data=None,user_id='0c803ddeaf4f4b3db07587419087b3b2',uuid=4db5d5f2-e263-41af-a833-642afe41d66d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd7b5ac7-f021-4ebe-9700-73daf0464312", "address": "fa:16:3e:6c:97:54", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7b5ac7-f0", "ovs_interfaceid": "bd7b5ac7-f021-4ebe-9700-73daf0464312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:05:10.669527 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converting VIF {"id": "bd7b5ac7-f021-4ebe-9700-73daf0464312", "address": "fa:16:3e:6c:97:54", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7b5ac7-f0", "ovs_interfaceid": "bd7b5ac7-f021-4ebe-9700-73daf0464312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:05:10.670165 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:97:54,bridge_name='br-int',has_traffic_filtering=True,id=bd7b5ac7-f021-4ebe-9700-73daf0464312,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd7b5ac7-f0') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:05:10.670968 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lazy-loading 'pci_devices' on Instance uuid 4db5d5f2-e263-41af-a833-642afe41d66d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:05:10.684755 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:10.690625 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:05:10.703412 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-49087bba-39ff-4106-b932-3ddc519d477f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.949s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:10.705348 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.533s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:10.705348 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:05:10.705348 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:10.733688 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.370s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:10.734134 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:05:11.102457 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lazy-loading 'ec2_ids' on Instance uuid 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:05:11.176094 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] End _get_guest_xml xml=<domain type="qemu">
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:   <uuid>4db5d5f2-e263-41af-a833-642afe41d66d</uuid>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:   <name>instance-0000002c</name>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestVolumeBootPattern-server-295326890</nova:name>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:05:06</nova:creationTime>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       <nova:image uuid="">
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:         <nova:user uuid="0c803ddeaf4f4b3db07587419087b3b2">tempest-TestVolumeBootPattern-1449742411-project-member</nova:user>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:         <nova:project uuid="050f928f1ce449d6a447cd343dc4ff80">tempest-TestVolumeBootPattern-1449742411</nova:project>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:         <nova:port uuid="bd7b5ac7-f021-4ebe-9700-73daf0464312">
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:     <system>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       <entry name="serial">4db5d5f2-e263-41af-a833-642afe41d66d</entry>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       <entry name="uuid">4db5d5f2-e263-41af-a833-642afe41d66d</entry>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:     </system>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:   <os>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:   </os>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:   <features>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:   </features>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:   <devices>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/4db5d5f2-e263-41af-a833-642afe41d66d/disk.config"/>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:     </disk>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       <alias name="ua-72808bd3-3842-48c6-9c29-e6cd146637aa"/>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-7"/>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       <serial>72808bd3-3842-48c6-9c29-e6cd146637aa</serial>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:     </disk>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:6c:97:54"/>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       <target dev="tapbd7b5ac7-f0"/>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:     </interface>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/4db5d5f2-e263-41af-a833-642afe41d66d/console.log" append="off"/>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:     </serial>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:     <video>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:     </video>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:     </rng>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:   </devices>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]: </domain>
May 28 01:05:11.176094 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:05:11.177956 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Preparing to wait for external event network-vif-plugged-bd7b5ac7-f021-4ebe-9700-73daf0464312 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:05:11.177956 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "4db5d5f2-e263-41af-a833-642afe41d66d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:11.177956 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "4db5d5f2-e263-41af-a833-642afe41d66d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:11.177956 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "4db5d5f2-e263-41af-a833-642afe41d66d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:11.177956 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:04:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-295326890',display_name='tempest-TestVolumeBootPattern-server-295326890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpattern-server-295326890',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='050f928f1ce449d6a447cd343dc4ff80',ramdisk_id='',reservation_id='r-rl5r4bgq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1449742411',owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:05:00Z,user_data=None,user_id='0c803ddeaf4f4b3db07587419087b3b2',uuid=4db5d5f2-e263-41af-a833-642afe41d66d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd7b5ac7-f021-4ebe-9700-73daf0464312", "address": "fa:16:3e:6c:97:54", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7b5ac7-f0", "ovs_interfaceid": "bd7b5ac7-f021-4ebe-9700-73daf0464312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:05:11.177956 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converting VIF {"id": "bd7b5ac7-f021-4ebe-9700-73daf0464312", "address": "fa:16:3e:6c:97:54", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7b5ac7-f0", "ovs_interfaceid": "bd7b5ac7-f021-4ebe-9700-73daf0464312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:05:11.179276 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:97:54,bridge_name='br-int',has_traffic_filtering=True,id=bd7b5ac7-f021-4ebe-9700-73daf0464312,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd7b5ac7-f0') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:05:11.179276 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:97:54,bridge_name='br-int',has_traffic_filtering=True,id=bd7b5ac7-f021-4ebe-9700-73daf0464312,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd7b5ac7-f0') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:05:11.179276 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:11.179276 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:11.179276 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:05:11.179974 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:11.180155 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd0e6479c-0e98-50aa-9ba8-10abe3fdc5fa', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:11.182158 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:11.182833 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:05:11.202570 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:11.204396 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:11.204396 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd7b5ac7-f0, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:11.204705 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd7b5ac7-f0, col_values=(('qos', UUID('db8e017e-c2d9-4c12-bdfc-cd440321738f')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:11.204838 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd7b5ac7-f0, col_values=(('external_ids', {'iface-id': 'bd7b5ac7-f021-4ebe-9700-73daf0464312', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:97:54', 'vm-uuid': '4db5d5f2-e263-41af-a833-642afe41d66d'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:11.208920 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:11.208920 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:05:11.218568 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:11.218568 np0000001577 nova-compute[98319]: INFO os_vif [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:97:54,bridge_name='br-int',has_traffic_filtering=True,id=bd7b5ac7-f021-4ebe-9700-73daf0464312,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd7b5ac7-f0')
May 28 01:05:11.239883 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:05:11.240539 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:05:11.242648 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:11.243007 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:11.269994 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:11.323826 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd854e42ac49d4e388f4dfb1eb45acae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44725643b25b416d937c23a6b7447cd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:05:11.607862 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Object Instance<2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:05:11.608051 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lazy-loading 'keypairs' on Instance uuid 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:05:11.740655 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Successfully created port: 81f6efb5-0378-4f9f-a914-02a5ce564ecd {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:05:11.743093 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:05:11.976893 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Acquiring lock "4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:11.977093 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Lock "4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:12.049039 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7fab0783-cff7-4c5e-bed4-4575d70b25f3 req-a8dc866a-a972-45ed-a62f-707b04d34f28 service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Received event network-changed-cf12ff4e-41ad-46b1-bece-7d46af7ad869 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:12.049177 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7fab0783-cff7-4c5e-bed4-4575d70b25f3 req-a8dc866a-a972-45ed-a62f-707b04d34f28 service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Refreshing instance network info cache due to event network-changed-cf12ff4e-41ad-46b1-bece-7d46af7ad869. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:05:12.049368 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7fab0783-cff7-4c5e-bed4-4575d70b25f3 req-a8dc866a-a972-45ed-a62f-707b04d34f28 service nova] Acquiring lock "refresh_cache-4fb6dc75-4a06-45ea-a050-4ddcd55e8559" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:05:12.051424 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7fab0783-cff7-4c5e-bed4-4575d70b25f3 req-a8dc866a-a972-45ed-a62f-707b04d34f28 service nova] Acquired lock "refresh_cache-4fb6dc75-4a06-45ea-a050-4ddcd55e8559" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:05:12.051618 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-7fab0783-cff7-4c5e-bed4-4575d70b25f3 req-a8dc866a-a972-45ed-a62f-707b04d34f28 service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Refreshing network info cache for port cf12ff4e-41ad-46b1-bece-7d46af7ad869 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:05:12.111267 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Object Instance<2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:05:12.115095 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:12.246046 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:05:12.277040 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Creating config drive at /opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk.config
May 28 01:05:12.283366 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9plijrld {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:12.314171 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Successfully updated port: 81f6efb5-0378-4f9f-a914-02a5ce564ecd {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:05:12.350779 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9plijrld" returned: 0 in 0.067s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:12.373275 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6cf7084c-11f4-416d-893f-2bff299c6c6d req-5a7aca08-04e9-419d-ad02-8eae9218cc27 service nova] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Received event network-changed-81f6efb5-0378-4f9f-a914-02a5ce564ecd {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:12.373426 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6cf7084c-11f4-416d-893f-2bff299c6c6d req-5a7aca08-04e9-419d-ad02-8eae9218cc27 service nova] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Refreshing instance network info cache due to event network-changed-81f6efb5-0378-4f9f-a914-02a5ce564ecd. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:05:12.373672 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6cf7084c-11f4-416d-893f-2bff299c6c6d req-5a7aca08-04e9-419d-ad02-8eae9218cc27 service nova] Acquiring lock "refresh_cache-5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:05:12.373772 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6cf7084c-11f4-416d-893f-2bff299c6c6d req-5a7aca08-04e9-419d-ad02-8eae9218cc27 service nova] Acquired lock "refresh_cache-5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:05:12.373895 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-6cf7084c-11f4-416d-893f-2bff299c6c6d req-5a7aca08-04e9-419d-ad02-8eae9218cc27 service nova] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Refreshing network info cache for port 81f6efb5-0378-4f9f-a914-02a5ce564ecd {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:05:12.479275 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:05:12.554898 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-7fab0783-cff7-4c5e-bed4-4575d70b25f3 req-a8dc866a-a972-45ed-a62f-707b04d34f28 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:12.743143 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:05:12.743317 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:05:12.743476 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] No VIF found with MAC fa:16:3e:6c:97:54, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:05:12.744075 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Using config drive
May 28 01:05:12.805575 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:12.821036 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Acquiring lock "refresh_cache-5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:05:12.844566 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:12.876503 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-6cf7084c-11f4-416d-893f-2bff299c6c6d req-5a7aca08-04e9-419d-ad02-8eae9218cc27 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:12.901322 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-7fab0783-cff7-4c5e-bed4-4575d70b25f3 req-a8dc866a-a972-45ed-a62f-707b04d34f28 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:12.938624 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:12.981318 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-6cf7084c-11f4-416d-893f-2bff299c6c6d req-5a7aca08-04e9-419d-ad02-8eae9218cc27 service nova] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:05:13.066241 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:13.066464 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:13.073392 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:05:13.073523 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Claim successful on node np0000001577
May 28 01:05:13.106037 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-7fab0783-cff7-4c5e-bed4-4575d70b25f3 req-a8dc866a-a972-45ed-a62f-707b04d34f28 service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Updated VIF entry in instance network info cache for port cf12ff4e-41ad-46b1-bece-7d46af7ad869. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:05:13.107212 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-7fab0783-cff7-4c5e-bed4-4575d70b25f3 req-a8dc866a-a972-45ed-a62f-707b04d34f28 service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Updating instance_info_cache with network_info: [{"id": "cf12ff4e-41ad-46b1-bece-7d46af7ad869", "address": "fa:16:3e:6d:b1:ae", "network": {"id": "328b8eaa-8fae-4e90-ac01-2f9b4e619fe8", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1060228276-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15fc68900185447586ee6ff0817087fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf12ff4e-41", "ovs_interfaceid": "cf12ff4e-41ad-46b1-bece-7d46af7ad869", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:05:13.179673 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:13.185988 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:13.189951 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:13.215682 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:13.220204 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:13.250031 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:13.259184 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:05:13.260114 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:05:13.260367 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Creating image(s)
May 28 01:05:13.261131 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Acquiring lock "/opt/stack/data/nova/instances/5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:13.261325 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "/opt/stack/data/nova/instances/5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:13.261776 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "/opt/stack/data/nova/instances/5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:13.262207 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:05:13.265651 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:05:13.266883 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:13.371062 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.104s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:13.371559 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:13.372040 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:13.372522 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:05:13.375378 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:05:13.375732 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:13.401502 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Creating config drive at /opt/stack/data/nova/instances/4db5d5f2-e263-41af-a833-642afe41d66d/disk.config
May 28 01:05:13.406294 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4db5d5f2-e263-41af-a833-642afe41d66d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpifp0zbp1 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:13.476605 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4db5d5f2-e263-41af-a833-642afe41d66d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpifp0zbp1" returned: 0 in 0.070s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:13.497123 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.121s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:13.497663 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:13.561572 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb/disk 1073741824" returned: 0 in 0.061s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:13.561572 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:13.561572 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:13.609321 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7fab0783-cff7-4c5e-bed4-4575d70b25f3 req-a8dc866a-a972-45ed-a62f-707b04d34f28 service nova] Releasing lock "refresh_cache-4fb6dc75-4a06-45ea-a050-4ddcd55e8559" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:05:13.662846 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.102s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:13.663470 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:05:13.663502 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:13.717373 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-bf918242-c2bc-4b75-b123-0e0d8506a233 req-d71f3130-7a0f-4c1f-9462-b5789c86598a service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Received event network-changed-cf12ff4e-41ad-46b1-bece-7d46af7ad869 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:13.717862 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-bf918242-c2bc-4b75-b123-0e0d8506a233 req-d71f3130-7a0f-4c1f-9462-b5789c86598a service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Refreshing instance network info cache due to event network-changed-cf12ff4e-41ad-46b1-bece-7d46af7ad869. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:05:13.717862 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bf918242-c2bc-4b75-b123-0e0d8506a233 req-d71f3130-7a0f-4c1f-9462-b5789c86598a service nova] Acquiring lock "refresh_cache-4fb6dc75-4a06-45ea-a050-4ddcd55e8559" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:05:13.717862 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bf918242-c2bc-4b75-b123-0e0d8506a233 req-d71f3130-7a0f-4c1f-9462-b5789c86598a service nova] Acquired lock "refresh_cache-4fb6dc75-4a06-45ea-a050-4ddcd55e8559" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:05:13.717927 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-bf918242-c2bc-4b75-b123-0e0d8506a233 req-d71f3130-7a0f-4c1f-9462-b5789c86598a service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Refreshing network info cache for port cf12ff4e-41ad-46b1-bece-7d46af7ad869 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:05:13.726828 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930313.7252936, 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:05:13.726828 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] VM Started (Lifecycle Event)
May 28 01:05:13.732498 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-6cf7084c-11f4-416d-893f-2bff299c6c6d req-5a7aca08-04e9-419d-ad02-8eae9218cc27 service nova] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:05:13.753034 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:13.753449 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Cannot resize image /opt/stack/data/nova/instances/5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:05:13.754117 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:05:13.754406 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Ensure instance console log exists: /opt/stack/data/nova/instances/5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:05:13.754799 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:13.755020 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:13.755194 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:13.930913 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:13.961143 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:13.964245 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:14.044706 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:14.225691 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-bf918242-c2bc-4b75-b123-0e0d8506a233 req-d71f3130-7a0f-4c1f-9462-b5789c86598a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:14.236264 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:14.237352 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6cf7084c-11f4-416d-893f-2bff299c6c6d req-5a7aca08-04e9-419d-ad02-8eae9218cc27 service nova] Releasing lock "refresh_cache-5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:05:14.237704 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Acquired lock "refresh_cache-5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:05:14.237839 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:05:14.243342 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930314.2430918, 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:05:14.243496 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] VM Paused (Lifecycle Event)
May 28 01:05:14.266029 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:14.270065 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:14.273371 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:14.302594 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:14.426821 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ec7cb7d6-bb29-4791-b513-530ae6f6b4ce req-61139d0c-8076-4c22-867b-fa214f5a5fe0 service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Received event network-vif-plugged-53846e61-8840-490f-a976-3997db8a0f0b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:14.427293 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ec7cb7d6-bb29-4791-b513-530ae6f6b4ce req-61139d0c-8076-4c22-867b-fa214f5a5fe0 service nova] Acquiring lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:14.427293 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ec7cb7d6-bb29-4791-b513-530ae6f6b4ce req-61139d0c-8076-4c22-867b-fa214f5a5fe0 service nova] Lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:14.427366 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ec7cb7d6-bb29-4791-b513-530ae6f6b4ce req-61139d0c-8076-4c22-867b-fa214f5a5fe0 service nova] Lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:14.430240 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ec7cb7d6-bb29-4791-b513-530ae6f6b4ce req-61139d0c-8076-4c22-867b-fa214f5a5fe0 service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Processing event network-vif-plugged-53846e61-8840-490f-a976-3997db8a0f0b {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:05:14.430240 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ec7cb7d6-bb29-4791-b513-530ae6f6b4ce req-61139d0c-8076-4c22-867b-fa214f5a5fe0 service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Received event network-vif-plugged-53846e61-8840-490f-a976-3997db8a0f0b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:14.430240 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:05:14.430240 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ec7cb7d6-bb29-4791-b513-530ae6f6b4ce req-61139d0c-8076-4c22-867b-fa214f5a5fe0 service nova] Acquiring lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:14.430240 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ec7cb7d6-bb29-4791-b513-530ae6f6b4ce req-61139d0c-8076-4c22-867b-fa214f5a5fe0 service nova] Lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:14.430240 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ec7cb7d6-bb29-4791-b513-530ae6f6b4ce req-61139d0c-8076-4c22-867b-fa214f5a5fe0 service nova] Lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:14.430240 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ec7cb7d6-bb29-4791-b513-530ae6f6b4ce req-61139d0c-8076-4c22-867b-fa214f5a5fe0 service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] No waiting events found dispatching network-vif-plugged-53846e61-8840-490f-a976-3997db8a0f0b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:05:14.430240 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-ec7cb7d6-bb29-4791-b513-530ae6f6b4ce req-61139d0c-8076-4c22-867b-fa214f5a5fe0 service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Received unexpected event network-vif-plugged-53846e61-8840-490f-a976-3997db8a0f0b for instance with vm_state shelved_offloaded and task_state spawning.
May 28 01:05:14.431905 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:05:14.433746 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Instance spawned successfully.
May 28 01:05:14.512655 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:05:14.512892 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:05:14.583759 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-bf918242-c2bc-4b75-b123-0e0d8506a233 req-d71f3130-7a0f-4c1f-9462-b5789c86598a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:14.704246 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-bf918242-c2bc-4b75-b123-0e0d8506a233 req-d71f3130-7a0f-4c1f-9462-b5789c86598a service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Updated VIF entry in instance network info cache for port cf12ff4e-41ad-46b1-bece-7d46af7ad869. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:05:14.704528 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-bf918242-c2bc-4b75-b123-0e0d8506a233 req-d71f3130-7a0f-4c1f-9462-b5789c86598a service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Updating instance_info_cache with network_info: [{"id": "cf12ff4e-41ad-46b1-bece-7d46af7ad869", "address": "fa:16:3e:6d:b1:ae", "network": {"id": "328b8eaa-8fae-4e90-ac01-2f9b4e619fe8", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1060228276-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15fc68900185447586ee6ff0817087fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf12ff4e-41", "ovs_interfaceid": "cf12ff4e-41ad-46b1-bece-7d46af7ad869", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:05:14.745740 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:14.752202 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930314.7502644, 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:05:14.752202 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] VM Resumed (Lifecycle Event)
May 28 01:05:14.808404 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:05:14.854304 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:14.973520 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:15.016006 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:05:15.092337 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Updating instance_info_cache with network_info: [{"id": "81f6efb5-0378-4f9f-a914-02a5ce564ecd", "address": "fa:16:3e:29:8d:59", "network": {"id": "cc24a3a3-ab24-4a70-a654-4f2a95e17af1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-112280041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44725643b25b416d937c23a6b7447cd7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81f6efb5-03", "ovs_interfaceid": "81f6efb5-0378-4f9f-a914-02a5ce564ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:05:15.208651 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bf918242-c2bc-4b75-b123-0e0d8506a233 req-d71f3130-7a0f-4c1f-9462-b5789c86598a service nova] Releasing lock "refresh_cache-4fb6dc75-4a06-45ea-a050-4ddcd55e8559" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:05:15.254710 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:15.256485 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:05:15.363343 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd697443-1125-44ae-97b7-33660f3295d5 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 21.718s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:15.364258 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 9.198s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:15.364258 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:05:15.364258 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:15.524521 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.458s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:15.524783 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:05:15.594056 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Releasing lock "refresh_cache-5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:05:15.594312 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Instance network_info: |[{"id": "81f6efb5-0378-4f9f-a914-02a5ce564ecd", "address": "fa:16:3e:29:8d:59", "network": {"id": "cc24a3a3-ab24-4a70-a654-4f2a95e17af1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-112280041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44725643b25b416d937c23a6b7447cd7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81f6efb5-03", "ovs_interfaceid": "81f6efb5-0378-4f9f-a914-02a5ce564ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:05:15.595825 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Start _get_guest_xml network_info=[{"id": "81f6efb5-0378-4f9f-a914-02a5ce564ecd", "address": "fa:16:3e:29:8d:59", "network": {"id": "cc24a3a3-ab24-4a70-a654-4f2a95e17af1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-112280041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44725643b25b416d937c23a6b7447cd7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81f6efb5-03", "ovs_interfaceid": "81f6efb5-0378-4f9f-a914-02a5ce564ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:05:15.597965 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:05:15.598986 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-290330547', uuid='5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb'), owner=OwnerMeta(userid='d854e42ac49d4e388f4dfb1eb45acae6', username='tempest-VolumesActionsTest-955634415-project-member', projectid='44725643b25b416d937c23a6b7447cd7', projectname='tempest-VolumesActionsTest-955634415'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "81f6efb5-0378-4f9f-a914-02a5ce564ecd", "address": "fa:16:3e:29:8d:59", "network": {"id": "cc24a3a3-ab24-4a70-a654-4f2a95e17af1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-112280041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44725643b25b416d937c23a6b7447cd7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81f6efb5-03", "ovs_interfaceid": "81f6efb5-0378-4f9f-a914-02a5ce564ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930315.598705) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:05:15.599829 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:05:15.600119 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:05:15.600953 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:05:15.601089 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:05:15.601859 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:05:15.602116 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:05:15.602258 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:05:15.602378 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:05:15.602515 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:05:15.602614 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:05:15.602700 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:05:15.602832 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:05:15.602916 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:05:15.603012 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:05:15.603127 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:05:15.603247 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:05:15.613702 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:05:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-290330547',display_name='tempest-VolumesActionsTest-instance-290330547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumesactionstest-instance-290330547',id=45,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44725643b25b416d937c23a6b7447cd7',ramdisk_id='',reservation_id='r-yihf9d36',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-955634415',owner_user_name='tempest-VolumesActionsTest-955634415-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:05:12Z,user_data=None,user_id='d854e42ac49d4e388f4dfb1eb45acae6',uuid=5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81f6efb5-0378-4f9f-a914-02a5ce564ecd", "address": "fa:16:3e:29:8d:59", "network": {"id": "cc24a3a3-ab24-4a70-a654-4f2a95e17af1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-112280041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44725643b25b416d937c23a6b7447cd7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81f6efb5-03", "ovs_interfaceid": "81f6efb5-0378-4f9f-a914-02a5ce564ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:05:15.613954 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Converting VIF {"id": "81f6efb5-0378-4f9f-a914-02a5ce564ecd", "address": "fa:16:3e:29:8d:59", "network": {"id": "cc24a3a3-ab24-4a70-a654-4f2a95e17af1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-112280041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44725643b25b416d937c23a6b7447cd7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81f6efb5-03", "ovs_interfaceid": "81f6efb5-0378-4f9f-a914-02a5ce564ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:05:15.614483 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:8d:59,bridge_name='br-int',has_traffic_filtering=True,id=81f6efb5-0378-4f9f-a914-02a5ce564ecd,network=Network(cc24a3a3-ab24-4a70-a654-4f2a95e17af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81f6efb5-03') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:05:15.614970 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:05:15.759403 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930315.7583308, 4db5d5f2-e263-41af-a833-642afe41d66d => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:05:15.759403 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] VM Started (Lifecycle Event)
May 28 01:05:15.762853 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-429300ee-0273-4734-9181-386d5e026863 req-6b96bc77-ad4b-4553-9b4e-530116c3f005 service nova] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Received event network-vif-plugged-bd7b5ac7-f021-4ebe-9700-73daf0464312 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:15.763054 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-429300ee-0273-4734-9181-386d5e026863 req-6b96bc77-ad4b-4553-9b4e-530116c3f005 service nova] Acquiring lock "4db5d5f2-e263-41af-a833-642afe41d66d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:15.763287 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-429300ee-0273-4734-9181-386d5e026863 req-6b96bc77-ad4b-4553-9b4e-530116c3f005 service nova] Lock "4db5d5f2-e263-41af-a833-642afe41d66d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:15.763443 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-429300ee-0273-4734-9181-386d5e026863 req-6b96bc77-ad4b-4553-9b4e-530116c3f005 service nova] Lock "4db5d5f2-e263-41af-a833-642afe41d66d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:15.763627 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-429300ee-0273-4734-9181-386d5e026863 req-6b96bc77-ad4b-4553-9b4e-530116c3f005 service nova] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Processing event network-vif-plugged-bd7b5ac7-f021-4ebe-9700-73daf0464312 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:05:15.763802 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-429300ee-0273-4734-9181-386d5e026863 req-6b96bc77-ad4b-4553-9b4e-530116c3f005 service nova] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Received event network-vif-plugged-bd7b5ac7-f021-4ebe-9700-73daf0464312 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:15.763969 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-429300ee-0273-4734-9181-386d5e026863 req-6b96bc77-ad4b-4553-9b4e-530116c3f005 service nova] Acquiring lock "4db5d5f2-e263-41af-a833-642afe41d66d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:15.764143 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-429300ee-0273-4734-9181-386d5e026863 req-6b96bc77-ad4b-4553-9b4e-530116c3f005 service nova] Lock "4db5d5f2-e263-41af-a833-642afe41d66d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:15.764767 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-429300ee-0273-4734-9181-386d5e026863 req-6b96bc77-ad4b-4553-9b4e-530116c3f005 service nova] Lock "4db5d5f2-e263-41af-a833-642afe41d66d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:15.764767 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-429300ee-0273-4734-9181-386d5e026863 req-6b96bc77-ad4b-4553-9b4e-530116c3f005 service nova] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] No waiting events found dispatching network-vif-plugged-bd7b5ac7-f021-4ebe-9700-73daf0464312 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:05:15.764767 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-429300ee-0273-4734-9181-386d5e026863 req-6b96bc77-ad4b-4553-9b4e-530116c3f005 service nova] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Received unexpected event network-vif-plugged-bd7b5ac7-f021-4ebe-9700-73daf0464312 for instance with vm_state building and task_state spawning.
May 28 01:05:15.765640 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:05:15.768501 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:05:15.770442 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Instance spawned successfully.
May 28 01:05:15.770795 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:05:16.030055 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:05:16.030055 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:05:16.030055 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:16.030475 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:16.118174 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] End _get_guest_xml xml=<domain type="qemu">
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:   <uuid>5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb</uuid>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:   <name>instance-0000002d</name>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       <nova:name>tempest-VolumesActionsTest-instance-290330547</nova:name>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:05:15</nova:creationTime>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:         <nova:user uuid="d854e42ac49d4e388f4dfb1eb45acae6">tempest-VolumesActionsTest-955634415-project-member</nova:user>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:         <nova:project uuid="44725643b25b416d937c23a6b7447cd7">tempest-VolumesActionsTest-955634415</nova:project>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:         <nova:port uuid="81f6efb5-0378-4f9f-a914-02a5ce564ecd">
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:     <system>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       <entry name="serial">5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb</entry>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       <entry name="uuid">5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb</entry>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:     </system>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:   <os>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:   </os>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:   <features>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:   </features>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:   <devices>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb/disk"/>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:     </disk>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb/disk.config"/>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:     </disk>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:29:8d:59"/>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       <target dev="tap81f6efb5-03"/>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:     </interface>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb/console.log" append="off"/>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:     </serial>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:     <video>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:     </video>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:     </rng>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:   </devices>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]: </domain>
May 28 01:05:16.118174 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:05:16.122316 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Preparing to wait for external event network-vif-plugged-81f6efb5-0378-4f9f-a914-02a5ce564ecd {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:05:16.122316 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Acquiring lock "5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:16.122316 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:16.122316 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:16.122316 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:05:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-290330547',display_name='tempest-VolumesActionsTest-instance-290330547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumesactionstest-instance-290330547',id=45,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44725643b25b416d937c23a6b7447cd7',ramdisk_id='',reservation_id='r-yihf9d36',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-955634415',owner_user_name='tempest-VolumesActionsTest-955634415-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:05:12Z,user_data=None,user_id='d854e42ac49d4e388f4dfb1eb45acae6',uuid=5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81f6efb5-0378-4f9f-a914-02a5ce564ecd", "address": "fa:16:3e:29:8d:59", "network": {"id": "cc24a3a3-ab24-4a70-a654-4f2a95e17af1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-112280041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44725643b25b416d937c23a6b7447cd7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81f6efb5-03", "ovs_interfaceid": "81f6efb5-0378-4f9f-a914-02a5ce564ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:05:16.122316 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Converting VIF {"id": "81f6efb5-0378-4f9f-a914-02a5ce564ecd", "address": "fa:16:3e:29:8d:59", "network": {"id": "cc24a3a3-ab24-4a70-a654-4f2a95e17af1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-112280041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44725643b25b416d937c23a6b7447cd7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81f6efb5-03", "ovs_interfaceid": "81f6efb5-0378-4f9f-a914-02a5ce564ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:05:16.122316 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:8d:59,bridge_name='br-int',has_traffic_filtering=True,id=81f6efb5-0378-4f9f-a914-02a5ce564ecd,network=Network(cc24a3a3-ab24-4a70-a654-4f2a95e17af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81f6efb5-03') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:05:16.122316 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:8d:59,bridge_name='br-int',has_traffic_filtering=True,id=81f6efb5-0378-4f9f-a914-02a5ce564ecd,network=Network(cc24a3a3-ab24-4a70-a654-4f2a95e17af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81f6efb5-03') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:05:16.126225 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:16.126225 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:16.126225 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:05:16.126682 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:16.126843 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '75211224-dd3c-58bc-92e3-ef8faa4ad896', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:16.129673 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:16.130481 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:05:16.132366 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:16.132502 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81f6efb5-03, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:16.132834 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap81f6efb5-03, col_values=(('qos', UUID('347ef6e8-7360-4a17-a8e2-ecebd4a76d34')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:16.132996 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap81f6efb5-03, col_values=(('external_ids', {'iface-id': '81f6efb5-0378-4f9f-a914-02a5ce564ecd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:8d:59', 'vm-uuid': '5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:16.134868 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:16.135228 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:05:16.141341 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:16.143075 np0000001577 nova-compute[98319]: INFO os_vif [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:8d:59,bridge_name='br-int',has_traffic_filtering=True,id=81f6efb5-0378-4f9f-a914-02a5ce564ecd,network=Network(cc24a3a3-ab24-4a70-a654-4f2a95e17af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81f6efb5-03')
May 28 01:05:16.151802 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a23d4e3ed3594ec68e24f846a1245e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37839662573425fa4f5e5f35b792df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:05:16.261704 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:16.263302 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:05:16.272033 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:16.281071 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:16.281929 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:16.282337 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:16.282634 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:16.282903 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:16.283190 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:16.531393 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:05:16.695992 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Successfully created port: c22a5836-b154-4420-9a35-59536357f7f9 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:05:16.766075 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:05:16.766319 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930316.7661433, 4db5d5f2-e263-41af-a833-642afe41d66d => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:05:16.766453 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] VM Paused (Lifecycle Event)
May 28 01:05:16.790664 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Took 10.48 seconds to spawn the instance on the hypervisor.
May 28 01:05:16.790806 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:17.034130 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:05:17.109415 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Successfully updated port: c22a5836-b154-4420-9a35-59536357f7f9 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:05:17.171598 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b72f621a-53b3-472f-b757-818368721563 req-047a7df0-8de7-41fc-b4c6-e81a06c65c71 service nova] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Received event network-changed-c22a5836-b154-4420-9a35-59536357f7f9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:17.171772 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b72f621a-53b3-472f-b757-818368721563 req-047a7df0-8de7-41fc-b4c6-e81a06c65c71 service nova] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Refreshing instance network info cache due to event network-changed-c22a5836-b154-4420-9a35-59536357f7f9. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:05:17.171963 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b72f621a-53b3-472f-b757-818368721563 req-047a7df0-8de7-41fc-b4c6-e81a06c65c71 service nova] Acquiring lock "refresh_cache-4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:05:17.172127 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b72f621a-53b3-472f-b757-818368721563 req-047a7df0-8de7-41fc-b4c6-e81a06c65c71 service nova] Acquired lock "refresh_cache-4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:05:17.172270 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b72f621a-53b3-472f-b757-818368721563 req-047a7df0-8de7-41fc-b4c6-e81a06c65c71 service nova] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Refreshing network info cache for port c22a5836-b154-4420-9a35-59536357f7f9 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:05:17.268814 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:17.270800 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930317.2704394, 4db5d5f2-e263-41af-a833-642afe41d66d => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:05:17.270800 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] VM Resumed (Lifecycle Event)
May 28 01:05:17.303050 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Took 23.11 seconds to build instance.
May 28 01:05:17.538692 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Booting with volume 2ab0972e-ab73-4218-80de-cfd312d4f541 at /dev/vda
May 28 01:05:17.578694 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:05:17.588666 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:05:17.604865 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:17.618539 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Acquiring lock "refresh_cache-4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:05:17.645393 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:05:17.645688 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:05:17.653795 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:05:17.655274 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fed1:bba5', 'fe80::49a:a7ff:fef7:c9e8', 'fe80::fc16:3eff:fea0:668f', 'fe80::843d:f9ff:fe8b:2ddd', 'fe80::fc16:3eff:fe6d:b1ae', 'fe80::9071:84ff:fea9:bd33', 'fe80::fc16:3eff:fe88:7ca', 'fe80::6cd5:f5ff:fe52:2a3e', 'fe80::fc16:3eff:fe6c:9754', 'fe80::e873:f8ff:fed0:1522'] 
May 28 01:05:17.655423 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:05:17.655520 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:05:17.655776 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] <== get_connector_properties: return (77ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:05:17.655957 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Updating existing volume attachment record: da6a46b8-b692-4cbe-8ae0-499a9b87d4fc {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:05:17.669526 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:05:17.669661 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:05:17.669754 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] No VIF found with MAC fa:16:3e:29:8d:59, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:05:17.670313 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Using config drive
May 28 01:05:17.674113 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-b72f621a-53b3-472f-b757-818368721563 req-047a7df0-8de7-41fc-b4c6-e81a06c65c71 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:17.741838 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b72f621a-53b3-472f-b757-818368721563 req-047a7df0-8de7-41fc-b4c6-e81a06c65c71 service nova] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:05:17.773199 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:17.776305 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:05:17.804677 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90893b57-65c8-45b8-98bb-1565ce21499f tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "4db5d5f2-e263-41af-a833-642afe41d66d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.614s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:17.805249 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "4db5d5f2-e263-41af-a833-642afe41d66d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 11.634s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:17.805742 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
May 28 01:05:17.805940 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "4db5d5f2-e263-41af-a833-642afe41d66d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:17.848744 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b72f621a-53b3-472f-b757-818368721563 req-047a7df0-8de7-41fc-b4c6-e81a06c65c71 service nova] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:05:18.103718 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "f4d80e03-89cd-4c85-93c4-442da626393e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:18.103946 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "f4d80e03-89cd-4c85-93c4-442da626393e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:18.176905 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:18.317850 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Creating config drive at /opt/stack/data/nova/instances/5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb/disk.config
May 28 01:05:18.322140 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo9zxj45z {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:18.352667 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b72f621a-53b3-472f-b757-818368721563 req-047a7df0-8de7-41fc-b4c6-e81a06c65c71 service nova] Releasing lock "refresh_cache-4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:05:18.355401 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Acquired lock "refresh_cache-4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:05:18.355401 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:05:18.379283 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo9zxj45z" returned: 0 in 0.057s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:18.607153 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lazy-loading 'flavor' on Instance uuid f4d80e03-89cd-4c85-93c4-442da626393e {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:05:18.822663 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:18.858250 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:18.859751 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:18.938844 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:18.941895 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:05:19.006347 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "4db5d5f2-e263-41af-a833-642afe41d66d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:19.006577 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "4db5d5f2-e263-41af-a833-642afe41d66d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:19.006774 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "4db5d5f2-e263-41af-a833-642afe41d66d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:19.006914 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "4db5d5f2-e263-41af-a833-642afe41d66d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:19.007046 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "4db5d5f2-e263-41af-a833-642afe41d66d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:19.009406 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Terminating instance
May 28 01:05:19.104455 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-030c2bae-24a4-41d1-964f-6716d73313b0 req-ae6fc8e2-0eb2-49ad-908e-51d7ef88370b service nova] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Received event network-vif-plugged-81f6efb5-0378-4f9f-a914-02a5ce564ecd {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:19.104818 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-030c2bae-24a4-41d1-964f-6716d73313b0 req-ae6fc8e2-0eb2-49ad-908e-51d7ef88370b service nova] Acquiring lock "5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:19.105006 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-030c2bae-24a4-41d1-964f-6716d73313b0 req-ae6fc8e2-0eb2-49ad-908e-51d7ef88370b service nova] Lock "5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:19.105257 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-030c2bae-24a4-41d1-964f-6716d73313b0 req-ae6fc8e2-0eb2-49ad-908e-51d7ef88370b service nova] Lock "5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:19.105350 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-030c2bae-24a4-41d1-964f-6716d73313b0 req-ae6fc8e2-0eb2-49ad-908e-51d7ef88370b service nova] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Processing event network-vif-plugged-81f6efb5-0378-4f9f-a914-02a5ce564ecd {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:05:19.154090 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:19.182925 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:19.186188 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:19.187666 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:19.215806 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:19.324067 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Updating instance_info_cache with network_info: [{"id": "c22a5836-b154-4420-9a35-59536357f7f9", "address": "fa:16:3e:2d:7c:a8", "network": {"id": "691a7343-2e9f-4fcd-b4b0-4acd54dcf670", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93c8070b691d4f708f2391bfb8de6d61", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22a5836-b1", "ovs_interfaceid": "c22a5836-b154-4420-9a35-59536357f7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:05:19.516333 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:05:19.537635 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:19.554614 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:19.567118 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:19.587437 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:19.593775 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:19.615508 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "f4d80e03-89cd-4c85-93c4-442da626393e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:19.716973 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d3b334f1-2825-4898-9288-faaf6af2c201 req-0e46d37b-00dc-4dfb-9b49-23472bb9480a service nova] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Received event network-vif-unplugged-bd7b5ac7-f021-4ebe-9700-73daf0464312 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:19.717140 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d3b334f1-2825-4898-9288-faaf6af2c201 req-0e46d37b-00dc-4dfb-9b49-23472bb9480a service nova] Acquiring lock "4db5d5f2-e263-41af-a833-642afe41d66d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:19.717305 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d3b334f1-2825-4898-9288-faaf6af2c201 req-0e46d37b-00dc-4dfb-9b49-23472bb9480a service nova] Lock "4db5d5f2-e263-41af-a833-642afe41d66d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:19.717415 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d3b334f1-2825-4898-9288-faaf6af2c201 req-0e46d37b-00dc-4dfb-9b49-23472bb9480a service nova] Lock "4db5d5f2-e263-41af-a833-642afe41d66d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:19.717517 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d3b334f1-2825-4898-9288-faaf6af2c201 req-0e46d37b-00dc-4dfb-9b49-23472bb9480a service nova] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] No waiting events found dispatching network-vif-unplugged-bd7b5ac7-f021-4ebe-9700-73daf0464312 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:05:19.717650 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d3b334f1-2825-4898-9288-faaf6af2c201 req-0e46d37b-00dc-4dfb-9b49-23472bb9480a service nova] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Received event network-vif-unplugged-bd7b5ac7-f021-4ebe-9700-73daf0464312 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:05:19.757693 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:05:19.759463 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:05:19.759756 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Creating image(s)
May 28 01:05:19.760119 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:05:19.760598 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Ensure instance console log exists: /opt/stack/data/nova/instances/4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:05:19.760911 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:19.761339 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:19.761593 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:19.764882 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930319.7644892, 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:05:19.766536 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:05:19.766684 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] VM Started (Lifecycle Event)
May 28 01:05:19.775937 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:05:19.780205 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Instance spawned successfully.
May 28 01:05:19.780530 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:05:19.827367 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Releasing lock "refresh_cache-4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:05:19.827367 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Instance network_info: |[{"id": "c22a5836-b154-4420-9a35-59536357f7f9", "address": "fa:16:3e:2d:7c:a8", "network": {"id": "691a7343-2e9f-4fcd-b4b0-4acd54dcf670", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93c8070b691d4f708f2391bfb8de6d61", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22a5836-b1", "ovs_interfaceid": "c22a5836-b154-4420-9a35-59536357f7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:05:19.827367 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Start _get_guest_xml network_info=[{"id": "c22a5836-b154-4420-9a35-59536357f7f9", "address": "fa:16:3e:2d:7c:a8", "network": {"id": "691a7343-2e9f-4fcd-b4b0-4acd54dcf670", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93c8070b691d4f708f2391bfb8de6d61", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22a5836-b1", "ovs_interfaceid": "c22a5836-b154-4420-9a35-59536357f7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541', 'iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ab0972e-ab73-4218-80de-cfd312d4f541', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789', 'attached_at': '', 'detached_at': '', 'volume_id': '2ab0972e-ab73-4218-80de-cfd312d4f541', 'serial': '2ab0972e-ab73-4218-80de-cfd312d4f541'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'da6a46b8-b692-4cbe-8ae0-499a9b87d4fc', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:05:19.832464 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:05:19.832464 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='instance-depend-image', uuid='4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789'), owner=OwnerMeta(userid='a23d4e3ed3594ec68e24f846a1245e7d', username='tempest-ImageDependencyTests-312985465-project-member', projectid='d37839662573425fa4f5e5f35b792df0', projectname='tempest-ImageDependencyTests-312985465'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c22a5836-b154-4420-9a35-59536357f7f9", "address": "fa:16:3e:2d:7c:a8", "network": {"id": "691a7343-2e9f-4fcd-b4b0-4acd54dcf670", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93c8070b691d4f708f2391bfb8de6d61", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22a5836-b1", "ovs_interfaceid": "c22a5836-b154-4420-9a35-59536357f7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930319.8318462) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:05:19.835207 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:05:19.835490 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:05:19.836721 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:05:19.836914 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:05:19.837928 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:05:19.838457 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:05:19.838742 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:05:19.839430 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:05:19.839430 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:05:19.839430 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:05:19.839430 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:05:19.839587 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:05:19.839746 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:05:19.839896 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:05:19.840030 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:05:19.840174 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:05:19.854655 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:05:19.854655 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541', 'iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ab0972e-ab73-4218-80de-cfd312d4f541', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:05:19.854886 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:05:19.855276 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:05:19.855575 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541', 'iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ab0972e-ab73-4218-80de-cfd312d4f541', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:05:19.875732 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:05:19.875732 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:05:19.875732 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:05:19.875732 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:05:19.875732 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:05:19.875732 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:05:19.888252 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Instance destroyed successfully.
May 28 01:05:19.889618 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lazy-loading 'resources' on Instance uuid 4db5d5f2-e263-41af-a833-642afe41d66d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:05:19.890951 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:05:19.890951 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:19.898128 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:05:19.898128 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:19.906621 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541] added
May 28 01:05:19.906621 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:05:19.906621 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:05:19.906621 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:05:19.906621 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:05:19.906621 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:05:19.906621 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:19.906621 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:05:19.906896 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0336(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:05:19.906896 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:05:19.914134 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541] added
May 28 01:05:19.914134 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:05:19.914134 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:05:19.914134 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:05:19.914134 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:05:19.914134 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:05:19.914134 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:19.914134 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:05:19.914134 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0394(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:05:19.914134 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:05:20.269718 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:20.271315 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:05:20.288134 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:20.288134 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:20.288134 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:20.288134 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:20.288614 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:20.288614 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:20.391080 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:04:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-295326890',display_name='tempest-TestVolumeBootPattern-server-295326890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpattern-server-295326890',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:05:16Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='050f928f1ce449d6a447cd343dc4ff80',ramdisk_id='',reservation_id='r-rl5r4bgq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1449742411',owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:05:17Z,user_data=None,user_id='0c803ddeaf4f4b3db07587419087b3b2',uuid=4db5d5f2-e263-41af-a833-642afe41d66d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd7b5ac7-f021-4ebe-9700-73daf0464312", "address": "fa:16:3e:6c:97:54", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7b5ac7-f0", "ovs_interfaceid": "bd7b5ac7-f021-4ebe-9700-73daf0464312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:05:20.391302 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converting VIF {"id": "bd7b5ac7-f021-4ebe-9700-73daf0464312", "address": "fa:16:3e:6c:97:54", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7b5ac7-f0", "ovs_interfaceid": "bd7b5ac7-f021-4ebe-9700-73daf0464312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:05:20.391868 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:97:54,bridge_name='br-int',has_traffic_filtering=True,id=bd7b5ac7-f021-4ebe-9700-73daf0464312,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd7b5ac7-f0') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:05:20.392085 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:97:54,bridge_name='br-int',has_traffic_filtering=True,id=bd7b5ac7-f021-4ebe-9700-73daf0464312,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd7b5ac7-f0') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:05:20.393410 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:20.393676 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd7b5ac7-f0, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:20.394589 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:20.395279 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:05:20.395667 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:20.396513 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:20.396657 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db8e017e-c2d9-4c12-bdfc-cd440321738f) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:20.397055 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:20.397560 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:05:20.397915 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:20.399537 np0000001577 nova-compute[98319]: INFO os_vif [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:97:54,bridge_name='br-int',has_traffic_filtering=True,id=bd7b5ac7-f021-4ebe-9700-73daf0464312,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd7b5ac7-f0')
May 28 01:05:20.401801 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:05:20.402038 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa', 'iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '72808bd3-3842-48c6-9c29-e6cd146637aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:05:20.402153 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:05:20.774094 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:05:20.774615 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930320.7741919, 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:05:20.774615 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] VM Paused (Lifecycle Event)
May 28 01:05:20.793016 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Took 7.53 seconds to spawn the instance on the hypervisor.
May 28 01:05:20.793152 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:20.838055 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "f4d80e03-89cd-4c85-93c4-442da626393e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:20.838055 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "f4d80e03-89cd-4c85-93c4-442da626393e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:20.838055 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Attaching volume 69a012ec-8f0e-4824-933d-81b69d6145fc to /dev/vdb
May 28 01:05:20.888729 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:05:20.898226 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:05:20.907318 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:05:20.916837 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:05:20.928980 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:05:20.948787 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:05:20.948787 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:05:20.951449 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:05:20.951449 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:20.964567 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:20.966990 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:20.986736 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:05:20.987166 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:05:20.988907 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:20.988907 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:20.988907 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:20.988907 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:20.988907 np0000001577 nova-compute[98319]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa (non-flash)
May 28 01:05:20.988907 np0000001577 nova-compute[98319]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa (non-flash)
May 28 01:05:20.988907 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:05:20.989093 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:20.989093 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:20.989093 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:20.989093 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:20.989093 np0000001577 nova-compute[98319]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa (non-flash)
May 28 01:05:20.989093 np0000001577 nova-compute[98319]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa (non-flash)
May 28 01:05:20.989093 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:05:20.994122 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:20.994122 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:20.994122 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:20.994122 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:20.994122 np0000001577 nova-compute[98319]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa (non-flash)
May 28 01:05:20.994122 np0000001577 nova-compute[98319]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa (non-flash)
May 28 01:05:20.994122 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:05:20.994425 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:20.994425 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:20.994425 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:20.994425 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:20.994425 np0000001577 nova-compute[98319]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa (non-flash)
May 28 01:05:20.994425 np0000001577 nova-compute[98319]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa (non-flash)
May 28 01:05:20.994425 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:05:21.005890 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:05:21.005890 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fed1:bba5', 'fe80::49a:a7ff:fef7:c9e8', 'fe80::fc16:3eff:fea0:668f', 'fe80::843d:f9ff:fe8b:2ddd', 'fe80::fc16:3eff:fe6d:b1ae', 'fe80::9071:84ff:fea9:bd33', 'fe80::fc16:3eff:fe88:7ca', 'fe80::6cd5:f5ff:fe52:2a3e', 'fe80::fc16:3eff:fe29:8d59', 'fe80::b0d6:82ff:fe1b:8869'] 
May 28 01:05:21.005890 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:05:21.006083 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:05:21.006190 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:05:21.006419 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Updating existing volume attachment record: a80cd513-3b6d-44aa-8f54-a6b33a46d8cb {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:05:21.038313 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541, portal: 192.168.40.100,3260]
May 28 01:05:21.038313 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541, portal: 192.168.40.100,3260] successful.
May 28 01:05:21.038313 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:21.049990 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541, portal: 192.168.50.100,3260]
May 28 01:05:21.049990 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541, portal: 192.168.50.100,3260] successful.
May 28 01:05:21.049990 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:21.050895 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:21.065143 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:21.079498 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:21.079498 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:21.079498 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:21.079498 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:21.079498 np0000001577 nova-compute[98319]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa (non-flash)
May 28 01:05:21.079498 np0000001577 nova-compute[98319]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa (non-flash)
May 28 01:05:21.079498 np0000001577 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:21.079498 np0000001577 nova-compute[98319]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:21.079498 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:05:21.079702 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:21.079702 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:21.079702 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:21.079702 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:21.079702 np0000001577 nova-compute[98319]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa (non-flash)
May 28 01:05:21.079702 np0000001577 nova-compute[98319]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa (non-flash)
May 28 01:05:21.079702 np0000001577 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:21.079702 np0000001577 nova-compute[98319]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:21.079702 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:05:21.080043 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.207s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:05:21.080161 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:05:21.081111 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] HCTL ('11', '-', '-', 0) found on session 96 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:05:21.081214 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:05:21.089344 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:21.089344 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:21.089344 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:21.089344 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:21.089344 np0000001577 nova-compute[98319]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa (non-flash)
May 28 01:05:21.089344 np0000001577 nova-compute[98319]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa (non-flash)
May 28 01:05:21.089344 np0000001577 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:21.089344 np0000001577 nova-compute[98319]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:21.089344 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:05:21.089344 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:21.089344 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:21.089344 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:21.089344 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:21.089344 np0000001577 nova-compute[98319]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa (non-flash)
May 28 01:05:21.089344 np0000001577 nova-compute[98319]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa (non-flash)
May 28 01:05:21.089344 np0000001577 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:21.089344 np0000001577 nova-compute[98319]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:21.089344 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:05:21.089344 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.214s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:05:21.089344 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:05:21.089344 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] HCTL ('12', '-', '-', 0) found on session 97 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:05:21.089344 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:05:21.102446 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Searching for a device in session 96 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:05:21.102662 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ab0972e-ab73-4218-80de-cfd312d4f541', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:05:21.115436 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Searching for a device in session 97 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:05:21.115436 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2ab0972e-ab73-4218-80de-cfd312d4f541', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:05:21.198211 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-cf0ddc15-5fbb-4d6d-8aa0-707bf4ab31b1 req-0ea32e3c-ff5b-4efc-9f55-b321e3c5da8d service nova] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Received event network-vif-plugged-81f6efb5-0378-4f9f-a914-02a5ce564ecd {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:21.198781 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cf0ddc15-5fbb-4d6d-8aa0-707bf4ab31b1 req-0ea32e3c-ff5b-4efc-9f55-b321e3c5da8d service nova] Acquiring lock "5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:21.199052 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cf0ddc15-5fbb-4d6d-8aa0-707bf4ab31b1 req-0ea32e3c-ff5b-4efc-9f55-b321e3c5da8d service nova] Lock "5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:21.202950 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cf0ddc15-5fbb-4d6d-8aa0-707bf4ab31b1 req-0ea32e3c-ff5b-4efc-9f55-b321e3c5da8d service nova] Lock "5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:21.202950 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-cf0ddc15-5fbb-4d6d-8aa0-707bf4ab31b1 req-0ea32e3c-ff5b-4efc-9f55-b321e3c5da8d service nova] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] No waiting events found dispatching network-vif-plugged-81f6efb5-0378-4f9f-a914-02a5ce564ecd {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:05:21.202950 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-cf0ddc15-5fbb-4d6d-8aa0-707bf4ab31b1 req-0ea32e3c-ff5b-4efc-9f55-b321e3c5da8d service nova] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Received unexpected event network-vif-plugged-81f6efb5-0378-4f9f-a914-02a5ce564ecd for instance with vm_state active and task_state None.
May 28 01:05:21.273386 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:21.278572 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:21.282210 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930321.281893, 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:05:21.282363 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] VM Resumed (Lifecycle Event)
May 28 01:05:21.305073 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Took 13.00 seconds to build instance.
May 28 01:05:21.587345 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'plain'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc', 'iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69a012ec-8f0e-4824-933d-81b69d6145fc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'f4d80e03-89cd-4c85-93c4-442da626393e', 'attached_at': '', 'detached_at': '', 'volume_id': '69a012ec-8f0e-4824-933d-81b69d6145fc', 'serial': '69a012ec-8f0e-4824-933d-81b69d6145fc'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 01:05:21.588920 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:05:21.589672 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc', 'iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69a012ec-8f0e-4824-933d-81b69d6145fc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:05:21.589780 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:05:21.781871 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d330813b-9b52-4ad3-9350-6b5be7aa73a4 req-0041cc23-a73b-433b-bf82-a0a837e9f1bb service nova] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Received event network-vif-unplugged-bd7b5ac7-f021-4ebe-9700-73daf0464312 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:21.782186 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d330813b-9b52-4ad3-9350-6b5be7aa73a4 req-0041cc23-a73b-433b-bf82-a0a837e9f1bb service nova] Acquiring lock "4db5d5f2-e263-41af-a833-642afe41d66d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:21.782269 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d330813b-9b52-4ad3-9350-6b5be7aa73a4 req-0041cc23-a73b-433b-bf82-a0a837e9f1bb service nova] Lock "4db5d5f2-e263-41af-a833-642afe41d66d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:21.782345 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d330813b-9b52-4ad3-9350-6b5be7aa73a4 req-0041cc23-a73b-433b-bf82-a0a837e9f1bb service nova] Lock "4db5d5f2-e263-41af-a833-642afe41d66d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:21.782445 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d330813b-9b52-4ad3-9350-6b5be7aa73a4 req-0041cc23-a73b-433b-bf82-a0a837e9f1bb service nova] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] No waiting events found dispatching network-vif-unplugged-bd7b5ac7-f021-4ebe-9700-73daf0464312 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:05:21.782570 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d330813b-9b52-4ad3-9350-6b5be7aa73a4 req-0041cc23-a73b-433b-bf82-a0a837e9f1bb service nova] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Received event network-vif-unplugged-bd7b5ac7-f021-4ebe-9700-73daf0464312 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:05:21.788541 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:21.790760 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:05:21.806010 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.513s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:21.875087 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:05:22.294315 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999731790999704 future=<Future at 0x7c984c7e1490 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:05:22.295447 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.998536865999995 future=<Future at 0x7c984c7e1490 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:05:22.295584 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.998398447 future=<Future at 0x7c984c7e1490 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:05:22.811473 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c666cb37-d9e2-4654-86c4-cc6b86d5ea69 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Acquiring lock "5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:22.811473 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c666cb37-d9e2-4654-86c4-cc6b86d5ea69 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:22.811473 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c666cb37-d9e2-4654-86c4-cc6b86d5ea69 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Acquiring lock "5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:22.811473 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c666cb37-d9e2-4654-86c4-cc6b86d5ea69 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:22.811473 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c666cb37-d9e2-4654-86c4-cc6b86d5ea69 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:22.812661 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-c666cb37-d9e2-4654-86c4-cc6b86d5ea69 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Terminating instance
May 28 01:05:22.903614 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Found WWN 33000000087243734 for multipath device dm-6 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:05:22.903930 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.049s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:05:22.904103 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] <== connect_volume: return (3049ms) {'type': 'block', 'scsi_wwn': '33000000087243734', 'path': '/dev/dm-6', 'multipath_id': '33000000087243734'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:05:22.904278 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000087243734', 'path': '/dev/dm-6', 'multipath_id': '33000000087243734'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:05:22.904861 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.503s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:05:22.905191 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa', 'iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '72808bd3-3842-48c6-9c29-e6cd146637aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:05:22.905407 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:05:22.937801 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:22.937801 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:22.937801 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:22.937801 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:22.937801 np0000001577 nova-compute[98319]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa (non-flash)
May 28 01:05:22.937801 np0000001577 nova-compute[98319]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa (non-flash)
May 28 01:05:22.937801 np0000001577 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:22.937801 np0000001577 nova-compute[98319]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:22.937801 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:05:22.939860 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:22.939860 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:22.939860 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:22.939860 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:22.939860 np0000001577 nova-compute[98319]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa (non-flash)
May 28 01:05:22.939860 np0000001577 nova-compute[98319]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa (non-flash)
May 28 01:05:22.939860 np0000001577 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:22.939860 np0000001577 nova-compute[98319]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:22.939860 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:05:22.939860 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', '88'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', '89'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6', '90'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6', '91'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa', '94'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa', '95'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541', '96'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541', '97')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:05:22.939860 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa', '95')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:05:22.939860 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa', '94')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:05:22.939860 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c984c52cd60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa'): ({'sdh'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:05:22.940410 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Removing multipathed devices sdh, sdi {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:05:22.940410 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Flush multipath device 3300000007a1118b4 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:05:22.987195 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:05:23.032888 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:05:23.078942 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:05:23.079092 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:05:23.080361 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:05:23.092281 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:05:23.092591 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:05:23.106157 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:23.142176 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 95, target: iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa, portal: 192.168.40.100,3260]
May 28 01:05:23.142176 np0000001577 nova-compute[98319]: Logout of [sid: 95, target: iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa, portal: 192.168.40.100,3260] successful.
May 28 01:05:23.142176 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:23.164466 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:23.177445 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:23.206818 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 94, target: iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa, portal: 192.168.50.100,3260]
May 28 01:05:23.206818 np0000001577 nova-compute[98319]: Logout of [sid: 94, target: iqn.2023-03.storpool.com:os--volume-72808bd3-3842-48c6-9c29-e6cd146637aa, portal: 192.168.50.100,3260] successful.
May 28 01:05:23.206818 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:23.222670 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:23.223012 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:05:23.223181 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] <== disconnect_volume: return (2820ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:05:23.223510 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:05:23.223846 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.634s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:05:23.224080 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc', 'iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69a012ec-8f0e-4824-933d-81b69d6145fc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:05:23.226573 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Deleting instance files /opt/stack/data/nova/instances/4db5d5f2-e263-41af-a833-642afe41d66d_del
May 28 01:05:23.226573 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Deletion of /opt/stack/data/nova/instances/4db5d5f2-e263-41af-a833-642afe41d66d_del complete
May 28 01:05:23.236728 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:05:23.237282 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:05:23.237605 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:05:23.237980 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:05:23.238193 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:05:23.238392 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:05:23.248942 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:05:23.248942 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:23.253442 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:05:23.253442 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:23.261507 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc] added
May 28 01:05:23.261507 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:05:23.261507 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:05:23.261507 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:05:23.261507 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:05:23.261507 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:05:23.261507 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:23.261507 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:05:23.261507 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0233(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:05:23.261507 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:05:23.264589 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc] added
May 28 01:05:23.264589 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:05:23.264589 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:05:23.264589 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:05:23.264589 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:05:23.264589 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:05:23.264589 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:23.264852 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:05:23.264896 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0265(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:05:23.265006 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:05:23.315796 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-c666cb37-d9e2-4654-86c4-cc6b86d5ea69 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:05:23.337284 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:23.359724 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:23.369952 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:23.393055 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:23.400973 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:23.412174 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:05:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='instance-depend-image',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d37839662573425fa4f5e5f35b792df0',ramdisk_id='',reservation_id='r-cswzrtv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-312985465',owner_user_name='tempest-ImageDependencyTests-312985465-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:05:17Z,user_data=None,user_id='a23d4e3ed3594ec68e24f846a1245e7d',uuid=4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c22a5836-b154-4420-9a35-59536357f7f9", "address": "fa:16:3e:2d:7c:a8", "network": {"id": "691a7343-2e9f-4fcd-b4b0-4acd54dcf670", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93c8070b691d4f708f2391bfb8de6d61", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22a5836-b1", "ovs_interfaceid": "c22a5836-b154-4420-9a35-59536357f7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:05:23.412426 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Converting VIF {"id": "c22a5836-b154-4420-9a35-59536357f7f9", "address": "fa:16:3e:2d:7c:a8", "network": {"id": "691a7343-2e9f-4fcd-b4b0-4acd54dcf670", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93c8070b691d4f708f2391bfb8de6d61", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22a5836-b1", "ovs_interfaceid": "c22a5836-b154-4420-9a35-59536357f7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:05:23.413249 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:7c:a8,bridge_name='br-int',has_traffic_filtering=True,id=c22a5836-b154-4420-9a35-59536357f7f9,network=Network(691a7343-2e9f-4fcd-b4b0-4acd54dcf670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc22a5836-b1') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:05:23.413965 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:05:23.487776 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a6a4432f-c2b5-4e3a-b520-77182beae791 req-51c827d9-8831-430c-8adc-b692ddf195e1 service nova] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Received event network-vif-unplugged-81f6efb5-0378-4f9f-a914-02a5ce564ecd {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:23.492031 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a6a4432f-c2b5-4e3a-b520-77182beae791 req-51c827d9-8831-430c-8adc-b692ddf195e1 service nova] Acquiring lock "5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:23.492176 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a6a4432f-c2b5-4e3a-b520-77182beae791 req-51c827d9-8831-430c-8adc-b692ddf195e1 service nova] Lock "5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:23.492304 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a6a4432f-c2b5-4e3a-b520-77182beae791 req-51c827d9-8831-430c-8adc-b692ddf195e1 service nova] Lock "5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:23.492416 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a6a4432f-c2b5-4e3a-b520-77182beae791 req-51c827d9-8831-430c-8adc-b692ddf195e1 service nova] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] No waiting events found dispatching network-vif-unplugged-81f6efb5-0378-4f9f-a914-02a5ce564ecd {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:05:23.492633 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a6a4432f-c2b5-4e3a-b520-77182beae791 req-51c827d9-8831-430c-8adc-b692ddf195e1 service nova] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Received event network-vif-unplugged-81f6efb5-0378-4f9f-a914-02a5ce564ecd for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:05:23.647395 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999643906999609 future=<Future at 0x7c98705bda90 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:05:23.649762 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Instance destroyed successfully.
May 28 01:05:23.651065 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-c666cb37-d9e2-4654-86c4-cc6b86d5ea69 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lazy-loading 'resources' on Instance uuid 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:05:23.735323 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Took 4.22 seconds to destroy the instance on the hypervisor.
May 28 01:05:23.735802 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:05:23.735979 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:05:23.736085 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:05:23.736310 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:23.825815 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:23.917247 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] End _get_guest_xml xml=<domain type="qemu">
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:   <uuid>4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789</uuid>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:   <name>instance-0000002e</name>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       <nova:name>instance-depend-image</nova:name>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:05:19</nova:creationTime>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       <nova:image uuid="">
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:         <nova:properties/>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:         <nova:user uuid="a23d4e3ed3594ec68e24f846a1245e7d">tempest-ImageDependencyTests-312985465-project-member</nova:user>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:         <nova:project uuid="d37839662573425fa4f5e5f35b792df0">tempest-ImageDependencyTests-312985465</nova:project>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:         <nova:port uuid="c22a5836-b154-4420-9a35-59536357f7f9">
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="192.168.233.14" ipVersion="4"/>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:     <system>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       <entry name="serial">4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789</entry>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       <entry name="uuid">4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789</entry>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:     </system>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:   <os>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:   </os>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:   <features>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:   </features>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:   <devices>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789/disk.config"/>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:     </disk>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       <alias name="ua-2ab0972e-ab73-4218-80de-cfd312d4f541"/>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-6"/>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       <serial>2ab0972e-ab73-4218-80de-cfd312d4f541</serial>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:     </disk>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:2d:7c:a8"/>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       <target dev="tapc22a5836-b1"/>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:     </interface>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789/console.log" append="off"/>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:     </serial>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:     <video>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:     </video>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:     </rng>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:   </devices>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]: </domain>
May 28 01:05:23.917247 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:05:23.920442 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Preparing to wait for external event network-vif-plugged-c22a5836-b154-4420-9a35-59536357f7f9 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:05:23.920442 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Acquiring lock "4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:23.920442 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Lock "4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:23.920442 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Lock "4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:23.920442 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:05:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='instance-depend-image',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d37839662573425fa4f5e5f35b792df0',ramdisk_id='',reservation_id='r-cswzrtv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-312985465',owner_user_name='tempest-ImageDependencyTests-312985465-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:05:17Z,user_data=None,user_id='a23d4e3ed3594ec68e24f846a1245e7d',uuid=4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c22a5836-b154-4420-9a35-59536357f7f9", "address": "fa:16:3e:2d:7c:a8", "network": {"id": "691a7343-2e9f-4fcd-b4b0-4acd54dcf670", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93c8070b691d4f708f2391bfb8de6d61", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22a5836-b1", "ovs_interfaceid": "c22a5836-b154-4420-9a35-59536357f7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:05:23.920442 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Converting VIF {"id": "c22a5836-b154-4420-9a35-59536357f7f9", "address": "fa:16:3e:2d:7c:a8", "network": {"id": "691a7343-2e9f-4fcd-b4b0-4acd54dcf670", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93c8070b691d4f708f2391bfb8de6d61", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22a5836-b1", "ovs_interfaceid": "c22a5836-b154-4420-9a35-59536357f7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:05:23.920442 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:7c:a8,bridge_name='br-int',has_traffic_filtering=True,id=c22a5836-b154-4420-9a35-59536357f7f9,network=Network(691a7343-2e9f-4fcd-b4b0-4acd54dcf670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc22a5836-b1') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:05:23.920442 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:7c:a8,bridge_name='br-int',has_traffic_filtering=True,id=c22a5836-b154-4420-9a35-59536357f7f9,network=Network(691a7343-2e9f-4fcd-b4b0-4acd54dcf670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc22a5836-b1') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:05:23.920442 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:23.920442 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:23.920442 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:05:23.921697 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:23.921874 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8645ba09-7a77-5b6c-84bd-9bda2a24bb0a', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:23.922780 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:23.923529 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:05:23.928589 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:23.930300 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:23.930455 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc22a5836-b1, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:23.930800 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc22a5836-b1, col_values=(('qos', UUID('e631d5c8-a32c-48fb-bf5d-541665ad0621')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:23.930957 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc22a5836-b1, col_values=(('external_ids', {'iface-id': 'c22a5836-b154-4420-9a35-59536357f7f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:7c:a8', 'vm-uuid': '4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:23.931676 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:23.933155 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:05:23.941637 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:23.942717 np0000001577 nova-compute[98319]: INFO os_vif [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:7c:a8,bridge_name='br-int',has_traffic_filtering=True,id=c22a5836-b154-4420-9a35-59536357f7f9,network=Network(691a7343-2e9f-4fcd-b4b0-4acd54dcf670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc22a5836-b1')
May 28 01:05:24.155683 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-c666cb37-d9e2-4654-86c4-cc6b86d5ea69 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:05:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-290330547',display_name='tempest-VolumesActionsTest-instance-290330547',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumesactionstest-instance-290330547',id=45,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:05:20Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44725643b25b416d937c23a6b7447cd7',ramdisk_id='',reservation_id='r-yihf9d36',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-955634415',owner_user_name='tempest-VolumesActionsTest-955634415-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:05:21Z,user_data=None,user_id='d854e42ac49d4e388f4dfb1eb45acae6',uuid=5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81f6efb5-0378-4f9f-a914-02a5ce564ecd", "address": "fa:16:3e:29:8d:59", "network": {"id": "cc24a3a3-ab24-4a70-a654-4f2a95e17af1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-112280041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44725643b25b416d937c23a6b7447cd7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81f6efb5-03", "ovs_interfaceid": "81f6efb5-0378-4f9f-a914-02a5ce564ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:05:24.155683 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c666cb37-d9e2-4654-86c4-cc6b86d5ea69 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Converting VIF {"id": "81f6efb5-0378-4f9f-a914-02a5ce564ecd", "address": "fa:16:3e:29:8d:59", "network": {"id": "cc24a3a3-ab24-4a70-a654-4f2a95e17af1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-112280041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44725643b25b416d937c23a6b7447cd7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap81f6efb5-03", "ovs_interfaceid": "81f6efb5-0378-4f9f-a914-02a5ce564ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:05:24.155683 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c666cb37-d9e2-4654-86c4-cc6b86d5ea69 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:8d:59,bridge_name='br-int',has_traffic_filtering=True,id=81f6efb5-0378-4f9f-a914-02a5ce564ecd,network=Network(cc24a3a3-ab24-4a70-a654-4f2a95e17af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81f6efb5-03') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:05:24.155683 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-c666cb37-d9e2-4654-86c4-cc6b86d5ea69 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:8d:59,bridge_name='br-int',has_traffic_filtering=True,id=81f6efb5-0378-4f9f-a914-02a5ce564ecd,network=Network(cc24a3a3-ab24-4a70-a654-4f2a95e17af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81f6efb5-03') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:05:24.156100 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:24.156100 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81f6efb5-03, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:24.157095 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:24.158072 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:05:24.163093 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:24.164070 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:24.164270 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=347ef6e8-7360-4a17-a8e2-ecebd4a76d34) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:24.165483 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:05:24.169965 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:24.174572 np0000001577 nova-compute[98319]: INFO os_vif [None req-c666cb37-d9e2-4654-86c4-cc6b86d5ea69 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:8d:59,bridge_name='br-int',has_traffic_filtering=True,id=81f6efb5-0378-4f9f-a914-02a5ce564ecd,network=Network(cc24a3a3-ab24-4a70-a654-4f2a95e17af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81f6efb5-03')
May 28 01:05:24.174572 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c666cb37-d9e2-4654-86c4-cc6b86d5ea69 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Deleting instance files /opt/stack/data/nova/instances/5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb_del
May 28 01:05:24.174572 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c666cb37-d9e2-4654-86c4-cc6b86d5ea69 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Deletion of /opt/stack/data/nova/instances/5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb_del complete
May 28 01:05:24.262008 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:05:24.269872 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:05:24.279067 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:05:24.279067 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:05:24.289500 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:05:24.289500 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:24.298674 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:24.304646 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:24.317216 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:24.317216 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:24.317216 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:24.317216 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:24.317216 np0000001577 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:24.317216 np0000001577 nova-compute[98319]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:24.317216 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:05:24.317216 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:24.317216 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:24.317216 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:24.317216 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:24.317216 np0000001577 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:24.317216 np0000001577 nova-compute[98319]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:24.317216 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:05:24.323628 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:24.323628 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:24.323628 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:24.323628 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:24.323628 np0000001577 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:24.323628 np0000001577 nova-compute[98319]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:24.323628 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:05:24.323628 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:24.323628 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:24.323628 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:24.323628 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:24.323628 np0000001577 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:24.323628 np0000001577 nova-compute[98319]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:24.323628 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:05:24.371065 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc, portal: 192.168.40.100,3260]
May 28 01:05:24.371065 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc, portal: 192.168.40.100,3260] successful.
May 28 01:05:24.371065 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:24.382873 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:24.388503 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc, portal: 192.168.50.100,3260]
May 28 01:05:24.388503 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc, portal: 192.168.50.100,3260] successful.
May 28 01:05:24.388503 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:24.401535 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:24.401535 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:24.401535 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:24.401535 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:24.401535 np0000001577 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:24.401535 np0000001577 nova-compute[98319]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:24.401535 np0000001577 nova-compute[98319]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc (non-flash)
May 28 01:05:24.401535 np0000001577 nova-compute[98319]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc (non-flash)
May 28 01:05:24.401535 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:05:24.401535 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:24.401535 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:24.401535 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:24.401535 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:24.401535 np0000001577 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:24.401535 np0000001577 nova-compute[98319]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:24.401535 np0000001577 nova-compute[98319]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc (non-flash)
May 28 01:05:24.401535 np0000001577 nova-compute[98319]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc (non-flash)
May 28 01:05:24.401535 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:05:24.401535 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:05:24.401535 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:05:24.401535 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] HCTL ('13', '-', '-', 0) found on session 98 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:05:24.401535 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:05:24.405412 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:24.420089 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Searching for a device in session 98 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:05:24.420089 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69a012ec-8f0e-4824-933d-81b69d6145fc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:05:24.425843 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:24.425843 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:24.425843 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:24.425843 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:24.425843 np0000001577 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:24.425843 np0000001577 nova-compute[98319]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:24.425843 np0000001577 nova-compute[98319]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc (non-flash)
May 28 01:05:24.425843 np0000001577 nova-compute[98319]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc (non-flash)
May 28 01:05:24.425843 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:05:24.426026 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:24.426026 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:24.426026 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:24.426026 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:24.426026 np0000001577 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:24.426026 np0000001577 nova-compute[98319]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:24.426026 np0000001577 nova-compute[98319]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc (non-flash)
May 28 01:05:24.426026 np0000001577 nova-compute[98319]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc (non-flash)
May 28 01:05:24.426026 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:05:24.426302 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.188s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:05:24.426437 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:05:24.427376 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] HCTL ('14', '-', '-', 0) found on session 99 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:05:24.427495 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:05:24.449561 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Searching for a device in session 99 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:05:24.449707 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '69a012ec-8f0e-4824-933d-81b69d6145fc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:05:24.551716 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:05:24.679190 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-c666cb37-d9e2-4654-86c4-cc6b86d5ea69 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Took 1.36 seconds to destroy the instance on the hypervisor.
May 28 01:05:24.679632 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-c666cb37-d9e2-4654-86c4-cc6b86d5ea69 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:05:24.679823 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:05:24.679923 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:05:24.680122 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:24.781951 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:25.053788 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Took 1.32 seconds to deallocate network for instance.
May 28 01:05:25.238000 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:05:25.457128 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:05:25.457266 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:05:25.457401 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] No VIF found with MAC fa:16:3e:2d:7c:a8, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:05:25.457761 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Using config drive
May 28 01:05:25.473266 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:05:25.552247 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d50f61ba-3f24-438e-8040-5650681c4592 req-a7df0ba7-a8cf-4012-b54d-543e68d1e637 service nova] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Received event network-vif-unplugged-81f6efb5-0378-4f9f-a914-02a5ce564ecd {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:25.552564 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d50f61ba-3f24-438e-8040-5650681c4592 req-a7df0ba7-a8cf-4012-b54d-543e68d1e637 service nova] Acquiring lock "5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:25.552702 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d50f61ba-3f24-438e-8040-5650681c4592 req-a7df0ba7-a8cf-4012-b54d-543e68d1e637 service nova] Lock "5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:25.552801 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d50f61ba-3f24-438e-8040-5650681c4592 req-a7df0ba7-a8cf-4012-b54d-543e68d1e637 service nova] Lock "5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:25.552903 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d50f61ba-3f24-438e-8040-5650681c4592 req-a7df0ba7-a8cf-4012-b54d-543e68d1e637 service nova] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] No waiting events found dispatching network-vif-unplugged-81f6efb5-0378-4f9f-a914-02a5ce564ecd {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:05:25.553003 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d50f61ba-3f24-438e-8040-5650681c4592 req-a7df0ba7-a8cf-4012-b54d-543e68d1e637 service nova] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Received event network-vif-unplugged-81f6efb5-0378-4f9f-a914-02a5ce564ecd for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:05:25.553132 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d50f61ba-3f24-438e-8040-5650681c4592 req-a7df0ba7-a8cf-4012-b54d-543e68d1e637 service nova] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Received event network-vif-deleted-bd7b5ac7-f021-4ebe-9700-73daf0464312 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:25.553220 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d50f61ba-3f24-438e-8040-5650681c4592 req-a7df0ba7-a8cf-4012-b54d-543e68d1e637 service nova] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Received event network-vif-deleted-81f6efb5-0378-4f9f-a914-02a5ce564ecd {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:25.604938 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Took 0.55 seconds to detach 1 volumes for instance.
May 28 01:05:25.606628 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Deleting volume: 72808bd3-3842-48c6-9c29-e6cd146637aa {{(pid=98319) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 01:05:25.962384 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:25.975664 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Took 1.30 seconds to deallocate network for instance.
May 28 01:05:26.069081 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Creating config drive at /opt/stack/data/nova/instances/4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789/disk.config
May 28 01:05:26.071880 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpz_yul2zg {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:26.122786 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpz_yul2zg" returned: 0 in 0.051s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:26.142126 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:26.142330 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:26.254780 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Found WWN 3300000003e27f15f for multipath device dm-7 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:05:26.256216 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:05:26.259001 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] <== connect_volume: return (4669ms) {'type': 'block', 'scsi_wwn': '3300000003e27f15f', 'path': '/dev/disk/by-id/os-brick+dev+dm-7', 'multipath_id': '3300000003e27f15f'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:05:26.259189 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003e27f15f', 'path': '/dev/disk/by-id/os-brick+dev+dm-7', 'multipath_id': '3300000003e27f15f'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:05:26.263126 np0000001577 nova-compute[98319]: WARNING stevedore.named [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 01:05:26.263408 np0000001577 nova-compute[98319]: WARNING castellan.key_manager [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:05:26.263616 np0000001577 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:05:26.264918 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Using volume encryptor '<os_brick.encryptors.cryptsetup.CryptsetupEncryptor object at 0x7c988c1b5640>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc', 'iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69a012ec-8f0e-4824-933d-81b69d6145fc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-7'}, 'status': 'reserved', 'instance': 'f4d80e03-89cd-4c85-93c4-442da626393e', 'attached_at': '', 'detached_at': '', 'volume_id': '69a012ec-8f0e-4824-933d-81b69d6145fc', 'serial': '69a012ec-8f0e-4824-933d-81b69d6145fc'} {{(pid=98319) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 01:05:26.265207 np0000001577 nova-compute[98319]: WARNING os_brick.encryptors.cryptsetup [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Deprecated: The plain CryptsetupEncryptor is deprecated and will be removed in a future release. Existing users are encouraged to retype any existing volumes using this encryptor to the 'luks' LuksEncryptor or 'luks2' Luks2Encryptor encryptors as soon as possible.
May 28 01:05:26.265440 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98319) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 28 01:05:26.265742 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors.cryptsetup [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] opening encrypted volume /dev/dm-7 {{(pid=98319) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/cryptsetup.py:104}}
May 28 01:05:26.288850 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:26.360232 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lazy-loading 'flavor' on Instance uuid f4d80e03-89cd-4c85-93c4-442da626393e {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:05:26.481165 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c666cb37-d9e2-4654-86c4-cc6b86d5ea69 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:26.503023 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:05:26.503320 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:05:26.549255 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:26.622841 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:26.671123 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:26.813602 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f203d5ce-c9c1-47f1-a4c5-689876abf9d8 req-21013f55-4599-4b92-94f6-7be1bf27be52 service nova] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Received event network-vif-plugged-c22a5836-b154-4420-9a35-59536357f7f9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:26.814387 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f203d5ce-c9c1-47f1-a4c5-689876abf9d8 req-21013f55-4599-4b92-94f6-7be1bf27be52 service nova] Acquiring lock "4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:26.814605 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f203d5ce-c9c1-47f1-a4c5-689876abf9d8 req-21013f55-4599-4b92-94f6-7be1bf27be52 service nova] Lock "4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:26.818744 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f203d5ce-c9c1-47f1-a4c5-689876abf9d8 req-21013f55-4599-4b92-94f6-7be1bf27be52 service nova] Lock "4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:26.818933 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f203d5ce-c9c1-47f1-a4c5-689876abf9d8 req-21013f55-4599-4b92-94f6-7be1bf27be52 service nova] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Processing event network-vif-plugged-c22a5836-b154-4420-9a35-59536357f7f9 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:05:26.877786 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Attempting to attach volume 69a012ec-8f0e-4824-933d-81b69d6145fc with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:05:26.879247 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:05:26.879247 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:05:26.879247 np0000001577 nova-compute[98319]:   <alias name="ua-69a012ec-8f0e-4824-933d-81b69d6145fc"/>
May 28 01:05:26.879247 np0000001577 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-7"/>
May 28 01:05:26.879247 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:05:26.879247 np0000001577 nova-compute[98319]:   <serial>69a012ec-8f0e-4824-933d-81b69d6145fc</serial>
May 28 01:05:26.879247 np0000001577 nova-compute[98319]: </disk>
May 28 01:05:26.879247 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:05:26.924864 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:26.928118 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:26.930278 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:26.956374 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:27.008102 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:05:27.335094 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:05:27.335610 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930327.335346, 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:05:27.335821 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] VM Started (Lifecycle Event)
May 28 01:05:27.337301 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:05:27.339725 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Instance spawned successfully.
May 28 01:05:27.340056 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:05:27.516918 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.374s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:27.518634 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c666cb37-d9e2-4654-86c4-cc6b86d5ea69 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.036s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:27.583630 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Deleted allocations for instance 4db5d5f2-e263-41af-a833-642afe41d66d
May 28 01:05:27.825862 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c666cb37-d9e2-4654-86c4-cc6b86d5ea69 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:05:27.826043 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-c666cb37-d9e2-4654-86c4-cc6b86d5ea69 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:05:27.838512 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:27.840204 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:05:27.846593 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:27.846593 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:27.846705 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:27.846816 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:27.847057 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:27.847322 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:28.328206 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-c666cb37-d9e2-4654-86c4-cc6b86d5ea69 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:05:28.344856 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:05:28.345301 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930328.3449032, 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:05:28.345301 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] VM Paused (Lifecycle Event)
May 28 01:05:28.352502 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Took 8.59 seconds to spawn the instance on the hypervisor.
May 28 01:05:28.353862 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:28.532963 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:05:28.532963 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:05:28.532963 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:05:28.532963 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] No VIF found with MAC fa:16:3e:d1:bb:a5, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:05:28.592946 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-34aeca46-8a32-4f18-acc1-8475ac5e4f32 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "4db5d5f2-e263-41af-a833-642afe41d66d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.586s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:28.834088 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c666cb37-d9e2-4654-86c4-cc6b86d5ea69 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.317s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:28.847595 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:28.849155 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930328.8489826, 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:05:28.849262 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] VM Resumed (Lifecycle Event)
May 28 01:05:28.860286 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Took 15.87 seconds to build instance.
May 28 01:05:28.869930 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8aa85404-6e4d-4c11-b942-ad0f64bcde3b req-ff8f18ef-22a9-4eea-b0b5-382595777d6f service nova] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Received event network-vif-plugged-c22a5836-b154-4420-9a35-59536357f7f9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:28.870457 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8aa85404-6e4d-4c11-b942-ad0f64bcde3b req-ff8f18ef-22a9-4eea-b0b5-382595777d6f service nova] Acquiring lock "4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:28.870738 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8aa85404-6e4d-4c11-b942-ad0f64bcde3b req-ff8f18ef-22a9-4eea-b0b5-382595777d6f service nova] Lock "4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:28.871299 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8aa85404-6e4d-4c11-b942-ad0f64bcde3b req-ff8f18ef-22a9-4eea-b0b5-382595777d6f service nova] Lock "4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:28.871299 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8aa85404-6e4d-4c11-b942-ad0f64bcde3b req-ff8f18ef-22a9-4eea-b0b5-382595777d6f service nova] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] No waiting events found dispatching network-vif-plugged-c22a5836-b154-4420-9a35-59536357f7f9 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:05:28.871299 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-8aa85404-6e4d-4c11-b942-ad0f64bcde3b req-ff8f18ef-22a9-4eea-b0b5-382595777d6f service nova] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Received unexpected event network-vif-plugged-c22a5836-b154-4420-9a35-59536357f7f9 for instance with vm_state active and task_state None.
May 28 01:05:28.880629 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-c666cb37-d9e2-4654-86c4-cc6b86d5ea69 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Deleted allocations for instance 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb
May 28 01:05:29.167416 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:29.351289 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:29.354156 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:05:29.361941 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Lock "4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.385s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:29.888133 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c666cb37-d9e2-4654-86c4-cc6b86d5ea69 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.078s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:30.224266 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9578903-a92c-4ad5-95b3-5ab384c96282 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "f4d80e03-89cd-4c85-93c4-442da626393e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.387s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:30.588277 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "f4d80e03-89cd-4c85-93c4-442da626393e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:30.588277 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "f4d80e03-89cd-4c85-93c4-442da626393e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:31.090486 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Detaching volume 69a012ec-8f0e-4824-933d-81b69d6145fc
May 28 01:05:31.122579 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Attempting to driver detach volume 69a012ec-8f0e-4824-933d-81b69d6145fc from mountpoint /dev/vdb
May 28 01:05:31.153784 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'plain'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc', 'iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69a012ec-8f0e-4824-933d-81b69d6145fc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-7'}, 'status': 'reserved', 'instance': 'f4d80e03-89cd-4c85-93c4-442da626393e', 'attached_at': '', 'detached_at': '', 'volume_id': '69a012ec-8f0e-4824-933d-81b69d6145fc', 'serial': '69a012ec-8f0e-4824-933d-81b69d6145fc'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 01:05:31.157095 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Found disk vdb by alias ua-69a012ec-8f0e-4824-933d-81b69d6145fc {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:05:31.157728 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Found disk vdb by alias ua-69a012ec-8f0e-4824-933d-81b69d6145fc {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:05:31.158211 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Attempting to detach device vdb from instance f4d80e03-89cd-4c85-93c4-442da626393e from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:05:31.158211 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:05:31.158211 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:05:31.158211 np0000001577 nova-compute[98319]:   <alias name="ua-69a012ec-8f0e-4824-933d-81b69d6145fc"/>
May 28 01:05:31.158211 np0000001577 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-7"/>
May 28 01:05:31.158211 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:05:31.158211 np0000001577 nova-compute[98319]:   <serial>69a012ec-8f0e-4824-933d-81b69d6145fc</serial>
May 28 01:05:31.158211 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:05:31.158211 np0000001577 nova-compute[98319]: </disk>
May 28 01:05:31.158211 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:05:31.163514 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Successfully detached device vdb from instance f4d80e03-89cd-4c85-93c4-442da626393e from the persistent domain config.
May 28 01:05:31.163514 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] (1/8): Attempting to detach device vdb with device alias ua-69a012ec-8f0e-4824-933d-81b69d6145fc from instance f4d80e03-89cd-4c85-93c4-442da626393e from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:05:31.163686 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:05:31.163686 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:05:31.163686 np0000001577 nova-compute[98319]:   <alias name="ua-69a012ec-8f0e-4824-933d-81b69d6145fc"/>
May 28 01:05:31.163686 np0000001577 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-7"/>
May 28 01:05:31.163686 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:05:31.163686 np0000001577 nova-compute[98319]:   <serial>69a012ec-8f0e-4824-933d-81b69d6145fc</serial>
May 28 01:05:31.163686 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:05:31.163686 np0000001577 nova-compute[98319]: </disk>
May 28 01:05:31.163686 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:05:31.292321 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:31.501299 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Acquiring lock "cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:31.501487 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:31.690827 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930331.690272, f4d80e03-89cd-4c85-93c4-442da626393e => ua-69a012ec-8f0e-4824-933d-81b69d6145fc> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:05:31.692464 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-69a012ec-8f0e-4824-933d-81b69d6145fc for instance f4d80e03-89cd-4c85-93c4-442da626393e {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:05:31.697152 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Successfully detached device vdb from instance f4d80e03-89cd-4c85-93c4-442da626393e from the live domain config.
May 28 01:05:31.702026 np0000001577 nova-compute[98319]: WARNING stevedore.named [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 01:05:31.702307 np0000001577 nova-compute[98319]: WARNING castellan.key_manager [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:05:31.703459 np0000001577 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:05:31.703459 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Using volume encryptor '<os_brick.encryptors.cryptsetup.CryptsetupEncryptor object at 0x7c984c6b5670>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc', 'iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69a012ec-8f0e-4824-933d-81b69d6145fc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-7'}, 'status': 'reserved', 'instance': 'f4d80e03-89cd-4c85-93c4-442da626393e', 'attached_at': '', 'detached_at': '', 'volume_id': '69a012ec-8f0e-4824-933d-81b69d6145fc', 'serial': '69a012ec-8f0e-4824-933d-81b69d6145fc'} {{(pid=98319) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 01:05:31.703459 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors.cryptsetup [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] closing encrypted volume /dev/dm-8 {{(pid=98319) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/cryptsetup.py:153}}
May 28 01:05:31.722991 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:05:31.723336 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc', 'iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69a012ec-8f0e-4824-933d-81b69d6145fc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:05:31.723559 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:05:31.723963 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:05:31.724611 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc', 'iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '69a012ec-8f0e-4824-933d-81b69d6145fc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:05:31.724611 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:05:31.755702 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:31.755702 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:31.755702 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:31.755702 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:31.755702 np0000001577 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:31.755702 np0000001577 nova-compute[98319]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:31.755702 np0000001577 nova-compute[98319]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc (non-flash)
May 28 01:05:31.755702 np0000001577 nova-compute[98319]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc (non-flash)
May 28 01:05:31.755702 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:05:31.756407 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:31.756407 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:31.756407 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:31.756407 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:31.756407 np0000001577 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:31.756407 np0000001577 nova-compute[98319]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:31.756407 np0000001577 nova-compute[98319]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc (non-flash)
May 28 01:05:31.756407 np0000001577 nova-compute[98319]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc (non-flash)
May 28 01:05:31.756407 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:05:31.756407 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', '88'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', '89'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6', '90'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541', '96'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541', '97'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc', '98'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc', '99')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:05:31.756407 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc', '98')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:05:31.757462 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc', '99')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:05:31.758196 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c9870309300>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc'): ({'sdi'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:05:31.758654 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Removing multipathed devices sdh, sdi {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:05:31.758654 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Flush multipath device 3300000003e27f15f {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:05:31.804960 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:05:31.852638 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:05:31.895998 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:05:31.896249 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:05:31.897873 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:05:31.911106 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:05:31.912422 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:05:31.925303 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:31.958634 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 98, target: iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc, portal: 192.168.40.100,3260]
May 28 01:05:31.958634 np0000001577 nova-compute[98319]: Logout of [sid: 98, target: iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc, portal: 192.168.40.100,3260] successful.
May 28 01:05:31.958634 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:31.975375 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:31.991171 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:32.003118 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:05:32.023512 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 99, target: iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc, portal: 192.168.50.100,3260]
May 28 01:05:32.023512 np0000001577 nova-compute[98319]: Logout of [sid: 99, target: iqn.2023-03.storpool.com:os--volume-69a012ec-8f0e-4824-933d-81b69d6145fc, portal: 192.168.50.100,3260] successful.
May 28 01:05:32.023512 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:32.042560 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:32.045286 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:05:32.045500 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] <== disconnect_volume: return (321ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:05:32.045636 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:05:32.547239 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:32.547382 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:32.550268 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:05:32.550427 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Claim successful on node np0000001577
May 28 01:05:32.599443 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lazy-loading 'flavor' on Instance uuid f4d80e03-89cd-4c85-93c4-442da626393e {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:05:33.611900 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-535a89da-7583-469b-8289-99bf166c904f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "f4d80e03-89cd-4c85-93c4-442da626393e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.023s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:33.857324 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:05:33.857498 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:05:33.901265 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-61fef490-bab6-44d1-8f1d-84256034311f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "f4d80e03-89cd-4c85-93c4-442da626393e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:33.901419 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-61fef490-bab6-44d1-8f1d-84256034311f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "f4d80e03-89cd-4c85-93c4-442da626393e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:33.901630 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-61fef490-bab6-44d1-8f1d-84256034311f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "f4d80e03-89cd-4c85-93c4-442da626393e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:33.901751 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-61fef490-bab6-44d1-8f1d-84256034311f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "f4d80e03-89cd-4c85-93c4-442da626393e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:33.901844 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-61fef490-bab6-44d1-8f1d-84256034311f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "f4d80e03-89cd-4c85-93c4-442da626393e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:33.905186 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-61fef490-bab6-44d1-8f1d-84256034311f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Terminating instance
May 28 01:05:34.035842 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Acquiring lock "4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:34.036041 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Lock "4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:34.036191 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Acquiring lock "4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:34.036328 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Lock "4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:34.036456 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Lock "4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:34.038154 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Terminating instance
May 28 01:05:34.170203 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:34.360929 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:05:34.408628 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-61fef490-bab6-44d1-8f1d-84256034311f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:05:34.434193 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:34.437298 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:34.459777 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:34.461913 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:34.488261 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:34.540596 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:05:34.568644 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:34.573594 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:34.587067 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-22c8f261-9909-4c43-9b66-d888747fae2c req-aa3f3790-b396-4829-a459-6a57d72b452b service nova] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Received event network-vif-unplugged-525eac81-fbc6-4dcc-b574-fca50bcfc9c9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:34.587373 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-22c8f261-9909-4c43-9b66-d888747fae2c req-aa3f3790-b396-4829-a459-6a57d72b452b service nova] Acquiring lock "f4d80e03-89cd-4c85-93c4-442da626393e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:34.587373 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-22c8f261-9909-4c43-9b66-d888747fae2c req-aa3f3790-b396-4829-a459-6a57d72b452b service nova] Lock "f4d80e03-89cd-4c85-93c4-442da626393e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:34.587527 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-22c8f261-9909-4c43-9b66-d888747fae2c req-aa3f3790-b396-4829-a459-6a57d72b452b service nova] Lock "f4d80e03-89cd-4c85-93c4-442da626393e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:34.587954 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-22c8f261-9909-4c43-9b66-d888747fae2c req-aa3f3790-b396-4829-a459-6a57d72b452b service nova] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] No waiting events found dispatching network-vif-unplugged-525eac81-fbc6-4dcc-b574-fca50bcfc9c9 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:05:34.588069 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-22c8f261-9909-4c43-9b66-d888747fae2c req-aa3f3790-b396-4829-a459-6a57d72b452b service nova] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Received event network-vif-unplugged-525eac81-fbc6-4dcc-b574-fca50bcfc9c9 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:05:34.599172 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:34.634603 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:34.635185 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:34.728711 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:34.742754 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:34.771399 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.99961055499989 future=<Future at 0x7c984c401f70 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:05:34.774832 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Instance destroyed successfully.
May 28 01:05:34.775122 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-61fef490-bab6-44d1-8f1d-84256034311f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lazy-loading 'resources' on Instance uuid f4d80e03-89cd-4c85-93c4-442da626393e {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:05:34.870722 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.998859016000097 future=<Future at 0x7c984c54ed50 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:05:34.874103 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.325s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:34.874103 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:05:34.878217 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Instance destroyed successfully.
May 28 01:05:34.878464 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Lazy-loading 'resources' on Instance uuid 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:05:34.946303 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "36be2ae9-c375-4335-a421-cf92ea63e489" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:34.946489 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "36be2ae9-c375-4335-a421-cf92ea63e489" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:34.980704 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:05:34.981260 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:05:35.279584 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-61fef490-bab6-44d1-8f1d-84256034311f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:04:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1977446406',display_name='tempest-TestEncryptedCinderVolumes-server-1977446406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testencryptedcindervolumes-server-1977446406',id=41,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGRPTJ6ejodf1Q3L0IjNVvQeFNLABSt5TAusszMgR3N3vr9IKTWFitsNJvMbnbr6GoZTcfmVR4BzCvUWM5nVC8QlDhk4nJ7EaCV62OH2oOoTXuJZCjWBkiGxAktquYgRA==',key_name='tempest-keypair-1974424304',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:04:40Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a430f0d6bcc84a29bc3e96514422896b',ramdisk_id='',reservation_id='r-cmse21k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-2086871542',owner_user_name='tempest-TestEncryptedCinderVolumes-2086871542-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:04:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbae7974478d45b3908aaaa5b4408e26',uuid=f4d80e03-89cd-4c85-93c4-442da626393e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "525eac81-fbc6-4dcc-b574-fca50bcfc9c9", "address": "fa:16:3e:d1:bb:a5", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap525eac81-fb", "ovs_interfaceid": "525eac81-fbc6-4dcc-b574-fca50bcfc9c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:05:35.279584 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-61fef490-bab6-44d1-8f1d-84256034311f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converting VIF {"id": "525eac81-fbc6-4dcc-b574-fca50bcfc9c9", "address": "fa:16:3e:d1:bb:a5", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap525eac81-fb", "ovs_interfaceid": "525eac81-fbc6-4dcc-b574-fca50bcfc9c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:05:35.279584 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-61fef490-bab6-44d1-8f1d-84256034311f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:bb:a5,bridge_name='br-int',has_traffic_filtering=True,id=525eac81-fbc6-4dcc-b574-fca50bcfc9c9,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525eac81-fb') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:05:35.279584 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-61fef490-bab6-44d1-8f1d-84256034311f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:bb:a5,bridge_name='br-int',has_traffic_filtering=True,id=525eac81-fbc6-4dcc-b574-fca50bcfc9c9,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525eac81-fb') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:05:35.282299 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:35.282527 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap525eac81-fb, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:35.298097 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:35.298910 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:05:35.302832 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:35.303775 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:35.303918 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0c0005ab-e8b5-428d-83ea-ea058f6b1c3a) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:35.304708 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:35.305257 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:05:35.309816 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:35.312153 np0000001577 nova-compute[98319]: INFO os_vif [None req-61fef490-bab6-44d1-8f1d-84256034311f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:bb:a5,bridge_name='br-int',has_traffic_filtering=True,id=525eac81-fbc6-4dcc-b574-fca50bcfc9c9,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525eac81-fb')
May 28 01:05:35.312153 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-61fef490-bab6-44d1-8f1d-84256034311f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Deleting instance files /opt/stack/data/nova/instances/f4d80e03-89cd-4c85-93c4-442da626393e_del
May 28 01:05:35.314447 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-61fef490-bab6-44d1-8f1d-84256034311f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Deletion of /opt/stack/data/nova/instances/f4d80e03-89cd-4c85-93c4-442da626393e_del complete
May 28 01:05:35.378495 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:05:35.378760 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:05:35.379255 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:35.379483 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:35.382451 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:05:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='instance-depend-image',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:05:28Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d37839662573425fa4f5e5f35b792df0',ramdisk_id='',reservation_id='r-cswzrtv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-ImageDependencyTests-312985465',owner_user_name='tempest-ImageDependencyTests-312985465-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:05:28Z,user_data=None,user_id='a23d4e3ed3594ec68e24f846a1245e7d',uuid=4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c22a5836-b154-4420-9a35-59536357f7f9", "address": "fa:16:3e:2d:7c:a8", "network": {"id": "691a7343-2e9f-4fcd-b4b0-4acd54dcf670", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93c8070b691d4f708f2391bfb8de6d61", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22a5836-b1", "ovs_interfaceid": "c22a5836-b154-4420-9a35-59536357f7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:05:35.382451 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Converting VIF {"id": "c22a5836-b154-4420-9a35-59536357f7f9", "address": "fa:16:3e:2d:7c:a8", "network": {"id": "691a7343-2e9f-4fcd-b4b0-4acd54dcf670", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93c8070b691d4f708f2391bfb8de6d61", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc22a5836-b1", "ovs_interfaceid": "c22a5836-b154-4420-9a35-59536357f7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:05:35.382451 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:7c:a8,bridge_name='br-int',has_traffic_filtering=True,id=c22a5836-b154-4420-9a35-59536357f7f9,network=Network(691a7343-2e9f-4fcd-b4b0-4acd54dcf670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc22a5836-b1') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:05:35.382451 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:7c:a8,bridge_name='br-int',has_traffic_filtering=True,id=c22a5836-b154-4420-9a35-59536357f7f9,network=Network(691a7343-2e9f-4fcd-b4b0-4acd54dcf670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc22a5836-b1') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:05:35.383103 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:35.383265 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc22a5836-b1, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:35.384304 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:35.385296 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:05:35.385670 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:35.385784 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e631d5c8-a32c-48fb-bf5d-541665ad0621) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:35.386923 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:05:35.388697 np0000001577 nova-compute[98319]: INFO os_vif [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:7c:a8,bridge_name='br-int',has_traffic_filtering=True,id=c22a5836-b154-4420-9a35-59536357f7f9,network=Network(691a7343-2e9f-4fcd-b4b0-4acd54dcf670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc22a5836-b1')
May 28 01:05:35.389875 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:05:35.390035 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541', 'iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ab0972e-ab73-4218-80de-cfd312d4f541', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:05:35.390147 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:05:35.390440 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:05:35.390878 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541', 'iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ab0972e-ab73-4218-80de-cfd312d4f541', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:05:35.390878 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:05:35.414760 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:35.414760 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:35.414760 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:35.414760 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:35.414760 np0000001577 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:35.414760 np0000001577 nova-compute[98319]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:35.414760 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:05:35.414923 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:35.414923 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:35.414923 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:35.414923 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:35.414923 np0000001577 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:35.414923 np0000001577 nova-compute[98319]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541 (non-flash)
May 28 01:05:35.414923 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:05:35.415058 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', '88'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', '89'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6', '90'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541', '96'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541', '97')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:05:35.415111 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541', '96')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:05:35.415894 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541', '97')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:05:35.416670 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c9870464ea0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541'): ({'sdg'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:05:35.416851 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Removing multipathed devices sdf, sdg {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:05:35.417087 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Flush multipath device 33000000087243734 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:05:35.444908 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd854e42ac49d4e388f4dfb1eb45acae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44725643b25b416d937c23a6b7447cd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:05:35.449182 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:05:35.451953 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:05:35.484701 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:35.484958 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:35.485126 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:35.485325 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Auditing locally available compute resources for np0000001577 (node: np0000001577) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 01:05:35.499066 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:05:35.545560 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:05:35.545719 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:05:35.546654 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:05:35.556469 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:05:35.556629 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:05:35.567428 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:35.601599 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 96, target: iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541, portal: 192.168.40.100,3260]
May 28 01:05:35.601599 np0000001577 nova-compute[98319]: Logout of [sid: 96, target: iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541, portal: 192.168.40.100,3260] successful.
May 28 01:05:35.601599 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:35.615856 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:35.625396 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:35.653411 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 97, target: iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541, portal: 192.168.50.100,3260]
May 28 01:05:35.653411 np0000001577 nova-compute[98319]: Logout of [sid: 97, target: iqn.2023-03.storpool.com:os--volume-2ab0972e-ab73-4218-80de-cfd312d4f541, portal: 192.168.50.100,3260] successful.
May 28 01:05:35.653411 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:35.666213 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:35.666517 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:05:35.666711 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] <== disconnect_volume: return (276ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:05:35.666876 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:05:35.667105 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Deleting instance files /opt/stack/data/nova/instances/4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789_del
May 28 01:05:35.667558 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Deletion of /opt/stack/data/nova/instances/4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789_del complete
May 28 01:05:35.812109 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Successfully created port: 42ec1a5e-ce13-4560-b5c1-63316f374ba8 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:05:35.820718 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-61fef490-bab6-44d1-8f1d-84256034311f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Took 1.41 seconds to destroy the instance on the hypervisor.
May 28 01:05:35.821453 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-61fef490-bab6-44d1-8f1d-84256034311f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:05:35.821822 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:05:35.821928 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:05:35.822133 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:35.882858 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:05:35.920860 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:36.012542 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:36.012740 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:36.015382 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:05:36.015502 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Claim successful on node np0000001577
May 28 01:05:36.183188 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Took 1.64 seconds to destroy the instance on the hypervisor.
May 28 01:05:36.184725 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:05:36.185356 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:05:36.185433 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:05:36.185671 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:36.188107 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Rebuilding instance
May 28 01:05:36.274957 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:36.286941 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Successfully updated port: 42ec1a5e-ce13-4560-b5c1-63316f374ba8 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:05:36.292425 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:36.342363 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5466c9cd-ebc1-469a-860c-6d451f4888de req-9c51c3cd-4bcc-420b-afbe-ee926eafaa5c service nova] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Received event network-changed-42ec1a5e-ce13-4560-b5c1-63316f374ba8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:36.342527 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5466c9cd-ebc1-469a-860c-6d451f4888de req-9c51c3cd-4bcc-420b-afbe-ee926eafaa5c service nova] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Refreshing instance network info cache due to event network-changed-42ec1a5e-ce13-4560-b5c1-63316f374ba8. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:05:36.342728 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5466c9cd-ebc1-469a-860c-6d451f4888de req-9c51c3cd-4bcc-420b-afbe-ee926eafaa5c service nova] Acquiring lock "refresh_cache-cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:05:36.342850 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5466c9cd-ebc1-469a-860c-6d451f4888de req-9c51c3cd-4bcc-420b-afbe-ee926eafaa5c service nova] Acquired lock "refresh_cache-cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:05:36.342997 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-5466c9cd-ebc1-469a-860c-6d451f4888de req-9c51c3cd-4bcc-420b-afbe-ee926eafaa5c service nova] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Refreshing network info cache for port 42ec1a5e-ce13-4560-b5c1-63316f374ba8 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:05:36.374038 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:36.387003 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:05:36.434745 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-903b4b54-9204-4732-b208-12120f0558a2 req-a852e667-0e17-450a-b8c9-a70ee282e698 service nova] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Received event network-vif-deleted-525eac81-fbc6-4dcc-b574-fca50bcfc9c9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:36.435323 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-903b4b54-9204-4732-b208-12120f0558a2 req-a852e667-0e17-450a-b8c9-a70ee282e698 service nova] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Neutron deleted interface 525eac81-fbc6-4dcc-b574-fca50bcfc9c9; detaching it from the instance and deleting it from the info cache
May 28 01:05:36.436901 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-903b4b54-9204-4732-b208-12120f0558a2 req-a852e667-0e17-450a-b8c9-a70ee282e698 service nova] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Detach interface failed, port_id=525eac81-fbc6-4dcc-b574-fca50bcfc9c9, reason: Instance f4d80e03-89cd-4c85-93c4-442da626393e could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:05:36.514170 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Error from libvirt while getting description of instance-00000029: [Error Code 42] Domain not found: no domain with matching uuid 'f4d80e03-89cd-4c85-93c4-442da626393e' (instance-00000029): libvirt.libvirtError: Domain not found: no domain with matching uuid 'f4d80e03-89cd-4c85-93c4-442da626393e' (instance-00000029)
May 28 01:05:36.515652 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:05:36.517241 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:05:36.518762 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:36.603714 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:36.604301 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:36.671130 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-81edfb79-c7b9-4eef-b62a-925fc9944d4a req-29e83bd7-774e-4a01-b119-0c04b735de39 service nova] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Received event network-vif-unplugged-525eac81-fbc6-4dcc-b574-fca50bcfc9c9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:36.671449 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-81edfb79-c7b9-4eef-b62a-925fc9944d4a req-29e83bd7-774e-4a01-b119-0c04b735de39 service nova] Acquiring lock "f4d80e03-89cd-4c85-93c4-442da626393e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:36.671590 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-81edfb79-c7b9-4eef-b62a-925fc9944d4a req-29e83bd7-774e-4a01-b119-0c04b735de39 service nova] Lock "f4d80e03-89cd-4c85-93c4-442da626393e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:36.671744 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-81edfb79-c7b9-4eef-b62a-925fc9944d4a req-29e83bd7-774e-4a01-b119-0c04b735de39 service nova] Lock "f4d80e03-89cd-4c85-93c4-442da626393e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:36.671913 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-81edfb79-c7b9-4eef-b62a-925fc9944d4a req-29e83bd7-774e-4a01-b119-0c04b735de39 service nova] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] No waiting events found dispatching network-vif-unplugged-525eac81-fbc6-4dcc-b574-fca50bcfc9c9 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:05:36.672086 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-81edfb79-c7b9-4eef-b62a-925fc9944d4a req-29e83bd7-774e-4a01-b119-0c04b735de39 service nova] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Received event network-vif-unplugged-525eac81-fbc6-4dcc-b574-fca50bcfc9c9 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:05:36.672237 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-81edfb79-c7b9-4eef-b62a-925fc9944d4a req-29e83bd7-774e-4a01-b119-0c04b735de39 service nova] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Received event network-vif-unplugged-c22a5836-b154-4420-9a35-59536357f7f9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:36.672399 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-81edfb79-c7b9-4eef-b62a-925fc9944d4a req-29e83bd7-774e-4a01-b119-0c04b735de39 service nova] Acquiring lock "4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:36.672835 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-81edfb79-c7b9-4eef-b62a-925fc9944d4a req-29e83bd7-774e-4a01-b119-0c04b735de39 service nova] Lock "4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:36.672974 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-81edfb79-c7b9-4eef-b62a-925fc9944d4a req-29e83bd7-774e-4a01-b119-0c04b735de39 service nova] Lock "4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:36.673115 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-81edfb79-c7b9-4eef-b62a-925fc9944d4a req-29e83bd7-774e-4a01-b119-0c04b735de39 service nova] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] No waiting events found dispatching network-vif-unplugged-c22a5836-b154-4420-9a35-59536357f7f9 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:05:36.673265 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-81edfb79-c7b9-4eef-b62a-925fc9944d4a req-29e83bd7-774e-4a01-b119-0c04b735de39 service nova] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Received event network-vif-unplugged-c22a5836-b154-4420-9a35-59536357f7f9 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:05:36.673392 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-81edfb79-c7b9-4eef-b62a-925fc9944d4a req-29e83bd7-774e-4a01-b119-0c04b735de39 service nova] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Received event network-vif-unplugged-c22a5836-b154-4420-9a35-59536357f7f9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:36.673527 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-81edfb79-c7b9-4eef-b62a-925fc9944d4a req-29e83bd7-774e-4a01-b119-0c04b735de39 service nova] Acquiring lock "4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:36.673689 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-81edfb79-c7b9-4eef-b62a-925fc9944d4a req-29e83bd7-774e-4a01-b119-0c04b735de39 service nova] Lock "4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:36.673814 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-81edfb79-c7b9-4eef-b62a-925fc9944d4a req-29e83bd7-774e-4a01-b119-0c04b735de39 service nova] Lock "4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:36.673946 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-81edfb79-c7b9-4eef-b62a-925fc9944d4a req-29e83bd7-774e-4a01-b119-0c04b735de39 service nova] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] No waiting events found dispatching network-vif-unplugged-c22a5836-b154-4420-9a35-59536357f7f9 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:05:36.674075 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-81edfb79-c7b9-4eef-b62a-925fc9944d4a req-29e83bd7-774e-4a01-b119-0c04b735de39 service nova] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Received event network-vif-unplugged-c22a5836-b154-4420-9a35-59536357f7f9 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:05:36.674183 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-81edfb79-c7b9-4eef-b62a-925fc9944d4a req-29e83bd7-774e-4a01-b119-0c04b735de39 service nova] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Received event network-vif-deleted-c22a5836-b154-4420-9a35-59536357f7f9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:36.674329 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-81edfb79-c7b9-4eef-b62a-925fc9944d4a req-29e83bd7-774e-4a01-b119-0c04b735de39 service nova] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Neutron deleted interface c22a5836-b154-4420-9a35-59536357f7f9; detaching it from the instance and deleting it from the info cache
May 28 01:05:36.679299 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-81edfb79-c7b9-4eef-b62a-925fc9944d4a req-29e83bd7-774e-4a01-b119-0c04b735de39 service nova] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Detach interface failed, port_id=c22a5836-b154-4420-9a35-59536357f7f9, reason: Instance 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:05:36.695111 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:36.696570 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Error from libvirt while getting description of instance-0000002e: [Error Code 42] Domain not found: no domain with matching uuid '4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789' (instance-0000002e): libvirt.libvirtError: Domain not found: no domain with matching uuid '4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789' (instance-0000002e)
May 28 01:05:36.698295 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:05:36.699453 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:36.748098 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "env LANG=C uptime" returned: 0 in 0.048s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:36.748704 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Hypervisor/Node resource view: name=np0000001577 free_ram=12891MB free_disk=73.91243743896484GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 01:05:36.748859 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:36.790204 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Acquiring lock "refresh_cache-cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:05:36.847362 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-5466c9cd-ebc1-469a-860c-6d451f4888de req-9c51c3cd-4bcc-420b-afbe-ee926eafaa5c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:36.885607 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:05:36.910486 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-5466c9cd-ebc1-469a-860c-6d451f4888de req-9c51c3cd-4bcc-420b-afbe-ee926eafaa5c service nova] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:05:37.005530 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:05:37.030797 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-5466c9cd-ebc1-469a-860c-6d451f4888de req-9c51c3cd-4bcc-420b-afbe-ee926eafaa5c service nova] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:05:37.294371 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00037915100028840243 future=<Future at 0x7c984c7e1490 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:05:37.294482 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:05:37.294539 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=1.352435991999755 future=<Future at 0x7c98705bda90 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:05:37.294657 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=1.352349831999618 future=<Future at 0x7c98705bda90 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:05:37.295056 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Emitting event <LifecycleEvent: 1779930322.2938983, 4db5d5f2-e263-41af-a833-642afe41d66d => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:05:37.295412 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] VM Stopped (Lifecycle Event)
May 28 01:05:37.363458 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:05:37.363712 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:05:37.387533 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Took 1.57 seconds to deallocate network for instance.
May 28 01:05:37.393832 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:05:37.394875 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:05:37.395109 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Creating image(s)
May 28 01:05:37.395688 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:37.395870 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "/opt/stack/data/nova/instances/cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:37.396337 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "/opt/stack/data/nova/instances/cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:37.396938 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:05:37.400331 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:05:37.401772 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:37.419514 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:37.424720 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:37.447680 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:37.454466 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:37.481085 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:37.486813 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:37.505918 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.104s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:37.506299 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:37.506736 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:37.507084 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:05:37.510031 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:05:37.511369 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Took 1.33 seconds to deallocate network for instance.
May 28 01:05:37.511720 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:37.535121 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5466c9cd-ebc1-469a-860c-6d451f4888de req-9c51c3cd-4bcc-420b-afbe-ee926eafaa5c service nova] Releasing lock "refresh_cache-cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:05:37.536529 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Acquired lock "refresh_cache-cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:05:37.536918 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:05:37.617793 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.106s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:37.618195 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:37.673845 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba/disk 1073741824" returned: 0 in 0.055s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:37.674419 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.168s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:37.674803 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:37.728288 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999063936999846 future=<Future at 0x7c984c5980e0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:05:37.734771 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Instance destroyed successfully.
May 28 01:05:37.737495 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Instance destroyed successfully.
May 28 01:05:37.739020 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:04:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-192077429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serveractionsv293testjson-server-417111260',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZCISJi6nlA4mDzDOiuCg9487tvddGj6j0Jn9d1BsbnnHFEGFqQb7Xhz7pIcCKtGhPE7XNyy3CeMbSPQsZu+OlSGdWSFk970ycf5MTngHfj4cd5ACI067WxxJTu4s1avA==',key_name='tempest-keypair-1686283236',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:04:56Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8ed67ebc30b04fe5895f2b2ddd66e9c3',ramdisk_id='',reservation_id='r-ue5gqdd9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5574e7a7-cbb4-4ae2-8b7f-aa34fd051b87',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1502319923',owner_user_name='tempest-ServerActionsV293TestJSON-1502319923-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:05:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5211ae90fcf1476b917822f860021f1b',uuid=d5aa4bd8-07f0-4329-88d3-63aa5a2be798,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "address": "fa:16:3e:a0:66:8f", "network": {"id": "330f1ba8-b51a-4cb7-8596-73705ae8eecd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-493364840-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed67ebc30b04fe5895f2b2ddd66e9c3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe5497e-7f", "ovs_interfaceid": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:05:37.739020 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Converting VIF {"id": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "address": "fa:16:3e:a0:66:8f", "network": {"id": "330f1ba8-b51a-4cb7-8596-73705ae8eecd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-493364840-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed67ebc30b04fe5895f2b2ddd66e9c3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe5497e-7f", "ovs_interfaceid": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:05:37.741216 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:66:8f,bridge_name='br-int',has_traffic_filtering=True,id=0fe5497e-7f98-48c5-89d4-5168815ab9c1,network=Network(330f1ba8-b51a-4cb7-8596-73705ae8eecd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe5497e-7f') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:05:37.743615 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:66:8f,bridge_name='br-int',has_traffic_filtering=True,id=0fe5497e-7f98-48c5-89d4-5168815ab9c1,network=Network(330f1ba8-b51a-4cb7-8596-73705ae8eecd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe5497e-7f') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:05:37.744859 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:37.745283 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0fe5497e-7f, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:37.747772 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:37.748842 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:05:37.751142 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:37.751686 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2dbe0f1d-5c52-4fd2-9e0a-a5c6a2254f85) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:37.752960 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:37.753583 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:05:37.755025 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:37.757400 np0000001577 nova-compute[98319]: INFO os_vif [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:66:8f,bridge_name='br-int',has_traffic_filtering=True,id=0fe5497e-7f98-48c5-89d4-5168815ab9c1,network=Network(330f1ba8-b51a-4cb7-8596-73705ae8eecd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe5497e-7f')
May 28 01:05:37.760050 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:05:37.761808 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:05:37.761808 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:05:37.761984 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:05:37.762763 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:05:37.763078 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:05:37.793598 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.119s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:37.794329 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:05:37.795681 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:37.810300 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 4db5d5f2-e263-41af-a833-642afe41d66d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:37.812435 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:37.812435 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:37.812435 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:37.812435 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:37.812435 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:05:37.813046 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsi session list stdout=tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:37.813046 np0000001577 nova-compute[98319]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:37.813046 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:37.813046 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:37.813046 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:05:37.813809 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', '88'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', '89'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6', '90'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6', '91')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:05:37.814476 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', '88')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:05:37.817482 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', '89')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:05:37.821127 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c9870420cc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46'): ({'sde'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:05:37.823347 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Removing multipathed devices sde, sdd {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:05:37.825509 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Flush multipath device 33000000034067dfc {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:05:37.867026 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:05:37.888512 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:37.888868 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Cannot resize image /opt/stack/data/nova/instances/cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:05:37.889583 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:05:37.889799 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Ensure instance console log exists: /opt/stack/data/nova/instances/cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:05:37.890106 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:37.890328 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:37.890496 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:37.894163 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-61fef490-bab6-44d1-8f1d-84256034311f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:37.894219 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:05:37.947067 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:05:37.984759 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:05:37.984922 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:05:37.985985 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:05:37.996056 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:05:37.996252 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:05:38.006272 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:38.036448 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 88, target: iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46, portal: 192.168.40.100,3260]
May 28 01:05:38.036448 np0000001577 nova-compute[98319]: Logout of [sid: 88, target: iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46, portal: 192.168.40.100,3260] successful.
May 28 01:05:38.036448 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:38.055992 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:38.065024 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:38.076819 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Took 0.56 seconds to detach 1 volumes for instance.
May 28 01:05:38.080174 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Deleting volume: 2ab0972e-ab73-4218-80de-cfd312d4f541 {{(pid=98319) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 01:05:38.093437 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 89, target: iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46, portal: 192.168.50.100,3260]
May 28 01:05:38.093437 np0000001577 nova-compute[98319]: Logout of [sid: 89, target: iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46, portal: 192.168.50.100,3260] successful.
May 28 01:05:38.093437 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:38.105483 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:38.105833 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:05:38.106006 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] <== disconnect_volume: return (345ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:05:38.106170 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:05:38.106466 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Deleting instance files /opt/stack/data/nova/instances/d5aa4bd8-07f0-4329-88d3-63aa5a2be798_del
May 28 01:05:38.106996 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Deletion of /opt/stack/data/nova/instances/d5aa4bd8-07f0-4329-88d3-63aa5a2be798_del complete
May 28 01:05:38.110634 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:05:38.272763 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:38.376527 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.364s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:38.377152 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.628s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:38.377844 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:05:38.423412 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Updating instance_info_cache with network_info: [{"id": "42ec1a5e-ce13-4560-b5c1-63316f374ba8", "address": "fa:16:3e:6a:68:52", "network": {"id": "cc24a3a3-ab24-4a70-a654-4f2a95e17af1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-112280041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44725643b25b416d937c23a6b7447cd7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42ec1a5e-ce", "ovs_interfaceid": "42ec1a5e-ce13-4560-b5c1-63316f374ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:05:38.618225 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:38.647706 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0004187020003882935 future=<Future at 0x7c98705bda90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:05:38.647706 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:05:38.647706 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=11.12262477000013 future=<Future at 0x7c984c401f70 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:05:38.647706 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=11.122547626000141 future=<Future at 0x7c984c401f70 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:05:38.648261 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Emitting event <LifecycleEvent: 1779930323.6469104, 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:05:38.648449 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] VM Stopped (Lifecycle Event)
May 28 01:05:38.674292 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance d5aa4bd8-07f0-4329-88d3-63aa5a2be798 could not be found.
May 28 01:05:38.675097 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:05:38.675420 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:05:38.675521 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:05:38.675830 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:05:38.676117 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:05:38.676255 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:05:38.698891 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:38.698891 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:38.698891 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:05:38.699081 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsi session list stdout=tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:38.699081 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:38.699081 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:05:38.699081 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6', '90'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6', '91')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:05:38.699277 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46, 0): [] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:05:38.699277 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46') {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 01:05:38.699387 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46, 0): [] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:05:38.699443 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46') {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 01:05:38.699531 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c9870494a40>, {}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:05:38.699645 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Disconnecting from: [] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:05:38.699789 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.024s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:05:38.699881 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] <== disconnect_volume: return (24ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:05:38.699993 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:05:38.729277 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ce8634af-b865-4b0f-84a8-163a4b4a3d61 req-59c7d64b-0cdb-4d1a-bf61-f000f5dbbb1a service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Received event network-vif-unplugged-0fe5497e-7f98-48c5-89d4-5168815ab9c1 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:38.729661 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ce8634af-b865-4b0f-84a8-163a4b4a3d61 req-59c7d64b-0cdb-4d1a-bf61-f000f5dbbb1a service nova] Acquiring lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:38.729793 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ce8634af-b865-4b0f-84a8-163a4b4a3d61 req-59c7d64b-0cdb-4d1a-bf61-f000f5dbbb1a service nova] Lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:38.729893 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ce8634af-b865-4b0f-84a8-163a4b4a3d61 req-59c7d64b-0cdb-4d1a-bf61-f000f5dbbb1a service nova] Lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:38.729994 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ce8634af-b865-4b0f-84a8-163a4b4a3d61 req-59c7d64b-0cdb-4d1a-bf61-f000f5dbbb1a service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] No waiting events found dispatching network-vif-unplugged-0fe5497e-7f98-48c5-89d4-5168815ab9c1 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:05:38.730102 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-ce8634af-b865-4b0f-84a8-163a4b4a3d61 req-59c7d64b-0cdb-4d1a-bf61-f000f5dbbb1a service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Received unexpected event network-vif-unplugged-0fe5497e-7f98-48c5-89d4-5168815ab9c1 for instance with vm_state active and task_state rebuilding.
May 28 01:05:38.730223 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ce8634af-b865-4b0f-84a8-163a4b4a3d61 req-59c7d64b-0cdb-4d1a-bf61-f000f5dbbb1a service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Received event network-vif-unplugged-0fe5497e-7f98-48c5-89d4-5168815ab9c1 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:38.730378 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ce8634af-b865-4b0f-84a8-163a4b4a3d61 req-59c7d64b-0cdb-4d1a-bf61-f000f5dbbb1a service nova] Acquiring lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:38.730434 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ce8634af-b865-4b0f-84a8-163a4b4a3d61 req-59c7d64b-0cdb-4d1a-bf61-f000f5dbbb1a service nova] Lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:38.730535 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ce8634af-b865-4b0f-84a8-163a4b4a3d61 req-59c7d64b-0cdb-4d1a-bf61-f000f5dbbb1a service nova] Lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:38.730634 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ce8634af-b865-4b0f-84a8-163a4b4a3d61 req-59c7d64b-0cdb-4d1a-bf61-f000f5dbbb1a service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] No waiting events found dispatching network-vif-unplugged-0fe5497e-7f98-48c5-89d4-5168815ab9c1 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:05:38.730726 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-ce8634af-b865-4b0f-84a8-163a4b4a3d61 req-59c7d64b-0cdb-4d1a-bf61-f000f5dbbb1a service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Received unexpected event network-vif-unplugged-0fe5497e-7f98-48c5-89d4-5168815ab9c1 for instance with vm_state active and task_state rebuilding.
May 28 01:05:38.886172 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:05:38.890488 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:05:38.891102 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:38.891320 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:38.927276 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Releasing lock "refresh_cache-cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:05:38.927276 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Instance network_info: |[{"id": "42ec1a5e-ce13-4560-b5c1-63316f374ba8", "address": "fa:16:3e:6a:68:52", "network": {"id": "cc24a3a3-ab24-4a70-a654-4f2a95e17af1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-112280041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44725643b25b416d937c23a6b7447cd7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42ec1a5e-ce", "ovs_interfaceid": "42ec1a5e-ce13-4560-b5c1-63316f374ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:05:38.929395 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Start _get_guest_xml network_info=[{"id": "42ec1a5e-ce13-4560-b5c1-63316f374ba8", "address": "fa:16:3e:6a:68:52", "network": {"id": "cc24a3a3-ab24-4a70-a654-4f2a95e17af1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-112280041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44725643b25b416d937c23a6b7447cd7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42ec1a5e-ce", "ovs_interfaceid": "42ec1a5e-ce13-4560-b5c1-63316f374ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:05:38.933705 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:05:38.935618 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-522876844', uuid='cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba'), owner=OwnerMeta(userid='d854e42ac49d4e388f4dfb1eb45acae6', username='tempest-VolumesActionsTest-955634415-project-member', projectid='44725643b25b416d937c23a6b7447cd7', projectname='tempest-VolumesActionsTest-955634415'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "42ec1a5e-ce13-4560-b5c1-63316f374ba8", "address": "fa:16:3e:6a:68:52", "network": {"id": "cc24a3a3-ab24-4a70-a654-4f2a95e17af1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-112280041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44725643b25b416d937c23a6b7447cd7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42ec1a5e-ce", "ovs_interfaceid": "42ec1a5e-ce13-4560-b5c1-63316f374ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930338.9347718) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:05:38.936185 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:05:38.936620 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:05:38.937448 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:05:38.937678 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:05:38.938990 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:05:38.939381 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:05:38.939582 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:05:38.939702 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:05:38.939865 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:05:38.939980 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:05:38.940101 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:05:38.942014 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:05:38.942014 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:05:38.942014 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:05:38.942014 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:05:38.942014 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:05:38.958105 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c803ddeaf4f4b3db07587419087b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050f928f1ce449d6a447cd343dc4ff80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:05:38.971227 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-522876844',display_name='tempest-VolumesActionsTest-instance-522876844',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumesactionstest-instance-522876844',id=47,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44725643b25b416d937c23a6b7447cd7',ramdisk_id='',reservation_id='r-e412h2hp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-955634415',owner_user_name='tempest-VolumesActionsTest-955634415-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:05:36Z,user_data=None,user_id='d854e42ac49d4e388f4dfb1eb45acae6',uuid=cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42ec1a5e-ce13-4560-b5c1-63316f374ba8", "address": "fa:16:3e:6a:68:52", "network": {"id": "cc24a3a3-ab24-4a70-a654-4f2a95e17af1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-112280041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44725643b25b416d937c23a6b7447cd7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42ec1a5e-ce", "ovs_interfaceid": "42ec1a5e-ce13-4560-b5c1-63316f374ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:05:38.971513 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Converting VIF {"id": "42ec1a5e-ce13-4560-b5c1-63316f374ba8", "address": "fa:16:3e:6a:68:52", "network": {"id": "cc24a3a3-ab24-4a70-a654-4f2a95e17af1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-112280041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44725643b25b416d937c23a6b7447cd7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42ec1a5e-ce", "ovs_interfaceid": "42ec1a5e-ce13-4560-b5c1-63316f374ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:05:38.972195 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:68:52,bridge_name='br-int',has_traffic_filtering=True,id=42ec1a5e-ce13-4560-b5c1-63316f374ba8,network=Network(cc24a3a3-ab24-4a70-a654-4f2a95e17af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42ec1a5e-ce') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:05:38.973271 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lazy-loading 'pci_devices' on Instance uuid cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:05:39.150959 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 5ccfaa60-f421-4f2e-93aa-f7e6f13aadfb] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:39.391619 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:05:39.445996 np0000001577 nova-compute[98319]: WARNING nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance f4d80e03-89cd-4c85-93c4-442da626393e is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. Skipping heal of allocation because we do not know what to do.
May 28 01:05:39.446493 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance d5aa4bd8-07f0-4329-88d3-63aa5a2be798 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:05:39.446615 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 4fb6dc75-4a06-45ea-a050-4ddcd55e8559 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:05:39.446706 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:05:39.446812 np0000001577 nova-compute[98319]: WARNING nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789 is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. Skipping heal of allocation because we do not know what to do.
May 28 01:05:39.446895 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:05:39.446973 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 36be2ae9-c375-4335-a421-cf92ea63e489 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:05:39.447174 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 01:05:39.447321 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Final resource view: name=np0000001577 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:05:36 up 37 min,  2 users,  load average: 6.42, 6.50, 3.97\n', 'num_instances': '5', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '5', 'num_proj_f6a7090a79f448f3abe4737bf127df53': '1', 'io_workload': '3', 'num_task_rebuilding': '1', 'num_proj_8ed67ebc30b04fe5895f2b2ddd66e9c3': '1', 'num_proj_15fc68900185447586ee6ff0817087fb': '1', 'num_vm_building': '2', 'num_task_spawning': '1', 'num_proj_44725643b25b416d937c23a6b7447cd7': '1', 'num_proj_050f928f1ce449d6a447cd343dc4ff80': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 01:05:39.459490 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Successfully created port: 8cf4ac4a-a821-414f-b4c5-cf06d543f090 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:05:39.478626 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] End _get_guest_xml xml=<domain type="qemu">
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:   <uuid>cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba</uuid>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:   <name>instance-0000002f</name>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       <nova:name>tempest-VolumesActionsTest-instance-522876844</nova:name>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:05:38</nova:creationTime>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:         <nova:user uuid="d854e42ac49d4e388f4dfb1eb45acae6">tempest-VolumesActionsTest-955634415-project-member</nova:user>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:         <nova:project uuid="44725643b25b416d937c23a6b7447cd7">tempest-VolumesActionsTest-955634415</nova:project>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:         <nova:port uuid="42ec1a5e-ce13-4560-b5c1-63316f374ba8">
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:     <system>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       <entry name="serial">cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba</entry>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       <entry name="uuid">cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba</entry>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:     </system>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:   <os>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:   </os>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:   <features>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:   </features>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:   <devices>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba/disk"/>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:     </disk>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba/disk.config"/>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:     </disk>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:6a:68:52"/>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       <target dev="tap42ec1a5e-ce"/>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:     </interface>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba/console.log" append="off"/>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:     </serial>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:     <video>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:     </video>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:     </rng>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:   </devices>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]: </domain>
May 28 01:05:39.478626 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:05:39.482934 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Preparing to wait for external event network-vif-plugged-42ec1a5e-ce13-4560-b5c1-63316f374ba8 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:05:39.482934 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Acquiring lock "cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:39.482934 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:39.482934 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:39.482934 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-522876844',display_name='tempest-VolumesActionsTest-instance-522876844',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumesactionstest-instance-522876844',id=47,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44725643b25b416d937c23a6b7447cd7',ramdisk_id='',reservation_id='r-e412h2hp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-955634415',owner_user_name='tempest-VolumesActionsTest-955634415-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:05:36Z,user_data=None,user_id='d854e42ac49d4e388f4dfb1eb45acae6',uuid=cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42ec1a5e-ce13-4560-b5c1-63316f374ba8", "address": "fa:16:3e:6a:68:52", "network": {"id": "cc24a3a3-ab24-4a70-a654-4f2a95e17af1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-112280041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44725643b25b416d937c23a6b7447cd7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42ec1a5e-ce", "ovs_interfaceid": "42ec1a5e-ce13-4560-b5c1-63316f374ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:05:39.482934 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Converting VIF {"id": "42ec1a5e-ce13-4560-b5c1-63316f374ba8", "address": "fa:16:3e:6a:68:52", "network": {"id": "cc24a3a3-ab24-4a70-a654-4f2a95e17af1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-112280041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44725643b25b416d937c23a6b7447cd7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42ec1a5e-ce", "ovs_interfaceid": "42ec1a5e-ce13-4560-b5c1-63316f374ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:05:39.484149 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:68:52,bridge_name='br-int',has_traffic_filtering=True,id=42ec1a5e-ce13-4560-b5c1-63316f374ba8,network=Network(cc24a3a3-ab24-4a70-a654-4f2a95e17af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42ec1a5e-ce') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:05:39.484149 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:68:52,bridge_name='br-int',has_traffic_filtering=True,id=42ec1a5e-ce13-4560-b5c1-63316f374ba8,network=Network(cc24a3a3-ab24-4a70-a654-4f2a95e17af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42ec1a5e-ce') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:05:39.485227 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:39.485627 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:39.485796 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:05:39.486734 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:39.486879 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '07d67860-9a03-53af-a68a-1aacd6c2a7dd', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:39.487575 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:39.488830 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:05:39.490611 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:39.490727 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap42ec1a5e-ce, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:39.491020 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap42ec1a5e-ce, col_values=(('qos', UUID('55c2baf4-7130-4084-8871-21effbed8591')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:39.491160 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap42ec1a5e-ce, col_values=(('external_ids', {'iface-id': '42ec1a5e-ce13-4560-b5c1-63316f374ba8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:68:52', 'vm-uuid': 'cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:39.491829 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:39.494322 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:05:39.503807 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:39.505212 np0000001577 nova-compute[98319]: INFO os_vif [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:68:52,bridge_name='br-int',has_traffic_filtering=True,id=42ec1a5e-ce13-4560-b5c1-63316f374ba8,network=Network(cc24a3a3-ab24-4a70-a654-4f2a95e17af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42ec1a5e-ce')
May 28 01:05:39.811224 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:05:39.811602 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:05:39.838289 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Preparing to wait for external event volume-reimaged-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:05:39.838427 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Acquiring lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:39.838568 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:39.838687 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:39.891844 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Successfully updated port: 8cf4ac4a-a821-414f-b4c5-cf06d543f090 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:05:39.897168 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:05:39.927140 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Acquiring lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:39.927333 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:40.314078 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:05:40.393573 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "refresh_cache-36be2ae9-c375-4335-a421-cf92ea63e489" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:05:40.393741 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquired lock "refresh_cache-36be2ae9-c375-4335-a421-cf92ea63e489" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:05:40.393921 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:05:40.400224 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Booting with volume 28977eca-9bcb-4827-ac8f-72d5f22c18ac at /dev/vda
May 28 01:05:40.430717 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lazy-loading 'flavor' on Instance uuid 4fb6dc75-4a06-45ea-a050-4ddcd55e8559 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:05:40.438695 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:05:40.449088 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:05:40.467578 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:40.508145 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:05:40.508485 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:05:40.516377 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:05:40.517299 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe6d:b1ae', 'fe80::9071:84ff:fea9:bd33', 'fe80::fc16:3eff:fe88:7ca', 'fe80::6cd5:f5ff:fe52:2a3e'] 
May 28 01:05:40.517447 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:05:40.517579 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:05:40.517816 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] <== get_connector_properties: return (79ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:05:40.518033 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Updating existing volume attachment record: 4895971f-87ff-4d0e-9fcb-98c0fc9f70b9 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:05:40.788219 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4525c1ca-13d4-4685-8a85-cc6d2cd0e50b req-30590d20-3ce7-4144-94e2-40a5b6407e7c service nova] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Received event network-changed-8cf4ac4a-a821-414f-b4c5-cf06d543f090 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:40.788697 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4525c1ca-13d4-4685-8a85-cc6d2cd0e50b req-30590d20-3ce7-4144-94e2-40a5b6407e7c service nova] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Refreshing instance network info cache due to event network-changed-8cf4ac4a-a821-414f-b4c5-cf06d543f090. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:05:40.788874 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4525c1ca-13d4-4685-8a85-cc6d2cd0e50b req-30590d20-3ce7-4144-94e2-40a5b6407e7c service nova] Acquiring lock "refresh_cache-36be2ae9-c375-4335-a421-cf92ea63e489" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:05:40.822009 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Compute_service record updated for np0000001577:np0000001577 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 01:05:40.822597 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.446s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:40.822974 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:05:40.823344 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-61fef490-bab6-44d1-8f1d-84256034311f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.929s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:40.826140 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-61fef490-bab6-44d1-8f1d-84256034311f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:40.828238 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.210s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:40.829286 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:40.881612 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Deleted allocations for instance 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789
May 28 01:05:40.890184 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-61fef490-bab6-44d1-8f1d-84256034311f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Deleted allocations for instance f4d80e03-89cd-4c85-93c4-442da626393e
May 28 01:05:40.951269 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:05:41.026648 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:05:41.026769 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:05:41.026876 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] No VIF found with MAC fa:16:3e:6a:68:52, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:05:41.027347 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Using config drive
May 28 01:05:41.111050 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:41.256625 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Updating instance_info_cache with network_info: [{"id": "8cf4ac4a-a821-414f-b4c5-cf06d543f090", "address": "fa:16:3e:49:4d:05", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf4ac4a-a8", "ovs_interfaceid": "8cf4ac4a-a821-414f-b4c5-cf06d543f090", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:05:41.296496 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:41.437004 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:41.531930 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:41.627763 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Creating config drive at /opt/stack/data/nova/instances/cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba/disk.config
May 28 01:05:41.630629 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppbv1tu_d {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:41.680553 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppbv1tu_d" returned: 0 in 0.050s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:41.758255 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Releasing lock "refresh_cache-36be2ae9-c375-4335-a421-cf92ea63e489" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:05:41.758877 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Instance network_info: |[{"id": "8cf4ac4a-a821-414f-b4c5-cf06d543f090", "address": "fa:16:3e:49:4d:05", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf4ac4a-a8", "ovs_interfaceid": "8cf4ac4a-a821-414f-b4c5-cf06d543f090", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:05:41.759289 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4525c1ca-13d4-4685-8a85-cc6d2cd0e50b req-30590d20-3ce7-4144-94e2-40a5b6407e7c service nova] Acquired lock "refresh_cache-36be2ae9-c375-4335-a421-cf92ea63e489" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:05:41.759452 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-4525c1ca-13d4-4685-8a85-cc6d2cd0e50b req-30590d20-3ce7-4144-94e2-40a5b6407e7c service nova] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Refreshing network info cache for port 8cf4ac4a-a821-414f-b4c5-cf06d543f090 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:05:41.890689 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b06a0d7c-f241-4610-bffc-d3220a2a2757 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Lock "4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.854s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:41.899307 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-61fef490-bab6-44d1-8f1d-84256034311f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "f4d80e03-89cd-4c85-93c4-442da626393e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.998s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:42.067923 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:42.093790 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:42.096533 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:42.177564 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:42.263769 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-4525c1ca-13d4-4685-8a85-cc6d2cd0e50b req-30590d20-3ce7-4144-94e2-40a5b6407e7c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:42.412698 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:42.419187 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:42.422979 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:42.426024 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:42.453359 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:42.497149 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Acquiring lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:42.497332 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:42.497564 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Attaching volume e04c3d46-81b2-492b-a811-117dcf51fc9e to /dev/vdb
May 28 01:05:42.546005 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:05:42.558450 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:05:42.579696 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:42.609871 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:05:42.612970 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:05:42.616074 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-4525c1ca-13d4-4685-8a85-cc6d2cd0e50b req-30590d20-3ce7-4144-94e2-40a5b6407e7c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:42.618716 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Creating image(s)
May 28 01:05:42.619317 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:05:42.619507 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Ensure instance console log exists: /opt/stack/data/nova/instances/36be2ae9-c375-4335-a421-cf92ea63e489/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:05:42.619922 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:42.620599 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:05:42.620763 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:42.621691 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:05:42.622039 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:42.622749 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Start _get_guest_xml network_info=[{"id": "8cf4ac4a-a821-414f-b4c5-cf06d543f090", "address": "fa:16:3e:49:4d:05", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf4ac4a-a8", "ovs_interfaceid": "8cf4ac4a-a821-414f-b4c5-cf06d543f090", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac', 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '28977eca-9bcb-4827-ac8f-72d5f22c18ac', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '36be2ae9-c375-4335-a421-cf92ea63e489', 'attached_at': '', 'detached_at': '', 'volume_id': '28977eca-9bcb-4827-ac8f-72d5f22c18ac', 'serial': '28977eca-9bcb-4827-ac8f-72d5f22c18ac'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '4895971f-87ff-4d0e-9fcb-98c0fc9f70b9', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:05:42.628213 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:05:42.629039 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-volume-backed-server-1709932323', uuid='36be2ae9-c375-4335-a421-cf92ea63e489'), owner=OwnerMeta(userid='0c803ddeaf4f4b3db07587419087b3b2', username='tempest-TestVolumeBootPattern-1449742411-project-member', projectid='050f928f1ce449d6a447cd343dc4ff80', projectname='tempest-TestVolumeBootPattern-1449742411'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8cf4ac4a-a821-414f-b4c5-cf06d543f090", "address": "fa:16:3e:49:4d:05", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf4ac4a-a8", "ovs_interfaceid": "8cf4ac4a-a821-414f-b4c5-cf06d543f090", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930342.628715) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:05:42.630595 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:05:42.632180 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe6d:b1ae', 'fe80::9071:84ff:fea9:bd33', 'fe80::fc16:3eff:fe88:7ca', 'fe80::6cd5:f5ff:fe52:2a3e', 'fe80::fc16:3eff:fe6a:6852', 'fe80::b0d6:82ff:fe1b:8869'] 
May 28 01:05:42.632180 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:05:42.632180 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:05:42.632180 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:05:42.633350 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Updating existing volume attachment record: 8e72a381-ac3e-4c07-bb72-9f59c5731bf2 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:05:42.635006 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:05:42.635117 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:05:42.636576 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:05:42.637584 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:05:42.639522 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:05:42.639522 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:05:42.639522 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:05:42.639787 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:05:42.639787 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:05:42.639787 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:05:42.639897 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:05:42.640013 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:05:42.640366 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:05:42.640808 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:05:42.640808 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:05:42.640932 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:05:42.650387 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:05:42.650711 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac', 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '28977eca-9bcb-4827-ac8f-72d5f22c18ac', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:05:42.650840 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:05:42.750383 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-4525c1ca-13d4-4685-8a85-cc6d2cd0e50b req-30590d20-3ce7-4144-94e2-40a5b6407e7c service nova] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Updated VIF entry in instance network info cache for port 8cf4ac4a-a821-414f-b4c5-cf06d543f090. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:05:42.750708 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-4525c1ca-13d4-4685-8a85-cc6d2cd0e50b req-30590d20-3ce7-4144-94e2-40a5b6407e7c service nova] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Updating instance_info_cache with network_info: [{"id": "8cf4ac4a-a821-414f-b4c5-cf06d543f090", "address": "fa:16:3e:49:4d:05", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf4ac4a-a8", "ovs_interfaceid": "8cf4ac4a-a821-414f-b4c5-cf06d543f090", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:05:42.813282 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930342.8129194, cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:05:42.813666 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] VM Started (Lifecycle Event)
May 28 01:05:42.838171 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1460f9e2-3235-4b88-8c2e-f26764fb3315 req-6cfc0b40-ca6a-4c61-b2b8-57dbce303ec1 service nova] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Received event network-vif-plugged-42ec1a5e-ce13-4560-b5c1-63316f374ba8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:42.838642 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1460f9e2-3235-4b88-8c2e-f26764fb3315 req-6cfc0b40-ca6a-4c61-b2b8-57dbce303ec1 service nova] Acquiring lock "cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:42.838860 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1460f9e2-3235-4b88-8c2e-f26764fb3315 req-6cfc0b40-ca6a-4c61-b2b8-57dbce303ec1 service nova] Lock "cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:42.839045 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1460f9e2-3235-4b88-8c2e-f26764fb3315 req-6cfc0b40-ca6a-4c61-b2b8-57dbce303ec1 service nova] Lock "cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:42.839218 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1460f9e2-3235-4b88-8c2e-f26764fb3315 req-6cfc0b40-ca6a-4c61-b2b8-57dbce303ec1 service nova] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Processing event network-vif-plugged-42ec1a5e-ce13-4560-b5c1-63316f374ba8 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:05:42.839418 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1460f9e2-3235-4b88-8c2e-f26764fb3315 req-6cfc0b40-ca6a-4c61-b2b8-57dbce303ec1 service nova] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Received event network-vif-plugged-42ec1a5e-ce13-4560-b5c1-63316f374ba8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:42.839607 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1460f9e2-3235-4b88-8c2e-f26764fb3315 req-6cfc0b40-ca6a-4c61-b2b8-57dbce303ec1 service nova] Acquiring lock "cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:42.839776 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1460f9e2-3235-4b88-8c2e-f26764fb3315 req-6cfc0b40-ca6a-4c61-b2b8-57dbce303ec1 service nova] Lock "cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:42.840132 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1460f9e2-3235-4b88-8c2e-f26764fb3315 req-6cfc0b40-ca6a-4c61-b2b8-57dbce303ec1 service nova] Lock "cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:42.840132 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1460f9e2-3235-4b88-8c2e-f26764fb3315 req-6cfc0b40-ca6a-4c61-b2b8-57dbce303ec1 service nova] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] No waiting events found dispatching network-vif-plugged-42ec1a5e-ce13-4560-b5c1-63316f374ba8 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:05:42.840302 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-1460f9e2-3235-4b88-8c2e-f26764fb3315 req-6cfc0b40-ca6a-4c61-b2b8-57dbce303ec1 service nova] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Received unexpected event network-vif-plugged-42ec1a5e-ce13-4560-b5c1-63316f374ba8 for instance with vm_state building and task_state spawning.
May 28 01:05:42.840820 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:05:42.843347 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:05:42.845361 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Instance spawned successfully.
May 28 01:05:42.845841 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:05:43.190463 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:05:43.190820 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e', 'iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e04c3d46-81b2-492b-a811-117dcf51fc9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:05:43.190820 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:05:43.204955 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.554s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:05:43.205254 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac', 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '28977eca-9bcb-4827-ac8f-72d5f22c18ac', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:05:43.216539 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:05:43.216961 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:05:43.217620 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:05:43.217859 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:05:43.218111 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:05:43.218275 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:05:43.229716 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:05:43.229716 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:43.234104 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:05:43.234104 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:43.242758 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac] added
May 28 01:05:43.242758 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:05:43.242758 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:05:43.242758 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:05:43.242758 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:05:43.242758 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:05:43.242758 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:43.242957 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:05:43.243043 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0252(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:05:43.243183 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:05:43.249784 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac] added
May 28 01:05:43.249784 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:05:43.249784 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:05:43.249784 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:05:43.249784 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:05:43.249784 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:05:43.249784 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:43.249966 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:05:43.250030 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0318(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:05:43.250140 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:05:43.252758 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4525c1ca-13d4-4685-8a85-cc6d2cd0e50b req-30590d20-3ce7-4144-94e2-40a5b6407e7c service nova] Releasing lock "refresh_cache-36be2ae9-c375-4335-a421-cf92ea63e489" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:05:43.317628 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:43.317982 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:05:43.350723 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:43.350834 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:43.351088 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:43.351300 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:43.351809 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:43.352070 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:43.820696 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:05:43.821290 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:05:43.821981 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930343.821482, cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:05:43.822071 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] VM Paused (Lifecycle Event)
May 28 01:05:43.823715 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:05:43.824038 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:05:43.824365 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:05:43.825057 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:05:43.825328 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:05:43.825478 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 01:05:43.826698 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 53.15 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:05:43.855751 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Took 6.46 seconds to spawn the instance on the hypervisor.
May 28 01:05:43.855989 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:44.243597 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:05:44.250717 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:05:44.258434 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:05:44.258434 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:05:44.267087 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:05:44.267087 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:44.276028 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:44.285176 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:44.295537 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:44.295537 np0000001577 nova-compute[98319]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:44.295537 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:44.295537 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:44.295537 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:05:44.295537 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:44.295537 np0000001577 nova-compute[98319]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:44.295537 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:44.295537 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:44.295537 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:05:44.303836 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:44.303836 np0000001577 nova-compute[98319]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:44.303836 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:44.303836 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:44.303836 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:05:44.304046 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:44.304046 np0000001577 nova-compute[98319]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:44.304046 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:44.304046 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:44.304046 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:05:44.324733 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:44.326339 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930344.326103, cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:05:44.326710 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] VM Resumed (Lifecycle Event)
May 28 01:05:44.341877 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac, portal: 192.168.40.100,3260]
May 28 01:05:44.341877 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac, portal: 192.168.40.100,3260] successful.
May 28 01:05:44.341877 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:44.350036 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac, portal: 192.168.50.100,3260]
May 28 01:05:44.350036 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac, portal: 192.168.50.100,3260] successful.
May 28 01:05:44.350036 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:44.356353 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:44.366000 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Took 11.86 seconds to build instance.
May 28 01:05:44.367192 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:44.374301 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:44.374301 np0000001577 nova-compute[98319]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:44.374301 np0000001577 nova-compute[98319]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:44.374301 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:44.374301 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:44.374301 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:44.374301 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:05:44.374469 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:44.374469 np0000001577 nova-compute[98319]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:44.374469 np0000001577 nova-compute[98319]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:44.374469 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:44.374469 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:44.374469 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:44.374469 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:05:44.374830 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:05:44.374947 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:05:44.376018 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] HCTL ('11', '-', '-', 0) found on session 102 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:05:44.376206 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:05:44.385790 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:44.385790 np0000001577 nova-compute[98319]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:44.385790 np0000001577 nova-compute[98319]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:44.385790 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:44.385790 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:44.385790 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:44.385790 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:05:44.385790 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:44.385790 np0000001577 nova-compute[98319]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:44.385790 np0000001577 nova-compute[98319]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:44.385790 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:44.385790 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:44.385790 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:44.385790 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:05:44.385790 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.167s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:05:44.385790 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:05:44.385790 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] HCTL ('12', '-', '-', 0) found on session 103 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:05:44.386417 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:05:44.396498 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching for a device in session 102 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:05:44.396720 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '28977eca-9bcb-4827-ac8f-72d5f22c18ac', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:05:44.404528 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching for a device in session 103 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:05:44.404528 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '28977eca-9bcb-4827-ac8f-72d5f22c18ac', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:05:44.495586 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:44.830866 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:44.834746 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:05:44.871583 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.370s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:45.220475 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:05:46.055743 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "1c35ef60-298f-47f3-99a0-c9de2bd34c55" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:46.056226 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "1c35ef60-298f-47f3-99a0-c9de2bd34c55" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:46.241460 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Found WWN 33000000009bf1d1a for multipath device dm-6 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:05:46.241772 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:05:46.242035 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] <== connect_volume: return (3591ms) {'type': 'block', 'scsi_wwn': '33000000009bf1d1a', 'path': '/dev/dm-6', 'multipath_id': '33000000009bf1d1a'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:05:46.242230 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000009bf1d1a', 'path': '/dev/dm-6', 'multipath_id': '33000000009bf1d1a'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:05:46.242481 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.052s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:05:46.242698 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e', 'iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e04c3d46-81b2-492b-a811-117dcf51fc9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:05:46.254309 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:05:46.254820 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:05:46.255300 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:05:46.255476 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:05:46.255834 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:05:46.256076 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:05:46.271620 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:05:46.271620 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:46.279877 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:05:46.279877 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:46.285130 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e] added
May 28 01:05:46.285130 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:05:46.285130 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:05:46.285130 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:05:46.285130 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:05:46.285130 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:05:46.285130 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:46.285365 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:05:46.285532 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.03(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:05:46.285724 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:05:46.294448 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e] added
May 28 01:05:46.294448 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:05:46.294448 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:05:46.294448 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:05:46.294448 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:05:46.294448 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:05:46.294448 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:46.294710 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:05:46.294753 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0387(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:05:46.294928 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:05:46.317599 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:46.557336 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:05:46.747408 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:05:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1709932323',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1709932323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpattern-volume-backed-server-1709932323',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEg/JvK7aO9JuiW+dJLhyl61WZn9UNxA8K+8igoa76/265jIzUINPBNGbtw6T4Igc046ehvcYHKeVzhpb4bmN6yPFdwExp54BG6xjn+UTTaDMeJRzBcZQluYk+1VKBAO7Q==',key_name='tempest-keypair-877231583',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='050f928f1ce449d6a447cd343dc4ff80',ramdisk_id='',reservation_id='r-hmwnkx3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1449742411',owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:05:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c803ddeaf4f4b3db07587419087b3b2',uuid=36be2ae9-c375-4335-a421-cf92ea63e489,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cf4ac4a-a821-414f-b4c5-cf06d543f090", "address": "fa:16:3e:49:4d:05", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf4ac4a-a8", "ovs_interfaceid": "8cf4ac4a-a821-414f-b4c5-cf06d543f090", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:05:46.747688 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converting VIF {"id": "8cf4ac4a-a821-414f-b4c5-cf06d543f090", "address": "fa:16:3e:49:4d:05", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf4ac4a-a8", "ovs_interfaceid": "8cf4ac4a-a821-414f-b4c5-cf06d543f090", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:05:46.748232 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:4d:05,bridge_name='br-int',has_traffic_filtering=True,id=8cf4ac4a-a821-414f-b4c5-cf06d543f090,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cf4ac4a-a8') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:05:46.748784 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lazy-loading 'pci_devices' on Instance uuid 36be2ae9-c375-4335-a421-cf92ea63e489 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:05:46.891271 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fa7842e-535f-4ef1-9538-d8a06e42a942 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Acquiring lock "cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:46.891452 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fa7842e-535f-4ef1-9538-d8a06e42a942 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:46.891686 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fa7842e-535f-4ef1-9538-d8a06e42a942 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Acquiring lock "cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:46.891772 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fa7842e-535f-4ef1-9538-d8a06e42a942 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:46.891916 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fa7842e-535f-4ef1-9538-d8a06e42a942 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:46.893658 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-3fa7842e-535f-4ef1-9538-d8a06e42a942 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Terminating instance
May 28 01:05:47.098798 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:47.099109 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:47.101808 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:05:47.101930 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Claim successful on node np0000001577
May 28 01:05:47.251114 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] End _get_guest_xml xml=<domain type="qemu">
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:   <uuid>36be2ae9-c375-4335-a421-cf92ea63e489</uuid>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:   <name>instance-00000030</name>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1709932323</nova:name>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:05:42</nova:creationTime>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       <nova:image uuid="">
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:         <nova:user uuid="0c803ddeaf4f4b3db07587419087b3b2">tempest-TestVolumeBootPattern-1449742411-project-member</nova:user>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:         <nova:project uuid="050f928f1ce449d6a447cd343dc4ff80">tempest-TestVolumeBootPattern-1449742411</nova:project>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:         <nova:port uuid="8cf4ac4a-a821-414f-b4c5-cf06d543f090">
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:     <system>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       <entry name="serial">36be2ae9-c375-4335-a421-cf92ea63e489</entry>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       <entry name="uuid">36be2ae9-c375-4335-a421-cf92ea63e489</entry>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:     </system>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:   <os>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:   </os>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:   <features>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:   </features>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:   <devices>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/36be2ae9-c375-4335-a421-cf92ea63e489/disk.config"/>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:     </disk>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       <alias name="ua-28977eca-9bcb-4827-ac8f-72d5f22c18ac"/>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-6"/>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       <serial>28977eca-9bcb-4827-ac8f-72d5f22c18ac</serial>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:     </disk>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:49:4d:05"/>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       <target dev="tap8cf4ac4a-a8"/>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:     </interface>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/36be2ae9-c375-4335-a421-cf92ea63e489/console.log" append="off"/>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:     </serial>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:     <video>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:     </video>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:     </rng>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:   </devices>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]: </domain>
May 28 01:05:47.251114 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:05:47.254010 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Preparing to wait for external event network-vif-plugged-8cf4ac4a-a821-414f-b4c5-cf06d543f090 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:05:47.254010 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "36be2ae9-c375-4335-a421-cf92ea63e489-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:47.254010 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "36be2ae9-c375-4335-a421-cf92ea63e489-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:47.254010 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "36be2ae9-c375-4335-a421-cf92ea63e489-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:47.254010 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:05:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1709932323',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1709932323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpattern-volume-backed-server-1709932323',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEg/JvK7aO9JuiW+dJLhyl61WZn9UNxA8K+8igoa76/265jIzUINPBNGbtw6T4Igc046ehvcYHKeVzhpb4bmN6yPFdwExp54BG6xjn+UTTaDMeJRzBcZQluYk+1VKBAO7Q==',key_name='tempest-keypair-877231583',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='050f928f1ce449d6a447cd343dc4ff80',ramdisk_id='',reservation_id='r-hmwnkx3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1449742411',owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:05:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c803ddeaf4f4b3db07587419087b3b2',uuid=36be2ae9-c375-4335-a421-cf92ea63e489,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cf4ac4a-a821-414f-b4c5-cf06d543f090", "address": "fa:16:3e:49:4d:05", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf4ac4a-a8", "ovs_interfaceid": "8cf4ac4a-a821-414f-b4c5-cf06d543f090", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:05:47.254010 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converting VIF {"id": "8cf4ac4a-a821-414f-b4c5-cf06d543f090", "address": "fa:16:3e:49:4d:05", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf4ac4a-a8", "ovs_interfaceid": "8cf4ac4a-a821-414f-b4c5-cf06d543f090", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:05:47.254010 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:4d:05,bridge_name='br-int',has_traffic_filtering=True,id=8cf4ac4a-a821-414f-b4c5-cf06d543f090,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cf4ac4a-a8') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:05:47.254010 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:4d:05,bridge_name='br-int',has_traffic_filtering=True,id=8cf4ac4a-a821-414f-b4c5-cf06d543f090,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cf4ac4a-a8') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:05:47.254010 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:47.254010 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:47.254010 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:05:47.255452 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:47.255452 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7cbb08af-197b-5173-8482-a181d6bb847c', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:47.257289 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:05:47.258116 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:47.260020 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:47.260183 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8cf4ac4a-a8, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:47.260653 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8cf4ac4a-a8, col_values=(('qos', UUID('af3cbbbe-9461-4c45-924a-7dab673cc98f')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:47.260810 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8cf4ac4a-a8, col_values=(('external_ids', {'iface-id': '8cf4ac4a-a821-414f-b4c5-cf06d543f090', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:4d:05', 'vm-uuid': '36be2ae9-c375-4335-a421-cf92ea63e489'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:47.265453 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:05:47.267366 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:47.269371 np0000001577 nova-compute[98319]: INFO os_vif [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:4d:05,bridge_name='br-int',has_traffic_filtering=True,id=8cf4ac4a-a821-414f-b4c5-cf06d543f090,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cf4ac4a-a8')
May 28 01:05:47.286036 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:05:47.295354 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:05:47.302330 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:05:47.302330 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:05:47.312395 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:05:47.312395 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:47.314193 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:47.325376 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:47.331312 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:47.331312 np0000001577 nova-compute[98319]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:47.331312 np0000001577 nova-compute[98319]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:47.331312 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:47.331312 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:47.331312 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:47.331312 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:05:47.331522 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:47.331522 np0000001577 nova-compute[98319]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:47.331522 np0000001577 nova-compute[98319]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:47.331522 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:47.331522 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:47.331522 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:47.331522 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:05:47.339500 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:47.339500 np0000001577 nova-compute[98319]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:47.339500 np0000001577 nova-compute[98319]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:47.339500 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:47.339500 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:47.339500 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:47.339500 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:05:47.339719 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:47.339719 np0000001577 nova-compute[98319]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:47.339719 np0000001577 nova-compute[98319]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:47.339719 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:47.339719 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:47.339719 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:47.339719 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:05:47.369837 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e, portal: 192.168.40.100,3260]
May 28 01:05:47.369837 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e, portal: 192.168.40.100,3260] successful.
May 28 01:05:47.369837 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:47.375867 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e, portal: 192.168.50.100,3260]
May 28 01:05:47.375867 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e, portal: 192.168.50.100,3260] successful.
May 28 01:05:47.375867 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:47.381588 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:47.388245 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:47.397134 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-3fa7842e-535f-4ef1-9538-d8a06e42a942 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:05:47.397937 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:47.397937 np0000001577 nova-compute[98319]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:47.397937 np0000001577 nova-compute[98319]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:47.397937 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:47.397937 np0000001577 nova-compute[98319]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:05:47.397937 np0000001577 nova-compute[98319]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:05:47.397937 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:47.397937 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:47.397937 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:05:47.398123 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:47.398123 np0000001577 nova-compute[98319]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:47.398123 np0000001577 nova-compute[98319]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:47.398123 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:47.398123 np0000001577 nova-compute[98319]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:05:47.398123 np0000001577 nova-compute[98319]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:05:47.398123 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:47.398123 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:47.398123 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:05:47.398369 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:05:47.398468 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:05:47.399367 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] HCTL ('13', '-', '-', 0) found on session 104 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:05:47.399367 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:05:47.406739 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:47.406739 np0000001577 nova-compute[98319]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:47.406739 np0000001577 nova-compute[98319]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:47.406739 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:47.406739 np0000001577 nova-compute[98319]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:05:47.406739 np0000001577 nova-compute[98319]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:05:47.406739 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:47.406739 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:47.406739 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:05:47.406739 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:47.406739 np0000001577 nova-compute[98319]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:47.406739 np0000001577 nova-compute[98319]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:47.406739 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:47.406739 np0000001577 nova-compute[98319]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:05:47.406739 np0000001577 nova-compute[98319]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:05:47.406739 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:47.406739 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:47.406739 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:05:47.407052 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:05:47.407052 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:05:47.407678 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] HCTL ('14', '-', '-', 0) found on session 105 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:05:47.407776 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:05:47.414116 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Searching for a device in session 104 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:05:47.414116 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e04c3d46-81b2-492b-a811-117dcf51fc9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:05:47.421655 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Searching for a device in session 105 and hctl ['14', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:05:47.435210 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:47.437301 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:47.454562 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:47.463042 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:47.485579 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:47.493949 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:47.577339 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-03bd8d0d-7c5b-4c14-9fbf-0d2a647f2fcc req-c1d73a5a-ab26-4cd6-ac6a-bb4700819e56 service nova] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Received event network-vif-unplugged-42ec1a5e-ce13-4560-b5c1-63316f374ba8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:47.577495 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-03bd8d0d-7c5b-4c14-9fbf-0d2a647f2fcc req-c1d73a5a-ab26-4cd6-ac6a-bb4700819e56 service nova] Acquiring lock "cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:47.577642 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-03bd8d0d-7c5b-4c14-9fbf-0d2a647f2fcc req-c1d73a5a-ab26-4cd6-ac6a-bb4700819e56 service nova] Lock "cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:47.577846 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-03bd8d0d-7c5b-4c14-9fbf-0d2a647f2fcc req-c1d73a5a-ab26-4cd6-ac6a-bb4700819e56 service nova] Lock "cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:47.577846 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-03bd8d0d-7c5b-4c14-9fbf-0d2a647f2fcc req-c1d73a5a-ab26-4cd6-ac6a-bb4700819e56 service nova] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] No waiting events found dispatching network-vif-unplugged-42ec1a5e-ce13-4560-b5c1-63316f374ba8 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:05:47.577976 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-03bd8d0d-7c5b-4c14-9fbf-0d2a647f2fcc req-c1d73a5a-ab26-4cd6-ac6a-bb4700819e56 service nova] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Received event network-vif-unplugged-42ec1a5e-ce13-4560-b5c1-63316f374ba8 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:05:47.718448 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999716602999797 future=<Future at 0x7c987047ae40 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:05:47.720028 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Instance destroyed successfully.
May 28 01:05:47.720430 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-3fa7842e-535f-4ef1-9538-d8a06e42a942 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lazy-loading 'resources' on Instance uuid cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:05:48.223236 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-3fa7842e-535f-4ef1-9538-d8a06e42a942 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-522876844',display_name='tempest-VolumesActionsTest-instance-522876844',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumesactionstest-instance-522876844',id=47,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:05:43Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44725643b25b416d937c23a6b7447cd7',ramdisk_id='',reservation_id='r-e412h2hp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-955634415',owner_user_name='tempest-VolumesActionsTest-955634415-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:05:44Z,user_data=None,user_id='d854e42ac49d4e388f4dfb1eb45acae6',uuid=cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "42ec1a5e-ce13-4560-b5c1-63316f374ba8", "address": "fa:16:3e:6a:68:52", "network": {"id": "cc24a3a3-ab24-4a70-a654-4f2a95e17af1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-112280041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44725643b25b416d937c23a6b7447cd7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42ec1a5e-ce", "ovs_interfaceid": "42ec1a5e-ce13-4560-b5c1-63316f374ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:05:48.223656 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3fa7842e-535f-4ef1-9538-d8a06e42a942 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Converting VIF {"id": "42ec1a5e-ce13-4560-b5c1-63316f374ba8", "address": "fa:16:3e:6a:68:52", "network": {"id": "cc24a3a3-ab24-4a70-a654-4f2a95e17af1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-112280041-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "44725643b25b416d937c23a6b7447cd7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42ec1a5e-ce", "ovs_interfaceid": "42ec1a5e-ce13-4560-b5c1-63316f374ba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:05:48.223913 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3fa7842e-535f-4ef1-9538-d8a06e42a942 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:68:52,bridge_name='br-int',has_traffic_filtering=True,id=42ec1a5e-ce13-4560-b5c1-63316f374ba8,network=Network(cc24a3a3-ab24-4a70-a654-4f2a95e17af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42ec1a5e-ce') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:05:48.224105 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-3fa7842e-535f-4ef1-9538-d8a06e42a942 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:68:52,bridge_name='br-int',has_traffic_filtering=True,id=42ec1a5e-ce13-4560-b5c1-63316f374ba8,network=Network(cc24a3a3-ab24-4a70-a654-4f2a95e17af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42ec1a5e-ce') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:05:48.225265 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:48.225439 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap42ec1a5e-ce, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:48.226349 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:48.227036 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:05:48.231837 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:48.232363 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:48.232472 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=55c2baf4-7130-4084-8871-21effbed8591) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:48.232886 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:48.233279 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:05:48.237559 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:48.238984 np0000001577 nova-compute[98319]: INFO os_vif [None req-3fa7842e-535f-4ef1-9538-d8a06e42a942 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:68:52,bridge_name='br-int',has_traffic_filtering=True,id=42ec1a5e-ce13-4560-b5c1-63316f374ba8,network=Network(cc24a3a3-ab24-4a70-a654-4f2a95e17af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42ec1a5e-ce')
May 28 01:05:48.239214 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3fa7842e-535f-4ef1-9538-d8a06e42a942 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Deleting instance files /opt/stack/data/nova/instances/cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba_del
May 28 01:05:48.239771 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3fa7842e-535f-4ef1-9538-d8a06e42a942 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Deletion of /opt/stack/data/nova/instances/cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba_del complete
May 28 01:05:48.363662 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:05:48.363864 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:05:48.421878 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Searching for a device in session 105 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:05:48.421968 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e04c3d46-81b2-492b-a811-117dcf51fc9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:05:48.744525 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-3fa7842e-535f-4ef1-9538-d8a06e42a942 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Took 1.35 seconds to destroy the instance on the hypervisor.
May 28 01:05:48.745053 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-3fa7842e-535f-4ef1-9538-d8a06e42a942 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:05:48.745344 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:05:48.745476 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:05:48.745727 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:48.782611 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:05:48.782778 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:05:48.782937 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] No VIF found with MAC fa:16:3e:49:4d:05, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:05:48.783395 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Using config drive
May 28 01:05:48.800675 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:48.866232 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:05:49.041591 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a1c29d03-a4ae-40ab-a4fa-145fda92bb4a req-2de7c8bc-7247-451b-b411-d3ea8c844b31 service nova] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Received event network-vif-deleted-42ec1a5e-ce13-4560-b5c1-63316f374ba8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:49.042269 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-a1c29d03-a4ae-40ab-a4fa-145fda92bb4a req-2de7c8bc-7247-451b-b411-d3ea8c844b31 service nova] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Neutron deleted interface 42ec1a5e-ce13-4560-b5c1-63316f374ba8; detaching it from the instance and deleting it from the info cache
May 28 01:05:49.043673 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a1c29d03-a4ae-40ab-a4fa-145fda92bb4a req-2de7c8bc-7247-451b-b411-d3ea8c844b31 service nova] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Detach interface failed, port_id=42ec1a5e-ce13-4560-b5c1-63316f374ba8, reason: Instance cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:05:49.269711 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Found WWN 330000000b54e87b9 for multipath device dm-9 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:05:49.270103 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.027s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:05:49.270103 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] <== connect_volume: return (6079ms) {'type': 'block', 'scsi_wwn': '330000000b54e87b9', 'path': '/dev/dm-9', 'multipath_id': '330000000b54e87b9'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:05:49.270103 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b54e87b9', 'path': '/dev/dm-9', 'multipath_id': '330000000b54e87b9'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:05:49.272042 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lazy-loading 'flavor' on Instance uuid 4fb6dc75-4a06-45ea-a050-4ddcd55e8559 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:05:49.287878 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:49.371715 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.273s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:49.372061 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:05:49.389647 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Creating config drive at /opt/stack/data/nova/instances/36be2ae9-c375-4335-a421-cf92ea63e489/disk.config
May 28 01:05:49.393599 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/36be2ae9-c375-4335-a421-cf92ea63e489/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprxwfwwj6 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:49.446396 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/36be2ae9-c375-4335-a421-cf92ea63e489/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprxwfwwj6" returned: 0 in 0.052s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:49.501873 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:05:49.635064 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-3197d801-00db-4bc1-a2b1-129b8eb7e99f req-b20bca9d-a23e-46c3-a274-ff7e96092981 service nova] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Received event network-vif-unplugged-42ec1a5e-ce13-4560-b5c1-63316f374ba8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:49.635905 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3197d801-00db-4bc1-a2b1-129b8eb7e99f req-b20bca9d-a23e-46c3-a274-ff7e96092981 service nova] Acquiring lock "cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:49.636146 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3197d801-00db-4bc1-a2b1-129b8eb7e99f req-b20bca9d-a23e-46c3-a274-ff7e96092981 service nova] Lock "cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:49.636267 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3197d801-00db-4bc1-a2b1-129b8eb7e99f req-b20bca9d-a23e-46c3-a274-ff7e96092981 service nova] Lock "cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:49.636441 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-3197d801-00db-4bc1-a2b1-129b8eb7e99f req-b20bca9d-a23e-46c3-a274-ff7e96092981 service nova] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] No waiting events found dispatching network-vif-unplugged-42ec1a5e-ce13-4560-b5c1-63316f374ba8 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:05:49.636637 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-3197d801-00db-4bc1-a2b1-129b8eb7e99f req-b20bca9d-a23e-46c3-a274-ff7e96092981 service nova] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Received event network-vif-unplugged-42ec1a5e-ce13-4560-b5c1-63316f374ba8 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:05:49.770728 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0004309149999244255 future=<Future at 0x7c984c401f70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:05:49.771372 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Emitting event <LifecycleEvent: 1779930334.7701337, f4d80e03-89cd-4c85-93c4-442da626393e => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:05:49.771554 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:05:49.771748 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] VM Stopped (Lifecycle Event)
May 28 01:05:49.773223 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=0.09634887099991829 future=<Future at 0x7c984c54ed50 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:05:49.773321 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=0.09623196400025336 future=<Future at 0x7c984c54ed50 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:05:49.777197 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Attempting to attach volume e04c3d46-81b2-492b-a811-117dcf51fc9e with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:05:49.778719 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:05:49.778719 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:05:49.778719 np0000001577 nova-compute[98319]:   <alias name="ua-e04c3d46-81b2-492b-a811-117dcf51fc9e"/>
May 28 01:05:49.778719 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-9"/>
May 28 01:05:49.778719 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:05:49.778719 np0000001577 nova-compute[98319]:   <serial>e04c3d46-81b2-492b-a811-117dcf51fc9e</serial>
May 28 01:05:49.778719 np0000001577 nova-compute[98319]: </disk>
May 28 01:05:49.778719 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:05:49.816202 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:49.844276 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:49.848140 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:49.869893 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00031509000018559163 future=<Future at 0x7c984c54ed50 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:05:49.870018 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:05:49.870063 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=2.857175769999685 future=<Future at 0x7c984c5980e0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:05:49.870156 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=2.8570921440000348 future=<Future at 0x7c984c5980e0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:05:49.870445 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Emitting event <LifecycleEvent: 1779930334.8694994, 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:05:49.870592 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] VM Stopped (Lifecycle Event)
May 28 01:05:49.878559 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:05:49.878698 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:05:49.879080 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:49.879744 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:49.996065 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fbae7974478d45b3908aaaa5b4408e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a430f0d6bcc84a29bc3e96514422896b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:05:50.007504 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Took 1.26 seconds to deallocate network for instance.
May 28 01:05:50.041318 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 req-c787294d-1650-45b8-9267-d0a24229008c service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Received event volume-reimaged-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:50.041506 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 req-c787294d-1650-45b8-9267-d0a24229008c service nova] Acquiring lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:50.041668 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 req-c787294d-1650-45b8-9267-d0a24229008c service nova] Lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:50.041788 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 req-c787294d-1650-45b8-9267-d0a24229008c service nova] Lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:50.043228 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 req-c787294d-1650-45b8-9267-d0a24229008c service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Processing event volume-reimaged-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:05:50.047919 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Instance event wait completed in 10 seconds for volume-reimaged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:05:50.083041 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:50.191954 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:50.195156 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:50.221356 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:50.278870 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-30473e08-6049-4c0b-8d2d-31af0bb5923e tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: f4d80e03-89cd-4c85-93c4-442da626393e] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:50.373049 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 4e846d8c-b8a8-4ecd-9bc6-6d11f8b63789] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:50.382142 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:05:50.517119 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fa7842e-535f-4ef1-9538-d8a06e42a942 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:50.517287 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fa7842e-535f-4ef1-9538-d8a06e42a942 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:50.550223 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Booting with volume b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 at /dev/vda
May 28 01:05:50.591612 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:05:50.601069 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:05:50.625321 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:50.681606 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:05:50.683711 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:05:50.691845 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930350.6911485, 36be2ae9-c375-4335-a421-cf92ea63e489 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:05:50.691845 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] VM Started (Lifecycle Event)
May 28 01:05:50.695756 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:05:50.696706 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe6d:b1ae', 'fe80::9071:84ff:fea9:bd33', 'fe80::fc16:3eff:fe88:7ca', 'fe80::6cd5:f5ff:fe52:2a3e', 'fe80::fc16:3eff:fe49:4d05', 'fe80::e873:f8ff:fed0:1522'] 
May 28 01:05:50.696823 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:05:50.696923 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:05:50.697137 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:05:50.697336 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Updating existing volume attachment record: 32883ea2-c6bd-4334-ad40-7fafa4ce405b {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:05:50.856810 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fa7842e-535f-4ef1-9538-d8a06e42a942 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:05:50.857013 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-3fa7842e-535f-4ef1-9538-d8a06e42a942 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:05:50.884944 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:05:50.916020 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Successfully created port: 64dc43ea-5ef6-44d3-96a1-31e10c8f2416 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:05:51.195664 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:51.198940 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930351.198761, 36be2ae9-c375-4335-a421-cf92ea63e489 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:05:51.199048 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] VM Paused (Lifecycle Event)
May 28 01:05:51.318874 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:51.359729 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-3fa7842e-535f-4ef1-9538-d8a06e42a942 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:05:51.371346 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Successfully updated port: 64dc43ea-5ef6-44d3-96a1-31e10c8f2416 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:05:51.421181 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7742c082-0f5a-4c1a-bfa0-5b3fe1ddacef req-9d24b800-79e3-45f9-bb2c-3fa52404f750 service nova] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Received event network-changed-64dc43ea-5ef6-44d3-96a1-31e10c8f2416 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:51.421534 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7742c082-0f5a-4c1a-bfa0-5b3fe1ddacef req-9d24b800-79e3-45f9-bb2c-3fa52404f750 service nova] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Refreshing instance network info cache due to event network-changed-64dc43ea-5ef6-44d3-96a1-31e10c8f2416. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:05:51.421720 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7742c082-0f5a-4c1a-bfa0-5b3fe1ddacef req-9d24b800-79e3-45f9-bb2c-3fa52404f750 service nova] Acquiring lock "refresh_cache-1c35ef60-298f-47f3-99a0-c9de2bd34c55" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:05:51.421868 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7742c082-0f5a-4c1a-bfa0-5b3fe1ddacef req-9d24b800-79e3-45f9-bb2c-3fa52404f750 service nova] Acquired lock "refresh_cache-1c35ef60-298f-47f3-99a0-c9de2bd34c55" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:05:51.421993 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-7742c082-0f5a-4c1a-bfa0-5b3fe1ddacef req-9d24b800-79e3-45f9-bb2c-3fa52404f750 service nova] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Refreshing network info cache for port 64dc43ea-5ef6-44d3-96a1-31e10c8f2416 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:05:51.492019 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:05:51.492358 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:05:51.492497 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:05:51.492656 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] No VIF found with MAC fa:16:3e:6d:b1:ae, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:05:51.685074 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0cd90007-0b26-48c9-952a-41bc49e82f82 req-0c461576-454c-4cbf-be27-2e7ab4ae81de service nova] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Received event network-vif-plugged-8cf4ac4a-a821-414f-b4c5-cf06d543f090 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:51.685669 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0cd90007-0b26-48c9-952a-41bc49e82f82 req-0c461576-454c-4cbf-be27-2e7ab4ae81de service nova] Acquiring lock "36be2ae9-c375-4335-a421-cf92ea63e489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:51.685825 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0cd90007-0b26-48c9-952a-41bc49e82f82 req-0c461576-454c-4cbf-be27-2e7ab4ae81de service nova] Lock "36be2ae9-c375-4335-a421-cf92ea63e489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:51.686050 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0cd90007-0b26-48c9-952a-41bc49e82f82 req-0c461576-454c-4cbf-be27-2e7ab4ae81de service nova] Lock "36be2ae9-c375-4335-a421-cf92ea63e489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:51.686050 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0cd90007-0b26-48c9-952a-41bc49e82f82 req-0c461576-454c-4cbf-be27-2e7ab4ae81de service nova] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Processing event network-vif-plugged-8cf4ac4a-a821-414f-b4c5-cf06d543f090 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:05:51.686244 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0cd90007-0b26-48c9-952a-41bc49e82f82 req-0c461576-454c-4cbf-be27-2e7ab4ae81de service nova] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Received event network-vif-plugged-8cf4ac4a-a821-414f-b4c5-cf06d543f090 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:51.686304 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0cd90007-0b26-48c9-952a-41bc49e82f82 req-0c461576-454c-4cbf-be27-2e7ab4ae81de service nova] Acquiring lock "36be2ae9-c375-4335-a421-cf92ea63e489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:51.686435 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0cd90007-0b26-48c9-952a-41bc49e82f82 req-0c461576-454c-4cbf-be27-2e7ab4ae81de service nova] Lock "36be2ae9-c375-4335-a421-cf92ea63e489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:51.686972 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:05:51.687168 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0cd90007-0b26-48c9-952a-41bc49e82f82 req-0c461576-454c-4cbf-be27-2e7ab4ae81de service nova] Lock "36be2ae9-c375-4335-a421-cf92ea63e489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:51.687301 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0cd90007-0b26-48c9-952a-41bc49e82f82 req-0c461576-454c-4cbf-be27-2e7ab4ae81de service nova] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] No waiting events found dispatching network-vif-plugged-8cf4ac4a-a821-414f-b4c5-cf06d543f090 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:05:51.687417 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-0cd90007-0b26-48c9-952a-41bc49e82f82 req-0c461576-454c-4cbf-be27-2e7ab4ae81de service nova] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Received unexpected event network-vif-plugged-8cf4ac4a-a821-414f-b4c5-cf06d543f090 for instance with vm_state building and task_state spawning.
May 28 01:05:51.689629 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:05:51.691704 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Instance spawned successfully.
May 28 01:05:51.692059 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:05:51.701090 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:51.702926 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930351.7027416, 36be2ae9-c375-4335-a421-cf92ea63e489 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:05:51.703022 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] VM Resumed (Lifecycle Event)
May 28 01:05:51.868319 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fa7842e-535f-4ef1-9538-d8a06e42a942 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.351s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:51.873382 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "refresh_cache-1c35ef60-298f-47f3-99a0-c9de2bd34c55" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:05:51.892233 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:05:51.893313 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:05:51.893531 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Creating image(s)
May 28 01:05:51.894136 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c35ef60-298f-47f3-99a0-c9de2bd34c55/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:51.894291 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "/opt/stack/data/nova/instances/1c35ef60-298f-47f3-99a0-c9de2bd34c55/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:51.894843 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "/opt/stack/data/nova/instances/1c35ef60-298f-47f3-99a0-c9de2bd34c55/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:51.895377 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:05:51.898695 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:05:51.899916 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:51.922141 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-3fa7842e-535f-4ef1-9538-d8a06e42a942 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Deleted allocations for instance cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba
May 28 01:05:51.928299 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-7742c082-0f5a-4c1a-bfa0-5b3fe1ddacef req-9d24b800-79e3-45f9-bb2c-3fa52404f750 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:51.987806 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-7742c082-0f5a-4c1a-bfa0-5b3fe1ddacef req-9d24b800-79e3-45f9-bb2c-3fa52404f750 service nova] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:05:51.990224 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:51.990762 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:51.991816 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:51.991892 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:05:51.995614 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:05:51.996983 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:52.094096 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.097s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:52.094472 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/1c35ef60-298f-47f3-99a0-c9de2bd34c55/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:52.168835 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/1c35ef60-298f-47f3-99a0-c9de2bd34c55/disk 1073741824" returned: 0 in 0.074s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:52.169399 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.178s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:52.169743 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:52.209112 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:52.213625 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-7742c082-0f5a-4c1a-bfa0-5b3fe1ddacef req-9d24b800-79e3-45f9-bb2c-3fa52404f750 service nova] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:05:52.217180 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:52.218893 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:05:52.221242 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:52.221242 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:52.221242 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:52.221510 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:52.223967 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:52.273479 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.104s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:52.274045 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c35ef60-298f-47f3-99a0-c9de2bd34c55/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:05:52.274369 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c35ef60-298f-47f3-99a0-c9de2bd34c55/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:52.381304 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c35ef60-298f-47f3-99a0-c9de2bd34c55/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:52.381745 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Cannot resize image /opt/stack/data/nova/instances/1c35ef60-298f-47f3-99a0-c9de2bd34c55/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:05:52.381941 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:05:52.382083 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Ensure instance console log exists: /opt/stack/data/nova/instances/1c35ef60-298f-47f3-99a0-c9de2bd34c55/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:05:52.382370 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:52.382575 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:52.382718 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:52.716688 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7742c082-0f5a-4c1a-bfa0-5b3fe1ddacef req-9d24b800-79e3-45f9-bb2c-3fa52404f750 service nova] Releasing lock "refresh_cache-1c35ef60-298f-47f3-99a0-c9de2bd34c55" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:05:52.718411 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquired lock "refresh_cache-1c35ef60-298f-47f3-99a0-c9de2bd34c55" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:05:52.718411 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:05:52.722851 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:05:52.728152 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00052466600027401 future=<Future at 0x7c984c5980e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:05:52.728152 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:05:52.728152 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=9.990029870999933 future=<Future at 0x7c987047ae40 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:05:52.728152 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=9.98994420300005 future=<Future at 0x7c987047ae40 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:05:52.728560 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] Emitting event <LifecycleEvent: 1779930337.7271218, d5aa4bd8-07f0-4329-88d3-63aa5a2be798 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:05:52.728758 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] VM Stopped (Lifecycle Event)
May 28 01:05:52.735734 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Took 10.12 seconds to spawn the instance on the hypervisor.
May 28 01:05:52.735734 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:52.803942 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:05:52.804194 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Creating image(s)
May 28 01:05:52.804503 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:05:52.810707 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Ensure instance console log exists: /opt/stack/data/nova/instances/d5aa4bd8-07f0-4329-88d3-63aa5a2be798/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:05:52.810981 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:52.811168 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:52.811332 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:52.812004 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Start _get_guest_xml network_info=[{"id": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "address": "fa:16:3e:a0:66:8f", "network": {"id": "330f1ba8-b51a-4cb7-8596-73705ae8eecd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-493364840-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed67ebc30b04fe5895f2b2ddd66e9c3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe5497e-7f", "ovs_interfaceid": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-28T00:54:52Z,direct_url=<?>,disk_format='qcow2',id=5574e7a7-cbb4-4ae2-8b7f-aa34fd051b87,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-28T00:54:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'd5aa4bd8-07f0-4329-88d3-63aa5a2be798', 'attached_at': '', 'detached_at': '', 'volume_id': 'b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'serial': 'b5c97cc4-39c3-49cb-a29f-3e7350d6fc46'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '32883ea2-c6bd-4334-ad40-7fafa4ce405b', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:05:52.819193 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
May 28 01:05:52.820679 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='5574e7a7-cbb4-4ae2-8b7f-aa34fd051b87', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-192077429', uuid='d5aa4bd8-07f0-4329-88d3-63aa5a2be798'), owner=OwnerMeta(userid='5211ae90fcf1476b917822f860021f1b', username='tempest-ServerActionsV293TestJSON-1502319923-project-member', projectid='8ed67ebc30b04fe5895f2b2ddd66e9c3', projectname='tempest-ServerActionsV293TestJSON-1502319923'), image=ImageMeta(id='', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "address": "fa:16:3e:a0:66:8f", "network": {"id": "330f1ba8-b51a-4cb7-8596-73705ae8eecd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-493364840-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed67ebc30b04fe5895f2b2ddd66e9c3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe5497e-7f", "ovs_interfaceid": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930352.8202386) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:05:52.822796 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:05:52.823177 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:05:52.826080 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:05:52.826301 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:05:52.827386 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:05:52.827784 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-28T00:54:52Z,direct_url=<?>,disk_format='qcow2',id=5574e7a7-cbb4-4ae2-8b7f-aa34fd051b87,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-28T00:54:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:05:52.827953 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:05:52.828065 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:05:52.828211 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:05:52.828333 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:05:52.828450 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:05:52.828646 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:05:52.828774 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:05:52.828911 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:05:52.829038 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:05:52.829184 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:05:52.829375 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lazy-loading 'vcpu_model' on Instance uuid d5aa4bd8-07f0-4329-88d3-63aa5a2be798 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:05:52.938987 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fa7842e-535f-4ef1-9538-d8a06e42a942 tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Lock "cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.047s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:53.063204 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-18fe7fab-a756-44a7-aea6-5f8926b0266c tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.566s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:53.231957 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a996b01-63b4-4b07-b169-c8f369755aaf tempest-ServersNegativeTestJSON-811169851 tempest-ServersNegativeTestJSON-811169851-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:53.234339 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:53.250747 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f55abad9-177f-4ac3-a1c4-65267df8bd85 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:53.253942 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f55abad9-177f-4ac3-a1c4-65267df8bd85 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:53.254117 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f55abad9-177f-4ac3-a1c4-65267df8bd85 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:53.254271 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f55abad9-177f-4ac3-a1c4-65267df8bd85 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:53.254374 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f55abad9-177f-4ac3-a1c4-65267df8bd85 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:53.256491 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Took 17.30 seconds to build instance.
May 28 01:05:53.259850 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-f55abad9-177f-4ac3-a1c4-65267df8bd85 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Terminating instance
May 28 01:05:53.293715 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:05:53.344566 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:05:53.344844 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:05:53.344998 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:05:53.345391 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:05:53.345562 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:05:53.358328 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:05:53.359298 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:05:53.359709 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:05:53.359913 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:05:53.361044 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:05:53.361226 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:05:53.379876 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:05:53.379876 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:53.388572 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:05:53.388572 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:53.395108 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46] added
May 28 01:05:53.395108 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:05:53.395108 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:05:53.395108 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:05:53.395108 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:05:53.395108 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:05:53.395108 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:53.395420 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:05:53.395777 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0357(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:05:53.396029 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:05:53.399251 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46] added
May 28 01:05:53.399251 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:05:53.399251 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:05:53.399251 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:05:53.399251 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:05:53.399251 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:05:53.399251 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:53.399251 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:05:53.399251 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0379(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:05:53.399501 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:05:53.543906 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:53.761219 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "36be2ae9-c375-4335-a421-cf92ea63e489" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.815s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:53.767912 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-f55abad9-177f-4ac3-a1c4-65267df8bd85 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:05:53.795443 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:53.825716 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:53.858046 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:53.866198 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Acquiring lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:53.866297 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:53.937808 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:53.985149 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Updating instance_info_cache with network_info: [{"id": "64dc43ea-5ef6-44d3-96a1-31e10c8f2416", "address": "fa:16:3e:90:82:0c", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64dc43ea-5e", "ovs_interfaceid": "64dc43ea-5ef6-44d3-96a1-31e10c8f2416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:05:54.025789 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5b6f612c-d0cb-40a0-9a6b-4be0cc5466d3 req-8c449c90-053f-4bec-b304-61bccce476ec service nova] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Received event network-changed-8cf4ac4a-a821-414f-b4c5-cf06d543f090 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:54.027594 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5b6f612c-d0cb-40a0-9a6b-4be0cc5466d3 req-8c449c90-053f-4bec-b304-61bccce476ec service nova] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Refreshing instance network info cache due to event network-changed-8cf4ac4a-a821-414f-b4c5-cf06d543f090. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:05:54.027948 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5b6f612c-d0cb-40a0-9a6b-4be0cc5466d3 req-8c449c90-053f-4bec-b304-61bccce476ec service nova] Acquiring lock "refresh_cache-36be2ae9-c375-4335-a421-cf92ea63e489" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:05:54.028043 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5b6f612c-d0cb-40a0-9a6b-4be0cc5466d3 req-8c449c90-053f-4bec-b304-61bccce476ec service nova] Acquired lock "refresh_cache-36be2ae9-c375-4335-a421-cf92ea63e489" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:05:54.028151 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-5b6f612c-d0cb-40a0-9a6b-4be0cc5466d3 req-8c449c90-053f-4bec-b304-61bccce476ec service nova] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Refreshing network info cache for port 8cf4ac4a-a821-414f-b4c5-cf06d543f090 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:05:54.068981 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:54.078573 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:54.101955 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-3d77d2ae-43b6-4e44-a047-243c10d592c3 req-190b3381-b3c5-4c12-a1f1-4add979df2ef service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Received event network-vif-unplugged-53846e61-8840-490f-a976-3997db8a0f0b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:54.103023 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999074586999996 future=<Future at 0x7c98705b6120 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:05:54.103725 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3d77d2ae-43b6-4e44-a047-243c10d592c3 req-190b3381-b3c5-4c12-a1f1-4add979df2ef service nova] Acquiring lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:54.103725 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3d77d2ae-43b6-4e44-a047-243c10d592c3 req-190b3381-b3c5-4c12-a1f1-4add979df2ef service nova] Lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:54.103725 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3d77d2ae-43b6-4e44-a047-243c10d592c3 req-190b3381-b3c5-4c12-a1f1-4add979df2ef service nova] Lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:54.103725 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-3d77d2ae-43b6-4e44-a047-243c10d592c3 req-190b3381-b3c5-4c12-a1f1-4add979df2ef service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] No waiting events found dispatching network-vif-unplugged-53846e61-8840-490f-a976-3997db8a0f0b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:05:54.103725 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-3d77d2ae-43b6-4e44-a047-243c10d592c3 req-190b3381-b3c5-4c12-a1f1-4add979df2ef service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Received event network-vif-unplugged-53846e61-8840-490f-a976-3997db8a0f0b for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:05:54.105560 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Instance destroyed successfully.
May 28 01:05:54.105939 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-f55abad9-177f-4ac3-a1c4-65267df8bd85 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lazy-loading 'resources' on Instance uuid 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:05:54.370968 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lazy-loading 'flavor' on Instance uuid 4fb6dc75-4a06-45ea-a050-4ddcd55e8559 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:05:54.396536 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:05:54.400689 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:05:54.414522 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:05:54.414522 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:05:54.416982 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:05:54.416982 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:54.427332 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:54.431598 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:54.443703 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:54.443703 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:54.443703 np0000001577 nova-compute[98319]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:05:54.443703 np0000001577 nova-compute[98319]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:05:54.443703 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:54.443703 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:54.443703 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:05:54.443917 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:54.443917 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:54.443917 np0000001577 nova-compute[98319]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:05:54.443917 np0000001577 nova-compute[98319]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:05:54.443917 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:54.443917 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:54.443917 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:05:54.447866 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:54.447866 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:54.447866 np0000001577 nova-compute[98319]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:05:54.447866 np0000001577 nova-compute[98319]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:05:54.447866 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:54.447866 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:54.447866 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:05:54.448041 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:54.448041 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:54.448041 np0000001577 nova-compute[98319]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:05:54.448041 np0000001577 nova-compute[98319]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:05:54.448041 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:54.448041 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:54.448041 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:05:54.488640 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Releasing lock "refresh_cache-1c35ef60-298f-47f3-99a0-c9de2bd34c55" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:05:54.488894 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Instance network_info: |[{"id": "64dc43ea-5ef6-44d3-96a1-31e10c8f2416", "address": "fa:16:3e:90:82:0c", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64dc43ea-5e", "ovs_interfaceid": "64dc43ea-5ef6-44d3-96a1-31e10c8f2416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:05:54.491111 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Start _get_guest_xml network_info=[{"id": "64dc43ea-5ef6-44d3-96a1-31e10c8f2416", "address": "fa:16:3e:90:82:0c", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64dc43ea-5e", "ovs_interfaceid": "64dc43ea-5ef6-44d3-96a1-31e10c8f2416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:05:54.491111 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46, portal: 192.168.40.100,3260]
May 28 01:05:54.491111 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46, portal: 192.168.40.100,3260] successful.
May 28 01:05:54.491111 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:54.492435 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:05:54.493859 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1327442409', uuid='1c35ef60-298f-47f3-99a0-c9de2bd34c55'), owner=OwnerMeta(userid='fbae7974478d45b3908aaaa5b4408e26', username='tempest-TestEncryptedCinderVolumes-2086871542-project-member', projectid='a430f0d6bcc84a29bc3e96514422896b', projectname='tempest-TestEncryptedCinderVolumes-2086871542'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "64dc43ea-5ef6-44d3-96a1-31e10c8f2416", "address": "fa:16:3e:90:82:0c", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64dc43ea-5e", "ovs_interfaceid": "64dc43ea-5ef6-44d3-96a1-31e10c8f2416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930354.4931042) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:05:54.495672 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:05:54.495672 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:05:54.495672 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:05:54.495672 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:05:54.496075 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:05:54.496359 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:05:54.496612 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:05:54.496675 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:05:54.496962 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:05:54.496962 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:05:54.496962 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:05:54.497131 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:05:54.497131 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:05:54.497225 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:05:54.497371 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:05:54.497519 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:05:54.504047 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:54.507416 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:05:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1327442409',display_name='tempest-TestEncryptedCinderVolumes-server-1327442409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testencryptedcindervolumes-server-1327442409',id=49,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSDSzGPeJZW05QcfiGV7kaIKUfndYJb64/RkBtVCAGwgL/F0R5ngZhEMPuPKF5GFUpuUWmT2zCg9hiW3u7uzagC5o8wgnbO21bK2+IoijzJglvfNeZV91xl5oHSxbvUjQ==',key_name='tempest-keypair-1056334667',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a430f0d6bcc84a29bc3e96514422896b',ramdisk_id='',reservation_id='r-9zov6z1d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-2086871542',owner_user_name='tempest-TestEncryptedCinderVolumes-2086871542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:05:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbae7974478d45b3908aaaa5b4408e26',uuid=1c35ef60-298f-47f3-99a0-c9de2bd34c55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64dc43ea-5ef6-44d3-96a1-31e10c8f2416", "address": "fa:16:3e:90:82:0c", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64dc43ea-5e", "ovs_interfaceid": "64dc43ea-5ef6-44d3-96a1-31e10c8f2416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:05:54.508293 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converting VIF {"id": "64dc43ea-5ef6-44d3-96a1-31e10c8f2416", "address": "fa:16:3e:90:82:0c", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64dc43ea-5e", "ovs_interfaceid": "64dc43ea-5ef6-44d3-96a1-31e10c8f2416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:05:54.508293 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:82:0c,bridge_name='br-int',has_traffic_filtering=True,id=64dc43ea-5ef6-44d3-96a1-31e10c8f2416,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64dc43ea-5e') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:05:54.508695 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c35ef60-298f-47f3-99a0-c9de2bd34c55 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:05:54.510013 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46, portal: 192.168.50.100,3260]
May 28 01:05:54.510013 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46, portal: 192.168.50.100,3260] successful.
May 28 01:05:54.510013 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:54.523980 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:54.526759 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:54.526759 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:54.526759 np0000001577 nova-compute[98319]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:05:54.526759 np0000001577 nova-compute[98319]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:05:54.526759 np0000001577 nova-compute[98319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:54.526759 np0000001577 nova-compute[98319]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:54.526759 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:54.526759 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:54.526759 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:05:54.526759 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:54.526759 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:54.526759 np0000001577 nova-compute[98319]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:05:54.526759 np0000001577 nova-compute[98319]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:05:54.526759 np0000001577 nova-compute[98319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:54.526759 np0000001577 nova-compute[98319]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:54.526759 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:54.526759 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:54.526759 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:05:54.526759 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.166s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:05:54.526759 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:05:54.527358 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] HCTL ('9', '-', '-', 0) found on session 106 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:05:54.527358 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:05:54.530734 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-5b6f612c-d0cb-40a0-9a6b-4be0cc5466d3 req-8c449c90-053f-4bec-b304-61bccce476ec service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:54.544589 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Searching for a device in session 106 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:05:54.544589 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:05:54.546883 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:54.546883 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:54.546883 np0000001577 nova-compute[98319]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:05:54.546883 np0000001577 nova-compute[98319]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:05:54.546883 np0000001577 nova-compute[98319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:54.546883 np0000001577 nova-compute[98319]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:54.546883 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:54.546883 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:54.546883 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:05:54.547103 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:54.547103 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:05:54.547103 np0000001577 nova-compute[98319]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:05:54.547103 np0000001577 nova-compute[98319]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:05:54.547103 np0000001577 nova-compute[98319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:54.547103 np0000001577 nova-compute[98319]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:05:54.547103 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:54.547103 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:05:54.547103 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:05:54.547301 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.186s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:05:54.547422 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:05:54.548387 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] HCTL ('10', '-', '-', 0) found on session 107 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:05:54.548528 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:05:54.562125 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Searching for a device in session 107 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:05:54.562125 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:05:54.611705 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-f55abad9-177f-4ac3-a1c4-65267df8bd85 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T01:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1328136978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumeshelvetestjson-server-1328136978',id=39,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwo7eu98M2lVJQz8v1lXS5seW0IzErKTm9jX0nEiUnke3eatP2nV5nyO/xoWW2Z6G175w5hkAxX1GDoRpaCGgexCFYaPFf5tCq63oY84sMYbDC7Go75ObhV5XSZRVJ03w==',key_name='tempest-keypair-866036055',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:05:14Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6a7090a79f448f3abe4737bf127df53',ramdisk_id='',reservation_id='r-wfzqk2ne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1260503814',owner_user_name='tempest-AttachVolumeShelveTestJSON-1260503814-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:05:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d375089981f8493598b33c4b6f122374',uuid=2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53846e61-8840-490f-a976-3997db8a0f0b", "address": "fa:16:3e:88:07:ca", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53846e61-88", "ovs_interfaceid": "53846e61-8840-490f-a976-3997db8a0f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:05:54.611943 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f55abad9-177f-4ac3-a1c4-65267df8bd85 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Converting VIF {"id": "53846e61-8840-490f-a976-3997db8a0f0b", "address": "fa:16:3e:88:07:ca", "network": {"id": "e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1604925087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f6a7090a79f448f3abe4737bf127df53", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53846e61-88", "ovs_interfaceid": "53846e61-8840-490f-a976-3997db8a0f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:05:54.612464 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f55abad9-177f-4ac3-a1c4-65267df8bd85 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:07:ca,bridge_name='br-int',has_traffic_filtering=True,id=53846e61-8840-490f-a976-3997db8a0f0b,network=Network(e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53846e61-88') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:05:54.612762 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-f55abad9-177f-4ac3-a1c4-65267df8bd85 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:07:ca,bridge_name='br-int',has_traffic_filtering=True,id=53846e61-8840-490f-a976-3997db8a0f0b,network=Network(e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53846e61-88') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:05:54.614508 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:54.614780 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53846e61-88, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:54.617538 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:05:54.621086 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:54.621188 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f43709ba-455f-4f52-8fe5-fd1e6f408a18) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:54.622660 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:54.624535 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:05:54.626074 np0000001577 nova-compute[98319]: INFO os_vif [None req-f55abad9-177f-4ac3-a1c4-65267df8bd85 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:07:ca,bridge_name='br-int',has_traffic_filtering=True,id=53846e61-8840-490f-a976-3997db8a0f0b,network=Network(e4f3fefe-ce47-45d8-b7c6-efa87b3e7c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53846e61-88')
May 28 01:05:54.626416 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f55abad9-177f-4ac3-a1c4-65267df8bd85 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Deleting instance files /opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e_del
May 28 01:05:54.637202 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f55abad9-177f-4ac3-a1c4-65267df8bd85 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Deletion of /opt/stack/data/nova/instances/2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e_del complete
May 28 01:05:54.853650 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-5b6f612c-d0cb-40a0-9a6b-4be0cc5466d3 req-8c449c90-053f-4bec-b304-61bccce476ec service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:54.986987 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-5b6f612c-d0cb-40a0-9a6b-4be0cc5466d3 req-8c449c90-053f-4bec-b304-61bccce476ec service nova] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Updated VIF entry in instance network info cache for port 8cf4ac4a-a821-414f-b4c5-cf06d543f090. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:05:54.987300 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-5b6f612c-d0cb-40a0-9a6b-4be0cc5466d3 req-8c449c90-053f-4bec-b304-61bccce476ec service nova] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Updating instance_info_cache with network_info: [{"id": "8cf4ac4a-a821-414f-b4c5-cf06d543f090", "address": "fa:16:3e:49:4d:05", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf4ac4a-a8", "ovs_interfaceid": "8cf4ac4a-a821-414f-b4c5-cf06d543f090", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:05:55.015442 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] End _get_guest_xml xml=<domain type="qemu">
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:   <uuid>1c35ef60-298f-47f3-99a0-c9de2bd34c55</uuid>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:   <name>instance-00000031</name>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1327442409</nova:name>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:05:54</nova:creationTime>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:         <nova:user uuid="fbae7974478d45b3908aaaa5b4408e26">tempest-TestEncryptedCinderVolumes-2086871542-project-member</nova:user>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:         <nova:project uuid="a430f0d6bcc84a29bc3e96514422896b">tempest-TestEncryptedCinderVolumes-2086871542</nova:project>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:         <nova:port uuid="64dc43ea-5ef6-44d3-96a1-31e10c8f2416">
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:     <system>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       <entry name="serial">1c35ef60-298f-47f3-99a0-c9de2bd34c55</entry>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       <entry name="uuid">1c35ef60-298f-47f3-99a0-c9de2bd34c55</entry>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:     </system>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:   <os>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:   </os>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:   <features>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:   </features>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:   <devices>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/1c35ef60-298f-47f3-99a0-c9de2bd34c55/disk"/>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:     </disk>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/1c35ef60-298f-47f3-99a0-c9de2bd34c55/disk.config"/>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:     </disk>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:90:82:0c"/>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       <target dev="tap64dc43ea-5e"/>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:     </interface>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/1c35ef60-298f-47f3-99a0-c9de2bd34c55/console.log" append="off"/>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:     </serial>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:     <video>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:     </video>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:     </rng>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:   </devices>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]: </domain>
May 28 01:05:55.015442 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:05:55.018264 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Preparing to wait for external event network-vif-plugged-64dc43ea-5ef6-44d3-96a1-31e10c8f2416 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:05:55.018264 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "1c35ef60-298f-47f3-99a0-c9de2bd34c55-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:55.018264 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "1c35ef60-298f-47f3-99a0-c9de2bd34c55-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:55.018264 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "1c35ef60-298f-47f3-99a0-c9de2bd34c55-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:55.018264 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:05:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1327442409',display_name='tempest-TestEncryptedCinderVolumes-server-1327442409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testencryptedcindervolumes-server-1327442409',id=49,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSDSzGPeJZW05QcfiGV7kaIKUfndYJb64/RkBtVCAGwgL/F0R5ngZhEMPuPKF5GFUpuUWmT2zCg9hiW3u7uzagC5o8wgnbO21bK2+IoijzJglvfNeZV91xl5oHSxbvUjQ==',key_name='tempest-keypair-1056334667',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a430f0d6bcc84a29bc3e96514422896b',ramdisk_id='',reservation_id='r-9zov6z1d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-2086871542',owner_user_name='tempest-TestEncryptedCinderVolumes-2086871542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:05:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbae7974478d45b3908aaaa5b4408e26',uuid=1c35ef60-298f-47f3-99a0-c9de2bd34c55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64dc43ea-5ef6-44d3-96a1-31e10c8f2416", "address": "fa:16:3e:90:82:0c", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64dc43ea-5e", "ovs_interfaceid": "64dc43ea-5ef6-44d3-96a1-31e10c8f2416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:05:55.018264 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converting VIF {"id": "64dc43ea-5ef6-44d3-96a1-31e10c8f2416", "address": "fa:16:3e:90:82:0c", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64dc43ea-5e", "ovs_interfaceid": "64dc43ea-5ef6-44d3-96a1-31e10c8f2416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:05:55.018979 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:82:0c,bridge_name='br-int',has_traffic_filtering=True,id=64dc43ea-5ef6-44d3-96a1-31e10c8f2416,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64dc43ea-5e') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:05:55.019732 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:82:0c,bridge_name='br-int',has_traffic_filtering=True,id=64dc43ea-5ef6-44d3-96a1-31e10c8f2416,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64dc43ea-5e') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:05:55.020241 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:55.020525 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:55.020721 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:05:55.021341 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:55.021606 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48cb26fe-5a36-5fc5-a70c-f18531e7684d', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:55.022227 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:55.022899 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:05:55.023843 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:55.025666 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:55.025790 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64dc43ea-5e, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:55.026064 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64dc43ea-5e, col_values=(('qos', UUID('7c03c126-d8dc-40e5-8a39-8a95ddcc0ecd')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:55.026210 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64dc43ea-5e, col_values=(('external_ids', {'iface-id': '64dc43ea-5ef6-44d3-96a1-31e10c8f2416', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:82:0c', 'vm-uuid': '1c35ef60-298f-47f3-99a0-c9de2bd34c55'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:55.026876 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:55.029795 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:05:55.035681 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:55.036427 np0000001577 nova-compute[98319]: INFO os_vif [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:82:0c,bridge_name='br-int',has_traffic_filtering=True,id=64dc43ea-5ef6-44d3-96a1-31e10c8f2416,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64dc43ea-5e')
May 28 01:05:55.142329 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-f55abad9-177f-4ac3-a1c4-65267df8bd85 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Took 1.37 seconds to destroy the instance on the hypervisor.
May 28 01:05:55.142825 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-f55abad9-177f-4ac3-a1c4-65267df8bd85 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:05:55.143111 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:05:55.143190 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:05:55.143826 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:55.255594 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:55.360580 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:05:55.381976 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:55.489136 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5b6f612c-d0cb-40a0-9a6b-4be0cc5466d3 req-8c449c90-053f-4bec-b304-61bccce476ec service nova] Releasing lock "refresh_cache-36be2ae9-c375-4335-a421-cf92ea63e489" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:05:56.155786 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:05:56.221172 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-881ae1ff-2c20-4fc8-9254-a8838a789451 req-36c43abe-f9d3-4f2d-bcb6-e22ad76643d2 service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Received event network-vif-unplugged-53846e61-8840-490f-a976-3997db8a0f0b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:56.221539 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-881ae1ff-2c20-4fc8-9254-a8838a789451 req-36c43abe-f9d3-4f2d-bcb6-e22ad76643d2 service nova] Acquiring lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:56.221693 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-881ae1ff-2c20-4fc8-9254-a8838a789451 req-36c43abe-f9d3-4f2d-bcb6-e22ad76643d2 service nova] Lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:56.221795 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-881ae1ff-2c20-4fc8-9254-a8838a789451 req-36c43abe-f9d3-4f2d-bcb6-e22ad76643d2 service nova] Lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:56.221904 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-881ae1ff-2c20-4fc8-9254-a8838a789451 req-36c43abe-f9d3-4f2d-bcb6-e22ad76643d2 service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] No waiting events found dispatching network-vif-unplugged-53846e61-8840-490f-a976-3997db8a0f0b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:05:56.222130 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-881ae1ff-2c20-4fc8-9254-a8838a789451 req-36c43abe-f9d3-4f2d-bcb6-e22ad76643d2 service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Received event network-vif-unplugged-53846e61-8840-490f-a976-3997db8a0f0b for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:05:56.222130 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-881ae1ff-2c20-4fc8-9254-a8838a789451 req-36c43abe-f9d3-4f2d-bcb6-e22ad76643d2 service nova] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Received event network-vif-deleted-53846e61-8840-490f-a976-3997db8a0f0b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:56.321051 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:56.378466 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Found WWN 33000000034067dfc for multipath device dm-3 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:05:56.378745 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:05:56.378916 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '33000000034067dfc', 'path': '/dev/dm-3', 'multipath_id': '33000000034067dfc'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:05:56.379040 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000034067dfc', 'path': '/dev/dm-3', 'multipath_id': '33000000034067dfc'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:05:56.448040 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Acquiring lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:56.448182 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:56.448361 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Attaching volume 8de1def3-320b-432b-99e0-674e18b4c68b to /dev/vdc
May 28 01:05:56.493359 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:05:56.503236 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:05:56.520716 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:56.556564 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:05:56.556745 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:05:56.556819 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] No VIF found with MAC fa:16:3e:90:82:0c, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:05:56.557428 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Using config drive
May 28 01:05:56.559691 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:05:56.560039 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:05:56.566997 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:05:56.567882 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe6d:b1ae', 'fe80::9071:84ff:fea9:bd33', 'fe80::fc16:3eff:fe49:4d05', 'fe80::e873:f8ff:fed0:1522'] 
May 28 01:05:56.568023 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:05:56.568150 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:05:56.568446 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] <== get_connector_properties: return (74ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:05:56.568686 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Updating existing volume attachment record: ffbf3c77-9923-49d5-a3fa-ad2250dfd3b6 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:05:56.659766 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Took 1.52 seconds to deallocate network for instance.
May 28 01:05:56.883791 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T01:04:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-192077429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serveractionsv293testjson-server-417111260',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZCISJi6nlA4mDzDOiuCg9487tvddGj6j0Jn9d1BsbnnHFEGFqQb7Xhz7pIcCKtGhPE7XNyy3CeMbSPQsZu+OlSGdWSFk970ycf5MTngHfj4cd5ACI067WxxJTu4s1avA==',key_name='tempest-keypair-1686283236',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:04:56Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8ed67ebc30b04fe5895f2b2ddd66e9c3',ramdisk_id='',reservation_id='r-ue5gqdd9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5574e7a7-cbb4-4ae2-8b7f-aa34fd051b87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1502319923',owner_user_name='tempest-ServerActionsV293TestJSON-1502319923-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:05:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5211ae90fcf1476b917822f860021f1b',uuid=d5aa4bd8-07f0-4329-88d3-63aa5a2be798,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "address": "fa:16:3e:a0:66:8f", "network": {"id": "330f1ba8-b51a-4cb7-8596-73705ae8eecd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-493364840-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed67ebc30b04fe5895f2b2ddd66e9c3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe5497e-7f", "ovs_interfaceid": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:05:56.884029 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Converting VIF {"id": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "address": "fa:16:3e:a0:66:8f", "network": {"id": "330f1ba8-b51a-4cb7-8596-73705ae8eecd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-493364840-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed67ebc30b04fe5895f2b2ddd66e9c3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe5497e-7f", "ovs_interfaceid": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:05:56.884563 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:66:8f,bridge_name='br-int',has_traffic_filtering=True,id=0fe5497e-7f98-48c5-89d4-5168815ab9c1,network=Network(330f1ba8-b51a-4cb7-8596-73705ae8eecd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe5497e-7f') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:05:56.885903 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] End _get_guest_xml xml=<domain type="qemu">
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:   <uuid>d5aa4bd8-07f0-4329-88d3-63aa5a2be798</uuid>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:   <name>instance-0000002a</name>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       <nova:name>tempest-ServerActionsV293TestJSON-server-192077429</nova:name>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:05:52</nova:creationTime>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       <nova:image uuid="5574e7a7-cbb4-4ae2-8b7f-aa34fd051b87">
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:         <nova:user uuid="5211ae90fcf1476b917822f860021f1b">tempest-ServerActionsV293TestJSON-1502319923-project-member</nova:user>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:         <nova:project uuid="8ed67ebc30b04fe5895f2b2ddd66e9c3">tempest-ServerActionsV293TestJSON-1502319923</nova:project>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       <nova:root type="volume" uuid="5574e7a7-cbb4-4ae2-8b7f-aa34fd051b87"/>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:         <nova:port uuid="0fe5497e-7f98-48c5-89d4-5168815ab9c1">
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:     <system>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       <entry name="serial">d5aa4bd8-07f0-4329-88d3-63aa5a2be798</entry>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       <entry name="uuid">d5aa4bd8-07f0-4329-88d3-63aa5a2be798</entry>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:     </system>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:   <os>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:   </os>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:   <features>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:   </features>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:   <devices>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/d5aa4bd8-07f0-4329-88d3-63aa5a2be798/disk.config"/>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:     </disk>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       <alias name="ua-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46"/>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-3"/>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       <serial>b5c97cc4-39c3-49cb-a29f-3e7350d6fc46</serial>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:     </disk>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:a0:66:8f"/>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       <target dev="tap0fe5497e-7f"/>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:     </interface>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/d5aa4bd8-07f0-4329-88d3-63aa5a2be798/console.log" append="off"/>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:     </serial>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:     <video>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:     </video>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:     </rng>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:   </devices>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]: </domain>
May 28 01:05:56.885903 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:05:56.888396 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T01:04:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-192077429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serveractionsv293testjson-server-417111260',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZCISJi6nlA4mDzDOiuCg9487tvddGj6j0Jn9d1BsbnnHFEGFqQb7Xhz7pIcCKtGhPE7XNyy3CeMbSPQsZu+OlSGdWSFk970ycf5MTngHfj4cd5ACI067WxxJTu4s1avA==',key_name='tempest-keypair-1686283236',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:04:56Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8ed67ebc30b04fe5895f2b2ddd66e9c3',ramdisk_id='',reservation_id='r-ue5gqdd9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5574e7a7-cbb4-4ae2-8b7f-aa34fd051b87',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1502319923',owner_user_name='tempest-ServerActionsV293TestJSON-1502319923-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:05:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5211ae90fcf1476b917822f860021f1b',uuid=d5aa4bd8-07f0-4329-88d3-63aa5a2be798,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "address": "fa:16:3e:a0:66:8f", "network": {"id": "330f1ba8-b51a-4cb7-8596-73705ae8eecd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-493364840-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed67ebc30b04fe5895f2b2ddd66e9c3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe5497e-7f", "ovs_interfaceid": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:05:56.888396 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Converting VIF {"id": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "address": "fa:16:3e:a0:66:8f", "network": {"id": "330f1ba8-b51a-4cb7-8596-73705ae8eecd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-493364840-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed67ebc30b04fe5895f2b2ddd66e9c3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe5497e-7f", "ovs_interfaceid": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:05:56.888396 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:66:8f,bridge_name='br-int',has_traffic_filtering=True,id=0fe5497e-7f98-48c5-89d4-5168815ab9c1,network=Network(330f1ba8-b51a-4cb7-8596-73705ae8eecd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe5497e-7f') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:05:56.888396 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:66:8f,bridge_name='br-int',has_traffic_filtering=True,id=0fe5497e-7f98-48c5-89d4-5168815ab9c1,network=Network(330f1ba8-b51a-4cb7-8596-73705ae8eecd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe5497e-7f') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:05:56.888396 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:56.888396 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:56.888396 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:05:56.888801 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:56.888959 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '267793bf-96ea-558d-a838-4def5ff4a369', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:56.889663 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:56.890241 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:05:56.894358 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:56.896053 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:56.896141 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0fe5497e-7f, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:56.896415 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0fe5497e-7f, col_values=(('qos', UUID('205eac0b-606b-4fd8-9e0d-5029ab5dec15')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:56.896556 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0fe5497e-7f, col_values=(('external_ids', {'iface-id': '0fe5497e-7f98-48c5-89d4-5168815ab9c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:66:8f', 'vm-uuid': 'd5aa4bd8-07f0-4329-88d3-63aa5a2be798'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:05:56.897146 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:56.898105 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:05:56.904636 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:56.905475 np0000001577 nova-compute[98319]: INFO os_vif [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:66:8f,bridge_name='br-int',has_traffic_filtering=True,id=0fe5497e-7f98-48c5-89d4-5168815ab9c1,network=Network(330f1ba8-b51a-4cb7-8596-73705ae8eecd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe5497e-7f')
May 28 01:05:57.063445 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:05:57.112101 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:05:57.112456 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b', 'iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8de1def3-320b-432b-99e0-674e18b4c68b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:05:57.112602 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:05:57.165716 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Creating config drive at /opt/stack/data/nova/instances/1c35ef60-298f-47f3-99a0-c9de2bd34c55/disk.config
May 28 01:05:57.167110 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f55abad9-177f-4ac3-a1c4-65267df8bd85 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:57.167336 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f55abad9-177f-4ac3-a1c4-65267df8bd85 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:57.173230 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1c35ef60-298f-47f3-99a0-c9de2bd34c55/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9b1okg1d {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:05:57.226564 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1c35ef60-298f-47f3-99a0-c9de2bd34c55/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9b1okg1d" returned: 0 in 0.053s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:05:57.434945 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f55abad9-177f-4ac3-a1c4-65267df8bd85 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:05:57.435157 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-f55abad9-177f-4ac3-a1c4-65267df8bd85 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:05:57.662912 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:57.698857 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:57.699688 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:57.806650 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:57.937993 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-f55abad9-177f-4ac3-a1c4-65267df8bd85 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:05:58.005234 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:58.010703 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:58.012773 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:58.038898 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:58.045142 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:05:58.286120 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-98beced5-f577-4e97-9430-2f528d1ba733 req-1ce736d2-11e5-4dd1-bcc9-dc64c5f2534e service nova] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Received event network-vif-plugged-64dc43ea-5ef6-44d3-96a1-31e10c8f2416 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:58.286366 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-98beced5-f577-4e97-9430-2f528d1ba733 req-1ce736d2-11e5-4dd1-bcc9-dc64c5f2534e service nova] Acquiring lock "1c35ef60-298f-47f3-99a0-c9de2bd34c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:58.286529 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-98beced5-f577-4e97-9430-2f528d1ba733 req-1ce736d2-11e5-4dd1-bcc9-dc64c5f2534e service nova] Lock "1c35ef60-298f-47f3-99a0-c9de2bd34c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:58.286652 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-98beced5-f577-4e97-9430-2f528d1ba733 req-1ce736d2-11e5-4dd1-bcc9-dc64c5f2534e service nova] Lock "1c35ef60-298f-47f3-99a0-c9de2bd34c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:58.286758 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-98beced5-f577-4e97-9430-2f528d1ba733 req-1ce736d2-11e5-4dd1-bcc9-dc64c5f2534e service nova] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Processing event network-vif-plugged-64dc43ea-5ef6-44d3-96a1-31e10c8f2416 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:05:58.286885 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-98beced5-f577-4e97-9430-2f528d1ba733 req-1ce736d2-11e5-4dd1-bcc9-dc64c5f2534e service nova] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Received event network-vif-plugged-64dc43ea-5ef6-44d3-96a1-31e10c8f2416 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:05:58.286983 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-98beced5-f577-4e97-9430-2f528d1ba733 req-1ce736d2-11e5-4dd1-bcc9-dc64c5f2534e service nova] Acquiring lock "1c35ef60-298f-47f3-99a0-c9de2bd34c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:05:58.287082 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-98beced5-f577-4e97-9430-2f528d1ba733 req-1ce736d2-11e5-4dd1-bcc9-dc64c5f2534e service nova] Lock "1c35ef60-298f-47f3-99a0-c9de2bd34c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:05:58.287143 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-98beced5-f577-4e97-9430-2f528d1ba733 req-1ce736d2-11e5-4dd1-bcc9-dc64c5f2534e service nova] Lock "1c35ef60-298f-47f3-99a0-c9de2bd34c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:58.287234 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-98beced5-f577-4e97-9430-2f528d1ba733 req-1ce736d2-11e5-4dd1-bcc9-dc64c5f2534e service nova] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] No waiting events found dispatching network-vif-plugged-64dc43ea-5ef6-44d3-96a1-31e10c8f2416 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:05:58.287372 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-98beced5-f577-4e97-9430-2f528d1ba733 req-1ce736d2-11e5-4dd1-bcc9-dc64c5f2534e service nova] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Received unexpected event network-vif-plugged-64dc43ea-5ef6-44d3-96a1-31e10c8f2416 for instance with vm_state building and task_state spawning.
May 28 01:05:58.393971 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930358.393648, 1c35ef60-298f-47f3-99a0-c9de2bd34c55 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:05:58.394336 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:05:58.394468 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] VM Started (Lifecycle Event)
May 28 01:05:58.396533 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:05:58.399142 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Instance spawned successfully.
May 28 01:05:58.399510 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:05:58.422716 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:05:58.422844 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:05:58.422973 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] No VIF found with MAC fa:16:3e:a0:66:8f, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:05:58.423420 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Using config drive
May 28 01:05:58.444987 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f55abad9-177f-4ac3-a1c4-65267df8bd85 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.277s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:58.491829 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-f55abad9-177f-4ac3-a1c4-65267df8bd85 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Deleted allocations for instance 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e
May 28 01:05:58.896674 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:58.898455 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:05:58.903867 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:58.903989 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:58.904223 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:58.904462 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:58.904748 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:58.904978 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:05:58.927783 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lazy-loading 'ec2_ids' on Instance uuid d5aa4bd8-07f0-4329-88d3-63aa5a2be798 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:05:59.400962 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:05:59.401103 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930359.4009573, 1c35ef60-298f-47f3-99a0-c9de2bd34c55 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:05:59.401205 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] VM Paused (Lifecycle Event)
May 28 01:05:59.408681 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Took 7.52 seconds to spawn the instance on the hypervisor.
May 28 01:05:59.408841 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:59.429829 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Object Instance<d5aa4bd8-07f0-4329-88d3-63aa5a2be798> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:05:59.429829 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lazy-loading 'keypairs' on Instance uuid d5aa4bd8-07f0-4329-88d3-63aa5a2be798 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:05:59.499998 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f55abad9-177f-4ac3-a1c4-65267df8bd85 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Lock "2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.246s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:05:59.567690 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.455s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:05:59.568022 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b', 'iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8de1def3-320b-432b-99e0-674e18b4c68b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:05:59.579362 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:05:59.579979 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:05:59.583062 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:05:59.583294 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:05:59.584972 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:05:59.584972 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:05:59.594236 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:05:59.594236 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:59.600790 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:05:59.600790 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:59.607943 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b] added
May 28 01:05:59.607943 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:05:59.607943 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:05:59.607943 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:05:59.607943 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:05:59.607943 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:05:59.607943 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:59.608220 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:05:59.608352 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.025(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:05:59.608521 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:05:59.611642 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b] added
May 28 01:05:59.611642 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:05:59.611642 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:05:59.611642 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:05:59.611642 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:05:59.611642 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:05:59.611642 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:05:59.611642 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:05:59.611642 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0264(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:05:59.611642 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:05:59.903174 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:05:59.908536 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930359.9054825, 1c35ef60-298f-47f3-99a0-c9de2bd34c55 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:05:59.908536 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] VM Resumed (Lifecycle Event)
May 28 01:05:59.918780 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Took 12.86 seconds to build instance.
May 28 01:05:59.931396 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Object Instance<d5aa4bd8-07f0-4329-88d3-63aa5a2be798> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:05:59.939686 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
May 28 01:06:00.064686 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Creating config drive at /opt/stack/data/nova/instances/d5aa4bd8-07f0-4329-88d3-63aa5a2be798/disk.config
May 28 01:06:00.068700 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d5aa4bd8-07f0-4329-88d3-63aa5a2be798/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdyj7gixq {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:06:00.120680 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d5aa4bd8-07f0-4329-88d3-63aa5a2be798/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdyj7gixq" returned: 0 in 0.052s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:06:00.410985 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:06:00.413739 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:06:00.424889 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-98c59d25-093e-4c8c-967d-4d87c5bca52e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "1c35ef60-298f-47f3-99a0-c9de2bd34c55" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.368s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:00.502804 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1da92fe5-a95c-4ee2-8a4b-8a1b581efab1 req-2005b9e6-b3d4-4077-a29b-07f0b9514e9d service nova] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Received event network-changed-64dc43ea-5ef6-44d3-96a1-31e10c8f2416 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:06:00.502804 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1da92fe5-a95c-4ee2-8a4b-8a1b581efab1 req-2005b9e6-b3d4-4077-a29b-07f0b9514e9d service nova] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Refreshing instance network info cache due to event network-changed-64dc43ea-5ef6-44d3-96a1-31e10c8f2416. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:06:00.502804 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1da92fe5-a95c-4ee2-8a4b-8a1b581efab1 req-2005b9e6-b3d4-4077-a29b-07f0b9514e9d service nova] Acquiring lock "refresh_cache-1c35ef60-298f-47f3-99a0-c9de2bd34c55" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:06:00.502804 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1da92fe5-a95c-4ee2-8a4b-8a1b581efab1 req-2005b9e6-b3d4-4077-a29b-07f0b9514e9d service nova] Acquired lock "refresh_cache-1c35ef60-298f-47f3-99a0-c9de2bd34c55" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:06:00.502804 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-1da92fe5-a95c-4ee2-8a4b-8a1b581efab1 req-2005b9e6-b3d4-4077-a29b-07f0b9514e9d service nova] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Refreshing network info cache for port 64dc43ea-5ef6-44d3-96a1-31e10c8f2416 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:06:00.588006 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:00.610094 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:06:00.613196 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:06:00.621248 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:06:00.625839 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:06:00.625839 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:06:00.633534 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:06:00.633534 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:00.643344 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:00.651643 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:00.662228 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:00.662228 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:00.662228 np0000001577 nova-compute[98319]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:06:00.662228 np0000001577 nova-compute[98319]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:06:00.662228 np0000001577 nova-compute[98319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:00.662228 np0000001577 nova-compute[98319]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:00.662228 np0000001577 nova-compute[98319]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d23049a-a2c8-4024-bd86-c85130839fbe (non-flash)
May 28 01:06:00.662228 np0000001577 nova-compute[98319]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d23049a-a2c8-4024-bd86-c85130839fbe (non-flash)
May 28 01:06:00.662228 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:06:00.662228 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:06:00.662228 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:06:00.662640 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:00.662640 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:00.662640 np0000001577 nova-compute[98319]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:06:00.662640 np0000001577 nova-compute[98319]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:06:00.662640 np0000001577 nova-compute[98319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:00.662640 np0000001577 nova-compute[98319]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:00.662640 np0000001577 nova-compute[98319]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d23049a-a2c8-4024-bd86-c85130839fbe (non-flash)
May 28 01:06:00.662640 np0000001577 nova-compute[98319]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d23049a-a2c8-4024-bd86-c85130839fbe (non-flash)
May 28 01:06:00.662640 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:06:00.662640 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:06:00.662640 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:06:00.671967 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:00.671967 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:00.671967 np0000001577 nova-compute[98319]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:06:00.671967 np0000001577 nova-compute[98319]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:06:00.671967 np0000001577 nova-compute[98319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:00.671967 np0000001577 nova-compute[98319]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:00.671967 np0000001577 nova-compute[98319]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d23049a-a2c8-4024-bd86-c85130839fbe (non-flash)
May 28 01:06:00.671967 np0000001577 nova-compute[98319]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d23049a-a2c8-4024-bd86-c85130839fbe (non-flash)
May 28 01:06:00.671967 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:06:00.671967 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:06:00.671967 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:06:00.672214 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:00.672214 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:00.672214 np0000001577 nova-compute[98319]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:06:00.672214 np0000001577 nova-compute[98319]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:06:00.672214 np0000001577 nova-compute[98319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:00.672214 np0000001577 nova-compute[98319]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:00.672214 np0000001577 nova-compute[98319]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d23049a-a2c8-4024-bd86-c85130839fbe (non-flash)
May 28 01:06:00.672214 np0000001577 nova-compute[98319]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d23049a-a2c8-4024-bd86-c85130839fbe (non-flash)
May 28 01:06:00.672214 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:06:00.672214 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:06:00.672214 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:06:00.715519 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:00.723857 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b, portal: 192.168.40.100,3260]
May 28 01:06:00.723857 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b, portal: 192.168.40.100,3260] successful.
May 28 01:06:00.723857 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:00.728160 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b, portal: 192.168.50.100,3260]
May 28 01:06:00.728160 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b, portal: 192.168.50.100,3260] successful.
May 28 01:06:00.728160 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:00.737685 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:00.742680 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:00.760431 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:00.760431 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:00.760431 np0000001577 nova-compute[98319]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:06:00.760431 np0000001577 nova-compute[98319]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:06:00.760431 np0000001577 nova-compute[98319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:00.760431 np0000001577 nova-compute[98319]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:00.760431 np0000001577 nova-compute[98319]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d23049a-a2c8-4024-bd86-c85130839fbe (non-flash)
May 28 01:06:00.760431 np0000001577 nova-compute[98319]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d23049a-a2c8-4024-bd86-c85130839fbe (non-flash)
May 28 01:06:00.760431 np0000001577 nova-compute[98319]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b (non-flash)
May 28 01:06:00.760431 np0000001577 nova-compute[98319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b (non-flash)
May 28 01:06:00.760431 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:06:00.760431 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:06:00.760431 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:06:00.760431 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:00.760431 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:00.760431 np0000001577 nova-compute[98319]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:06:00.760431 np0000001577 nova-compute[98319]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:06:00.760431 np0000001577 nova-compute[98319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:00.760431 np0000001577 nova-compute[98319]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:00.760431 np0000001577 nova-compute[98319]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d23049a-a2c8-4024-bd86-c85130839fbe (non-flash)
May 28 01:06:00.760431 np0000001577 nova-compute[98319]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d23049a-a2c8-4024-bd86-c85130839fbe (non-flash)
May 28 01:06:00.760431 np0000001577 nova-compute[98319]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b (non-flash)
May 28 01:06:00.760431 np0000001577 nova-compute[98319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b (non-flash)
May 28 01:06:00.760431 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:06:00.760431 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:06:00.760431 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:06:00.760967 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.178s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:06:00.760967 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:06:00.765397 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] HCTL ('17', '-', '-', 0) found on session 110 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:06:00.765397 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:06:00.768647 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:00.768647 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:00.768647 np0000001577 nova-compute[98319]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:06:00.768647 np0000001577 nova-compute[98319]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:06:00.768647 np0000001577 nova-compute[98319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:00.768647 np0000001577 nova-compute[98319]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:00.768647 np0000001577 nova-compute[98319]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d23049a-a2c8-4024-bd86-c85130839fbe (non-flash)
May 28 01:06:00.768647 np0000001577 nova-compute[98319]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d23049a-a2c8-4024-bd86-c85130839fbe (non-flash)
May 28 01:06:00.768647 np0000001577 nova-compute[98319]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b (non-flash)
May 28 01:06:00.768647 np0000001577 nova-compute[98319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b (non-flash)
May 28 01:06:00.768647 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:06:00.768647 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:06:00.768647 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:06:00.769046 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:00.769046 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:00.769046 np0000001577 nova-compute[98319]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:06:00.769046 np0000001577 nova-compute[98319]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:06:00.769046 np0000001577 nova-compute[98319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:00.769046 np0000001577 nova-compute[98319]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:00.769046 np0000001577 nova-compute[98319]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d23049a-a2c8-4024-bd86-c85130839fbe (non-flash)
May 28 01:06:00.769046 np0000001577 nova-compute[98319]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d23049a-a2c8-4024-bd86-c85130839fbe (non-flash)
May 28 01:06:00.769046 np0000001577 nova-compute[98319]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b (non-flash)
May 28 01:06:00.769046 np0000001577 nova-compute[98319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b (non-flash)
May 28 01:06:00.769046 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:06:00.769046 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:06:00.769046 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:06:00.769398 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.184s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:06:00.769398 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:06:00.771478 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] HCTL ('18', '-', '-', 0) found on session 111 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:06:00.772120 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:06:00.797309 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Searching for a device in session 110 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:06:00.797309 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8de1def3-320b-432b-99e0-674e18b4c68b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:06:00.797309 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Searching for a device in session 111 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:06:00.797309 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8de1def3-320b-432b-99e0-674e18b4c68b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:06:00.890576 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-3a966049-3ecb-4978-b43e-99114d328592 req-9c93dfc0-662b-4948-a105-15e784def034 service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Received event network-vif-plugged-0fe5497e-7f98-48c5-89d4-5168815ab9c1 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:06:00.891291 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3a966049-3ecb-4978-b43e-99114d328592 req-9c93dfc0-662b-4948-a105-15e784def034 service nova] Acquiring lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:00.891291 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3a966049-3ecb-4978-b43e-99114d328592 req-9c93dfc0-662b-4948-a105-15e784def034 service nova] Lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:00.891291 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3a966049-3ecb-4978-b43e-99114d328592 req-9c93dfc0-662b-4948-a105-15e784def034 service nova] Lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:00.891496 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-3a966049-3ecb-4978-b43e-99114d328592 req-9c93dfc0-662b-4948-a105-15e784def034 service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] No waiting events found dispatching network-vif-plugged-0fe5497e-7f98-48c5-89d4-5168815ab9c1 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:06:00.891604 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-3a966049-3ecb-4978-b43e-99114d328592 req-9c93dfc0-662b-4948-a105-15e784def034 service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Received unexpected event network-vif-plugged-0fe5497e-7f98-48c5-89d4-5168815ab9c1 for instance with vm_state active and task_state rebuild_spawning.
May 28 01:06:00.991399 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:00.993794 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:01.002169 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:01.007990 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-1da92fe5-a95c-4ee2-8a4b-8a1b581efab1 req-2005b9e6-b3d4-4077-a29b-07f0b9514e9d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:06:01.027688 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:01.333043 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:01.404887 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-1da92fe5-a95c-4ee2-8a4b-8a1b581efab1 req-2005b9e6-b3d4-4077-a29b-07f0b9514e9d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:06:01.572893 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-1da92fe5-a95c-4ee2-8a4b-8a1b581efab1 req-2005b9e6-b3d4-4077-a29b-07f0b9514e9d service nova] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Updated VIF entry in instance network info cache for port 64dc43ea-5ef6-44d3-96a1-31e10c8f2416. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:06:01.572893 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-1da92fe5-a95c-4ee2-8a4b-8a1b581efab1 req-2005b9e6-b3d4-4077-a29b-07f0b9514e9d service nova] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Updating instance_info_cache with network_info: [{"id": "64dc43ea-5ef6-44d3-96a1-31e10c8f2416", "address": "fa:16:3e:90:82:0c", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64dc43ea-5e", "ovs_interfaceid": "64dc43ea-5ef6-44d3-96a1-31e10c8f2416", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:06:01.586104 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:06:01.614415 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930361.6139865, d5aa4bd8-07f0-4329-88d3-63aa5a2be798 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:06:01.614415 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] VM Resumed (Lifecycle Event)
May 28 01:06:01.620727 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Instance event wait completed in 0 seconds for  {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:06:01.620909 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:06:01.626035 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Instance spawned successfully.
May 28 01:06:01.626584 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:06:01.897837 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:02.076723 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1da92fe5-a95c-4ee2-8a4b-8a1b581efab1 req-2005b9e6-b3d4-4077-a29b-07f0b9514e9d service nova] Releasing lock "refresh_cache-1c35ef60-298f-47f3-99a0-c9de2bd34c55" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:06:02.124155 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:06:02.130840 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:06:02.140686 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:06:02.140855 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:06:02.141240 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:06:02.141511 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:06:02.141873 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:06:02.142166 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:06:02.605244 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Found WWN 33000000085e15ff7 for multipath device dm-11 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:06:02.605562 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:06:02.605739 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] <== connect_volume: return (5493ms) {'type': 'block', 'scsi_wwn': '33000000085e15ff7', 'path': '/dev/dm-11', 'multipath_id': '33000000085e15ff7'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:06:02.605860 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000085e15ff7', 'path': '/dev/dm-11', 'multipath_id': '33000000085e15ff7'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:06:02.614658 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lazy-loading 'flavor' on Instance uuid 4fb6dc75-4a06-45ea-a050-4ddcd55e8559 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:06:02.635159 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
May 28 01:06:02.635455 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930362.6352866, d5aa4bd8-07f0-4329-88d3-63aa5a2be798 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:06:02.635581 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] VM Started (Lifecycle Event)
May 28 01:06:02.660069 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:06:02.718872 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0007385389999399194 future=<Future at 0x7c987047ae40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:06:02.721569 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Emitting event <LifecycleEvent: 1779930347.7180107, cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:06:02.723835 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:06:02.723835 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] VM Stopped (Lifecycle Event)
May 28 01:06:02.723988 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=6.3781799439998395 future=<Future at 0x7c98705b6120 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:06:02.724313 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=6.3778009589996145 future=<Future at 0x7c98705b6120 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:06:02.975129 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d19ac2bf-af03-45d9-aea1-a4cbd01a6266 req-086061c0-654d-48ec-b5b3-8812ab1ebaf0 service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Received event network-vif-plugged-0fe5497e-7f98-48c5-89d4-5168815ab9c1 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:06:02.975392 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d19ac2bf-af03-45d9-aea1-a4cbd01a6266 req-086061c0-654d-48ec-b5b3-8812ab1ebaf0 service nova] Acquiring lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:02.975534 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d19ac2bf-af03-45d9-aea1-a4cbd01a6266 req-086061c0-654d-48ec-b5b3-8812ab1ebaf0 service nova] Lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:02.975738 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d19ac2bf-af03-45d9-aea1-a4cbd01a6266 req-086061c0-654d-48ec-b5b3-8812ab1ebaf0 service nova] Lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:02.975844 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d19ac2bf-af03-45d9-aea1-a4cbd01a6266 req-086061c0-654d-48ec-b5b3-8812ab1ebaf0 service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] No waiting events found dispatching network-vif-plugged-0fe5497e-7f98-48c5-89d4-5168815ab9c1 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:06:02.975991 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-d19ac2bf-af03-45d9-aea1-a4cbd01a6266 req-086061c0-654d-48ec-b5b3-8812ab1ebaf0 service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Received unexpected event network-vif-plugged-0fe5497e-7f98-48c5-89d4-5168815ab9c1 for instance with vm_state active and task_state None.
May 28 01:06:03.118035 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Attempting to attach volume 8de1def3-320b-432b-99e0-674e18b4c68b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:06:03.119611 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:06:03.119611 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:06:03.119611 np0000001577 nova-compute[98319]:   <alias name="ua-8de1def3-320b-432b-99e0-674e18b4c68b"/>
May 28 01:06:03.119611 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-11"/>
May 28 01:06:03.119611 np0000001577 nova-compute[98319]:   <target dev="vdc" bus="virtio"/>
May 28 01:06:03.119611 np0000001577 nova-compute[98319]:   <serial>8de1def3-320b-432b-99e0-674e18b4c68b</serial>
May 28 01:06:03.119611 np0000001577 nova-compute[98319]: </disk>
May 28 01:06:03.119611 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:06:03.142607 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:06:03.150718 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:06:03.176946 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:03.177198 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:03.177198 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Trying to apply a migration context that does not seem to be set for this instance {{(pid=98319) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
May 28 01:06:03.226860 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b4199955-e699-47ac-ae16-8e1faf3561e3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: cb8c79c3-cdb1-4e09-8669-cbab7a9b61ba] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:06:04.193014 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c2a13bfc-36df-4a41-a6e1-6bea5c8ab970 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.016s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:04.812761 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:06:04.815593 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:06:04.815593 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:06:04.815593 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:06:04.815593 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] No VIF found with MAC fa:16:3e:6d:b1:ae, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:06:04.835233 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:06.335592 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:06.376145 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dde7fa2e-ae09-422f-a56e-8b6f36cd45d7 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.928s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:06.899145 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:08.577449 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:09.103022 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0008872739999787882 future=<Future at 0x7c98705b6120 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:06:09.103138 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:06:09.104022 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] Emitting event <LifecycleEvent: 1779930354.1020045, 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:06:09.104022 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] VM Stopped (Lifecycle Event)
May 28 01:06:09.606818 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-dfe86b82-6091-4605-ac9e-a08b86906923 tempest-AttachVolumeMultiAttachTest-89204095 tempest-AttachVolumeMultiAttachTest-89204095-project-member] [instance: 2f6b0e4d-ec5b-4d23-81f7-6ab114cb025e] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:06:11.340750 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:11.734654 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:11.901346 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:12.611301 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Acquiring lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:12.611663 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:13.114050 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Detaching volume e04c3d46-81b2-492b-a811-117dcf51fc9e
May 28 01:06:13.146792 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Attempting to driver detach volume e04c3d46-81b2-492b-a811-117dcf51fc9e from mountpoint /dev/vdb
May 28 01:06:13.155153 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Found disk vdb by alias ua-e04c3d46-81b2-492b-a811-117dcf51fc9e {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:06:13.156357 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Found disk vdb by alias ua-e04c3d46-81b2-492b-a811-117dcf51fc9e {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:06:13.156480 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Attempting to detach device vdb from instance 4fb6dc75-4a06-45ea-a050-4ddcd55e8559 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:06:13.156747 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:06:13.156747 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:06:13.156747 np0000001577 nova-compute[98319]:   <alias name="ua-e04c3d46-81b2-492b-a811-117dcf51fc9e"/>
May 28 01:06:13.156747 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-9"/>
May 28 01:06:13.156747 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:06:13.156747 np0000001577 nova-compute[98319]:   <serial>e04c3d46-81b2-492b-a811-117dcf51fc9e</serial>
May 28 01:06:13.156747 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:06:13.156747 np0000001577 nova-compute[98319]: </disk>
May 28 01:06:13.156747 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:06:13.169666 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Successfully detached device vdb from instance 4fb6dc75-4a06-45ea-a050-4ddcd55e8559 from the persistent domain config.
May 28 01:06:13.170191 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] (1/8): Attempting to detach device vdb with device alias ua-e04c3d46-81b2-492b-a811-117dcf51fc9e from instance 4fb6dc75-4a06-45ea-a050-4ddcd55e8559 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:06:13.170883 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:06:13.170883 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:06:13.170883 np0000001577 nova-compute[98319]:   <alias name="ua-e04c3d46-81b2-492b-a811-117dcf51fc9e"/>
May 28 01:06:13.170883 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-9"/>
May 28 01:06:13.170883 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:06:13.170883 np0000001577 nova-compute[98319]:   <serial>e04c3d46-81b2-492b-a811-117dcf51fc9e</serial>
May 28 01:06:13.170883 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:06:13.170883 np0000001577 nova-compute[98319]: </disk>
May 28 01:06:13.170883 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:06:13.654861 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930373.6545627, 4fb6dc75-4a06-45ea-a050-4ddcd55e8559 => ua-e04c3d46-81b2-492b-a811-117dcf51fc9e> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:06:13.655971 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e04c3d46-81b2-492b-a811-117dcf51fc9e for instance 4fb6dc75-4a06-45ea-a050-4ddcd55e8559 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:06:13.658003 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Successfully detached device vdb from instance 4fb6dc75-4a06-45ea-a050-4ddcd55e8559 from the live domain config.
May 28 01:06:13.659209 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:06:13.659570 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e', 'iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e04c3d46-81b2-492b-a811-117dcf51fc9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:06:13.659643 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:06:16.339524 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:16.903102 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:18.921970 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 5.262s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:06:18.922365 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e', 'iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e04c3d46-81b2-492b-a811-117dcf51fc9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:06:18.922497 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:06:19.022801 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:19.022801 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:19.022801 np0000001577 nova-compute[98319]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:06:19.022801 np0000001577 nova-compute[98319]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:06:19.022801 np0000001577 nova-compute[98319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:19.022801 np0000001577 nova-compute[98319]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:19.022801 np0000001577 nova-compute[98319]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b (non-flash)
May 28 01:06:19.022801 np0000001577 nova-compute[98319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b (non-flash)
May 28 01:06:19.022801 np0000001577 nova-compute[98319]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d23049a-a2c8-4024-bd86-c85130839fbe (non-flash)
May 28 01:06:19.022801 np0000001577 nova-compute[98319]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d23049a-a2c8-4024-bd86-c85130839fbe (non-flash)
May 28 01:06:19.022801 np0000001577 nova-compute[98319]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3efa5642-5a0c-4e2a-b4cb-f9ff76b25f5a (non-flash)
May 28 01:06:19.022801 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:06:19.022801 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:06:19.022801 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:06:19.023392 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:19.023392 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:19.023392 np0000001577 nova-compute[98319]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:06:19.023392 np0000001577 nova-compute[98319]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e (non-flash)
May 28 01:06:19.023392 np0000001577 nova-compute[98319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:19.023392 np0000001577 nova-compute[98319]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:19.023392 np0000001577 nova-compute[98319]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b (non-flash)
May 28 01:06:19.023392 np0000001577 nova-compute[98319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b (non-flash)
May 28 01:06:19.023392 np0000001577 nova-compute[98319]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d23049a-a2c8-4024-bd86-c85130839fbe (non-flash)
May 28 01:06:19.023392 np0000001577 nova-compute[98319]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d23049a-a2c8-4024-bd86-c85130839fbe (non-flash)
May 28 01:06:19.023392 np0000001577 nova-compute[98319]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3efa5642-5a0c-4e2a-b4cb-f9ff76b25f5a (non-flash)
May 28 01:06:19.023392 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:06:19.023392 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:06:19.023392 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:06:19.023392 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e', '105'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b', '110'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b', '111'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d23049a-a2c8-4024-bd86-c85130839fbe', '112'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d23049a-a2c8-4024-bd86-c85130839fbe', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3efa5642-5a0c-4e2a-b4cb-f9ff76b25f5a', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6', '90'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6', '91')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:06:19.023392 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e', '104')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:06:19.024414 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e', '105')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:06:19.025669 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c987056c360>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e'): ({'sdi'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:06:19.026028 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Removing multipathed devices sdh, sdi {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:06:19.026126 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Flush multipath device 330000000b54e87b9 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:06:19.061081 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:06:19.117888 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:06:19.167994 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:06:19.167994 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:06:19.167994 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:06:19.181401 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:06:19.181598 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:06:19.222299 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:19.270110 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 104, target: iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e, portal: 192.168.40.100,3260]
May 28 01:06:19.270110 np0000001577 nova-compute[98319]: Logout of [sid: 104, target: iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e, portal: 192.168.40.100,3260] successful.
May 28 01:06:19.270110 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:19.290513 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:19.302766 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:19.344995 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 105, target: iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e, portal: 192.168.50.100,3260]
May 28 01:06:19.344995 np0000001577 nova-compute[98319]: Logout of [sid: 105, target: iqn.2023-03.storpool.com:os--volume-e04c3d46-81b2-492b-a811-117dcf51fc9e, portal: 192.168.50.100,3260] successful.
May 28 01:06:19.344995 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:19.366350 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:19.366820 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.445s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:06:19.366820 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] <== disconnect_volume: return (5707ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:06:19.366820 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:06:19.916444 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lazy-loading 'flavor' on Instance uuid 4fb6dc75-4a06-45ea-a050-4ddcd55e8559 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:06:20.933201 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d1a93ff1-8ca9-4a13-a880-e9bbadb3bd95 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 8.322s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:21.341414 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:21.904986 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:25.424566 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Acquiring lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:25.425030 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:25.929047 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Detaching volume 8de1def3-320b-432b-99e0-674e18b4c68b
May 28 01:06:25.982903 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Attempting to driver detach volume 8de1def3-320b-432b-99e0-674e18b4c68b from mountpoint /dev/vdc
May 28 01:06:25.991647 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Found disk vdc by alias ua-8de1def3-320b-432b-99e0-674e18b4c68b {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:06:25.994040 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Found disk vdc by alias ua-8de1def3-320b-432b-99e0-674e18b4c68b {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:06:25.994040 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Attempting to detach device vdc from instance 4fb6dc75-4a06-45ea-a050-4ddcd55e8559 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:06:25.994040 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:06:25.994040 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:06:25.994040 np0000001577 nova-compute[98319]:   <alias name="ua-8de1def3-320b-432b-99e0-674e18b4c68b"/>
May 28 01:06:25.994040 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-11"/>
May 28 01:06:25.994040 np0000001577 nova-compute[98319]:   <target dev="vdc" bus="virtio"/>
May 28 01:06:25.994040 np0000001577 nova-compute[98319]:   <serial>8de1def3-320b-432b-99e0-674e18b4c68b</serial>
May 28 01:06:25.994040 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 01:06:25.994040 np0000001577 nova-compute[98319]: </disk>
May 28 01:06:25.994040 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:06:26.003217 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Successfully detached device vdc from instance 4fb6dc75-4a06-45ea-a050-4ddcd55e8559 from the persistent domain config.
May 28 01:06:26.003217 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] (1/8): Attempting to detach device vdc with device alias ua-8de1def3-320b-432b-99e0-674e18b4c68b from instance 4fb6dc75-4a06-45ea-a050-4ddcd55e8559 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:06:26.003217 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:06:26.003217 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:06:26.003217 np0000001577 nova-compute[98319]:   <alias name="ua-8de1def3-320b-432b-99e0-674e18b4c68b"/>
May 28 01:06:26.003217 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-11"/>
May 28 01:06:26.003217 np0000001577 nova-compute[98319]:   <target dev="vdc" bus="virtio"/>
May 28 01:06:26.003217 np0000001577 nova-compute[98319]:   <serial>8de1def3-320b-432b-99e0-674e18b4c68b</serial>
May 28 01:06:26.003217 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 01:06:26.003217 np0000001577 nova-compute[98319]: </disk>
May 28 01:06:26.003217 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:06:26.028651 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:26.345090 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:26.601475 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930386.5987363, 4fb6dc75-4a06-45ea-a050-4ddcd55e8559 => ua-8de1def3-320b-432b-99e0-674e18b4c68b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:06:26.604985 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-8de1def3-320b-432b-99e0-674e18b4c68b for instance 4fb6dc75-4a06-45ea-a050-4ddcd55e8559 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:06:26.607044 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Successfully detached device vdc from instance 4fb6dc75-4a06-45ea-a050-4ddcd55e8559 from the live domain config.
May 28 01:06:26.608051 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:06:26.608418 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b', 'iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8de1def3-320b-432b-99e0-674e18b4c68b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:06:26.609866 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:06:26.609866 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:06:26.609866 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b', 'iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8de1def3-320b-432b-99e0-674e18b4c68b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:06:26.609866 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:06:26.640368 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:26.640368 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:26.640368 np0000001577 nova-compute[98319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:26.640368 np0000001577 nova-compute[98319]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:26.640368 np0000001577 nova-compute[98319]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b (non-flash)
May 28 01:06:26.640368 np0000001577 nova-compute[98319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b (non-flash)
May 28 01:06:26.640368 np0000001577 nova-compute[98319]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3efa5642-5a0c-4e2a-b4cb-f9ff76b25f5a (non-flash)
May 28 01:06:26.640368 np0000001577 nova-compute[98319]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17626513-5ef1-4171-8bb8-d4ef0beabb75 (non-flash)
May 28 01:06:26.640368 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:06:26.640368 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:06:26.640368 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:06:26.640368 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:26.640368 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:26.640368 np0000001577 nova-compute[98319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:26.640368 np0000001577 nova-compute[98319]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:26.640368 np0000001577 nova-compute[98319]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b (non-flash)
May 28 01:06:26.640368 np0000001577 nova-compute[98319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b (non-flash)
May 28 01:06:26.640368 np0000001577 nova-compute[98319]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3efa5642-5a0c-4e2a-b4cb-f9ff76b25f5a (non-flash)
May 28 01:06:26.640368 np0000001577 nova-compute[98319]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17626513-5ef1-4171-8bb8-d4ef0beabb75 (non-flash)
May 28 01:06:26.640368 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:06:26.640368 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:06:26.640368 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:06:26.640368 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b', '110'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b', '111'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3efa5642-5a0c-4e2a-b4cb-f9ff76b25f5a', '114'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17626513-5ef1-4171-8bb8-d4ef0beabb75', '115'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6', '90'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6', '91')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:06:26.640368 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b', '110')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:06:26.640368 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b', '111')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:06:26.640368 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c9870584e00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b'): ({'sdm'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:06:26.640368 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Removing multipathed devices sdm, sdl {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:06:26.640368 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Flush multipath device 33000000085e15ff7 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:06:26.667929 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:06:26.732937 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:06:26.800108 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:06:26.800278 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:06:26.801713 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:06:26.813766 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:06:26.813958 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:06:26.827096 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:26.868771 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 110, target: iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b, portal: 192.168.40.100,3260]
May 28 01:06:26.868771 np0000001577 nova-compute[98319]: Logout of [sid: 110, target: iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b, portal: 192.168.40.100,3260] successful.
May 28 01:06:26.868771 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:26.891517 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:26.907319 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:26.908561 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:26.947606 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 111, target: iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b, portal: 192.168.50.100,3260]
May 28 01:06:26.947606 np0000001577 nova-compute[98319]: Logout of [sid: 111, target: iqn.2023-03.storpool.com:os--volume-8de1def3-320b-432b-99e0-674e18b4c68b, portal: 192.168.50.100,3260] successful.
May 28 01:06:26.947606 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:26.972123 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:26.972315 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:06:26.972416 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] <== disconnect_volume: return (363ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:06:26.972524 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:06:27.523717 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lazy-loading 'flavor' on Instance uuid 4fb6dc75-4a06-45ea-a050-4ddcd55e8559 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:06:28.533752 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5e18ee29-3a6b-4b90-84fb-8b706182d825 tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.109s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:28.951494 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-989e4fc2-5408-4529-8ae9-3afbb0e6f693 req-c8454a1f-0440-4dca-bcff-349e1fb55e63 service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Received event network-changed-cf12ff4e-41ad-46b1-bece-7d46af7ad869 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:06:28.951494 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-989e4fc2-5408-4529-8ae9-3afbb0e6f693 req-c8454a1f-0440-4dca-bcff-349e1fb55e63 service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Refreshing instance network info cache due to event network-changed-cf12ff4e-41ad-46b1-bece-7d46af7ad869. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:06:28.951494 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-989e4fc2-5408-4529-8ae9-3afbb0e6f693 req-c8454a1f-0440-4dca-bcff-349e1fb55e63 service nova] Acquiring lock "refresh_cache-4fb6dc75-4a06-45ea-a050-4ddcd55e8559" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:06:28.951494 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-989e4fc2-5408-4529-8ae9-3afbb0e6f693 req-c8454a1f-0440-4dca-bcff-349e1fb55e63 service nova] Acquired lock "refresh_cache-4fb6dc75-4a06-45ea-a050-4ddcd55e8559" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:06:28.951494 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-989e4fc2-5408-4529-8ae9-3afbb0e6f693 req-c8454a1f-0440-4dca-bcff-349e1fb55e63 service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Refreshing network info cache for port cf12ff4e-41ad-46b1-bece-7d46af7ad869 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:06:29.451664 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-989e4fc2-5408-4529-8ae9-3afbb0e6f693 req-c8454a1f-0440-4dca-bcff-349e1fb55e63 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:06:29.504831 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0b2a74e8-2332-466d-be40-46fe10293a01 req-365e3755-d82e-48e9-bdc6-9cd70226c7f9 service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Received event network-changed-cf12ff4e-41ad-46b1-bece-7d46af7ad869 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:06:29.504947 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0b2a74e8-2332-466d-be40-46fe10293a01 req-365e3755-d82e-48e9-bdc6-9cd70226c7f9 service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Refreshing instance network info cache due to event network-changed-cf12ff4e-41ad-46b1-bece-7d46af7ad869. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:06:29.505528 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b2a74e8-2332-466d-be40-46fe10293a01 req-365e3755-d82e-48e9-bdc6-9cd70226c7f9 service nova] Acquiring lock "refresh_cache-4fb6dc75-4a06-45ea-a050-4ddcd55e8559" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:06:29.738692 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-989e4fc2-5408-4529-8ae9-3afbb0e6f693 req-c8454a1f-0440-4dca-bcff-349e1fb55e63 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:06:29.854150 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-989e4fc2-5408-4529-8ae9-3afbb0e6f693 req-c8454a1f-0440-4dca-bcff-349e1fb55e63 service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Updated VIF entry in instance network info cache for port cf12ff4e-41ad-46b1-bece-7d46af7ad869. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:06:29.854399 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-989e4fc2-5408-4529-8ae9-3afbb0e6f693 req-c8454a1f-0440-4dca-bcff-349e1fb55e63 service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Updating instance_info_cache with network_info: [{"id": "cf12ff4e-41ad-46b1-bece-7d46af7ad869", "address": "fa:16:3e:6d:b1:ae", "network": {"id": "328b8eaa-8fae-4e90-ac01-2f9b4e619fe8", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1060228276-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15fc68900185447586ee6ff0817087fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf12ff4e-41", "ovs_interfaceid": "cf12ff4e-41ad-46b1-bece-7d46af7ad869", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:06:30.034195 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Acquiring lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:30.034354 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:30.034516 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Acquiring lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:30.034710 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:30.034863 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:30.036637 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Terminating instance
May 28 01:06:30.356093 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-989e4fc2-5408-4529-8ae9-3afbb0e6f693 req-c8454a1f-0440-4dca-bcff-349e1fb55e63 service nova] Releasing lock "refresh_cache-4fb6dc75-4a06-45ea-a050-4ddcd55e8559" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:06:30.356671 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b2a74e8-2332-466d-be40-46fe10293a01 req-365e3755-d82e-48e9-bdc6-9cd70226c7f9 service nova] Acquired lock "refresh_cache-4fb6dc75-4a06-45ea-a050-4ddcd55e8559" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:06:30.356825 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-0b2a74e8-2332-466d-be40-46fe10293a01 req-365e3755-d82e-48e9-bdc6-9cd70226c7f9 service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Refreshing network info cache for port cf12ff4e-41ad-46b1-bece-7d46af7ad869 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:06:30.539149 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:06:30.562649 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:30.564418 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:30.590423 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:30.597555 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:30.623771 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:30.862177 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-0b2a74e8-2332-466d-be40-46fe10293a01 req-365e3755-d82e-48e9-bdc6-9cd70226c7f9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:06:30.878575 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.9997472189998 future=<Future at 0x7c984c5330e0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:06:30.878575 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999399192000055 future=<Future at 0x7c984c5330e0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:06:30.878575 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999277905999861 future=<Future at 0x7c984c5330e0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:06:30.878874 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Instance destroyed successfully.
May 28 01:06:30.879449 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lazy-loading 'resources' on Instance uuid 4fb6dc75-4a06-45ea-a050-4ddcd55e8559 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:06:31.159900 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-0b2a74e8-2332-466d-be40-46fe10293a01 req-365e3755-d82e-48e9-bdc6-9cd70226c7f9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:06:31.289500 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-0b2a74e8-2332-466d-be40-46fe10293a01 req-365e3755-d82e-48e9-bdc6-9cd70226c7f9 service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Updated VIF entry in instance network info cache for port cf12ff4e-41ad-46b1-bece-7d46af7ad869. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:06:31.289759 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-0b2a74e8-2332-466d-be40-46fe10293a01 req-365e3755-d82e-48e9-bdc6-9cd70226c7f9 service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Updating instance_info_cache with network_info: [{"id": "cf12ff4e-41ad-46b1-bece-7d46af7ad869", "address": "fa:16:3e:6d:b1:ae", "network": {"id": "328b8eaa-8fae-4e90-ac01-2f9b4e619fe8", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1060228276-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15fc68900185447586ee6ff0817087fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf12ff4e-41", "ovs_interfaceid": "cf12ff4e-41ad-46b1-bece-7d46af7ad869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:06:31.344974 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:31.382611 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:04:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-1806060241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testinstanceswithcindervolumes-server-1806060241',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAe8gEcGEQ/stc3fEgwIW65M0AVq3AHTtqALSUztyu0nDHvzM5q0XODHSIjQcrLzlTNzjXRCsZgBdykHaRcNFL5BPyhoQLiM/TCxeJVQwmG3kEXtnF/FP5ATsgrgHp/YJg==',key_name='tempest-TestInstancesWithCinderVolumes-1357887979',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:05:09Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15fc68900185447586ee6ff0817087fb',ramdisk_id='',reservation_id='r-waombbhh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-TestInstancesWithCinderVolumes-513545111',owner_user_name='tempest-TestInstancesWithCinderVolumes-513545111-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:05:10Z,user_data=None,user_id='91e7f4b4eca54b6198bbaea3ce953850',uuid=4fb6dc75-4a06-45ea-a050-4ddcd55e8559,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf12ff4e-41ad-46b1-bece-7d46af7ad869", "address": "fa:16:3e:6d:b1:ae", "network": {"id": "328b8eaa-8fae-4e90-ac01-2f9b4e619fe8", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1060228276-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15fc68900185447586ee6ff0817087fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf12ff4e-41", "ovs_interfaceid": "cf12ff4e-41ad-46b1-bece-7d46af7ad869", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:06:31.382830 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Converting VIF {"id": "cf12ff4e-41ad-46b1-bece-7d46af7ad869", "address": "fa:16:3e:6d:b1:ae", "network": {"id": "328b8eaa-8fae-4e90-ac01-2f9b4e619fe8", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-1060228276-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "15fc68900185447586ee6ff0817087fb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf12ff4e-41", "ovs_interfaceid": "cf12ff4e-41ad-46b1-bece-7d46af7ad869", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:06:31.383361 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:b1:ae,bridge_name='br-int',has_traffic_filtering=True,id=cf12ff4e-41ad-46b1-bece-7d46af7ad869,network=Network(328b8eaa-8fae-4e90-ac01-2f9b4e619fe8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf12ff4e-41') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:06:31.384846 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:b1:ae,bridge_name='br-int',has_traffic_filtering=True,id=cf12ff4e-41ad-46b1-bece-7d46af7ad869,network=Network(328b8eaa-8fae-4e90-ac01-2f9b4e619fe8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf12ff4e-41') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:06:31.384846 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:31.385044 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf12ff4e-41, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:06:31.386192 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:31.388539 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:06:31.389158 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:31.389367 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a4573bce-7766-4bad-9e94-c4ace8f0a8f3) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:06:31.389873 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:31.390532 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:06:31.390754 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:31.393041 np0000001577 nova-compute[98319]: INFO os_vif [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:b1:ae,bridge_name='br-int',has_traffic_filtering=True,id=cf12ff4e-41ad-46b1-bece-7d46af7ad869,network=Network(328b8eaa-8fae-4e90-ac01-2f9b4e619fe8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf12ff4e-41')
May 28 01:06:31.394206 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:06:31.394476 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6', 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1a631603-68c5-4259-80bc-36cc022416c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:06:31.394620 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:06:31.394925 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:06:31.395159 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6', 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1a631603-68c5-4259-80bc-36cc022416c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:06:31.395286 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:06:31.419802 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:31.419802 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:31.419802 np0000001577 nova-compute[98319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:31.419802 np0000001577 nova-compute[98319]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:31.419802 np0000001577 nova-compute[98319]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3efa5642-5a0c-4e2a-b4cb-f9ff76b25f5a (non-flash)
May 28 01:06:31.419802 np0000001577 nova-compute[98319]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17626513-5ef1-4171-8bb8-d4ef0beabb75 (non-flash)
May 28 01:06:31.419802 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:06:31.419802 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:06:31.419802 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:06:31.420207 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:31.420207 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:31.420207 np0000001577 nova-compute[98319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:31.420207 np0000001577 nova-compute[98319]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:31.420207 np0000001577 nova-compute[98319]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3efa5642-5a0c-4e2a-b4cb-f9ff76b25f5a (non-flash)
May 28 01:06:31.420207 np0000001577 nova-compute[98319]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-17626513-5ef1-4171-8bb8-d4ef0beabb75 (non-flash)
May 28 01:06:31.420207 np0000001577 nova-compute[98319]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:06:31.420207 np0000001577 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6 (non-flash)
May 28 01:06:31.420207 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:06:31.420207 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3efa5642-5a0c-4e2a-b4cb-f9ff76b25f5a', '114'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-17626513-5ef1-4171-8bb8-d4ef0beabb75', '115'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6', '90'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6', '91')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:06:31.420207 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6', '91')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:06:31.421071 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6', '90')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:06:31.421805 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c98704b71a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6'): ({'sdb'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:06:31.421968 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:06:31.422384 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Flush multipath device 330000000cd2a6fbc {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:06:31.472965 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:06:31.522657 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:06:31.564145 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-709097fb-1d3b-4ac8-b1f6-dd16f41e0e0c req-8c642547-c5fd-403e-bd50-31fd746a3a28 service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Received event network-vif-unplugged-cf12ff4e-41ad-46b1-bece-7d46af7ad869 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:06:31.564396 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-709097fb-1d3b-4ac8-b1f6-dd16f41e0e0c req-8c642547-c5fd-403e-bd50-31fd746a3a28 service nova] Acquiring lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:31.564634 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-709097fb-1d3b-4ac8-b1f6-dd16f41e0e0c req-8c642547-c5fd-403e-bd50-31fd746a3a28 service nova] Lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:31.564826 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-709097fb-1d3b-4ac8-b1f6-dd16f41e0e0c req-8c642547-c5fd-403e-bd50-31fd746a3a28 service nova] Lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:31.564994 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-709097fb-1d3b-4ac8-b1f6-dd16f41e0e0c req-8c642547-c5fd-403e-bd50-31fd746a3a28 service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] No waiting events found dispatching network-vif-unplugged-cf12ff4e-41ad-46b1-bece-7d46af7ad869 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:06:31.565177 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-709097fb-1d3b-4ac8-b1f6-dd16f41e0e0c req-8c642547-c5fd-403e-bd50-31fd746a3a28 service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Received event network-vif-unplugged-cf12ff4e-41ad-46b1-bece-7d46af7ad869 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:06:31.565344 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-709097fb-1d3b-4ac8-b1f6-dd16f41e0e0c req-8c642547-c5fd-403e-bd50-31fd746a3a28 service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Received event network-vif-unplugged-cf12ff4e-41ad-46b1-bece-7d46af7ad869 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:06:31.565558 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-709097fb-1d3b-4ac8-b1f6-dd16f41e0e0c req-8c642547-c5fd-403e-bd50-31fd746a3a28 service nova] Acquiring lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:31.565729 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-709097fb-1d3b-4ac8-b1f6-dd16f41e0e0c req-8c642547-c5fd-403e-bd50-31fd746a3a28 service nova] Lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:31.566150 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-709097fb-1d3b-4ac8-b1f6-dd16f41e0e0c req-8c642547-c5fd-403e-bd50-31fd746a3a28 service nova] Lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:31.566331 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-709097fb-1d3b-4ac8-b1f6-dd16f41e0e0c req-8c642547-c5fd-403e-bd50-31fd746a3a28 service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] No waiting events found dispatching network-vif-unplugged-cf12ff4e-41ad-46b1-bece-7d46af7ad869 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:06:31.566486 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-709097fb-1d3b-4ac8-b1f6-dd16f41e0e0c req-8c642547-c5fd-403e-bd50-31fd746a3a28 service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Received event network-vif-unplugged-cf12ff4e-41ad-46b1-bece-7d46af7ad869 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:06:31.574030 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:06:31.574181 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:06:31.576441 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:06:31.589069 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:06:31.589203 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:06:31.600705 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:31.644983 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 91, target: iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6, portal: 192.168.40.100,3260]
May 28 01:06:31.644983 np0000001577 nova-compute[98319]: Logout of [sid: 91, target: iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6, portal: 192.168.40.100,3260] successful.
May 28 01:06:31.644983 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:31.661842 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:31.672859 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:31.707102 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 90, target: iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6, portal: 192.168.50.100,3260]
May 28 01:06:31.707102 np0000001577 nova-compute[98319]: Logout of [sid: 90, target: iqn.2023-03.storpool.com:os--volume-1a631603-68c5-4259-80bc-36cc022416c6, portal: 192.168.50.100,3260] successful.
May 28 01:06:31.707102 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:31.721855 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:31.722087 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:06:31.722564 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] <== disconnect_volume: return (327ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:06:31.722564 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:06:31.722749 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Deleting instance files /opt/stack/data/nova/instances/4fb6dc75-4a06-45ea-a050-4ddcd55e8559_del
May 28 01:06:31.723277 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Deletion of /opt/stack/data/nova/instances/4fb6dc75-4a06-45ea-a050-4ddcd55e8559_del complete
May 28 01:06:31.791843 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b2a74e8-2332-466d-be40-46fe10293a01 req-365e3755-d82e-48e9-bdc6-9cd70226c7f9 service nova] Releasing lock "refresh_cache-4fb6dc75-4a06-45ea-a050-4ddcd55e8559" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:06:32.228983 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Took 1.69 seconds to destroy the instance on the hypervisor.
May 28 01:06:32.229635 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:06:32.229954 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:06:32.230129 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:06:32.230332 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:06:32.303064 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:06:32.593026 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-dc5d1342-949e-4c2f-85b3-a06457ad2a8d req-3dbd212e-9538-483e-9078-171dec380e2a service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Received event network-vif-deleted-cf12ff4e-41ad-46b1-bece-7d46af7ad869 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:06:32.593198 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-dc5d1342-949e-4c2f-85b3-a06457ad2a8d req-3dbd212e-9538-483e-9078-171dec380e2a service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Neutron deleted interface cf12ff4e-41ad-46b1-bece-7d46af7ad869; detaching it from the instance and deleting it from the info cache
May 28 01:06:32.594779 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-dc5d1342-949e-4c2f-85b3-a06457ad2a8d req-3dbd212e-9538-483e-9078-171dec380e2a service nova] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Detach interface failed, port_id=cf12ff4e-41ad-46b1-bece-7d46af7ad869, reason: Instance 4fb6dc75-4a06-45ea-a050-4ddcd55e8559 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:06:33.045420 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:06:33.314220 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:33.547341 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Took 1.32 seconds to deallocate network for instance.
May 28 01:06:34.092305 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Took 0.54 seconds to detach 1 volumes for instance.
May 28 01:06:34.598812 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:34.598812 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:34.790984 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:06:34.791131 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:06:35.072006 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "19c25c52-03a6-4665-ac3e-aa455fd99345" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:35.072174 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "19c25c52-03a6-4665-ac3e-aa455fd99345" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:35.294380 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:06:35.581001 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:06:35.715064 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:35.799973 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.201s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:35.843048 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Deleted allocations for instance 4fb6dc75-4a06-45ea-a050-4ddcd55e8559
May 28 01:06:36.130633 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:36.130861 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:36.134213 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:06:36.134462 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Claim successful on node np0000001577
May 28 01:06:36.346880 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:36.390660 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:36.851351 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c8100f0c-a153-4f9c-8e8e-443df991cc8f tempest-TestInstancesWithCinderVolumes-513545111 tempest-TestInstancesWithCinderVolumes-513545111-project-member] Lock "4fb6dc75-4a06-45ea-a050-4ddcd55e8559" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.817s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:36.902220 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "1c35ef60-298f-47f3-99a0-c9de2bd34c55" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:36.902429 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "1c35ef60-298f-47f3-99a0-c9de2bd34c55" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:36.978008 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:06:36.978573 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:06:37.408305 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lazy-loading 'flavor' on Instance uuid 1c35ef60-298f-47f3-99a0-c9de2bd34c55 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:06:37.482753 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:37.489667 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:06:37.489919 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:06:37.992602 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:06:38.231964 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:38.413062 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "1c35ef60-298f-47f3-99a0-c9de2bd34c55" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:38.499150 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.368s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:38.500076 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.017s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:38.500375 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:06:38.501857 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:38.502004 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Auditing locally available compute resources for np0000001577 (node: np0000001577) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 01:06:39.005135 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:06:39.007063 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:06:39.007285 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:06:39.007536 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:06:39.007815 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:06:39.083043 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c803ddeaf4f4b3db07587419087b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050f928f1ce449d6a447cd343dc4ff80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:06:39.486481 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Successfully created port: c2f50d6d-6f06-4817-ab50-46a6b07ac6e2 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:06:39.509920 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:06:39.521849 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c35ef60-298f-47f3-99a0-c9de2bd34c55/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:06:39.564586 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "1c35ef60-298f-47f3-99a0-c9de2bd34c55" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:39.564752 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "1c35ef60-298f-47f3-99a0-c9de2bd34c55" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:39.565054 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Attaching volume 7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 to /dev/vdb
May 28 01:06:39.611102 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:06:39.611912 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c35ef60-298f-47f3-99a0-c9de2bd34c55/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:06:39.612605 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c35ef60-298f-47f3-99a0-c9de2bd34c55/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:06:39.627743 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:06:39.649817 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:06:39.690326 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:06:39.690783 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:06:39.698608 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c35ef60-298f-47f3-99a0-c9de2bd34c55/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:06:39.699850 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:06:39.701257 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe49:4d05', 'fe80::e873:f8ff:fed0:1522', 'fe80::fc16:3eff:fe90:820c', 'fe80::49a:a7ff:fef7:c9e8', 'fe80::fc16:3eff:fea0:668f', 'fe80::843d:f9ff:fe8b:2ddd'] 
May 28 01:06:39.701902 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:06:39.701902 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:06:39.701902 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:06:39.702169 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Updating existing volume attachment record: 95aa4e6c-bb37-445f-8be9-ecb89e84eff5 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:06:39.709740 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:06:39.713962 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "b1ae3969-7f8a-457a-aed8-539761a6d03e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:39.714257 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "b1ae3969-7f8a-457a-aed8-539761a6d03e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:39.718439 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-6 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:06:39.719963 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:06:39.720889 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:06:39.770284 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "env LANG=C uptime" returned: 0 in 0.049s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:06:39.770690 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Hypervisor/Node resource view: name=np0000001577 free_ram=12740MB free_disk=73.04660415649414GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 01:06:39.773560 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:39.773560 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:39.938451 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Successfully updated port: c2f50d6d-6f06-4817-ab50-46a6b07ac6e2 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:06:39.988813 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-464dfc21-1ba2-4e73-bf11-abbc19b0fcd7 req-e2ae3bc1-91f6-4e8e-875c-385cd5edb1c1 service nova] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Received event network-changed-c2f50d6d-6f06-4817-ab50-46a6b07ac6e2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:06:39.989125 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-464dfc21-1ba2-4e73-bf11-abbc19b0fcd7 req-e2ae3bc1-91f6-4e8e-875c-385cd5edb1c1 service nova] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Refreshing instance network info cache due to event network-changed-c2f50d6d-6f06-4817-ab50-46a6b07ac6e2. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:06:39.989353 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-464dfc21-1ba2-4e73-bf11-abbc19b0fcd7 req-e2ae3bc1-91f6-4e8e-875c-385cd5edb1c1 service nova] Acquiring lock "refresh_cache-19c25c52-03a6-4665-ac3e-aa455fd99345" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:06:39.989490 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-464dfc21-1ba2-4e73-bf11-abbc19b0fcd7 req-e2ae3bc1-91f6-4e8e-875c-385cd5edb1c1 service nova] Acquired lock "refresh_cache-19c25c52-03a6-4665-ac3e-aa455fd99345" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:06:39.989664 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-464dfc21-1ba2-4e73-bf11-abbc19b0fcd7 req-e2ae3bc1-91f6-4e8e-875c-385cd5edb1c1 service nova] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Refreshing network info cache for port c2f50d6d-6f06-4817-ab50-46a6b07ac6e2 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:06:40.016205 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Booting with volume snapshot 31508f27-f00f-4272-929a-f449929ca16c at /dev/vda
May 28 01:06:40.217529 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:06:40.314598 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', 'iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '1c35ef60-298f-47f3-99a0-c9de2bd34c55', 'attached_at': '', 'detached_at': '', 'volume_id': '7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', 'serial': '7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 01:06:40.315824 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:06:40.315996 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', 'iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:06:40.316165 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:06:40.316677 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:06:40.316677 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', 'iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:06:40.329560 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:06:40.331052 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:06:40.332203 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:06:40.332442 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:06:40.333721 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:06:40.334065 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:06:40.346666 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:06:40.346666 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:40.351208 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:06:40.351208 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:40.362645 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6] added
May 28 01:06:40.362645 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:06:40.362645 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:06:40.362645 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:06:40.362645 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:06:40.362645 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:06:40.362645 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:40.362916 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:06:40.363122 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0306(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:06:40.363327 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:06:40.366526 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6] added
May 28 01:06:40.366526 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:06:40.366526 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:06:40.366526 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:06:40.366526 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:06:40.366526 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:06:40.366526 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:40.366771 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:06:40.366806 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.033(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:06:40.367828 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:06:40.442680 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "refresh_cache-19c25c52-03a6-4665-ac3e-aa455fd99345" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:06:40.491537 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-464dfc21-1ba2-4e73-bf11-abbc19b0fcd7 req-e2ae3bc1-91f6-4e8e-875c-385cd5edb1c1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:06:40.564319 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-464dfc21-1ba2-4e73-bf11-abbc19b0fcd7 req-e2ae3bc1-91f6-4e8e-875c-385cd5edb1c1 service nova] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:06:40.688590 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-464dfc21-1ba2-4e73-bf11-abbc19b0fcd7 req-e2ae3bc1-91f6-4e8e-875c-385cd5edb1c1 service nova] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:06:40.767170 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:40.808719 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Acquiring lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:40.808865 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:40.809017 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Acquiring lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:40.809119 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:40.809226 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:40.811605 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Terminating instance
May 28 01:06:40.822022 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance d5aa4bd8-07f0-4329-88d3-63aa5a2be798 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:06:40.822655 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 36be2ae9-c375-4335-a421-cf92ea63e489 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:06:40.822785 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 1c35ef60-298f-47f3-99a0-c9de2bd34c55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:06:40.822828 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 19c25c52-03a6-4665-ac3e-aa455fd99345 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:06:40.855039 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:40.868096 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:41.190971 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-464dfc21-1ba2-4e73-bf11-abbc19b0fcd7 req-e2ae3bc1-91f6-4e8e-875c-385cd5edb1c1 service nova] Releasing lock "refresh_cache-19c25c52-03a6-4665-ac3e-aa455fd99345" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:06:41.192084 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquired lock "refresh_cache-19c25c52-03a6-4665-ac3e-aa455fd99345" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:06:41.192084 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:06:41.316533 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:06:41.325507 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance b1ae3969-7f8a-457a-aed8-539761a6d03e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 28 01:06:41.326490 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 01:06:41.326490 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Final resource view: name=np0000001577 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:06:39 up 38 min,  2 users,  load average: 6.09, 6.46, 4.12\n', 'num_instances': '4', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '4', 'num_proj_8ed67ebc30b04fe5895f2b2ddd66e9c3': '1', 'io_workload': '1', 'num_proj_050f928f1ce449d6a447cd343dc4ff80': '2', 'num_proj_a430f0d6bcc84a29bc3e96514422896b': '1', 'num_vm_building': '1', 'num_task_block_device_mapping': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 01:06:41.342145 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:41.344911 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:41.363923 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:06:41.365121 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:41.367807 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:06:41.369261 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:06:41.386732 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:06:41.386732 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:06:41.390338 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:06:41.390338 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:41.395085 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:41.400243 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:41.403616 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:41.408596 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:41.415904 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:41.424539 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:41.424539 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:41.424539 np0000001577 nova-compute[98319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:41.424539 np0000001577 nova-compute[98319]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:41.424539 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:06:41.424873 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:41.424873 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:41.424873 np0000001577 nova-compute[98319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:41.424873 np0000001577 nova-compute[98319]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:41.424873 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:06:41.431389 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:41.431389 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:41.431389 np0000001577 nova-compute[98319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:41.431389 np0000001577 nova-compute[98319]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:41.431389 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:06:41.431389 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:41.431389 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:41.431389 np0000001577 nova-compute[98319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:41.431389 np0000001577 nova-compute[98319]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:41.431389 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:06:41.467143 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6, portal: 192.168.50.100,3260]
May 28 01:06:41.467143 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6, portal: 192.168.50.100,3260] successful.
May 28 01:06:41.467143 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:41.476988 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6, portal: 192.168.40.100,3260]
May 28 01:06:41.476988 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6, portal: 192.168.40.100,3260] successful.
May 28 01:06:41.476988 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:41.484210 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:41.491027 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:41.503980 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:41.503980 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:41.503980 np0000001577 nova-compute[98319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:41.503980 np0000001577 nova-compute[98319]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:41.503980 np0000001577 nova-compute[98319]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 (non-flash)
May 28 01:06:41.503980 np0000001577 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 (non-flash)
May 28 01:06:41.503980 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:06:41.503980 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:41.503980 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:41.503980 np0000001577 nova-compute[98319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:41.503980 np0000001577 nova-compute[98319]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:41.503980 np0000001577 nova-compute[98319]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 (non-flash)
May 28 01:06:41.503980 np0000001577 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 (non-flash)
May 28 01:06:41.503980 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:06:41.503980 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:06:41.503980 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:06:41.503980 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] HCTL ('7', '-', '-', 0) found on session 116 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:06:41.503980 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:06:41.506924 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:41.506924 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:41.506924 np0000001577 nova-compute[98319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:41.506924 np0000001577 nova-compute[98319]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:41.506924 np0000001577 nova-compute[98319]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 (non-flash)
May 28 01:06:41.506924 np0000001577 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 (non-flash)
May 28 01:06:41.506924 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:06:41.509161 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:41.509161 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:41.509161 np0000001577 nova-compute[98319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:41.509161 np0000001577 nova-compute[98319]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:41.509161 np0000001577 nova-compute[98319]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 (non-flash)
May 28 01:06:41.509161 np0000001577 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 (non-flash)
May 28 01:06:41.509161 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:06:41.509161 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.176s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:06:41.509161 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:06:41.509161 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] HCTL ('8', '-', '-', 0) found on session 117 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:06:41.509161 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:06:41.523077 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Searching for a device in session 116 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:06:41.523077 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:06:41.525135 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Searching for a device in session 117 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:06:41.525422 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:06:41.533578 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b6e0a413-b949-4006-9a02-6c958d92cf73 req-9a99a759-2e80-4024-8761-54f3d6f5cc7d service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Received event network-vif-unplugged-0fe5497e-7f98-48c5-89d4-5168815ab9c1 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:06:41.533578 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b6e0a413-b949-4006-9a02-6c958d92cf73 req-9a99a759-2e80-4024-8761-54f3d6f5cc7d service nova] Acquiring lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:41.533578 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b6e0a413-b949-4006-9a02-6c958d92cf73 req-9a99a759-2e80-4024-8761-54f3d6f5cc7d service nova] Lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:41.533946 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b6e0a413-b949-4006-9a02-6c958d92cf73 req-9a99a759-2e80-4024-8761-54f3d6f5cc7d service nova] Lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:41.534116 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b6e0a413-b949-4006-9a02-6c958d92cf73 req-9a99a759-2e80-4024-8761-54f3d6f5cc7d service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] No waiting events found dispatching network-vif-unplugged-0fe5497e-7f98-48c5-89d4-5168815ab9c1 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:06:41.534253 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b6e0a413-b949-4006-9a02-6c958d92cf73 req-9a99a759-2e80-4024-8761-54f3d6f5cc7d service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Received event network-vif-unplugged-0fe5497e-7f98-48c5-89d4-5168815ab9c1 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:06:41.626223 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:41.634560 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:41.636957 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:06:41.636957 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:06:41.651120 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.998979741999847 future=<Future at 0x7c984c645670 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:06:41.652885 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Instance destroyed successfully.
May 28 01:06:41.653501 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lazy-loading 'resources' on Instance uuid d5aa4bd8-07f0-4329-88d3-63aa5a2be798 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:06:41.743668 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:06:41.873642 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:06:41.987080 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Updating instance_info_cache with network_info: [{"id": "c2f50d6d-6f06-4817-ab50-46a6b07ac6e2", "address": "fa:16:3e:49:81:23", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f50d6d-6f", "ovs_interfaceid": "c2f50d6d-6f06-4817-ab50-46a6b07ac6e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:06:42.055181 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-864029c3-fa40-4240-a46f-4f4e02118074 req-2ed0e8f3-21f4-49c3-8b0b-399c9cff30b5 service nova] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Received event network-vif-unplugged-c2f50d6d-6f06-4817-ab50-46a6b07ac6e2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:06:42.055358 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-864029c3-fa40-4240-a46f-4f4e02118074 req-2ed0e8f3-21f4-49c3-8b0b-399c9cff30b5 service nova] Acquiring lock "19c25c52-03a6-4665-ac3e-aa455fd99345-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:42.055581 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-864029c3-fa40-4240-a46f-4f4e02118074 req-2ed0e8f3-21f4-49c3-8b0b-399c9cff30b5 service nova] Lock "19c25c52-03a6-4665-ac3e-aa455fd99345-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:42.055723 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-864029c3-fa40-4240-a46f-4f4e02118074 req-2ed0e8f3-21f4-49c3-8b0b-399c9cff30b5 service nova] Lock "19c25c52-03a6-4665-ac3e-aa455fd99345-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:42.055894 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-864029c3-fa40-4240-a46f-4f4e02118074 req-2ed0e8f3-21f4-49c3-8b0b-399c9cff30b5 service nova] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] No waiting events found dispatching network-vif-unplugged-c2f50d6d-6f06-4817-ab50-46a6b07ac6e2 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:06:42.056054 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-864029c3-fa40-4240-a46f-4f4e02118074 req-2ed0e8f3-21f4-49c3-8b0b-399c9cff30b5 service nova] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Received unexpected event network-vif-unplugged-c2f50d6d-6f06-4817-ab50-46a6b07ac6e2 for instance with vm_state building and task_state block_device_mapping.
May 28 01:06:42.141804 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:06:42.155501 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T01:04:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-192077429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-serveractionsv293testjson-server-417111260',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZCISJi6nlA4mDzDOiuCg9487tvddGj6j0Jn9d1BsbnnHFEGFqQb7Xhz7pIcCKtGhPE7XNyy3CeMbSPQsZu+OlSGdWSFk970ycf5MTngHfj4cd5ACI067WxxJTu4s1avA==',key_name='tempest-keypair-1686283236',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:06:02Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ed67ebc30b04fe5895f2b2ddd66e9c3',ramdisk_id='',reservation_id='r-ue5gqdd9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5574e7a7-cbb4-4ae2-8b7f-aa34fd051b87',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1502319923',owner_user_name='tempest-ServerActionsV293TestJSON-1502319923-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:06:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5211ae90fcf1476b917822f860021f1b',uuid=d5aa4bd8-07f0-4329-88d3-63aa5a2be798,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "address": "fa:16:3e:a0:66:8f", "network": {"id": "330f1ba8-b51a-4cb7-8596-73705ae8eecd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-493364840-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed67ebc30b04fe5895f2b2ddd66e9c3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe5497e-7f", "ovs_interfaceid": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:06:42.155720 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Converting VIF {"id": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "address": "fa:16:3e:a0:66:8f", "network": {"id": "330f1ba8-b51a-4cb7-8596-73705ae8eecd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-493364840-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8ed67ebc30b04fe5895f2b2ddd66e9c3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe5497e-7f", "ovs_interfaceid": "0fe5497e-7f98-48c5-89d4-5168815ab9c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:06:42.156187 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:66:8f,bridge_name='br-int',has_traffic_filtering=True,id=0fe5497e-7f98-48c5-89d4-5168815ab9c1,network=Network(330f1ba8-b51a-4cb7-8596-73705ae8eecd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe5497e-7f') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:06:42.156450 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:66:8f,bridge_name='br-int',has_traffic_filtering=True,id=0fe5497e-7f98-48c5-89d4-5168815ab9c1,network=Network(330f1ba8-b51a-4cb7-8596-73705ae8eecd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe5497e-7f') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:06:42.160038 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:42.160038 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0fe5497e-7f, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:06:42.160038 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:42.160038 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:06:42.160038 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:42.162422 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:42.162578 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=205eac0b-606b-4fd8-9e0d-5029ab5dec15) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:06:42.163615 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:42.164094 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:06:42.164351 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:42.166103 np0000001577 nova-compute[98319]: INFO os_vif [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:66:8f,bridge_name='br-int',has_traffic_filtering=True,id=0fe5497e-7f98-48c5-89d4-5168815ab9c1,network=Network(330f1ba8-b51a-4cb7-8596-73705ae8eecd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe5497e-7f')
May 28 01:06:42.167279 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:06:42.167490 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:06:42.167612 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:06:42.334046 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:06:42.488910 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Releasing lock "refresh_cache-19c25c52-03a6-4665-ac3e-aa455fd99345" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:06:42.489191 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Instance network_info: |[{"id": "c2f50d6d-6f06-4817-ab50-46a6b07ac6e2", "address": "fa:16:3e:49:81:23", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f50d6d-6f", "ovs_interfaceid": "c2f50d6d-6f06-4817-ab50-46a6b07ac6e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:06:42.647395 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Compute_service record updated for np0000001577:np0000001577 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 01:06:42.647593 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.876s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:42.647825 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.881s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:42.648026 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:06:42.651394 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:06:42.651529 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Claim successful on node np0000001577
May 28 01:06:42.939312 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:43.351159 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Found WWN 3300000006e61318b for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:06:43.351525 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:06:43.351942 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.184s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:06:43.352258 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:06:43.352593 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:06:43.352859 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '3300000006e61318b', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '3300000006e61318b'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:06:43.352998 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006e61318b', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '3300000006e61318b'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:06:43.354598 np0000001577 nova-compute[98319]: WARNING stevedore.named [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 01:06:43.354894 np0000001577 nova-compute[98319]: WARNING castellan.key_manager [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:06:43.355074 np0000001577 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:06:43.373577 np0000001577 nova-compute[98319]: WARNING os_brick.encryptors.luks [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 28 01:06:43.373916 np0000001577 nova-compute[98319]: WARNING stevedore.named [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 01:06:43.374056 np0000001577 nova-compute[98319]: WARNING castellan.key_manager [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:06:43.374176 np0000001577 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:06:43.374657 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x7c984c6dc4d0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', 'iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '1c35ef60-298f-47f3-99a0-c9de2bd34c55', 'attached_at': '', 'detached_at': '', 'volume_id': '7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', 'serial': '7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6'} {{(pid=98319) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 01:06:43.374787 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors.luks [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] formatting encrypted volume /dev/dm-0 {{(pid=98319) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 28 01:06:43.379735 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:43.379735 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:43.379735 np0000001577 nova-compute[98319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:43.379735 np0000001577 nova-compute[98319]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:43.379735 np0000001577 nova-compute[98319]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 (non-flash)
May 28 01:06:43.379735 np0000001577 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 (non-flash)
May 28 01:06:43.379735 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:06:43.379927 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:43.379927 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:43.379927 np0000001577 nova-compute[98319]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:43.379927 np0000001577 nova-compute[98319]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 (non-flash)
May 28 01:06:43.379927 np0000001577 nova-compute[98319]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 (non-flash)
May 28 01:06:43.379927 np0000001577 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 (non-flash)
May 28 01:06:43.379927 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:06:43.380049 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', '107'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', '116'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', '117')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:06:43.380119 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', '106')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:06:43.381055 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46', '107')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:06:43.381664 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c9870586660>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46'): ({'sde'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:06:43.381834 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Removing multipathed devices sde, sdd {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:06:43.382051 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Flush multipath device 33000000034067dfc {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:06:43.434803 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:06:43.461133 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:06:43.471322 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:06:43.482895 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:06:43.495261 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:06:43.535213 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:06:43.535588 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:06:43.536712 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:06:43.544365 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:06:43.545471 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:06:43.550496 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:06:43.550764 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:06:43.559723 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:06:43.559723 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe49:4d05', 'fe80::e873:f8ff:fed0:1522', 'fe80::fc16:3eff:fe90:820c', 'fe80::49a:a7ff:fef7:c9e8'] 
May 28 01:06:43.559723 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:06:43.559723 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:06:43.559723 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:06:43.559723 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Updating existing volume attachment record: fe05f7db-8461-4326-b9e8-f4d10db72908 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:06:43.565017 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:43.596661 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 106, target: iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46, portal: 192.168.40.100,3260]
May 28 01:06:43.596661 np0000001577 nova-compute[98319]: Logout of [sid: 106, target: iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46, portal: 192.168.40.100,3260] successful.
May 28 01:06:43.596661 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:43.608744 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e8f09a20-1a2d-4b6c-91e7-acccb68f9c62 req-006eb544-8473-48ee-8165-d9183df6c65b service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Received event network-vif-unplugged-0fe5497e-7f98-48c5-89d4-5168815ab9c1 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:06:43.612010 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:43.612316 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e8f09a20-1a2d-4b6c-91e7-acccb68f9c62 req-006eb544-8473-48ee-8165-d9183df6c65b service nova] Acquiring lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:43.612607 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e8f09a20-1a2d-4b6c-91e7-acccb68f9c62 req-006eb544-8473-48ee-8165-d9183df6c65b service nova] Lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:43.612771 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e8f09a20-1a2d-4b6c-91e7-acccb68f9c62 req-006eb544-8473-48ee-8165-d9183df6c65b service nova] Lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:43.612934 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e8f09a20-1a2d-4b6c-91e7-acccb68f9c62 req-006eb544-8473-48ee-8165-d9183df6c65b service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] No waiting events found dispatching network-vif-unplugged-0fe5497e-7f98-48c5-89d4-5168815ab9c1 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:06:43.613077 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e8f09a20-1a2d-4b6c-91e7-acccb68f9c62 req-006eb544-8473-48ee-8165-d9183df6c65b service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Received event network-vif-unplugged-0fe5497e-7f98-48c5-89d4-5168815ab9c1 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:06:43.629744 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:43.648152 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:06:43.649197 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:06:43.649402 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:06:43.649620 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:06:43.649816 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:06:43.650298 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:06:43.650438 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 01:06:43.650725 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.33 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:06:43.660770 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 107, target: iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46, portal: 192.168.50.100,3260]
May 28 01:06:43.660770 np0000001577 nova-compute[98319]: Logout of [sid: 107, target: iqn.2023-03.storpool.com:os--volume-b5c97cc4-39c3-49cb-a29f-3e7350d6fc46, portal: 192.168.50.100,3260] successful.
May 28 01:06:43.660770 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:43.676507 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:43.676804 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:06:43.676916 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] <== disconnect_volume: return (1509ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:06:43.677055 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:06:43.677438 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Deleting instance files /opt/stack/data/nova/instances/d5aa4bd8-07f0-4329-88d3-63aa5a2be798_del
May 28 01:06:43.678298 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Deletion of /opt/stack/data/nova/instances/d5aa4bd8-07f0-4329-88d3-63aa5a2be798_del complete
May 28 01:06:43.962932 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:06:43.963296 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:06:43.978612 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:06:43.978941 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 53.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:06:44.184104 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Took 2.87 seconds to destroy the instance on the hypervisor.
May 28 01:06:44.185206 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:06:44.185625 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:06:44.185724 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:06:44.186245 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:06:44.252958 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:06:44.315151 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Acquiring lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:44.315368 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:44.466177 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:06:44.673133 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-12c3ba63-2144-4fff-a329-45c7f70fbb35 req-ab1701bc-51c3-456a-bec5-504fecbe7376 service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Received event network-vif-deleted-0fe5497e-7f98-48c5-89d4-5168815ab9c1 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:06:44.673819 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-12c3ba63-2144-4fff-a329-45c7f70fbb35 req-ab1701bc-51c3-456a-bec5-504fecbe7376 service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Neutron deleted interface 0fe5497e-7f98-48c5-89d4-5168815ab9c1; detaching it from the instance and deleting it from the info cache
May 28 01:06:44.675135 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-12c3ba63-2144-4fff-a329-45c7f70fbb35 req-ab1701bc-51c3-456a-bec5-504fecbe7376 service nova] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Detach interface failed, port_id=0fe5497e-7f98-48c5-89d4-5168815ab9c1, reason: Instance d5aa4bd8-07f0-4329-88d3-63aa5a2be798 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:06:44.817196 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:06:44.973662 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.326s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:44.974608 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:06:45.124671 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:06:45.362161 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:45.362373 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:45.365207 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:06:45.365389 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Claim successful on node np0000001577
May 28 01:06:45.479637 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:06:45.480188 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:06:45.480188 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:06:45.480349 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:06:45.547189 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf90ea61781a41ca91d0d5266f37cae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f132ca2a48c44f6097340763039224c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:06:45.626568 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Took 1.44 seconds to deallocate network for instance.
May 28 01:06:45.667364 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:06:45.668851 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:06:45.669074 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Creating image(s)
May 28 01:06:45.669444 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:06:45.669862 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Ensure instance console log exists: /opt/stack/data/nova/instances/19c25c52-03a6-4665-ac3e-aa455fd99345/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:06:45.670075 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:45.670215 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:45.670344 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:45.670860 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Start _get_guest_xml network_info=[{"id": "c2f50d6d-6f06-4817-ab50-46a6b07ac6e2", "address": "fa:16:3e:49:81:23", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f50d6d-6f", "ovs_interfaceid": "c2f50d6d-6f06-4817-ab50-46a6b07ac6e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2026-05-28T01:06:32Z,direct_url=<?>,disk_format='raw',id=7137f17c-dc43-4144-8e21-3a7d7f7d7e9e,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-423561588',owner='050f928f1ce449d6a447cd343dc4ff80',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2026-05-28T01:06:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474', 'iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe6b70ee-a1a2-4174-beec-7239b6484474', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '19c25c52-03a6-4665-ac3e-aa455fd99345', 'attached_at': '', 'detached_at': '', 'volume_id': 'fe6b70ee-a1a2-4174-beec-7239b6484474', 'serial': 'fe6b70ee-a1a2-4174-beec-7239b6484474'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'fe05f7db-8461-4326-b9e8-f4d10db72908', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:06:45.673881 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:06:45.675275 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-image-snapshot-server-1614040866', uuid='19c25c52-03a6-4665-ac3e-aa455fd99345'), owner=OwnerMeta(userid='0c803ddeaf4f4b3db07587419087b3b2', username='tempest-TestVolumeBootPattern-1449742411-project-member', projectid='050f928f1ce449d6a447cd343dc4ff80', projectname='tempest-TestVolumeBootPattern-1449742411'), image=ImageMeta(id='7137f17c-dc43-4144-8e21-3a7d7f7d7e9e', name=None, container_format='bare', disk_format='raw', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio', 'img_bdm_v2': True, 'img_root_device_name': '/dev/vda'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c2f50d6d-6f06-4817-ab50-46a6b07ac6e2", "address": "fa:16:3e:49:81:23", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f50d6d-6f", "ovs_interfaceid": "c2f50d6d-6f06-4817-ab50-46a6b07ac6e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930405.6747947) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:06:45.676219 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:06:45.676558 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:06:45.677366 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:06:45.677517 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:06:45.678431 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:06:45.678728 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2026-05-28T01:06:32Z,direct_url=<?>,disk_format='raw',id=7137f17c-dc43-4144-8e21-3a7d7f7d7e9e,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-423561588',owner='050f928f1ce449d6a447cd343dc4ff80',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2026-05-28T01:06:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:06:45.678864 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:06:45.678951 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:06:45.679068 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:06:45.679141 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:06:45.679235 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:06:45.679386 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:06:45.679477 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:06:45.679606 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:06:45.679703 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:06:45.679808 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:06:45.689348 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:06:45.689603 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474', 'iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe6b70ee-a1a2-4174-beec-7239b6484474', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:06:45.689747 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:06:45.875868 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00040355100009037415 future=<Future at 0x7c984c5330e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:06:45.875868 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:06:45.876018 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=10.77381655299996 future=<Future at 0x7c984c645670 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:06:45.876018 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=10.773751651999646 future=<Future at 0x7c984c645670 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:06:45.877895 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Emitting event <LifecycleEvent: 1779930390.8753078, 4fb6dc75-4a06-45ea-a050-4ddcd55e8559 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:06:45.877895 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] VM Stopped (Lifecycle Event)
May 28 01:06:45.972703 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.282s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:06:45.972703 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474', 'iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe6b70ee-a1a2-4174-beec-7239b6484474', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:06:45.984623 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:06:45.984997 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:06:45.986207 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:06:45.986468 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:06:45.987283 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:06:45.987497 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:06:45.987836 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:06:45.999256 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:06:45.999256 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:46.005815 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:06:46.005815 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:46.013006 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474] added
May 28 01:06:46.013006 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:06:46.013006 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:06:46.013006 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:06:46.013006 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:06:46.013006 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:06:46.013006 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:46.013177 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:06:46.013392 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.027(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:06:46.013527 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:06:46.017888 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474] added
May 28 01:06:46.017888 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:06:46.017888 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:06:46.017888 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:06:46.017888 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:06:46.017888 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:06:46.017888 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:46.018051 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:06:46.018243 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.031(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:06:46.018326 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:06:46.031075 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Successfully created port: 99bb5945-b1ef-41b0-bda0-bc7d698b2789 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:06:46.173664 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Took 0.55 seconds to detach 1 volumes for instance.
May 28 01:06:46.175716 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Deleting volume: b5c97cc4-39c3-49cb-a29f-3e7350d6fc46 {{(pid=98319) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 01:06:46.378702 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: 4fb6dc75-4a06-45ea-a050-4ddcd55e8559] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:06:46.410951 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:46.492254 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Successfully updated port: 99bb5945-b1ef-41b0-bda0-bc7d698b2789 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:06:46.493721 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:06:46.657296 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:06:46.657474 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:06:46.724981 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-00195ec8-4223-4b44-8135-d67511d9e5b4 req-90da62b8-2660-4e3d-83a7-33d8cbe08986 service nova] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Received event network-changed-99bb5945-b1ef-41b0-bda0-bc7d698b2789 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:06:46.725456 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-00195ec8-4223-4b44-8135-d67511d9e5b4 req-90da62b8-2660-4e3d-83a7-33d8cbe08986 service nova] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Refreshing instance network info cache due to event network-changed-99bb5945-b1ef-41b0-bda0-bc7d698b2789. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:06:46.725683 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-00195ec8-4223-4b44-8135-d67511d9e5b4 req-90da62b8-2660-4e3d-83a7-33d8cbe08986 service nova] Acquiring lock "refresh_cache-b1ae3969-7f8a-457a-aed8-539761a6d03e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:06:46.726371 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-00195ec8-4223-4b44-8135-d67511d9e5b4 req-90da62b8-2660-4e3d-83a7-33d8cbe08986 service nova] Acquired lock "refresh_cache-b1ae3969-7f8a-457a-aed8-539761a6d03e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:06:46.726371 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-00195ec8-4223-4b44-8135-d67511d9e5b4 req-90da62b8-2660-4e3d-83a7-33d8cbe08986 service nova] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Refreshing network info cache for port 99bb5945-b1ef-41b0-bda0-bc7d698b2789 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:06:46.732105 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:46.898969 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:47.000341 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "refresh_cache-b1ae3969-7f8a-457a-aed8-539761a6d03e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:06:47.013908 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:06:47.018716 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:06:47.026702 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:06:47.026702 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:06:47.033358 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:06:47.033358 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:47.041622 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:47.050893 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:47.059138 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:47.059138 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:47.059138 np0000001577 nova-compute[98319]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 (non-flash)
May 28 01:06:47.059138 np0000001577 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 (non-flash)
May 28 01:06:47.059138 np0000001577 nova-compute[98319]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3be836-64e9-46e8-b395-c9149d0d79b6 (non-flash)
May 28 01:06:47.059138 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:06:47.059423 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:47.059423 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:47.059423 np0000001577 nova-compute[98319]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 (non-flash)
May 28 01:06:47.059423 np0000001577 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 (non-flash)
May 28 01:06:47.059423 np0000001577 nova-compute[98319]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3be836-64e9-46e8-b395-c9149d0d79b6 (non-flash)
May 28 01:06:47.059423 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:06:47.066945 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:47.066945 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:47.066945 np0000001577 nova-compute[98319]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 (non-flash)
May 28 01:06:47.066945 np0000001577 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 (non-flash)
May 28 01:06:47.066945 np0000001577 nova-compute[98319]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3be836-64e9-46e8-b395-c9149d0d79b6 (non-flash)
May 28 01:06:47.066945 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:06:47.067130 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:47.067130 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:47.067130 np0000001577 nova-compute[98319]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 (non-flash)
May 28 01:06:47.067130 np0000001577 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 (non-flash)
May 28 01:06:47.067130 np0000001577 nova-compute[98319]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3be836-64e9-46e8-b395-c9149d0d79b6 (non-flash)
May 28 01:06:47.067130 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:06:47.105539 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474, portal: 192.168.50.100,3260]
May 28 01:06:47.105539 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474, portal: 192.168.50.100,3260] successful.
May 28 01:06:47.105539 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:47.116759 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474, portal: 192.168.40.100,3260]
May 28 01:06:47.116759 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474, portal: 192.168.40.100,3260] successful.
May 28 01:06:47.116759 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:47.117187 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:47.131978 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:47.146634 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:47.146634 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:47.146634 np0000001577 nova-compute[98319]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 (non-flash)
May 28 01:06:47.146634 np0000001577 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 (non-flash)
May 28 01:06:47.146634 np0000001577 nova-compute[98319]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3be836-64e9-46e8-b395-c9149d0d79b6 (non-flash)
May 28 01:06:47.146634 np0000001577 nova-compute[98319]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:06:47.146634 np0000001577 nova-compute[98319]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:06:47.146634 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:06:47.147006 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:47.147006 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:47.147006 np0000001577 nova-compute[98319]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 (non-flash)
May 28 01:06:47.147006 np0000001577 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 (non-flash)
May 28 01:06:47.147006 np0000001577 nova-compute[98319]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3be836-64e9-46e8-b395-c9149d0d79b6 (non-flash)
May 28 01:06:47.147006 np0000001577 nova-compute[98319]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:06:47.147006 np0000001577 nova-compute[98319]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:06:47.147006 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:06:47.147170 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:06:47.147280 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:06:47.148397 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] HCTL ('10', '-', '-', 0) found on session 119 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:06:47.148573 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:06:47.154660 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:47.154660 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:47.154660 np0000001577 nova-compute[98319]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 (non-flash)
May 28 01:06:47.154660 np0000001577 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 (non-flash)
May 28 01:06:47.154660 np0000001577 nova-compute[98319]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3be836-64e9-46e8-b395-c9149d0d79b6 (non-flash)
May 28 01:06:47.154660 np0000001577 nova-compute[98319]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:06:47.154660 np0000001577 nova-compute[98319]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:06:47.154660 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:06:47.154998 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:47.154998 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:47.154998 np0000001577 nova-compute[98319]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 (non-flash)
May 28 01:06:47.154998 np0000001577 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 (non-flash)
May 28 01:06:47.154998 np0000001577 nova-compute[98319]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3be836-64e9-46e8-b395-c9149d0d79b6 (non-flash)
May 28 01:06:47.154998 np0000001577 nova-compute[98319]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:06:47.154998 np0000001577 nova-compute[98319]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:06:47.154998 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:06:47.154998 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.169s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:06:47.155359 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:06:47.155803 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] HCTL ('13', '-', '-', 0) found on session 120 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:06:47.155887 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:06:47.161012 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:06:47.166335 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching for a device in session 119 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:06:47.166522 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'fe6b70ee-a1a2-4174-beec-7239b6484474', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:06:47.171012 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching for a device in session 120 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:06:47.171012 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe6b70ee-a1a2-4174-beec-7239b6484474', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:06:47.171012 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:47.227951 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-00195ec8-4223-4b44-8135-d67511d9e5b4 req-90da62b8-2660-4e3d-83a7-33d8cbe08986 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:06:47.280020 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 01:06:47.280020 np0000001577 nova-compute[98319]:   <usage type="volume">
May 28 01:06:47.280020 np0000001577 nova-compute[98319]:     <volume>7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6</volume>
May 28 01:06:47.280020 np0000001577 nova-compute[98319]:   </usage>
May 28 01:06:47.280020 np0000001577 nova-compute[98319]: </secret>
May 28 01:06:47.280020 np0000001577 nova-compute[98319]:  {{(pid=98319) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 01:06:47.288190 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lazy-loading 'flavor' on Instance uuid 1c35ef60-298f-47f3-99a0-c9de2bd34c55 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:06:47.318786 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-00195ec8-4223-4b44-8135-d67511d9e5b4 req-90da62b8-2660-4e3d-83a7-33d8cbe08986 service nova] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:06:47.464491 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-00195ec8-4223-4b44-8135-d67511d9e5b4 req-90da62b8-2660-4e3d-83a7-33d8cbe08986 service nova] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:06:47.510564 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:06:47.510564 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:06:47.510564 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Creating image(s)
May 28 01:06:47.510564 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1ae3969-7f8a-457a-aed8-539761a6d03e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:47.510564 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "/opt/stack/data/nova/instances/b1ae3969-7f8a-457a-aed8-539761a6d03e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:47.510564 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "/opt/stack/data/nova/instances/b1ae3969-7f8a-457a-aed8-539761a6d03e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:47.510564 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:06:47.513958 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:06:47.514979 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:06:47.594283 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.078s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:06:47.594283 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:47.594646 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:47.595068 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:06:47.597645 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:06:47.597785 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:06:47.671091 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.308s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:47.672039 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:06:47.677721 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.940s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:47.682806 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.081s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:06:47.683212 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/b1ae3969-7f8a-457a-aed8-539761a6d03e/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:06:47.731466 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/b1ae3969-7f8a-457a-aed8-539761a6d03e/disk 1073741824" returned: 0 in 0.047s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:06:47.731466 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.136s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:47.731466 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:06:47.791244 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Attempting to attach volume 7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:06:47.793765 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:06:47.793765 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:06:47.793765 np0000001577 nova-compute[98319]:   <alias name="ua-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6"/>
May 28 01:06:47.793765 np0000001577 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 28 01:06:47.793765 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:06:47.793765 np0000001577 nova-compute[98319]:   <serial>7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6</serial>
May 28 01:06:47.793765 np0000001577 nova-compute[98319]:   <encryption format="luks">
May 28 01:06:47.793765 np0000001577 nova-compute[98319]:     <secret type="passphrase" uuid="7ace94a9-e373-44db-b272-e2028a2a1a34"/>
May 28 01:06:47.793765 np0000001577 nova-compute[98319]:   </encryption>
May 28 01:06:47.793765 np0000001577 nova-compute[98319]: </disk>
May 28 01:06:47.793765 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:06:47.812238 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.081s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:06:47.812810 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b1ae3969-7f8a-457a-aed8-539761a6d03e/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:06:47.813186 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ae3969-7f8a-457a-aed8-539761a6d03e/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:06:47.896182 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ae3969-7f8a-457a-aed8-539761a6d03e/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:06:47.896637 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Cannot resize image /opt/stack/data/nova/instances/b1ae3969-7f8a-457a-aed8-539761a6d03e/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:06:47.897083 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:06:47.898395 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Ensure instance console log exists: /opt/stack/data/nova/instances/b1ae3969-7f8a-457a-aed8-539761a6d03e/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:06:47.898747 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:47.898966 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:47.899095 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:47.967428 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-00195ec8-4223-4b44-8135-d67511d9e5b4 req-90da62b8-2660-4e3d-83a7-33d8cbe08986 service nova] Releasing lock "refresh_cache-b1ae3969-7f8a-457a-aed8-539761a6d03e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:06:47.968050 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquired lock "refresh_cache-b1ae3969-7f8a-457a-aed8-539761a6d03e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:06:47.968243 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:06:47.988872 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:06:48.029648 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:06:48.030017 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:06:48.184038 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:06:48.184038 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:06:48.184038 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:06:48.184038 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:06:48.271688 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9c8304f887443e7bc1e76215fb5417b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fd7e521412e4720ae46e6c810f6dbf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:06:48.532494 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:06:48.541058 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:06:48.686568 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:06:48.751659 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:06:48.756931 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Successfully created port: 08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:06:48.987013 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Updating instance_info_cache with network_info: [{"id": "99bb5945-b1ef-41b0-bda0-bc7d698b2789", "address": "fa:16:3e:f5:a8:9f", "network": {"id": "c24d30f5-c7e1-4457-bdc3-ef51ebdf3991", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-116184687-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f132ca2a48c44f6097340763039224c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb5945-b1", "ovs_interfaceid": "99bb5945-b1ef-41b0-bda0-bc7d698b2789", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:06:49.006069 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Found WWN 330000000de79e3ec for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:06:49.006649 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:06:49.006858 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] <== connect_volume: return (3317ms) {'type': 'block', 'scsi_wwn': '330000000de79e3ec', 'path': '/dev/dm-1', 'multipath_id': '330000000de79e3ec'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:06:49.008226 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000de79e3ec', 'path': '/dev/dm-1', 'multipath_id': '330000000de79e3ec'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:06:49.043136 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.371s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:49.112938 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Deleted allocations for instance d5aa4bd8-07f0-4329-88d3-63aa5a2be798
May 28 01:06:49.189875 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:06:49.218227 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Successfully updated port: 08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:06:49.262772 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6591e261-5e09-49f1-926d-6ad0a4ae2015 req-8178d234-0014-4b5b-af0f-75cd77a647e8 service nova] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Received event network-changed-08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:06:49.264142 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6591e261-5e09-49f1-926d-6ad0a4ae2015 req-8178d234-0014-4b5b-af0f-75cd77a647e8 service nova] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Refreshing instance network info cache due to event network-changed-08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:06:49.264302 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6591e261-5e09-49f1-926d-6ad0a4ae2015 req-8178d234-0014-4b5b-af0f-75cd77a647e8 service nova] Acquiring lock "refresh_cache-a9179c5a-9c48-4d9a-9a7a-3e4baa721bba" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:06:49.264412 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6591e261-5e09-49f1-926d-6ad0a4ae2015 req-8178d234-0014-4b5b-af0f-75cd77a647e8 service nova] Acquired lock "refresh_cache-a9179c5a-9c48-4d9a-9a7a-3e4baa721bba" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:06:49.264516 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-6591e261-5e09-49f1-926d-6ad0a4ae2015 req-8178d234-0014-4b5b-af0f-75cd77a647e8 service nova] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Refreshing network info cache for port 08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:06:49.384243 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0a8cc9e2-712e-4644-abeb-0989771f8e26 req-7c0f0313-1acb-4469-8413-aa737e11c050 service nova] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Received event network-vif-unplugged-08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:06:49.384662 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0a8cc9e2-712e-4644-abeb-0989771f8e26 req-7c0f0313-1acb-4469-8413-aa737e11c050 service nova] Acquiring lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:49.384804 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0a8cc9e2-712e-4644-abeb-0989771f8e26 req-7c0f0313-1acb-4469-8413-aa737e11c050 service nova] Lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:49.384911 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0a8cc9e2-712e-4644-abeb-0989771f8e26 req-7c0f0313-1acb-4469-8413-aa737e11c050 service nova] Lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:49.385030 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0a8cc9e2-712e-4644-abeb-0989771f8e26 req-7c0f0313-1acb-4469-8413-aa737e11c050 service nova] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] No waiting events found dispatching network-vif-unplugged-08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:06:49.385138 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-0a8cc9e2-712e-4644-abeb-0989771f8e26 req-7c0f0313-1acb-4469-8413-aa737e11c050 service nova] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Received unexpected event network-vif-unplugged-08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a for instance with vm_state building and task_state block_device_mapping.
May 28 01:06:49.493204 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Releasing lock "refresh_cache-b1ae3969-7f8a-457a-aed8-539761a6d03e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:06:49.493537 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Instance network_info: |[{"id": "99bb5945-b1ef-41b0-bda0-bc7d698b2789", "address": "fa:16:3e:f5:a8:9f", "network": {"id": "c24d30f5-c7e1-4457-bdc3-ef51ebdf3991", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-116184687-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f132ca2a48c44f6097340763039224c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb5945-b1", "ovs_interfaceid": "99bb5945-b1ef-41b0-bda0-bc7d698b2789", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:06:49.495620 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Start _get_guest_xml network_info=[{"id": "99bb5945-b1ef-41b0-bda0-bc7d698b2789", "address": "fa:16:3e:f5:a8:9f", "network": {"id": "c24d30f5-c7e1-4457-bdc3-ef51ebdf3991", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-116184687-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f132ca2a48c44f6097340763039224c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb5945-b1", "ovs_interfaceid": "99bb5945-b1ef-41b0-bda0-bc7d698b2789", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:06:49.504117 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:06:49.506630 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-453420150', uuid='b1ae3969-7f8a-457a-aed8-539761a6d03e'), owner=OwnerMeta(userid='bf90ea61781a41ca91d0d5266f37cae4', username='tempest-VolumesSnapshotTestJSON-1352681167-project-member', projectid='f132ca2a48c44f6097340763039224c1', projectname='tempest-VolumesSnapshotTestJSON-1352681167'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "99bb5945-b1ef-41b0-bda0-bc7d698b2789", "address": "fa:16:3e:f5:a8:9f", "network": {"id": "c24d30f5-c7e1-4457-bdc3-ef51ebdf3991", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-116184687-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f132ca2a48c44f6097340763039224c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb5945-b1", "ovs_interfaceid": "99bb5945-b1ef-41b0-bda0-bc7d698b2789", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930409.504903) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:06:49.510603 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:06:49.511254 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:06:49.512443 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1614040866',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1614040866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpattern-image-snapshot-server-1614040866',id=50,image_ref='7137f17c-dc43-4144-8e21-3a7d7f7d7e9e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJU9yYW065PfXMeztEuE17kwrpdMzmLcl6/5/bF0WLE/z55Va5K+yZkgbZDwuamAi13h36qAewjx279aVTmJPpTuosXPuVHcMTW9JPTTEzds9KPbP5bofMYJpmhJToJfXw==',key_name='tempest-keypair-352056663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='050f928f1ce449d6a447cd343dc4ff80',ramdisk_id='',reservation_id='r-kgobve0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1449742411',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1449742411',owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:06:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c803ddeaf4f4b3db07587419087b3b2',uuid=19c25c52-03a6-4665-ac3e-aa455fd99345,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2f50d6d-6f06-4817-ab50-46a6b07ac6e2", "address": "fa:16:3e:49:81:23", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f50d6d-6f", "ovs_interfaceid": "c2f50d6d-6f06-4817-ab50-46a6b07ac6e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:06:49.512775 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converting VIF {"id": "c2f50d6d-6f06-4817-ab50-46a6b07ac6e2", "address": "fa:16:3e:49:81:23", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f50d6d-6f", "ovs_interfaceid": "c2f50d6d-6f06-4817-ab50-46a6b07ac6e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:06:49.513602 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:81:23,bridge_name='br-int',has_traffic_filtering=True,id=c2f50d6d-6f06-4817-ab50-46a6b07ac6e2,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f50d6d-6f') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:06:49.514301 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lazy-loading 'pci_devices' on Instance uuid 19c25c52-03a6-4665-ac3e-aa455fd99345 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:06:49.516755 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:06:49.516755 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:06:49.516755 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:06:49.516861 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:06:49.517040 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:06:49.518194 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:06:49.518349 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:06:49.520402 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:06:49.520402 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:06:49.520402 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:06:49.520402 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:06:49.520402 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:06:49.520402 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:06:49.520402 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:06:49.531620 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:06:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-453420150',display_name='tempest-VolumesSnapshotTestJSON-instance-453420150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumessnapshottestjson-instance-453420150',id=51,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNlYLnV8wBRlh6eYOjhRBpA7YA/QVstPxrilQA72A7sR7I3nreOzCGddDeuX7fKr77wcEdf5feNwsjyD8Lb3i9MPrO/aNUtK27NRumlAzYN5u+3aKEQdbuQpi/2ovi5zA==',key_name='tempest-keypair-339709474',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f132ca2a48c44f6097340763039224c1',ramdisk_id='',reservation_id='r-s8yhrga7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1352681167',owner_user_name='tempest-VolumesSnapshotTestJSON-1352681167-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:06:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf90ea61781a41ca91d0d5266f37cae4',uuid=b1ae3969-7f8a-457a-aed8-539761a6d03e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99bb5945-b1ef-41b0-bda0-bc7d698b2789", "address": "fa:16:3e:f5:a8:9f", "network": {"id": "c24d30f5-c7e1-4457-bdc3-ef51ebdf3991", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-116184687-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f132ca2a48c44f6097340763039224c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb5945-b1", "ovs_interfaceid": "99bb5945-b1ef-41b0-bda0-bc7d698b2789", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:06:49.531620 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Converting VIF {"id": "99bb5945-b1ef-41b0-bda0-bc7d698b2789", "address": "fa:16:3e:f5:a8:9f", "network": {"id": "c24d30f5-c7e1-4457-bdc3-ef51ebdf3991", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-116184687-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f132ca2a48c44f6097340763039224c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb5945-b1", "ovs_interfaceid": "99bb5945-b1ef-41b0-bda0-bc7d698b2789", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:06:49.532041 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a8:9f,bridge_name='br-int',has_traffic_filtering=True,id=99bb5945-b1ef-41b0-bda0-bc7d698b2789,network=Network(c24d30f5-c7e1-4457-bdc3-ef51ebdf3991),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bb5945-b1') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:06:49.532468 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lazy-loading 'pci_devices' on Instance uuid b1ae3969-7f8a-457a-aed8-539761a6d03e {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:06:49.555851 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:49.721121 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Acquiring lock "refresh_cache-a9179c5a-9c48-4d9a-9a7a-3e4baa721bba" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:06:49.769448 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-6591e261-5e09-49f1-926d-6ad0a4ae2015 req-8178d234-0014-4b5b-af0f-75cd77a647e8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:06:49.821098 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-6591e261-5e09-49f1-926d-6ad0a4ae2015 req-8178d234-0014-4b5b-af0f-75cd77a647e8 service nova] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:06:49.936833 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-6591e261-5e09-49f1-926d-6ad0a4ae2015 req-8178d234-0014-4b5b-af0f-75cd77a647e8 service nova] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:06:50.018609 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] End _get_guest_xml xml=<domain type="qemu">
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:   <uuid>19c25c52-03a6-4665-ac3e-aa455fd99345</uuid>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:   <name>instance-00000032</name>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1614040866</nova:name>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:06:45</nova:creationTime>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       <nova:image uuid="">
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:         <nova:diskFormat>raw</nova:diskFormat>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:           <nova:property name="img_bdm_v2">True</nova:property>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:           <nova:property name="img_root_device_name">/dev/vda</nova:property>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:         <nova:user uuid="0c803ddeaf4f4b3db07587419087b3b2">tempest-TestVolumeBootPattern-1449742411-project-member</nova:user>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:         <nova:project uuid="050f928f1ce449d6a447cd343dc4ff80">tempest-TestVolumeBootPattern-1449742411</nova:project>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid=""/>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:         <nova:port uuid="c2f50d6d-6f06-4817-ab50-46a6b07ac6e2">
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:     <system>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       <entry name="serial">19c25c52-03a6-4665-ac3e-aa455fd99345</entry>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       <entry name="uuid">19c25c52-03a6-4665-ac3e-aa455fd99345</entry>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:     </system>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:   <os>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:   </os>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:   <features>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:   </features>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:   <devices>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/19c25c52-03a6-4665-ac3e-aa455fd99345/disk.config"/>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:     </disk>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       <alias name="ua-fe6b70ee-a1a2-4174-beec-7239b6484474"/>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-1"/>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       <serial>fe6b70ee-a1a2-4174-beec-7239b6484474</serial>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:     </disk>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:49:81:23"/>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       <target dev="tapc2f50d6d-6f"/>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:     </interface>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/19c25c52-03a6-4665-ac3e-aa455fd99345/console.log" append="off"/>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:     </serial>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:     <video>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:     </video>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:     </rng>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:   </devices>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]: </domain>
May 28 01:06:50.018609 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:06:50.022628 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Preparing to wait for external event network-vif-plugged-c2f50d6d-6f06-4817-ab50-46a6b07ac6e2 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:06:50.022628 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "19c25c52-03a6-4665-ac3e-aa455fd99345-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:50.022628 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "19c25c52-03a6-4665-ac3e-aa455fd99345-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:50.022628 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "19c25c52-03a6-4665-ac3e-aa455fd99345-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:50.022628 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1614040866',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1614040866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpattern-image-snapshot-server-1614040866',id=50,image_ref='7137f17c-dc43-4144-8e21-3a7d7f7d7e9e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJU9yYW065PfXMeztEuE17kwrpdMzmLcl6/5/bF0WLE/z55Va5K+yZkgbZDwuamAi13h36qAewjx279aVTmJPpTuosXPuVHcMTW9JPTTEzds9KPbP5bofMYJpmhJToJfXw==',key_name='tempest-keypair-352056663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='050f928f1ce449d6a447cd343dc4ff80',ramdisk_id='',reservation_id='r-kgobve0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1449742411',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1449742411',owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:06:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c803ddeaf4f4b3db07587419087b3b2',uuid=19c25c52-03a6-4665-ac3e-aa455fd99345,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2f50d6d-6f06-4817-ab50-46a6b07ac6e2", "address": "fa:16:3e:49:81:23", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f50d6d-6f", "ovs_interfaceid": "c2f50d6d-6f06-4817-ab50-46a6b07ac6e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:06:50.022628 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converting VIF {"id": "c2f50d6d-6f06-4817-ab50-46a6b07ac6e2", "address": "fa:16:3e:49:81:23", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f50d6d-6f", "ovs_interfaceid": "c2f50d6d-6f06-4817-ab50-46a6b07ac6e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:06:50.022628 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:81:23,bridge_name='br-int',has_traffic_filtering=True,id=c2f50d6d-6f06-4817-ab50-46a6b07ac6e2,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f50d6d-6f') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:06:50.023038 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:81:23,bridge_name='br-int',has_traffic_filtering=True,id=c2f50d6d-6f06-4817-ab50-46a6b07ac6e2,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f50d6d-6f') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:06:50.023568 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:50.023855 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:06:50.024103 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:06:50.024838 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:50.025001 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '34455be3-4191-51da-bcd5-340276161ce2', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:06:50.025778 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:50.026522 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:06:50.028577 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:50.028754 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2f50d6d-6f, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:06:50.029120 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2f50d6d-6f, col_values=(('qos', UUID('5e05ce39-ca5a-4b95-aaaf-8077a4131bc9')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:06:50.029309 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2f50d6d-6f, col_values=(('external_ids', {'iface-id': 'c2f50d6d-6f06-4817-ab50-46a6b07ac6e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:81:23', 'vm-uuid': '19c25c52-03a6-4665-ac3e-aa455fd99345'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:06:50.030007 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:50.031383 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:06:50.035309 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:50.036350 np0000001577 nova-compute[98319]: INFO os_vif [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:81:23,bridge_name='br-int',has_traffic_filtering=True,id=c2f50d6d-6f06-4817-ab50-46a6b07ac6e2,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f50d6d-6f')
May 28 01:06:50.036985 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] End _get_guest_xml xml=<domain type="qemu">
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:   <uuid>b1ae3969-7f8a-457a-aed8-539761a6d03e</uuid>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:   <name>instance-00000033</name>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-453420150</nova:name>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:06:49</nova:creationTime>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:         <nova:user uuid="bf90ea61781a41ca91d0d5266f37cae4">tempest-VolumesSnapshotTestJSON-1352681167-project-member</nova:user>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:         <nova:project uuid="f132ca2a48c44f6097340763039224c1">tempest-VolumesSnapshotTestJSON-1352681167</nova:project>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:         <nova:port uuid="99bb5945-b1ef-41b0-bda0-bc7d698b2789">
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:     <system>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       <entry name="serial">b1ae3969-7f8a-457a-aed8-539761a6d03e</entry>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       <entry name="uuid">b1ae3969-7f8a-457a-aed8-539761a6d03e</entry>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:     </system>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:   <os>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:   </os>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:   <features>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:   </features>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:   <devices>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/b1ae3969-7f8a-457a-aed8-539761a6d03e/disk"/>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:     </disk>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/b1ae3969-7f8a-457a-aed8-539761a6d03e/disk.config"/>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:     </disk>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:f5:a8:9f"/>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       <target dev="tap99bb5945-b1"/>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:     </interface>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/b1ae3969-7f8a-457a-aed8-539761a6d03e/console.log" append="off"/>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:     </serial>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:     <video>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:     </video>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:     </rng>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:   </devices>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]: </domain>
May 28 01:06:50.036985 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:06:50.038853 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Preparing to wait for external event network-vif-plugged-99bb5945-b1ef-41b0-bda0-bc7d698b2789 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:06:50.038853 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "b1ae3969-7f8a-457a-aed8-539761a6d03e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:50.038853 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "b1ae3969-7f8a-457a-aed8-539761a6d03e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:50.038853 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "b1ae3969-7f8a-457a-aed8-539761a6d03e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:50.038853 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:06:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-453420150',display_name='tempest-VolumesSnapshotTestJSON-instance-453420150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumessnapshottestjson-instance-453420150',id=51,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNlYLnV8wBRlh6eYOjhRBpA7YA/QVstPxrilQA72A7sR7I3nreOzCGddDeuX7fKr77wcEdf5feNwsjyD8Lb3i9MPrO/aNUtK27NRumlAzYN5u+3aKEQdbuQpi/2ovi5zA==',key_name='tempest-keypair-339709474',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f132ca2a48c44f6097340763039224c1',ramdisk_id='',reservation_id='r-s8yhrga7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1352681167',owner_user_name='tempest-VolumesSnapshotTestJSON-1352681167-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:06:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf90ea61781a41ca91d0d5266f37cae4',uuid=b1ae3969-7f8a-457a-aed8-539761a6d03e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99bb5945-b1ef-41b0-bda0-bc7d698b2789", "address": "fa:16:3e:f5:a8:9f", "network": {"id": "c24d30f5-c7e1-4457-bdc3-ef51ebdf3991", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-116184687-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f132ca2a48c44f6097340763039224c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb5945-b1", "ovs_interfaceid": "99bb5945-b1ef-41b0-bda0-bc7d698b2789", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:06:50.038853 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Converting VIF {"id": "99bb5945-b1ef-41b0-bda0-bc7d698b2789", "address": "fa:16:3e:f5:a8:9f", "network": {"id": "c24d30f5-c7e1-4457-bdc3-ef51ebdf3991", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-116184687-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f132ca2a48c44f6097340763039224c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb5945-b1", "ovs_interfaceid": "99bb5945-b1ef-41b0-bda0-bc7d698b2789", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:06:50.038853 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a8:9f,bridge_name='br-int',has_traffic_filtering=True,id=99bb5945-b1ef-41b0-bda0-bc7d698b2789,network=Network(c24d30f5-c7e1-4457-bdc3-ef51ebdf3991),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bb5945-b1') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:06:50.039161 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a8:9f,bridge_name='br-int',has_traffic_filtering=True,id=99bb5945-b1ef-41b0-bda0-bc7d698b2789,network=Network(c24d30f5-c7e1-4457-bdc3-ef51ebdf3991),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bb5945-b1') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:06:50.039161 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:50.039509 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:06:50.039509 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:06:50.040091 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:50.040420 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0ca82ab-f080-59fe-ad07-050f77c69ed0', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:06:50.040935 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:50.041682 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:06:50.045914 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:50.048806 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:50.048967 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99bb5945-b1, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:06:50.049326 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap99bb5945-b1, col_values=(('qos', UUID('761540e4-02f3-49d6-ae4e-db1bb64d8fcc')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:06:50.049494 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap99bb5945-b1, col_values=(('external_ids', {'iface-id': '99bb5945-b1ef-41b0-bda0-bc7d698b2789', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:a8:9f', 'vm-uuid': 'b1ae3969-7f8a-457a-aed8-539761a6d03e'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:06:50.050651 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:50.052059 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:06:50.058256 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:50.059213 np0000001577 nova-compute[98319]: INFO os_vif [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a8:9f,bridge_name='br-int',has_traffic_filtering=True,id=99bb5945-b1ef-41b0-bda0-bc7d698b2789,network=Network(c24d30f5-c7e1-4457-bdc3-ef51ebdf3991),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bb5945-b1')
May 28 01:06:50.121656 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-249b5133-f413-4ed9-ab6c-f0c379e17207 tempest-ServerActionsV293TestJSON-1502319923 tempest-ServerActionsV293TestJSON-1502319923-project-member] Lock "d5aa4bd8-07f0-4329-88d3-63aa5a2be798" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.313s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:50.197297 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:06:50.198696 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:06:50.198972 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Creating image(s)
May 28 01:06:50.199411 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Acquiring lock "/opt/stack/data/nova/instances/a9179c5a-9c48-4d9a-9a7a-3e4baa721bba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:50.199597 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lock "/opt/stack/data/nova/instances/a9179c5a-9c48-4d9a-9a7a-3e4baa721bba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:50.200033 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lock "/opt/stack/data/nova/instances/a9179c5a-9c48-4d9a-9a7a-3e4baa721bba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:50.200473 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:06:50.202836 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:06:50.203660 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:06:50.286962 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.083s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:06:50.287453 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:50.287961 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:50.288463 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:06:50.290977 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:06:50.291289 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:06:50.374191 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.083s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:06:50.374661 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/a9179c5a-9c48-4d9a-9a7a-3e4baa721bba/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:06:50.426925 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/a9179c5a-9c48-4d9a-9a7a-3e4baa721bba/disk 1073741824" returned: 0 in 0.052s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:06:50.427424 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.139s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:50.427928 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:06:50.443140 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6591e261-5e09-49f1-926d-6ad0a4ae2015 req-8178d234-0014-4b5b-af0f-75cd77a647e8 service nova] Releasing lock "refresh_cache-a9179c5a-9c48-4d9a-9a7a-3e4baa721bba" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:06:50.444336 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Acquired lock "refresh_cache-a9179c5a-9c48-4d9a-9a7a-3e4baa721bba" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:06:50.444630 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:06:50.453472 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:06:50.453472 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:06:50.453973 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:06:50.455694 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] No VIF found with MAC fa:16:3e:90:82:0c, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:06:50.512829 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:06:50.513905 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a9179c5a-9c48-4d9a-9a7a-3e4baa721bba/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:06:50.513905 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9179c5a-9c48-4d9a-9a7a-3e4baa721bba/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:06:50.601107 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9179c5a-9c48-4d9a-9a7a-3e4baa721bba/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:06:50.601516 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Cannot resize image /opt/stack/data/nova/instances/a9179c5a-9c48-4d9a-9a7a-3e4baa721bba/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:06:50.601857 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:06:50.602014 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Ensure instance console log exists: /opt/stack/data/nova/instances/a9179c5a-9c48-4d9a-9a7a-3e4baa721bba/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:06:50.602295 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:50.602531 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:50.602689 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:51.012406 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:06:51.151538 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:06:51.269979 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Updating instance_info_cache with network_info: [{"id": "08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a", "address": "fa:16:3e:2f:51:39", "network": {"id": "358e1547-921f-470b-bc81-811a08eac4d8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1437976996-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fd7e521412e4720ae46e6c810f6dbf4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08875f6f-a4", "ovs_interfaceid": "08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:06:51.413527 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:51.558655 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:06:51.558826 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:06:51.558979 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] No VIF found with MAC fa:16:3e:49:81:23, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:06:51.559768 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Using config drive
May 28 01:06:51.576351 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:06:51.576482 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:06:51.576560 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] No VIF found with MAC fa:16:3e:f5:a8:9f, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:06:51.576970 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Using config drive
May 28 01:06:51.771675 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Releasing lock "refresh_cache-a9179c5a-9c48-4d9a-9a7a-3e4baa721bba" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:06:51.772031 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Instance network_info: |[{"id": "08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a", "address": "fa:16:3e:2f:51:39", "network": {"id": "358e1547-921f-470b-bc81-811a08eac4d8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1437976996-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fd7e521412e4720ae46e6c810f6dbf4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08875f6f-a4", "ovs_interfaceid": "08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:06:51.773620 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Start _get_guest_xml network_info=[{"id": "08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a", "address": "fa:16:3e:2f:51:39", "network": {"id": "358e1547-921f-470b-bc81-811a08eac4d8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1437976996-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fd7e521412e4720ae46e6c810f6dbf4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08875f6f-a4", "ovs_interfaceid": "08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:06:51.776597 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:06:51.778748 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-VolumesExtendAttachedTest-instance-993199777', uuid='a9179c5a-9c48-4d9a-9a7a-3e4baa721bba'), owner=OwnerMeta(userid='d9c8304f887443e7bc1e76215fb5417b', username='tempest-VolumesExtendAttachedTest-1834466927-project-member', projectid='7fd7e521412e4720ae46e6c810f6dbf4', projectname='tempest-VolumesExtendAttachedTest-1834466927'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a", "address": "fa:16:3e:2f:51:39", "network": {"id": "358e1547-921f-470b-bc81-811a08eac4d8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1437976996-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fd7e521412e4720ae46e6c810f6dbf4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08875f6f-a4", "ovs_interfaceid": "08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930411.7783754) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:06:51.783533 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:06:51.783771 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:06:51.784683 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:06:51.784730 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:06:51.785680 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:06:51.786042 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:06:51.786218 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:06:51.786379 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:06:51.786521 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:06:51.786658 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:06:51.786791 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:06:51.787448 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:06:51.787448 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:06:51.787448 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:06:51.787448 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:06:51.787448 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:06:51.806226 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:06:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-993199777',display_name='tempest-VolumesExtendAttachedTest-instance-993199777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumesextendattachedtest-instance-993199777',id=52,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6xzFjx6QJjsW9XuyE9Cg4jlFPZQxbND7n8MNeftmVkLHDC/fTIvnw3lo2P4BMbBOKE3a1z4KRcdXBUH3EkGf96eEPcQ96dYDV4/lP7mTjv9rF9tDCpvEtaaa9avDxEsQ==',key_name='tempest-keypair-1555826923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fd7e521412e4720ae46e6c810f6dbf4',ramdisk_id='',reservation_id='r-p3u0wi4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-1834466927',owner_user_name='tempest-VolumesExtendAttachedTest-1834466927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:06:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9c8304f887443e7bc1e76215fb5417b',uuid=a9179c5a-9c48-4d9a-9a7a-3e4baa721bba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a", "address": "fa:16:3e:2f:51:39", "network": {"id": "358e1547-921f-470b-bc81-811a08eac4d8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1437976996-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fd7e521412e4720ae46e6c810f6dbf4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08875f6f-a4", "ovs_interfaceid": "08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:06:51.806469 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Converting VIF {"id": "08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a", "address": "fa:16:3e:2f:51:39", "network": {"id": "358e1547-921f-470b-bc81-811a08eac4d8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1437976996-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fd7e521412e4720ae46e6c810f6dbf4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08875f6f-a4", "ovs_interfaceid": "08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:06:51.807086 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:51:39,bridge_name='br-int',has_traffic_filtering=True,id=08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a,network=Network(358e1547-921f-470b-bc81-811a08eac4d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08875f6f-a4') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:06:51.807650 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lazy-loading 'pci_devices' on Instance uuid a9179c5a-9c48-4d9a-9a7a-3e4baa721bba {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:06:51.957336 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:52.004081 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e57b7e58-b010-4c7f-8e68-7569813412d2 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "1c35ef60-298f-47f3-99a0-c9de2bd34c55" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.439s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:52.067348 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:06:52.082305 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:06:52.240558 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Creating config drive at /opt/stack/data/nova/instances/19c25c52-03a6-4665-ac3e-aa455fd99345/disk.config
May 28 01:06:52.245002 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/19c25c52-03a6-4665-ac3e-aa455fd99345/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8nk49cl9 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:06:52.269953 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Creating config drive at /opt/stack/data/nova/instances/b1ae3969-7f8a-457a-aed8-539761a6d03e/disk.config
May 28 01:06:52.277643 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b1ae3969-7f8a-457a-aed8-539761a6d03e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgaxx0_m7 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:06:52.300678 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/19c25c52-03a6-4665-ac3e-aa455fd99345/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8nk49cl9" returned: 0 in 0.054s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:06:52.312461 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] End _get_guest_xml xml=<domain type="qemu">
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:   <uuid>a9179c5a-9c48-4d9a-9a7a-3e4baa721bba</uuid>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:   <name>instance-00000034</name>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       <nova:name>tempest-VolumesExtendAttachedTest-instance-993199777</nova:name>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:06:51</nova:creationTime>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:         <nova:user uuid="d9c8304f887443e7bc1e76215fb5417b">tempest-VolumesExtendAttachedTest-1834466927-project-member</nova:user>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:         <nova:project uuid="7fd7e521412e4720ae46e6c810f6dbf4">tempest-VolumesExtendAttachedTest-1834466927</nova:project>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:         <nova:port uuid="08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a">
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:     <system>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       <entry name="serial">a9179c5a-9c48-4d9a-9a7a-3e4baa721bba</entry>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       <entry name="uuid">a9179c5a-9c48-4d9a-9a7a-3e4baa721bba</entry>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:     </system>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:   <os>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:   </os>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:   <features>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:   </features>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:   <devices>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/a9179c5a-9c48-4d9a-9a7a-3e4baa721bba/disk"/>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:     </disk>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/a9179c5a-9c48-4d9a-9a7a-3e4baa721bba/disk.config"/>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:     </disk>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:2f:51:39"/>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       <target dev="tap08875f6f-a4"/>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:     </interface>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/a9179c5a-9c48-4d9a-9a7a-3e4baa721bba/console.log" append="off"/>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:     </serial>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:     <video>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:     </video>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:     </rng>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:   </devices>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]: </domain>
May 28 01:06:52.312461 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:06:52.314938 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Preparing to wait for external event network-vif-plugged-08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:06:52.314938 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Acquiring lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:52.314938 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:52.314938 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:52.314938 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:06:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-993199777',display_name='tempest-VolumesExtendAttachedTest-instance-993199777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumesextendattachedtest-instance-993199777',id=52,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6xzFjx6QJjsW9XuyE9Cg4jlFPZQxbND7n8MNeftmVkLHDC/fTIvnw3lo2P4BMbBOKE3a1z4KRcdXBUH3EkGf96eEPcQ96dYDV4/lP7mTjv9rF9tDCpvEtaaa9avDxEsQ==',key_name='tempest-keypair-1555826923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fd7e521412e4720ae46e6c810f6dbf4',ramdisk_id='',reservation_id='r-p3u0wi4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-1834466927',owner_user_name='tempest-VolumesExtendAttachedTest-1834466927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:06:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9c8304f887443e7bc1e76215fb5417b',uuid=a9179c5a-9c48-4d9a-9a7a-3e4baa721bba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a", "address": "fa:16:3e:2f:51:39", "network": {"id": "358e1547-921f-470b-bc81-811a08eac4d8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1437976996-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fd7e521412e4720ae46e6c810f6dbf4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08875f6f-a4", "ovs_interfaceid": "08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:06:52.314938 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Converting VIF {"id": "08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a", "address": "fa:16:3e:2f:51:39", "network": {"id": "358e1547-921f-470b-bc81-811a08eac4d8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1437976996-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fd7e521412e4720ae46e6c810f6dbf4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08875f6f-a4", "ovs_interfaceid": "08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:06:52.315697 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:51:39,bridge_name='br-int',has_traffic_filtering=True,id=08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a,network=Network(358e1547-921f-470b-bc81-811a08eac4d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08875f6f-a4') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:06:52.315977 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:51:39,bridge_name='br-int',has_traffic_filtering=True,id=08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a,network=Network(358e1547-921f-470b-bc81-811a08eac4d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08875f6f-a4') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:06:52.316751 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:52.317405 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:06:52.317949 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:06:52.318975 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:52.319145 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '13764f02-1d24-5e36-abb3-2674b6cd8884', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:06:52.319964 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:52.320644 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:06:52.330604 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:52.333077 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:52.333251 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08875f6f-a4, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:06:52.333669 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap08875f6f-a4, col_values=(('qos', UUID('6f97d85f-c414-4d04-9b19-ab7cd1f0a2ae')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:06:52.333885 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap08875f6f-a4, col_values=(('external_ids', {'iface-id': '08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:51:39', 'vm-uuid': 'a9179c5a-9c48-4d9a-9a7a-3e4baa721bba'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:06:52.334641 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b1ae3969-7f8a-457a-aed8-539761a6d03e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgaxx0_m7" returned: 0 in 0.059s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:06:52.335074 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:52.336506 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:06:52.348732 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:52.349845 np0000001577 nova-compute[98319]: INFO os_vif [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:51:39,bridge_name='br-int',has_traffic_filtering=True,id=08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a,network=Network(358e1547-921f-470b-bc81-811a08eac4d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08875f6f-a4')
May 28 01:06:52.527311 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:52.574436 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "1c35ef60-298f-47f3-99a0-c9de2bd34c55" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:52.574436 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "1c35ef60-298f-47f3-99a0-c9de2bd34c55" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:53.075592 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:53.079879 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Detaching volume 7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6
May 28 01:06:53.123234 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:53.134235 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Attempting to driver detach volume 7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 from mountpoint /dev/vdb
May 28 01:06:53.175745 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', 'iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '1c35ef60-298f-47f3-99a0-c9de2bd34c55', 'attached_at': '', 'detached_at': '', 'volume_id': '7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', 'serial': '7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 01:06:53.184337 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Found disk vdb by alias ua-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:06:53.186890 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Found disk vdb by alias ua-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:06:53.186890 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Attempting to detach device vdb from instance 1c35ef60-298f-47f3-99a0-c9de2bd34c55 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:06:53.187108 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:06:53.187108 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:06:53.187108 np0000001577 nova-compute[98319]:   <alias name="ua-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6"/>
May 28 01:06:53.187108 np0000001577 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 28 01:06:53.187108 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:06:53.187108 np0000001577 nova-compute[98319]:   <serial>7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6</serial>
May 28 01:06:53.187108 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:06:53.187108 np0000001577 nova-compute[98319]:   <encryption format="luks">
May 28 01:06:53.187108 np0000001577 nova-compute[98319]:     <secret type="passphrase" uuid="7ace94a9-e373-44db-b272-e2028a2a1a34"/>
May 28 01:06:53.187108 np0000001577 nova-compute[98319]:   </encryption>
May 28 01:06:53.187108 np0000001577 nova-compute[98319]: </disk>
May 28 01:06:53.187108 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:06:53.195891 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:53.199322 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Successfully detached device vdb from instance 1c35ef60-298f-47f3-99a0-c9de2bd34c55 from the persistent domain config.
May 28 01:06:53.199915 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] (1/8): Attempting to detach device vdb with device alias ua-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 from instance 1c35ef60-298f-47f3-99a0-c9de2bd34c55 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:06:53.200038 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:06:53.200038 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:06:53.200038 np0000001577 nova-compute[98319]:   <alias name="ua-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6"/>
May 28 01:06:53.200038 np0000001577 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 28 01:06:53.200038 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:06:53.200038 np0000001577 nova-compute[98319]:   <serial>7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6</serial>
May 28 01:06:53.200038 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:06:53.200038 np0000001577 nova-compute[98319]:   <encryption format="luks">
May 28 01:06:53.200038 np0000001577 nova-compute[98319]:     <secret type="passphrase" uuid="7ace94a9-e373-44db-b272-e2028a2a1a34"/>
May 28 01:06:53.200038 np0000001577 nova-compute[98319]:   </encryption>
May 28 01:06:53.200038 np0000001577 nova-compute[98319]: </disk>
May 28 01:06:53.200038 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:06:53.222890 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:53.224315 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:53.272828 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:53.278322 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:53.415871 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:53.597280 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-74e1bb1e-8e5a-422f-9276-c14bd40a6858 req-1b3971b7-8d3e-48fe-9492-f5dac357f1b1 service nova] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Received event network-vif-plugged-99bb5945-b1ef-41b0-bda0-bc7d698b2789 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:06:53.597456 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-74e1bb1e-8e5a-422f-9276-c14bd40a6858 req-1b3971b7-8d3e-48fe-9492-f5dac357f1b1 service nova] Acquiring lock "b1ae3969-7f8a-457a-aed8-539761a6d03e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:53.602566 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-74e1bb1e-8e5a-422f-9276-c14bd40a6858 req-1b3971b7-8d3e-48fe-9492-f5dac357f1b1 service nova] Lock "b1ae3969-7f8a-457a-aed8-539761a6d03e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:53.602566 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-74e1bb1e-8e5a-422f-9276-c14bd40a6858 req-1b3971b7-8d3e-48fe-9492-f5dac357f1b1 service nova] Lock "b1ae3969-7f8a-457a-aed8-539761a6d03e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:53.602566 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-74e1bb1e-8e5a-422f-9276-c14bd40a6858 req-1b3971b7-8d3e-48fe-9492-f5dac357f1b1 service nova] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Processing event network-vif-plugged-99bb5945-b1ef-41b0-bda0-bc7d698b2789 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:06:53.651210 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:53.659380 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:53.660867 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:53.687852 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:53.694721 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:53.739966 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930413.7391145, 1c35ef60-298f-47f3-99a0-c9de2bd34c55 => ua-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:06:53.743771 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 for instance 1c35ef60-298f-47f3-99a0-c9de2bd34c55 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:06:53.748018 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Successfully detached device vdb from instance 1c35ef60-298f-47f3-99a0-c9de2bd34c55 from the live domain config.
May 28 01:06:53.751446 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:06:53.752363 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', 'iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:06:53.752363 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:06:53.752363 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:06:53.752601 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', 'iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:06:53.752669 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:06:53.780708 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:53.780708 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:53.780708 np0000001577 nova-compute[98319]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 (non-flash)
May 28 01:06:53.780708 np0000001577 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 (non-flash)
May 28 01:06:53.780708 np0000001577 nova-compute[98319]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3be836-64e9-46e8-b395-c9149d0d79b6 (non-flash)
May 28 01:06:53.780708 np0000001577 nova-compute[98319]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:06:53.780708 np0000001577 nova-compute[98319]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:06:53.780708 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:06:53.780937 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:53.780937 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:06:53.780937 np0000001577 nova-compute[98319]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 (non-flash)
May 28 01:06:53.780937 np0000001577 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6 (non-flash)
May 28 01:06:53.780937 np0000001577 nova-compute[98319]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3be836-64e9-46e8-b395-c9149d0d79b6 (non-flash)
May 28 01:06:53.780937 np0000001577 nova-compute[98319]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:06:53.780937 np0000001577 nova-compute[98319]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:06:53.780937 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:06:53.781102 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac', '103'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', '116'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', '117'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec3be836-64e9-46e8-b395-c9149d0d79b6', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474', '119'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474', '120')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:06:53.781102 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', '117')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:06:53.781932 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6', '116')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:06:53.782623 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c988c01c860>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6'): ({'sdb'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:06:53.782819 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:06:53.783099 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Flush multipath device 3300000006e61318b {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:06:53.816951 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:06:53.874611 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:06:53.880141 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:06:53.880325 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:06:53.880446 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] No VIF found with MAC fa:16:3e:2f:51:39, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:06:53.880958 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Using config drive
May 28 01:06:53.910718 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:06:53.910862 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:06:53.911926 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:06:53.923883 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:06:53.923883 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:06:53.939325 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:53.969084 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 117, target: iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6, portal: 192.168.40.100,3260]
May 28 01:06:53.969084 np0000001577 nova-compute[98319]: Logout of [sid: 117, target: iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6, portal: 192.168.40.100,3260] successful.
May 28 01:06:53.969084 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:53.994306 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:54.006868 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:54.038851 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 116, target: iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6, portal: 192.168.50.100,3260]
May 28 01:06:54.038851 np0000001577 nova-compute[98319]: Logout of [sid: 116, target: iqn.2023-03.storpool.com:os--volume-7c61fa79-7c92-43ef-ab3b-c7f8b51fd0a6, portal: 192.168.50.100,3260] successful.
May 28 01:06:54.038851 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:54.059767 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:06:54.060885 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:06:54.060999 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] <== disconnect_volume: return (309ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:06:54.061102 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:06:54.160535 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:06:54.160911 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930414.1606255, b1ae3969-7f8a-457a-aed8-539761a6d03e => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:06:54.162128 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] VM Started (Lifecycle Event)
May 28 01:06:54.162958 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:06:54.168642 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Instance spawned successfully.
May 28 01:06:54.168826 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:06:54.254496 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:54.391288 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:06:54.521460 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Creating config drive at /opt/stack/data/nova/instances/a9179c5a-9c48-4d9a-9a7a-3e4baa721bba/disk.config
May 28 01:06:54.526092 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a9179c5a-9c48-4d9a-9a7a-3e4baa721bba/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9d_pn258 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:06:54.594375 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a9179c5a-9c48-4d9a-9a7a-3e4baa721bba/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9d_pn258" returned: 0 in 0.068s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:06:54.621424 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lazy-loading 'flavor' on Instance uuid 1c35ef60-298f-47f3-99a0-c9de2bd34c55 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:06:54.666004 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:06:54.669349 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:06:54.681245 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:06:54.681387 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:06:54.681800 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:06:54.682067 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:06:54.682385 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:06:54.682716 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:06:54.890500 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:55.063330 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:55.063330 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:55.089840 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:55.173906 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:06:55.175183 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930415.1738353, b1ae3969-7f8a-457a-aed8-539761a6d03e => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:06:55.175183 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] VM Paused (Lifecycle Event)
May 28 01:06:55.176894 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:55.184487 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f30900d8-894c-470c-963a-2649c976422d req-51544e58-f786-4ad0-9f63-cefb025cfd6e service nova] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Received event network-vif-plugged-c2f50d6d-6f06-4817-ab50-46a6b07ac6e2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:06:55.185614 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f30900d8-894c-470c-963a-2649c976422d req-51544e58-f786-4ad0-9f63-cefb025cfd6e service nova] Acquiring lock "19c25c52-03a6-4665-ac3e-aa455fd99345-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:55.185963 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f30900d8-894c-470c-963a-2649c976422d req-51544e58-f786-4ad0-9f63-cefb025cfd6e service nova] Lock "19c25c52-03a6-4665-ac3e-aa455fd99345-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:55.186169 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f30900d8-894c-470c-963a-2649c976422d req-51544e58-f786-4ad0-9f63-cefb025cfd6e service nova] Lock "19c25c52-03a6-4665-ac3e-aa455fd99345-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:55.186513 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f30900d8-894c-470c-963a-2649c976422d req-51544e58-f786-4ad0-9f63-cefb025cfd6e service nova] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Processing event network-vif-plugged-c2f50d6d-6f06-4817-ab50-46a6b07ac6e2 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:06:55.187103 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:06:55.188707 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Took 7.68 seconds to spawn the instance on the hypervisor.
May 28 01:06:55.188949 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:06:55.194136 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:06:55.207950 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Instance spawned successfully.
May 28 01:06:55.208839 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:06:55.215242 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:06:55.215589 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:06:55.457164 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:55.458977 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:55.462850 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:55.493346 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:55.637578 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca58c8ea-eed5-4550-8dfb-1fe58edd1aec tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "1c35ef60-298f-47f3-99a0-c9de2bd34c55" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.062s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:55.678873 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b029f8e1-2556-40bc-b685-471d54715faa req-bf161a55-911b-4b9a-9c91-019be0182158 service nova] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Received event network-vif-plugged-99bb5945-b1ef-41b0-bda0-bc7d698b2789 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:06:55.679054 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b029f8e1-2556-40bc-b685-471d54715faa req-bf161a55-911b-4b9a-9c91-019be0182158 service nova] Acquiring lock "b1ae3969-7f8a-457a-aed8-539761a6d03e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:55.683796 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b029f8e1-2556-40bc-b685-471d54715faa req-bf161a55-911b-4b9a-9c91-019be0182158 service nova] Lock "b1ae3969-7f8a-457a-aed8-539761a6d03e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:55.684343 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b029f8e1-2556-40bc-b685-471d54715faa req-bf161a55-911b-4b9a-9c91-019be0182158 service nova] Lock "b1ae3969-7f8a-457a-aed8-539761a6d03e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:55.686650 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b029f8e1-2556-40bc-b685-471d54715faa req-bf161a55-911b-4b9a-9c91-019be0182158 service nova] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] No waiting events found dispatching network-vif-plugged-99bb5945-b1ef-41b0-bda0-bc7d698b2789 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:06:55.686650 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-b029f8e1-2556-40bc-b685-471d54715faa req-bf161a55-911b-4b9a-9c91-019be0182158 service nova] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Received unexpected event network-vif-plugged-99bb5945-b1ef-41b0-bda0-bc7d698b2789 for instance with vm_state active and task_state None.
May 28 01:06:55.686650 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b029f8e1-2556-40bc-b685-471d54715faa req-bf161a55-911b-4b9a-9c91-019be0182158 service nova] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Received event network-vif-plugged-08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:06:55.686650 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b029f8e1-2556-40bc-b685-471d54715faa req-bf161a55-911b-4b9a-9c91-019be0182158 service nova] Acquiring lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:55.686650 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b029f8e1-2556-40bc-b685-471d54715faa req-bf161a55-911b-4b9a-9c91-019be0182158 service nova] Lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:55.686817 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:06:55.687102 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b029f8e1-2556-40bc-b685-471d54715faa req-bf161a55-911b-4b9a-9c91-019be0182158 service nova] Lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:55.688104 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b029f8e1-2556-40bc-b685-471d54715faa req-bf161a55-911b-4b9a-9c91-019be0182158 service nova] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Processing event network-vif-plugged-08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:06:55.688256 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b029f8e1-2556-40bc-b685-471d54715faa req-bf161a55-911b-4b9a-9c91-019be0182158 service nova] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Received event network-vif-plugged-08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:06:55.688424 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b029f8e1-2556-40bc-b685-471d54715faa req-bf161a55-911b-4b9a-9c91-019be0182158 service nova] Acquiring lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:55.688642 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b029f8e1-2556-40bc-b685-471d54715faa req-bf161a55-911b-4b9a-9c91-019be0182158 service nova] Lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:55.688687 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b029f8e1-2556-40bc-b685-471d54715faa req-bf161a55-911b-4b9a-9c91-019be0182158 service nova] Lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:55.688816 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b029f8e1-2556-40bc-b685-471d54715faa req-bf161a55-911b-4b9a-9c91-019be0182158 service nova] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] No waiting events found dispatching network-vif-plugged-08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:06:55.689233 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-b029f8e1-2556-40bc-b685-471d54715faa req-bf161a55-911b-4b9a-9c91-019be0182158 service nova] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Received unexpected event network-vif-plugged-08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a for instance with vm_state building and task_state spawning.
May 28 01:06:55.694326 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930415.69406, b1ae3969-7f8a-457a-aed8-539761a6d03e => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:06:55.694694 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] VM Resumed (Lifecycle Event)
May 28 01:06:55.708231 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Took 14.99 seconds to build instance.
May 28 01:06:55.724512 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Took 10.06 seconds to spawn the instance on the hypervisor.
May 28 01:06:55.724681 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:06:55.934153 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-68dcd3b8-b106-4847-8520-a0df2c86afac tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "1c35ef60-298f-47f3-99a0-c9de2bd34c55" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:55.934321 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-68dcd3b8-b106-4847-8520-a0df2c86afac tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "1c35ef60-298f-47f3-99a0-c9de2bd34c55" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:55.934517 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-68dcd3b8-b106-4847-8520-a0df2c86afac tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "1c35ef60-298f-47f3-99a0-c9de2bd34c55-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:55.934818 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-68dcd3b8-b106-4847-8520-a0df2c86afac tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "1c35ef60-298f-47f3-99a0-c9de2bd34c55-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:55.934818 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-68dcd3b8-b106-4847-8520-a0df2c86afac tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "1c35ef60-298f-47f3-99a0-c9de2bd34c55-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:55.939225 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-68dcd3b8-b106-4847-8520-a0df2c86afac tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Terminating instance
May 28 01:06:55.994564 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:06:55.999673 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:06:56.002737 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Instance spawned successfully.
May 28 01:06:56.003079 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:06:56.184771 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.49 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:06:56.200753 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:06:56.205580 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:06:56.210709 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-068c8976-ff23-4dd4-8ce0-d9402be1c0fe tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "b1ae3969-7f8a-457a-aed8-539761a6d03e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.496s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:56.244283 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Took 20.16 seconds to build instance.
May 28 01:06:56.415291 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:56.444086 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-68dcd3b8-b106-4847-8520-a0df2c86afac tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:06:56.467818 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:56.470658 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:56.496859 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:56.522018 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:06:56.522167 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:06:56.522567 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:06:56.522854 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:06:56.523157 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:06:56.523450 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:06:56.533125 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:56.653953 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0041381480000382 future=<Future at 0x7c984c645670 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:06:56.655205 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:06:56.657840 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Emitting event <LifecycleEvent: 1779930401.6496246, d5aa4bd8-07f0-4329-88d3-63aa5a2be798 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:06:56.659975 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] VM Stopped (Lifecycle Event)
May 28 01:06:56.708369 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930416.7080908, 19c25c52-03a6-4665-ac3e-aa455fd99345 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:06:56.708467 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] VM Started (Lifecycle Event)
May 28 01:06:56.747499 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:56.751054 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e6069f2-c48f-4a70-9e08-ba9fa2fc0bc5 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "19c25c52-03a6-4665-ac3e-aa455fd99345" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.675s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:56.756240 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:56.780603 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Instance destroyed successfully.
May 28 01:06:56.780603 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-68dcd3b8-b106-4847-8520-a0df2c86afac tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lazy-loading 'resources' on Instance uuid 1c35ef60-298f-47f3-99a0-c9de2bd34c55 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:06:57.037974 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Took 6.84 seconds to spawn the instance on the hypervisor.
May 28 01:06:57.038117 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:06:57.163229 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: d5aa4bd8-07f0-4329-88d3-63aa5a2be798] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:06:57.194105 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:57.211891 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:06:57.219098 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:06:57.282970 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-68dcd3b8-b106-4847-8520-a0df2c86afac tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:05:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1327442409',display_name='tempest-TestEncryptedCinderVolumes-server-1327442409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testencryptedcindervolumes-server-1327442409',id=49,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSDSzGPeJZW05QcfiGV7kaIKUfndYJb64/RkBtVCAGwgL/F0R5ngZhEMPuPKF5GFUpuUWmT2zCg9hiW3u7uzagC5o8wgnbO21bK2+IoijzJglvfNeZV91xl5oHSxbvUjQ==',key_name='tempest-keypair-1056334667',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:05:59Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a430f0d6bcc84a29bc3e96514422896b',ramdisk_id='',reservation_id='r-9zov6z1d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-2086871542',owner_user_name='tempest-TestEncryptedCinderVolumes-2086871542-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:05:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbae7974478d45b3908aaaa5b4408e26',uuid=1c35ef60-298f-47f3-99a0-c9de2bd34c55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64dc43ea-5ef6-44d3-96a1-31e10c8f2416", "address": "fa:16:3e:90:82:0c", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64dc43ea-5e", "ovs_interfaceid": "64dc43ea-5ef6-44d3-96a1-31e10c8f2416", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:06:57.285974 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1f6a1771-d16b-46fa-a88a-608186c4d860 req-7ca648ea-2b33-4a95-ad93-4b6d67bfd650 service nova] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Received event network-vif-plugged-c2f50d6d-6f06-4817-ab50-46a6b07ac6e2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:06:57.286335 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-68dcd3b8-b106-4847-8520-a0df2c86afac tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converting VIF {"id": "64dc43ea-5ef6-44d3-96a1-31e10c8f2416", "address": "fa:16:3e:90:82:0c", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64dc43ea-5e", "ovs_interfaceid": "64dc43ea-5ef6-44d3-96a1-31e10c8f2416", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:06:57.286994 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1f6a1771-d16b-46fa-a88a-608186c4d860 req-7ca648ea-2b33-4a95-ad93-4b6d67bfd650 service nova] Acquiring lock "19c25c52-03a6-4665-ac3e-aa455fd99345-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:57.287319 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-68dcd3b8-b106-4847-8520-a0df2c86afac tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:82:0c,bridge_name='br-int',has_traffic_filtering=True,id=64dc43ea-5ef6-44d3-96a1-31e10c8f2416,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64dc43ea-5e') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:06:57.287580 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1f6a1771-d16b-46fa-a88a-608186c4d860 req-7ca648ea-2b33-4a95-ad93-4b6d67bfd650 service nova] Lock "19c25c52-03a6-4665-ac3e-aa455fd99345-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:57.287972 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-68dcd3b8-b106-4847-8520-a0df2c86afac tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:82:0c,bridge_name='br-int',has_traffic_filtering=True,id=64dc43ea-5ef6-44d3-96a1-31e10c8f2416,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64dc43ea-5e') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:06:57.288240 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1f6a1771-d16b-46fa-a88a-608186c4d860 req-7ca648ea-2b33-4a95-ad93-4b6d67bfd650 service nova] Lock "19c25c52-03a6-4665-ac3e-aa455fd99345-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:57.288484 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1f6a1771-d16b-46fa-a88a-608186c4d860 req-7ca648ea-2b33-4a95-ad93-4b6d67bfd650 service nova] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] No waiting events found dispatching network-vif-plugged-c2f50d6d-6f06-4817-ab50-46a6b07ac6e2 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:06:57.288904 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-1f6a1771-d16b-46fa-a88a-608186c4d860 req-7ca648ea-2b33-4a95-ad93-4b6d67bfd650 service nova] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Received unexpected event network-vif-plugged-c2f50d6d-6f06-4817-ab50-46a6b07ac6e2 for instance with vm_state active and task_state None.
May 28 01:06:57.291763 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:57.292020 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64dc43ea-5e, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:06:57.293027 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:57.294430 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:06:57.296150 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:57.297679 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:57.297844 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7c03c126-d8dc-40e5-8a39-8a95ddcc0ecd) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:06:57.298431 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:57.299700 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:06:57.301660 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:57.304343 np0000001577 nova-compute[98319]: INFO os_vif [None req-68dcd3b8-b106-4847-8520-a0df2c86afac tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:82:0c,bridge_name='br-int',has_traffic_filtering=True,id=64dc43ea-5ef6-44d3-96a1-31e10c8f2416,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64dc43ea-5e')
May 28 01:06:57.304604 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-68dcd3b8-b106-4847-8520-a0df2c86afac tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Deleting instance files /opt/stack/data/nova/instances/1c35ef60-298f-47f3-99a0-c9de2bd34c55_del
May 28 01:06:57.305251 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-68dcd3b8-b106-4847-8520-a0df2c86afac tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Deletion of /opt/stack/data/nova/instances/1c35ef60-298f-47f3-99a0-c9de2bd34c55_del complete
May 28 01:06:57.547217 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Took 12.22 seconds to build instance.
May 28 01:06:57.723733 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930417.722191, 19c25c52-03a6-4665-ac3e-aa455fd99345 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:06:57.723733 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] VM Paused (Lifecycle Event)
May 28 01:06:57.756234 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0b10c6fc-6c0e-4f91-8a6a-b6bfb6aec40e req-252e5142-26c6-4440-a02d-6c0233c4e987 service nova] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Received event network-vif-unplugged-64dc43ea-5ef6-44d3-96a1-31e10c8f2416 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:06:57.756691 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b10c6fc-6c0e-4f91-8a6a-b6bfb6aec40e req-252e5142-26c6-4440-a02d-6c0233c4e987 service nova] Acquiring lock "1c35ef60-298f-47f3-99a0-c9de2bd34c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:57.756842 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b10c6fc-6c0e-4f91-8a6a-b6bfb6aec40e req-252e5142-26c6-4440-a02d-6c0233c4e987 service nova] Lock "1c35ef60-298f-47f3-99a0-c9de2bd34c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:57.757145 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b10c6fc-6c0e-4f91-8a6a-b6bfb6aec40e req-252e5142-26c6-4440-a02d-6c0233c4e987 service nova] Lock "1c35ef60-298f-47f3-99a0-c9de2bd34c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:57.757319 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0b10c6fc-6c0e-4f91-8a6a-b6bfb6aec40e req-252e5142-26c6-4440-a02d-6c0233c4e987 service nova] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] No waiting events found dispatching network-vif-unplugged-64dc43ea-5ef6-44d3-96a1-31e10c8f2416 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:06:57.759282 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0b10c6fc-6c0e-4f91-8a6a-b6bfb6aec40e req-252e5142-26c6-4440-a02d-6c0233c4e987 service nova] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Received event network-vif-unplugged-64dc43ea-5ef6-44d3-96a1-31e10c8f2416 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:06:57.759472 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0b10c6fc-6c0e-4f91-8a6a-b6bfb6aec40e req-252e5142-26c6-4440-a02d-6c0233c4e987 service nova] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Received event network-changed-99bb5945-b1ef-41b0-bda0-bc7d698b2789 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:06:57.759472 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0b10c6fc-6c0e-4f91-8a6a-b6bfb6aec40e req-252e5142-26c6-4440-a02d-6c0233c4e987 service nova] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Refreshing instance network info cache due to event network-changed-99bb5945-b1ef-41b0-bda0-bc7d698b2789. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:06:57.759645 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b10c6fc-6c0e-4f91-8a6a-b6bfb6aec40e req-252e5142-26c6-4440-a02d-6c0233c4e987 service nova] Acquiring lock "refresh_cache-b1ae3969-7f8a-457a-aed8-539761a6d03e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:06:57.759731 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b10c6fc-6c0e-4f91-8a6a-b6bfb6aec40e req-252e5142-26c6-4440-a02d-6c0233c4e987 service nova] Acquired lock "refresh_cache-b1ae3969-7f8a-457a-aed8-539761a6d03e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:06:57.759867 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-0b10c6fc-6c0e-4f91-8a6a-b6bfb6aec40e req-252e5142-26c6-4440-a02d-6c0233c4e987 service nova] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Refreshing network info cache for port 99bb5945-b1ef-41b0-bda0-bc7d698b2789 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:06:57.815384 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-68dcd3b8-b106-4847-8520-a0df2c86afac tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Took 1.37 seconds to destroy the instance on the hypervisor.
May 28 01:06:57.815982 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-68dcd3b8-b106-4847-8520-a0df2c86afac tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:06:57.816343 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:06:57.816478 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:06:57.816833 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:06:57.905487 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:06:58.048752 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4972beac-28bf-41ed-98ff-bc406dc25d2d tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.733s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:58.204466 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Acquiring lock "5dafacc2-fb17-4781-8dda-8b9f21e57dee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:58.204906 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lock "5dafacc2-fb17-4781-8dda-8b9f21e57dee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:58.228432 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:06:58.231412 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930418.2311363, 19c25c52-03a6-4665-ac3e-aa455fd99345 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:06:58.231479 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] VM Resumed (Lifecycle Event)
May 28 01:06:58.261833 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-0b10c6fc-6c0e-4f91-8a6a-b6bfb6aec40e req-252e5142-26c6-4440-a02d-6c0233c4e987 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:06:58.688337 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9fbfa0c5-9d58-47f5-baa6-2843b3dd5cad req-bea1211e-63fc-4b4e-a7da-49937fbddd34 service nova] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Received event network-vif-deleted-64dc43ea-5ef6-44d3-96a1-31e10c8f2416 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:06:58.688529 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-9fbfa0c5-9d58-47f5-baa6-2843b3dd5cad req-bea1211e-63fc-4b4e-a7da-49937fbddd34 service nova] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Neutron deleted interface 64dc43ea-5ef6-44d3-96a1-31e10c8f2416; detaching it from the instance and deleting it from the info cache
May 28 01:06:58.690907 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9fbfa0c5-9d58-47f5-baa6-2843b3dd5cad req-bea1211e-63fc-4b4e-a7da-49937fbddd34 service nova] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Detach interface failed, port_id=64dc43ea-5ef6-44d3-96a1-31e10c8f2416, reason: Instance 1c35ef60-298f-47f3-99a0-c9de2bd34c55 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:06:58.706459 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:06:58.734818 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:06:58.738664 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:06:58.746115 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:06:58.955562 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-0b10c6fc-6c0e-4f91-8a6a-b6bfb6aec40e req-252e5142-26c6-4440-a02d-6c0233c4e987 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:06:59.099858 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-0b10c6fc-6c0e-4f91-8a6a-b6bfb6aec40e req-252e5142-26c6-4440-a02d-6c0233c4e987 service nova] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Updated VIF entry in instance network info cache for port 99bb5945-b1ef-41b0-bda0-bc7d698b2789. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:06:59.099858 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-0b10c6fc-6c0e-4f91-8a6a-b6bfb6aec40e req-252e5142-26c6-4440-a02d-6c0233c4e987 service nova] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Updating instance_info_cache with network_info: [{"id": "99bb5945-b1ef-41b0-bda0-bc7d698b2789", "address": "fa:16:3e:f5:a8:9f", "network": {"id": "c24d30f5-c7e1-4457-bdc3-ef51ebdf3991", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-116184687-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f132ca2a48c44f6097340763039224c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb5945-b1", "ovs_interfaceid": "99bb5945-b1ef-41b0-bda0-bc7d698b2789", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:06:59.134744 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:06:59.241888 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930419.2405949, a9179c5a-9c48-4d9a-9a7a-3e4baa721bba => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:06:59.241888 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] VM Started (Lifecycle Event)
May 28 01:06:59.265491 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:59.265657 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:59.268692 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:06:59.268850 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Claim successful on node np0000001577
May 28 01:06:59.600872 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b10c6fc-6c0e-4f91-8a6a-b6bfb6aec40e req-252e5142-26c6-4440-a02d-6c0233c4e987 service nova] Releasing lock "refresh_cache-b1ae3969-7f8a-457a-aed8-539761a6d03e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:06:59.602979 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0b10c6fc-6c0e-4f91-8a6a-b6bfb6aec40e req-252e5142-26c6-4440-a02d-6c0233c4e987 service nova] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Received event network-vif-unplugged-64dc43ea-5ef6-44d3-96a1-31e10c8f2416 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:06:59.602979 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b10c6fc-6c0e-4f91-8a6a-b6bfb6aec40e req-252e5142-26c6-4440-a02d-6c0233c4e987 service nova] Acquiring lock "1c35ef60-298f-47f3-99a0-c9de2bd34c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:06:59.602979 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b10c6fc-6c0e-4f91-8a6a-b6bfb6aec40e req-252e5142-26c6-4440-a02d-6c0233c4e987 service nova] Lock "1c35ef60-298f-47f3-99a0-c9de2bd34c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:06:59.602979 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b10c6fc-6c0e-4f91-8a6a-b6bfb6aec40e req-252e5142-26c6-4440-a02d-6c0233c4e987 service nova] Lock "1c35ef60-298f-47f3-99a0-c9de2bd34c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:06:59.602979 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0b10c6fc-6c0e-4f91-8a6a-b6bfb6aec40e req-252e5142-26c6-4440-a02d-6c0233c4e987 service nova] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] No waiting events found dispatching network-vif-unplugged-64dc43ea-5ef6-44d3-96a1-31e10c8f2416 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:06:59.602979 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0b10c6fc-6c0e-4f91-8a6a-b6bfb6aec40e req-252e5142-26c6-4440-a02d-6c0233c4e987 service nova] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Received event network-vif-unplugged-64dc43ea-5ef6-44d3-96a1-31e10c8f2416 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:06:59.602979 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0b10c6fc-6c0e-4f91-8a6a-b6bfb6aec40e req-252e5142-26c6-4440-a02d-6c0233c4e987 service nova] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Received event network-changed-c2f50d6d-6f06-4817-ab50-46a6b07ac6e2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:06:59.602979 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0b10c6fc-6c0e-4f91-8a6a-b6bfb6aec40e req-252e5142-26c6-4440-a02d-6c0233c4e987 service nova] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Refreshing instance network info cache due to event network-changed-c2f50d6d-6f06-4817-ab50-46a6b07ac6e2. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:06:59.602979 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b10c6fc-6c0e-4f91-8a6a-b6bfb6aec40e req-252e5142-26c6-4440-a02d-6c0233c4e987 service nova] Acquiring lock "refresh_cache-19c25c52-03a6-4665-ac3e-aa455fd99345" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:06:59.602979 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b10c6fc-6c0e-4f91-8a6a-b6bfb6aec40e req-252e5142-26c6-4440-a02d-6c0233c4e987 service nova] Acquired lock "refresh_cache-19c25c52-03a6-4665-ac3e-aa455fd99345" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:06:59.602979 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-0b10c6fc-6c0e-4f91-8a6a-b6bfb6aec40e req-252e5142-26c6-4440-a02d-6c0233c4e987 service nova] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Refreshing network info cache for port c2f50d6d-6f06-4817-ab50-46a6b07ac6e2 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:06:59.638975 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Took 1.82 seconds to deallocate network for instance.
May 28 01:06:59.743331 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:06:59.745206 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:06:59.815597 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a466461c-c339-4e82-a10f-91e2202fc5c1 req-587b1746-86bf-4038-8d81-6ab34b4acc7c service nova] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Received event network-changed-08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:06:59.816878 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a466461c-c339-4e82-a10f-91e2202fc5c1 req-587b1746-86bf-4038-8d81-6ab34b4acc7c service nova] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Refreshing instance network info cache due to event network-changed-08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:06:59.817138 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a466461c-c339-4e82-a10f-91e2202fc5c1 req-587b1746-86bf-4038-8d81-6ab34b4acc7c service nova] Acquiring lock "refresh_cache-a9179c5a-9c48-4d9a-9a7a-3e4baa721bba" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:06:59.817138 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a466461c-c339-4e82-a10f-91e2202fc5c1 req-587b1746-86bf-4038-8d81-6ab34b4acc7c service nova] Acquired lock "refresh_cache-a9179c5a-9c48-4d9a-9a7a-3e4baa721bba" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:06:59.817302 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-a466461c-c339-4e82-a10f-91e2202fc5c1 req-587b1746-86bf-4038-8d81-6ab34b4acc7c service nova] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Refreshing network info cache for port 08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:07:00.104412 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-0b10c6fc-6c0e-4f91-8a6a-b6bfb6aec40e req-252e5142-26c6-4440-a02d-6c0233c4e987 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:00.143764 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-68dcd3b8-b106-4847-8520-a0df2c86afac tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:00.247734 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930420.2472596, a9179c5a-9c48-4d9a-9a7a-3e4baa721bba => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:07:00.248222 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] VM Paused (Lifecycle Event)
May 28 01:07:00.319942 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-a466461c-c339-4e82-a10f-91e2202fc5c1 req-587b1746-86bf-4038-8d81-6ab34b4acc7c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:00.499233 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-0b10c6fc-6c0e-4f91-8a6a-b6bfb6aec40e req-252e5142-26c6-4440-a02d-6c0233c4e987 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:00.694996 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:07:00.695185 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:07:00.703920 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-0b10c6fc-6c0e-4f91-8a6a-b6bfb6aec40e req-252e5142-26c6-4440-a02d-6c0233c4e987 service nova] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Updated VIF entry in instance network info cache for port c2f50d6d-6f06-4817-ab50-46a6b07ac6e2. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:07:00.704777 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-0b10c6fc-6c0e-4f91-8a6a-b6bfb6aec40e req-252e5142-26c6-4440-a02d-6c0233c4e987 service nova] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Updating instance_info_cache with network_info: [{"id": "c2f50d6d-6f06-4817-ab50-46a6b07ac6e2", "address": "fa:16:3e:49:81:23", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f50d6d-6f", "ovs_interfaceid": "c2f50d6d-6f06-4817-ab50-46a6b07ac6e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:07:00.750700 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:07:00.753422 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-a466461c-c339-4e82-a10f-91e2202fc5c1 req-587b1746-86bf-4038-8d81-6ab34b4acc7c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:00.756160 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930420.755965, a9179c5a-9c48-4d9a-9a7a-3e4baa721bba => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:07:00.756433 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] VM Resumed (Lifecycle Event)
May 28 01:07:00.888180 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-a466461c-c339-4e82-a10f-91e2202fc5c1 req-587b1746-86bf-4038-8d81-6ab34b4acc7c service nova] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Updated VIF entry in instance network info cache for port 08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:07:00.888488 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-a466461c-c339-4e82-a10f-91e2202fc5c1 req-587b1746-86bf-4038-8d81-6ab34b4acc7c service nova] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Updating instance_info_cache with network_info: [{"id": "08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a", "address": "fa:16:3e:2f:51:39", "network": {"id": "358e1547-921f-470b-bc81-811a08eac4d8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1437976996-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fd7e521412e4720ae46e6c810f6dbf4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08875f6f-a4", "ovs_interfaceid": "08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:07:01.200515 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:07:01.212168 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b10c6fc-6c0e-4f91-8a6a-b6bfb6aec40e req-252e5142-26c6-4440-a02d-6c0233c4e987 service nova] Releasing lock "refresh_cache-19c25c52-03a6-4665-ac3e-aa455fd99345" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:07:01.258798 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:07:01.261157 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:07:01.390213 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a466461c-c339-4e82-a10f-91e2202fc5c1 req-587b1746-86bf-4038-8d81-6ab34b4acc7c service nova] Releasing lock "refresh_cache-a9179c5a-9c48-4d9a-9a7a-3e4baa721bba" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:07:01.417191 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:01.422788 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "1e7c5308-80cc-4991-8626-2ba32fa09acf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:01.422972 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:01.706653 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.441s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:01.706915 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:07:01.709199 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-68dcd3b8-b106-4847-8520-a0df2c86afac tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.565s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:01.765938 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.99978260600028 future=<Future at 0x7c988c089730 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:07:01.766256 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999455076000231 future=<Future at 0x7c988c089730 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:07:01.766434 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999268909999955 future=<Future at 0x7c988c089730 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:07:01.926566 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:07:02.052686 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-68dcd3b8-b106-4847-8520-a0df2c86afac tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:07:02.052858 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-68dcd3b8-b106-4847-8520-a0df2c86afac tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:07:02.212814 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:07:02.213193 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:07:02.213429 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:02.213628 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:02.287503 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4713b3cdaa0643a294fb14fda14d8e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd8820c03574b9d86542c61bf1fdc43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:07:02.299151 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:02.474651 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:02.555106 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-68dcd3b8-b106-4847-8520-a0df2c86afac tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:07:02.716772 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Successfully created port: fa7eeb89-fccc-45b2-ac90-b44568ff2c34 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:07:02.718337 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:07:03.061910 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-68dcd3b8-b106-4847-8520-a0df2c86afac tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.352s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:03.062269 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.587s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:03.070513 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:07:03.071579 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Claim successful on node np0000001577
May 28 01:07:03.114475 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-68dcd3b8-b106-4847-8520-a0df2c86afac tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Deleted allocations for instance 1c35ef60-298f-47f3-99a0-c9de2bd34c55
May 28 01:07:03.169619 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Successfully updated port: fa7eeb89-fccc-45b2-ac90-b44568ff2c34 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:07:03.216701 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0f9278bd-5fe1-4634-97f9-92d927637c5e req-f1820dc9-e979-41cf-9dc8-b861a4a2b1c2 service nova] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Received event network-changed-fa7eeb89-fccc-45b2-ac90-b44568ff2c34 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:07:03.217498 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0f9278bd-5fe1-4634-97f9-92d927637c5e req-f1820dc9-e979-41cf-9dc8-b861a4a2b1c2 service nova] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Refreshing instance network info cache due to event network-changed-fa7eeb89-fccc-45b2-ac90-b44568ff2c34. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:07:03.217814 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0f9278bd-5fe1-4634-97f9-92d927637c5e req-f1820dc9-e979-41cf-9dc8-b861a4a2b1c2 service nova] Acquiring lock "refresh_cache-5dafacc2-fb17-4781-8dda-8b9f21e57dee" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:07:03.218052 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0f9278bd-5fe1-4634-97f9-92d927637c5e req-f1820dc9-e979-41cf-9dc8-b861a4a2b1c2 service nova] Acquired lock "refresh_cache-5dafacc2-fb17-4781-8dda-8b9f21e57dee" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:07:03.218215 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-0f9278bd-5fe1-4634-97f9-92d927637c5e req-f1820dc9-e979-41cf-9dc8-b861a4a2b1c2 service nova] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Refreshing network info cache for port fa7eeb89-fccc-45b2-ac90-b44568ff2c34 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:07:03.221725 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:07:03.673390 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Acquiring lock "refresh_cache-5dafacc2-fb17-4781-8dda-8b9f21e57dee" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:07:03.720406 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-0f9278bd-5fe1-4634-97f9-92d927637c5e req-f1820dc9-e979-41cf-9dc8-b861a4a2b1c2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:03.821235 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-0f9278bd-5fe1-4634-97f9-92d927637c5e req-f1820dc9-e979-41cf-9dc8-b861a4a2b1c2 service nova] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:07:03.950705 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-0f9278bd-5fe1-4634-97f9-92d927637c5e req-f1820dc9-e979-41cf-9dc8-b861a4a2b1c2 service nova] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:07:04.122912 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-68dcd3b8-b106-4847-8520-a0df2c86afac tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "1c35ef60-298f-47f3-99a0-c9de2bd34c55" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.185s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:04.239101 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:07:04.240050 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:07:04.240424 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Creating image(s)
May 28 01:07:04.242028 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Acquiring lock "/opt/stack/data/nova/instances/5dafacc2-fb17-4781-8dda-8b9f21e57dee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:04.242425 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lock "/opt/stack/data/nova/instances/5dafacc2-fb17-4781-8dda-8b9f21e57dee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:04.243012 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lock "/opt/stack/data/nova/instances/5dafacc2-fb17-4781-8dda-8b9f21e57dee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:04.243539 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:07:04.249441 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:07:04.249555 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:07:04.349950 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.100s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:07:04.350386 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:04.350985 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:04.351383 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:07:04.355019 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:07:04.355019 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:07:04.442866 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.087s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:07:04.443892 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/5dafacc2-fb17-4781-8dda-8b9f21e57dee/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:07:04.460804 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0f9278bd-5fe1-4634-97f9-92d927637c5e req-f1820dc9-e979-41cf-9dc8-b861a4a2b1c2 service nova] Releasing lock "refresh_cache-5dafacc2-fb17-4781-8dda-8b9f21e57dee" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:07:04.465570 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Acquired lock "refresh_cache-5dafacc2-fb17-4781-8dda-8b9f21e57dee" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:07:04.465570 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:07:04.501019 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/5dafacc2-fb17-4781-8dda-8b9f21e57dee/disk 1073741824" returned: 0 in 0.057s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:07:04.502141 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.151s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:04.502603 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:07:04.572101 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:07:04.573616 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:07:04.592694 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:07:04.593035 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5dafacc2-fb17-4781-8dda-8b9f21e57dee/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:07:04.593328 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dafacc2-fb17-4781-8dda-8b9f21e57dee/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:07:04.677844 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dafacc2-fb17-4781-8dda-8b9f21e57dee/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:07:04.678381 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Cannot resize image /opt/stack/data/nova/instances/5dafacc2-fb17-4781-8dda-8b9f21e57dee/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:07:04.678900 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:07:04.679157 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Ensure instance console log exists: /opt/stack/data/nova/instances/5dafacc2-fb17-4781-8dda-8b9f21e57dee/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:07:04.679527 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:04.679897 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:04.680043 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:05.024372 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:07:05.079569 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:07:05.165591 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:05.315497 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Updating instance_info_cache with network_info: [{"id": "fa7eeb89-fccc-45b2-ac90-b44568ff2c34", "address": "fa:16:3e:c5:08:a5", "network": {"id": "7c483e76-809a-4260-af12-f58188f6bd77", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-964714137-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2dd8820c03574b9d86542c61bf1fdc43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7eeb89-fc", "ovs_interfaceid": "fa7eeb89-fccc-45b2-ac90-b44568ff2c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:07:05.586570 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.523s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:05.586570 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:07:05.810323 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Releasing lock "refresh_cache-5dafacc2-fb17-4781-8dda-8b9f21e57dee" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:07:05.812395 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Instance network_info: |[{"id": "fa7eeb89-fccc-45b2-ac90-b44568ff2c34", "address": "fa:16:3e:c5:08:a5", "network": {"id": "7c483e76-809a-4260-af12-f58188f6bd77", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-964714137-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2dd8820c03574b9d86542c61bf1fdc43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7eeb89-fc", "ovs_interfaceid": "fa7eeb89-fccc-45b2-ac90-b44568ff2c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:07:05.813067 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Start _get_guest_xml network_info=[{"id": "fa7eeb89-fccc-45b2-ac90-b44568ff2c34", "address": "fa:16:3e:c5:08:a5", "network": {"id": "7c483e76-809a-4260-af12-f58188f6bd77", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-964714137-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2dd8820c03574b9d86542c61bf1fdc43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7eeb89-fc", "ovs_interfaceid": "fa7eeb89-fccc-45b2-ac90-b44568ff2c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:07:05.818727 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:07:05.819891 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1445838070', uuid='5dafacc2-fb17-4781-8dda-8b9f21e57dee'), owner=OwnerMeta(userid='4713b3cdaa0643a294fb14fda14d8e42', username='tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member', projectid='2dd8820c03574b9d86542c61bf1fdc43', projectname='tempest-TestServerVolumeAttachScenarioOldVersion-1694940975'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fa7eeb89-fccc-45b2-ac90-b44568ff2c34", "address": "fa:16:3e:c5:08:a5", "network": {"id": "7c483e76-809a-4260-af12-f58188f6bd77", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-964714137-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2dd8820c03574b9d86542c61bf1fdc43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7eeb89-fc", "ovs_interfaceid": "fa7eeb89-fccc-45b2-ac90-b44568ff2c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930425.8194964) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:07:05.824561 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:07:05.828454 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:07:05.828454 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:07:05.829049 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:07:05.829702 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:07:05.830130 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:07:05.831414 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:07:05.831414 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:07:05.831414 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:07:05.831414 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:07:05.831414 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:07:05.831414 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:07:05.831414 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:07:05.831414 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:07:05.831414 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:07:05.831414 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:07:05.846111 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1445838070',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1445838070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testservervolumeattachscenariooldversion-server-1445838',id=53,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFzW5EnarGM8vFr4N+Ob9J7OTqJSitsFQTAl4ERV86+U83ksaNsAyasFT7VUoD6qyXQSTylO+6fT3TOevVEdkOWV/khD8BSukf3y6+GtuZObLM22Xr2grmnvzEq4sHAEA==',key_name='tempest-keypair-680236774',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2dd8820c03574b9d86542c61bf1fdc43',ramdisk_id='',reservation_id='r-fhrag7t9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1694940975',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:07:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4713b3cdaa0643a294fb14fda14d8e42',uuid=5dafacc2-fb17-4781-8dda-8b9f21e57dee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa7eeb89-fccc-45b2-ac90-b44568ff2c34", "address": "fa:16:3e:c5:08:a5", "network": {"id": "7c483e76-809a-4260-af12-f58188f6bd77", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-964714137-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2dd8820c03574b9d86542c61bf1fdc43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7eeb89-fc", "ovs_interfaceid": "fa7eeb89-fccc-45b2-ac90-b44568ff2c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:07:05.846923 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Converting VIF {"id": "fa7eeb89-fccc-45b2-ac90-b44568ff2c34", "address": "fa:16:3e:c5:08:a5", "network": {"id": "7c483e76-809a-4260-af12-f58188f6bd77", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-964714137-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2dd8820c03574b9d86542c61bf1fdc43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7eeb89-fc", "ovs_interfaceid": "fa7eeb89-fccc-45b2-ac90-b44568ff2c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:07:05.846923 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:08:a5,bridge_name='br-int',has_traffic_filtering=True,id=fa7eeb89-fccc-45b2-ac90-b44568ff2c34,network=Network(7c483e76-809a-4260-af12-f58188f6bd77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa7eeb89-fc') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:07:05.847845 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lazy-loading 'pci_devices' on Instance uuid 5dafacc2-fb17-4781-8dda-8b9f21e57dee {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:07:06.091201 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:07:06.091435 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:07:06.091639 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:06.091861 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:06.179301 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60d68bbf62c74dd2bfe638f00ef6aa3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23578125da1e4bf2bb3d59281a0e261e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:07:06.351669 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] End _get_guest_xml xml=<domain type="qemu">
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:   <uuid>5dafacc2-fb17-4781-8dda-8b9f21e57dee</uuid>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:   <name>instance-00000035</name>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1445838070</nova:name>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:07:05</nova:creationTime>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:         <nova:user uuid="4713b3cdaa0643a294fb14fda14d8e42">tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member</nova:user>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:         <nova:project uuid="2dd8820c03574b9d86542c61bf1fdc43">tempest-TestServerVolumeAttachScenarioOldVersion-1694940975</nova:project>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:         <nova:port uuid="fa7eeb89-fccc-45b2-ac90-b44568ff2c34">
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:     <system>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       <entry name="serial">5dafacc2-fb17-4781-8dda-8b9f21e57dee</entry>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       <entry name="uuid">5dafacc2-fb17-4781-8dda-8b9f21e57dee</entry>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:     </system>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:   <os>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:   </os>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:   <features>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:   </features>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:   <devices>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/5dafacc2-fb17-4781-8dda-8b9f21e57dee/disk"/>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:     </disk>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/5dafacc2-fb17-4781-8dda-8b9f21e57dee/disk.config"/>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:     </disk>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:c5:08:a5"/>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       <target dev="tapfa7eeb89-fc"/>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:     </interface>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/5dafacc2-fb17-4781-8dda-8b9f21e57dee/console.log" append="off"/>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:     </serial>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:     <video>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:     </video>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:     </rng>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:   </devices>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]: </domain>
May 28 01:07:06.351669 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:07:06.369146 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Preparing to wait for external event network-vif-plugged-fa7eeb89-fccc-45b2-ac90-b44568ff2c34 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:07:06.369146 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Acquiring lock "5dafacc2-fb17-4781-8dda-8b9f21e57dee-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:06.369146 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lock "5dafacc2-fb17-4781-8dda-8b9f21e57dee-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:06.369146 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lock "5dafacc2-fb17-4781-8dda-8b9f21e57dee-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:06.369146 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1445838070',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1445838070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testservervolumeattachscenariooldversion-server-1445838',id=53,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFzW5EnarGM8vFr4N+Ob9J7OTqJSitsFQTAl4ERV86+U83ksaNsAyasFT7VUoD6qyXQSTylO+6fT3TOevVEdkOWV/khD8BSukf3y6+GtuZObLM22Xr2grmnvzEq4sHAEA==',key_name='tempest-keypair-680236774',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2dd8820c03574b9d86542c61bf1fdc43',ramdisk_id='',reservation_id='r-fhrag7t9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1694940975',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:07:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4713b3cdaa0643a294fb14fda14d8e42',uuid=5dafacc2-fb17-4781-8dda-8b9f21e57dee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa7eeb89-fccc-45b2-ac90-b44568ff2c34", "address": "fa:16:3e:c5:08:a5", "network": {"id": "7c483e76-809a-4260-af12-f58188f6bd77", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-964714137-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2dd8820c03574b9d86542c61bf1fdc43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7eeb89-fc", "ovs_interfaceid": "fa7eeb89-fccc-45b2-ac90-b44568ff2c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:07:06.369146 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Converting VIF {"id": "fa7eeb89-fccc-45b2-ac90-b44568ff2c34", "address": "fa:16:3e:c5:08:a5", "network": {"id": "7c483e76-809a-4260-af12-f58188f6bd77", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-964714137-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2dd8820c03574b9d86542c61bf1fdc43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7eeb89-fc", "ovs_interfaceid": "fa7eeb89-fccc-45b2-ac90-b44568ff2c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:07:06.369146 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:08:a5,bridge_name='br-int',has_traffic_filtering=True,id=fa7eeb89-fccc-45b2-ac90-b44568ff2c34,network=Network(7c483e76-809a-4260-af12-f58188f6bd77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa7eeb89-fc') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:07:06.369146 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:08:a5,bridge_name='br-int',has_traffic_filtering=True,id=fa7eeb89-fccc-45b2-ac90-b44568ff2c34,network=Network(7c483e76-809a-4260-af12-f58188f6bd77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa7eeb89-fc') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:07:06.369146 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:06.369146 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:07:06.369146 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:07:06.369146 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:06.369146 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bedd9151-0ea1-5ec3-8f91-90519b4ef091', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:07:06.369146 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:06.369146 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:07:06.369146 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:06.369146 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:06.369146 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa7eeb89-fc, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:07:06.369146 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa7eeb89-fc, col_values=(('qos', UUID('8aa1c919-489d-49f2-8059-9bfa6770f5a7')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:07:06.369146 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa7eeb89-fc, col_values=(('external_ids', {'iface-id': 'fa7eeb89-fccc-45b2-ac90-b44568ff2c34', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:08:a5', 'vm-uuid': '5dafacc2-fb17-4781-8dda-8b9f21e57dee'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:07:06.369146 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:06.369146 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:07:06.374156 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:06.374156 np0000001577 nova-compute[98319]: INFO os_vif [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:08:a5,bridge_name='br-int',has_traffic_filtering=True,id=fa7eeb89-fccc-45b2-ac90-b44568ff2c34,network=Network(7c483e76-809a-4260-af12-f58188f6bd77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa7eeb89-fc')
May 28 01:07:06.431881 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:06.594029 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:07:06.675317 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Successfully created port: cc1de356-c44a-46bf-bb87-d123239afbe7 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:07:07.099197 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:07:07.212844 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Successfully updated port: cc1de356-c44a-46bf-bb87-d123239afbe7 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:07:07.261439 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-07d1d757-d135-4510-aecb-1f7329d1928e req-f097c217-cec5-40f4-9261-b52c4e0b10cc service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Received event network-changed-cc1de356-c44a-46bf-bb87-d123239afbe7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:07:07.261671 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-07d1d757-d135-4510-aecb-1f7329d1928e req-f097c217-cec5-40f4-9261-b52c4e0b10cc service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Refreshing instance network info cache due to event network-changed-cc1de356-c44a-46bf-bb87-d123239afbe7. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:07:07.261814 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-07d1d757-d135-4510-aecb-1f7329d1928e req-f097c217-cec5-40f4-9261-b52c4e0b10cc service nova] Acquiring lock "refresh_cache-1e7c5308-80cc-4991-8626-2ba32fa09acf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:07:07.261943 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-07d1d757-d135-4510-aecb-1f7329d1928e req-f097c217-cec5-40f4-9261-b52c4e0b10cc service nova] Acquired lock "refresh_cache-1e7c5308-80cc-4991-8626-2ba32fa09acf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:07:07.262085 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-07d1d757-d135-4510-aecb-1f7329d1928e req-f097c217-cec5-40f4-9261-b52c4e0b10cc service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Refreshing network info cache for port cc1de356-c44a-46bf-bb87-d123239afbe7 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:07:07.714985 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "refresh_cache-1e7c5308-80cc-4991-8626-2ba32fa09acf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:07:07.764905 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-07d1d757-d135-4510-aecb-1f7329d1928e req-f097c217-cec5-40f4-9261-b52c4e0b10cc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:07.833425 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-07d1d757-d135-4510-aecb-1f7329d1928e req-f097c217-cec5-40f4-9261-b52c4e0b10cc service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:07:07.905191 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:07:07.905191 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:07:07.905191 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] No VIF found with MAC fa:16:3e:c5:08:a5, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:07:07.905617 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Using config drive
May 28 01:07:07.993855 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-07d1d757-d135-4510-aecb-1f7329d1928e req-f097c217-cec5-40f4-9261-b52c4e0b10cc service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:07:08.124677 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:07:08.129115 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:07:08.131538 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Creating image(s)
May 28 01:07:08.133064 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:08.133644 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "/opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:08.135571 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "/opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:08.137266 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:07:08.150750 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:07:08.153577 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:07:08.295869 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.142s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:07:08.296422 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:08.297060 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:08.298865 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:07:08.303015 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:07:08.303489 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:07:08.389220 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:07:08.389742 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:07:08.416524 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:08.449936 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk 1073741824" returned: 0 in 0.060s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:07:08.450335 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.153s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:08.450669 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:07:08.496329 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "48bfd06f-62f4-4691-bf98-2426e359a90e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:08.497473 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-07d1d757-d135-4510-aecb-1f7329d1928e req-f097c217-cec5-40f4-9261-b52c4e0b10cc service nova] Releasing lock "refresh_cache-1e7c5308-80cc-4991-8626-2ba32fa09acf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:07:08.498507 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "48bfd06f-62f4-4691-bf98-2426e359a90e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:08.501186 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquired lock "refresh_cache-1e7c5308-80cc-4991-8626-2ba32fa09acf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:07:08.501186 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:07:08.561978 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.111s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:07:08.562392 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:07:08.562662 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:07:08.625476 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Creating config drive at /opt/stack/data/nova/instances/5dafacc2-fb17-4781-8dda-8b9f21e57dee/disk.config
May 28 01:07:08.631320 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5dafacc2-fb17-4781-8dda-8b9f21e57dee/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjh3ktzqz {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:07:08.659174 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:07:08.662935 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Cannot resize image /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:07:08.663482 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:07:08.666794 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Ensure instance console log exists: /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:07:08.669665 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:08.670040 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:08.671107 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:08.679303 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5dafacc2-fb17-4781-8dda-8b9f21e57dee/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjh3ktzqz" returned: 0 in 0.049s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:07:09.004695 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:07:09.086256 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:09.104925 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:07:09.116838 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:09.212717 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:09.343602 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:09.352216 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0007ad41-7da5-4eae-8c5c-d6f235e2ceca req-10d66e00-8175-4c2b-a7d9-b9ce4c725a09 service nova] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Received event network-vif-plugged-fa7eeb89-fccc-45b2-ac90-b44568ff2c34 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:07:09.354574 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0007ad41-7da5-4eae-8c5c-d6f235e2ceca req-10d66e00-8175-4c2b-a7d9-b9ce4c725a09 service nova] Acquiring lock "5dafacc2-fb17-4781-8dda-8b9f21e57dee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:09.354574 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0007ad41-7da5-4eae-8c5c-d6f235e2ceca req-10d66e00-8175-4c2b-a7d9-b9ce4c725a09 service nova] Lock "5dafacc2-fb17-4781-8dda-8b9f21e57dee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:09.354574 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0007ad41-7da5-4eae-8c5c-d6f235e2ceca req-10d66e00-8175-4c2b-a7d9-b9ce4c725a09 service nova] Lock "5dafacc2-fb17-4781-8dda-8b9f21e57dee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:09.354574 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0007ad41-7da5-4eae-8c5c-d6f235e2ceca req-10d66e00-8175-4c2b-a7d9-b9ce4c725a09 service nova] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Processing event network-vif-plugged-fa7eeb89-fccc-45b2-ac90-b44568ff2c34 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:07:09.451483 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:09.479579 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:09.497813 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Updating instance_info_cache with network_info: [{"id": "cc1de356-c44a-46bf-bb87-d123239afbe7", "address": "fa:16:3e:05:9d:ed", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1de356-c4", "ovs_interfaceid": "cc1de356-c44a-46bf-bb87-d123239afbe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:07:09.559882 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:09.560052 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:09.563171 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:07:09.563306 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Claim successful on node np0000001577
May 28 01:07:09.918629 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930429.9171727, 5dafacc2-fb17-4781-8dda-8b9f21e57dee => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:07:09.918629 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:07:09.918629 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] VM Started (Lifecycle Event)
May 28 01:07:09.924306 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:07:09.926309 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Instance spawned successfully.
May 28 01:07:09.926309 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:07:09.999594 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Releasing lock "refresh_cache-1e7c5308-80cc-4991-8626-2ba32fa09acf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:07:10.002180 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Instance network_info: |[{"id": "cc1de356-c44a-46bf-bb87-d123239afbe7", "address": "fa:16:3e:05:9d:ed", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1de356-c4", "ovs_interfaceid": "cc1de356-c44a-46bf-bb87-d123239afbe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:07:10.002180 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Start _get_guest_xml network_info=[{"id": "cc1de356-c44a-46bf-bb87-d123239afbe7", "address": "fa:16:3e:05:9d:ed", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1de356-c4", "ovs_interfaceid": "cc1de356-c44a-46bf-bb87-d123239afbe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:07:10.004283 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:07:10.005458 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-1575785918', uuid='1e7c5308-80cc-4991-8626-2ba32fa09acf'), owner=OwnerMeta(userid='60d68bbf62c74dd2bfe638f00ef6aa3d', username='tempest-AttachVolumeTestJSON-1682604103-project-member', projectid='23578125da1e4bf2bb3d59281a0e261e', projectname='tempest-AttachVolumeTestJSON-1682604103'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cc1de356-c44a-46bf-bb87-d123239afbe7", "address": "fa:16:3e:05:9d:ed", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1de356-c4", "ovs_interfaceid": "cc1de356-c44a-46bf-bb87-d123239afbe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930430.0051484) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:07:10.006478 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:07:10.007130 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:07:10.007829 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:07:10.008083 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:07:10.009024 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:07:10.010570 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:07:10.010570 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:07:10.010570 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:07:10.010570 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:07:10.010570 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:07:10.010570 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:07:10.010570 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:07:10.010570 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:07:10.010570 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:07:10.010570 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:07:10.010570 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:07:10.021174 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:07:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1575785918',display_name='tempest-AttachVolumeTestJSON-server-1575785918',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumetestjson-server-1575785918',id=54,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQqj5ulFm44LqcwStG35x3hx4kF2OHc+g0tTlOd4Z/Xec3CPwxGXUEAq08Fq2dSZhFKLMTCPF7EJ6q4KRfVK6ZgmNMJOJWZlgopXWPXQJWBjVOvQj1zQw9ZKwPgeXE7Hw==',key_name='tempest-keypair-749432862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23578125da1e4bf2bb3d59281a0e261e',ramdisk_id='',reservation_id='r-8bk45cr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1682604103',owner_user_name='tempest-AttachVolumeTestJSON-1682604103-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:07:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d68bbf62c74dd2bfe638f00ef6aa3d',uuid=1e7c5308-80cc-4991-8626-2ba32fa09acf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc1de356-c44a-46bf-bb87-d123239afbe7", "address": "fa:16:3e:05:9d:ed", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1de356-c4", "ovs_interfaceid": "cc1de356-c44a-46bf-bb87-d123239afbe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:07:10.021660 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Converting VIF {"id": "cc1de356-c44a-46bf-bb87-d123239afbe7", "address": "fa:16:3e:05:9d:ed", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1de356-c4", "ovs_interfaceid": "cc1de356-c44a-46bf-bb87-d123239afbe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:07:10.022405 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=cc1de356-c44a-46bf-bb87-d123239afbe7,network=Network(02f45984-182d-4648-ab01-d4773a271319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc1de356-c4') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:07:10.023145 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e7c5308-80cc-4991-8626-2ba32fa09acf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:07:10.422172 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:07:10.425117 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:07:10.434346 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:07:10.434555 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:07:10.435009 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:07:10.435310 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:07:10.435566 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:07:10.435803 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:07:10.526597 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] End _get_guest_xml xml=<domain type="qemu">
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:   <uuid>1e7c5308-80cc-4991-8626-2ba32fa09acf</uuid>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:   <name>instance-00000036</name>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       <nova:name>tempest-AttachVolumeTestJSON-server-1575785918</nova:name>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:07:10</nova:creationTime>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:         <nova:user uuid="60d68bbf62c74dd2bfe638f00ef6aa3d">tempest-AttachVolumeTestJSON-1682604103-project-member</nova:user>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:         <nova:project uuid="23578125da1e4bf2bb3d59281a0e261e">tempest-AttachVolumeTestJSON-1682604103</nova:project>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:         <nova:port uuid="cc1de356-c44a-46bf-bb87-d123239afbe7">
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:     <system>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       <entry name="serial">1e7c5308-80cc-4991-8626-2ba32fa09acf</entry>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       <entry name="uuid">1e7c5308-80cc-4991-8626-2ba32fa09acf</entry>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:     </system>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:   <os>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:   </os>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:   <features>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:   </features>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:   <devices>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk"/>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:     </disk>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk.config"/>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:     </disk>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:05:9d:ed"/>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       <target dev="tapcc1de356-c4"/>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:     </interface>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/console.log" append="off"/>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:     </serial>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:     <video>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:     </video>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:     </rng>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:   </devices>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]: </domain>
May 28 01:07:10.526597 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:07:10.528459 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Preparing to wait for external event network-vif-plugged-cc1de356-c44a-46bf-bb87-d123239afbe7 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:07:10.528459 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:10.528459 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:10.528459 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:10.528459 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:07:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1575785918',display_name='tempest-AttachVolumeTestJSON-server-1575785918',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumetestjson-server-1575785918',id=54,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQqj5ulFm44LqcwStG35x3hx4kF2OHc+g0tTlOd4Z/Xec3CPwxGXUEAq08Fq2dSZhFKLMTCPF7EJ6q4KRfVK6ZgmNMJOJWZlgopXWPXQJWBjVOvQj1zQw9ZKwPgeXE7Hw==',key_name='tempest-keypair-749432862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23578125da1e4bf2bb3d59281a0e261e',ramdisk_id='',reservation_id='r-8bk45cr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1682604103',owner_user_name='tempest-AttachVolumeTestJSON-1682604103-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:07:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d68bbf62c74dd2bfe638f00ef6aa3d',uuid=1e7c5308-80cc-4991-8626-2ba32fa09acf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc1de356-c44a-46bf-bb87-d123239afbe7", "address": "fa:16:3e:05:9d:ed", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1de356-c4", "ovs_interfaceid": "cc1de356-c44a-46bf-bb87-d123239afbe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:07:10.528459 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Converting VIF {"id": "cc1de356-c44a-46bf-bb87-d123239afbe7", "address": "fa:16:3e:05:9d:ed", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1de356-c4", "ovs_interfaceid": "cc1de356-c44a-46bf-bb87-d123239afbe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:07:10.528459 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=cc1de356-c44a-46bf-bb87-d123239afbe7,network=Network(02f45984-182d-4648-ab01-d4773a271319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc1de356-c4') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:07:10.528459 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=cc1de356-c44a-46bf-bb87-d123239afbe7,network=Network(02f45984-182d-4648-ab01-d4773a271319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc1de356-c4') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:07:10.529615 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:10.529615 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:07:10.529615 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:07:10.530610 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:10.530772 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cac515f6-6dde-52e3-b94a-a44740fd1d11', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:07:10.548453 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:10.548453 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:10.548764 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:07:10.550798 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:10.553477 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:10.553696 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc1de356-c4, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:07:10.555723 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc1de356-c4, col_values=(('qos', UUID('5afbd613-f3bb-46db-bbdd-7822551797d0')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:07:10.555723 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc1de356-c4, col_values=(('external_ids', {'iface-id': 'cc1de356-c44a-46bf-bb87-d123239afbe7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:9d:ed', 'vm-uuid': '1e7c5308-80cc-4991-8626-2ba32fa09acf'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:07:10.558617 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:07:10.562737 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:10.564127 np0000001577 nova-compute[98319]: INFO os_vif [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=cc1de356-c44a-46bf-bb87-d123239afbe7,network=Network(02f45984-182d-4648-ab01-d4773a271319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc1de356-c4')
May 28 01:07:10.930607 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:07:10.930870 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930430.9306908, 5dafacc2-fb17-4781-8dda-8b9f21e57dee => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:07:10.931052 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] VM Paused (Lifecycle Event)
May 28 01:07:10.941049 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Took 6.70 seconds to spawn the instance on the hypervisor.
May 28 01:07:10.941199 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:07:10.995354 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:07:10.995561 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:07:11.435947 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6a434d17-c3c9-42e3-a69b-a849387d0f23 req-5e957645-1139-49b9-bbbf-10796140b2a1 service nova] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Received event network-vif-plugged-fa7eeb89-fccc-45b2-ac90-b44568ff2c34 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:07:11.435947 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6a434d17-c3c9-42e3-a69b-a849387d0f23 req-5e957645-1139-49b9-bbbf-10796140b2a1 service nova] Acquiring lock "5dafacc2-fb17-4781-8dda-8b9f21e57dee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:11.435947 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6a434d17-c3c9-42e3-a69b-a849387d0f23 req-5e957645-1139-49b9-bbbf-10796140b2a1 service nova] Lock "5dafacc2-fb17-4781-8dda-8b9f21e57dee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:11.435947 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6a434d17-c3c9-42e3-a69b-a849387d0f23 req-5e957645-1139-49b9-bbbf-10796140b2a1 service nova] Lock "5dafacc2-fb17-4781-8dda-8b9f21e57dee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:11.435947 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6a434d17-c3c9-42e3-a69b-a849387d0f23 req-5e957645-1139-49b9-bbbf-10796140b2a1 service nova] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] No waiting events found dispatching network-vif-plugged-fa7eeb89-fccc-45b2-ac90-b44568ff2c34 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:07:11.435947 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-6a434d17-c3c9-42e3-a69b-a849387d0f23 req-5e957645-1139-49b9-bbbf-10796140b2a1 service nova] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Received unexpected event network-vif-plugged-fa7eeb89-fccc-45b2-ac90-b44568ff2c34 for instance with vm_state active and task_state None.
May 28 01:07:11.435947 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:11.440737 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:07:11.448195 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930431.4465282, 5dafacc2-fb17-4781-8dda-8b9f21e57dee => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:07:11.448195 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] VM Resumed (Lifecycle Event)
May 28 01:07:11.455828 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Took 12.25 seconds to build instance.
May 28 01:07:11.500058 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:07:11.950813 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:07:11.953907 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:07:11.962533 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-90c083d6-07d4-4ea8-88ca-1f237a036839 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lock "5dafacc2-fb17-4781-8dda-8b9f21e57dee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.758s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:12.008509 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.448s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:12.008835 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:07:12.083115 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:07:12.083217 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:07:12.083338 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] No VIF found with MAC fa:16:3e:05:9d:ed, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:07:12.083707 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Using config drive
May 28 01:07:12.507428 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d8b3dc3c-7b20-48c3-8a3e-7bfb6a87d6b1 req-83cdcb2a-a202-47ba-b7ee-cf479b669054 service nova] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Received event network-changed-fa7eeb89-fccc-45b2-ac90-b44568ff2c34 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:07:12.508676 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d8b3dc3c-7b20-48c3-8a3e-7bfb6a87d6b1 req-83cdcb2a-a202-47ba-b7ee-cf479b669054 service nova] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Refreshing instance network info cache due to event network-changed-fa7eeb89-fccc-45b2-ac90-b44568ff2c34. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:07:12.508676 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d8b3dc3c-7b20-48c3-8a3e-7bfb6a87d6b1 req-83cdcb2a-a202-47ba-b7ee-cf479b669054 service nova] Acquiring lock "refresh_cache-5dafacc2-fb17-4781-8dda-8b9f21e57dee" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:07:12.508676 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d8b3dc3c-7b20-48c3-8a3e-7bfb6a87d6b1 req-83cdcb2a-a202-47ba-b7ee-cf479b669054 service nova] Acquired lock "refresh_cache-5dafacc2-fb17-4781-8dda-8b9f21e57dee" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:07:12.508676 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-d8b3dc3c-7b20-48c3-8a3e-7bfb6a87d6b1 req-83cdcb2a-a202-47ba-b7ee-cf479b669054 service nova] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Refreshing network info cache for port fa7eeb89-fccc-45b2-ac90-b44568ff2c34 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:07:12.515272 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:07:12.515750 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:07:12.516023 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:12.516303 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:12.597061 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:12.689437 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fbae7974478d45b3908aaaa5b4408e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a430f0d6bcc84a29bc3e96514422896b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:07:12.771528 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Creating config drive at /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk.config
May 28 01:07:12.776434 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj083jkey {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:07:12.832946 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj083jkey" returned: 0 in 0.056s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:07:13.010852 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-d8b3dc3c-7b20-48c3-8a3e-7bfb6a87d6b1 req-83cdcb2a-a202-47ba-b7ee-cf479b669054 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:13.019175 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:07:13.219627 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Successfully created port: 9205b46e-8a1f-49e3-99c3-dfc929263fa3 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:07:13.270407 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:13.300604 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:13.302465 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:13.379459 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:13.443223 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-d8b3dc3c-7b20-48c3-8a3e-7bfb6a87d6b1 req-83cdcb2a-a202-47ba-b7ee-cf479b669054 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:13.525803 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:07:13.551149 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-38338f51-abb6-4bfb-861d-1cac0af3716c req-e90a59f6-a09d-4d47-9029-fe8a28c9fe89 service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Received event network-vif-plugged-cc1de356-c44a-46bf-bb87-d123239afbe7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:07:13.552402 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-38338f51-abb6-4bfb-861d-1cac0af3716c req-e90a59f6-a09d-4d47-9029-fe8a28c9fe89 service nova] Acquiring lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:13.552621 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-38338f51-abb6-4bfb-861d-1cac0af3716c req-e90a59f6-a09d-4d47-9029-fe8a28c9fe89 service nova] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:13.552759 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-38338f51-abb6-4bfb-861d-1cac0af3716c req-e90a59f6-a09d-4d47-9029-fe8a28c9fe89 service nova] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:13.552884 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-38338f51-abb6-4bfb-861d-1cac0af3716c req-e90a59f6-a09d-4d47-9029-fe8a28c9fe89 service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Processing event network-vif-plugged-cc1de356-c44a-46bf-bb87-d123239afbe7 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:07:13.624757 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-d8b3dc3c-7b20-48c3-8a3e-7bfb6a87d6b1 req-83cdcb2a-a202-47ba-b7ee-cf479b669054 service nova] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Updated VIF entry in instance network info cache for port fa7eeb89-fccc-45b2-ac90-b44568ff2c34. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:07:13.624757 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-d8b3dc3c-7b20-48c3-8a3e-7bfb6a87d6b1 req-83cdcb2a-a202-47ba-b7ee-cf479b669054 service nova] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Updating instance_info_cache with network_info: [{"id": "fa7eeb89-fccc-45b2-ac90-b44568ff2c34", "address": "fa:16:3e:c5:08:a5", "network": {"id": "7c483e76-809a-4260-af12-f58188f6bd77", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-964714137-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2dd8820c03574b9d86542c61bf1fdc43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7eeb89-fc", "ovs_interfaceid": "fa7eeb89-fccc-45b2-ac90-b44568ff2c34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:07:13.652912 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:13.657478 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:13.661984 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:13.693774 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:13.694010 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:14.014724 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Successfully updated port: 9205b46e-8a1f-49e3-99c3-dfc929263fa3 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:07:14.095484 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:07:14.096080 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930434.0956824, 1e7c5308-80cc-4991-8626-2ba32fa09acf => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:07:14.096242 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] VM Started (Lifecycle Event)
May 28 01:07:14.099902 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:07:14.101777 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Instance spawned successfully.
May 28 01:07:14.102015 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:07:14.126307 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d8b3dc3c-7b20-48c3-8a3e-7bfb6a87d6b1 req-83cdcb2a-a202-47ba-b7ee-cf479b669054 service nova] Releasing lock "refresh_cache-5dafacc2-fb17-4781-8dda-8b9f21e57dee" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:07:14.517383 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "refresh_cache-48bfd06f-62f4-4691-bf98-2426e359a90e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:07:14.517533 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquired lock "refresh_cache-48bfd06f-62f4-4691-bf98-2426e359a90e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:07:14.517600 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:07:14.537350 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:07:14.538163 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:07:14.538397 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Creating image(s)
May 28 01:07:14.538812 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "/opt/stack/data/nova/instances/48bfd06f-62f4-4691-bf98-2426e359a90e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:14.538935 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "/opt/stack/data/nova/instances/48bfd06f-62f4-4691-bf98-2426e359a90e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:14.539521 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "/opt/stack/data/nova/instances/48bfd06f-62f4-4691-bf98-2426e359a90e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:14.540556 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:07:14.543415 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:07:14.544648 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:07:14.604608 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:07:14.609389 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:07:14.613281 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:07:14.613415 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:07:14.613781 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:07:14.613993 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:07:14.614294 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:07:14.614555 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:07:14.632337 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.088s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:07:14.632819 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:14.634388 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:14.635805 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:07:14.641101 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:07:14.642015 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:07:14.726594 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.084s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:07:14.727065 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/48bfd06f-62f4-4691-bf98-2426e359a90e/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:07:14.777353 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/48bfd06f-62f4-4691-bf98-2426e359a90e/disk 1073741824" returned: 0 in 0.050s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:07:14.777960 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.144s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:14.778372 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:07:14.859721 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.081s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:07:14.860111 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Checking if we can resize image /opt/stack/data/nova/instances/48bfd06f-62f4-4691-bf98-2426e359a90e/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:07:14.860342 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48bfd06f-62f4-4691-bf98-2426e359a90e/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:07:14.945444 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48bfd06f-62f4-4691-bf98-2426e359a90e/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:07:14.946567 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Cannot resize image /opt/stack/data/nova/instances/48bfd06f-62f4-4691-bf98-2426e359a90e/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:07:14.946567 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:07:14.946567 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Ensure instance console log exists: /opt/stack/data/nova/instances/48bfd06f-62f4-4691-bf98-2426e359a90e/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:07:14.946850 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:14.947087 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:14.947268 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:15.081442 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:07:15.114850 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:07:15.114850 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930435.1132135, 1e7c5308-80cc-4991-8626-2ba32fa09acf => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:07:15.114850 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] VM Paused (Lifecycle Event)
May 28 01:07:15.120690 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Took 7.00 seconds to spawn the instance on the hypervisor.
May 28 01:07:15.120878 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:07:15.238998 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:15.351789 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Updating instance_info_cache with network_info: [{"id": "9205b46e-8a1f-49e3-99c3-dfc929263fa3", "address": "fa:16:3e:8d:51:0f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9205b46e-8a", "ovs_interfaceid": "9205b46e-8a1f-49e3-99c3-dfc929263fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:07:15.567354 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:15.616327 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:07:15.622790 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c6115a1c-f2d5-4358-941e-776472b7862b req-319ffe0d-3b48-4057-91c9-628d2796ba95 service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Received event network-vif-plugged-cc1de356-c44a-46bf-bb87-d123239afbe7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:07:15.623243 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c6115a1c-f2d5-4358-941e-776472b7862b req-319ffe0d-3b48-4057-91c9-628d2796ba95 service nova] Acquiring lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:15.623351 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c6115a1c-f2d5-4358-941e-776472b7862b req-319ffe0d-3b48-4057-91c9-628d2796ba95 service nova] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:15.624575 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c6115a1c-f2d5-4358-941e-776472b7862b req-319ffe0d-3b48-4057-91c9-628d2796ba95 service nova] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:15.624575 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c6115a1c-f2d5-4358-941e-776472b7862b req-319ffe0d-3b48-4057-91c9-628d2796ba95 service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] No waiting events found dispatching network-vif-plugged-cc1de356-c44a-46bf-bb87-d123239afbe7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:07:15.624575 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-c6115a1c-f2d5-4358-941e-776472b7862b req-319ffe0d-3b48-4057-91c9-628d2796ba95 service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Received unexpected event network-vif-plugged-cc1de356-c44a-46bf-bb87-d123239afbe7 for instance with vm_state active and task_state None.
May 28 01:07:15.624575 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c6115a1c-f2d5-4358-941e-776472b7862b req-319ffe0d-3b48-4057-91c9-628d2796ba95 service nova] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Received event network-changed-9205b46e-8a1f-49e3-99c3-dfc929263fa3 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:07:15.624575 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c6115a1c-f2d5-4358-941e-776472b7862b req-319ffe0d-3b48-4057-91c9-628d2796ba95 service nova] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Refreshing instance network info cache due to event network-changed-9205b46e-8a1f-49e3-99c3-dfc929263fa3. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:07:15.624575 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c6115a1c-f2d5-4358-941e-776472b7862b req-319ffe0d-3b48-4057-91c9-628d2796ba95 service nova] Acquiring lock "refresh_cache-48bfd06f-62f4-4691-bf98-2426e359a90e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:07:15.626373 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930435.6258614, 1e7c5308-80cc-4991-8626-2ba32fa09acf => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:07:15.627522 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] VM Resumed (Lifecycle Event)
May 28 01:07:15.646016 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Took 13.22 seconds to build instance.
May 28 01:07:15.853606 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Releasing lock "refresh_cache-48bfd06f-62f4-4691-bf98-2426e359a90e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:07:15.853827 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Instance network_info: |[{"id": "9205b46e-8a1f-49e3-99c3-dfc929263fa3", "address": "fa:16:3e:8d:51:0f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9205b46e-8a", "ovs_interfaceid": "9205b46e-8a1f-49e3-99c3-dfc929263fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:07:15.854274 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c6115a1c-f2d5-4358-941e-776472b7862b req-319ffe0d-3b48-4057-91c9-628d2796ba95 service nova] Acquired lock "refresh_cache-48bfd06f-62f4-4691-bf98-2426e359a90e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:07:15.855805 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Start _get_guest_xml network_info=[{"id": "9205b46e-8a1f-49e3-99c3-dfc929263fa3", "address": "fa:16:3e:8d:51:0f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9205b46e-8a", "ovs_interfaceid": "9205b46e-8a1f-49e3-99c3-dfc929263fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:07:15.856067 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-c6115a1c-f2d5-4358-941e-776472b7862b req-319ffe0d-3b48-4057-91c9-628d2796ba95 service nova] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Refreshing network info cache for port 9205b46e-8a1f-49e3-99c3-dfc929263fa3 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:07:15.858882 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:07:15.860010 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1829593862', uuid='48bfd06f-62f4-4691-bf98-2426e359a90e'), owner=OwnerMeta(userid='fbae7974478d45b3908aaaa5b4408e26', username='tempest-TestEncryptedCinderVolumes-2086871542-project-member', projectid='a430f0d6bcc84a29bc3e96514422896b', projectname='tempest-TestEncryptedCinderVolumes-2086871542'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9205b46e-8a1f-49e3-99c3-dfc929263fa3", "address": "fa:16:3e:8d:51:0f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9205b46e-8a", "ovs_interfaceid": "9205b46e-8a1f-49e3-99c3-dfc929263fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930435.8597012) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:07:15.861415 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:07:15.861738 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:07:15.862812 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:07:15.863188 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:07:15.864061 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:07:15.864404 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:07:15.864601 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:07:15.864736 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:07:15.865096 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:07:15.865221 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:07:15.865387 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:07:15.865583 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:07:15.865732 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:07:15.865879 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:07:15.866023 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:07:15.866176 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:07:15.876095 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:07:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1829593862',display_name='tempest-TestEncryptedCinderVolumes-server-1829593862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testencryptedcindervolumes-server-1829593862',id=55,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrmWHf8duJgWSyLYGvzhKVCPBx/McbpzQLqrrmbNM+uny8PX8YfdE3Zh3IGK41HXnF6HUj2qs1a/bPPx0H6w0SdF7pU7A2XSDGpiS0Laf5uvZsnFgG5rdiOvLlyI7Ljxw==',key_name='tempest-keypair-1102120832',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a430f0d6bcc84a29bc3e96514422896b',ramdisk_id='',reservation_id='r-uirmo1q0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-2086871542',owner_user_name='tempest-TestEncryptedCinderVolumes-2086871542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:07:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbae7974478d45b3908aaaa5b4408e26',uuid=48bfd06f-62f4-4691-bf98-2426e359a90e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9205b46e-8a1f-49e3-99c3-dfc929263fa3", "address": "fa:16:3e:8d:51:0f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9205b46e-8a", "ovs_interfaceid": "9205b46e-8a1f-49e3-99c3-dfc929263fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:07:15.876463 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converting VIF {"id": "9205b46e-8a1f-49e3-99c3-dfc929263fa3", "address": "fa:16:3e:8d:51:0f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9205b46e-8a", "ovs_interfaceid": "9205b46e-8a1f-49e3-99c3-dfc929263fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:07:15.877027 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:51:0f,bridge_name='br-int',has_traffic_filtering=True,id=9205b46e-8a1f-49e3-99c3-dfc929263fa3,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9205b46e-8a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:07:15.877787 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lazy-loading 'pci_devices' on Instance uuid 48bfd06f-62f4-4691-bf98-2426e359a90e {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:07:16.128761 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:07:16.130653 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:07:16.147447 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.724s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:16.358036 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-c6115a1c-f2d5-4358-941e-776472b7862b req-319ffe0d-3b48-4057-91c9-628d2796ba95 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:16.380155 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] End _get_guest_xml xml=<domain type="qemu">
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:   <uuid>48bfd06f-62f4-4691-bf98-2426e359a90e</uuid>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:   <name>instance-00000037</name>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1829593862</nova:name>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:07:15</nova:creationTime>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:         <nova:user uuid="fbae7974478d45b3908aaaa5b4408e26">tempest-TestEncryptedCinderVolumes-2086871542-project-member</nova:user>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:         <nova:project uuid="a430f0d6bcc84a29bc3e96514422896b">tempest-TestEncryptedCinderVolumes-2086871542</nova:project>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:         <nova:port uuid="9205b46e-8a1f-49e3-99c3-dfc929263fa3">
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:     <system>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       <entry name="serial">48bfd06f-62f4-4691-bf98-2426e359a90e</entry>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       <entry name="uuid">48bfd06f-62f4-4691-bf98-2426e359a90e</entry>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:     </system>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:   <os>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:   </os>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:   <features>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:   </features>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:   <devices>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/48bfd06f-62f4-4691-bf98-2426e359a90e/disk"/>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:     </disk>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/48bfd06f-62f4-4691-bf98-2426e359a90e/disk.config"/>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:     </disk>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:8d:51:0f"/>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       <target dev="tap9205b46e-8a"/>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:     </interface>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/48bfd06f-62f4-4691-bf98-2426e359a90e/console.log" append="off"/>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:     </serial>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:     <video>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:     </video>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:     </rng>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:   </devices>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]: </domain>
May 28 01:07:16.380155 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:07:16.381952 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Preparing to wait for external event network-vif-plugged-9205b46e-8a1f-49e3-99c3-dfc929263fa3 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:07:16.381952 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "48bfd06f-62f4-4691-bf98-2426e359a90e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:16.381952 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "48bfd06f-62f4-4691-bf98-2426e359a90e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:16.381952 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "48bfd06f-62f4-4691-bf98-2426e359a90e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:16.381952 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:07:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1829593862',display_name='tempest-TestEncryptedCinderVolumes-server-1829593862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testencryptedcindervolumes-server-1829593862',id=55,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrmWHf8duJgWSyLYGvzhKVCPBx/McbpzQLqrrmbNM+uny8PX8YfdE3Zh3IGK41HXnF6HUj2qs1a/bPPx0H6w0SdF7pU7A2XSDGpiS0Laf5uvZsnFgG5rdiOvLlyI7Ljxw==',key_name='tempest-keypair-1102120832',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a430f0d6bcc84a29bc3e96514422896b',ramdisk_id='',reservation_id='r-uirmo1q0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-2086871542',owner_user_name='tempest-TestEncryptedCinderVolumes-2086871542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:07:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbae7974478d45b3908aaaa5b4408e26',uuid=48bfd06f-62f4-4691-bf98-2426e359a90e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9205b46e-8a1f-49e3-99c3-dfc929263fa3", "address": "fa:16:3e:8d:51:0f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9205b46e-8a", "ovs_interfaceid": "9205b46e-8a1f-49e3-99c3-dfc929263fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:07:16.381952 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converting VIF {"id": "9205b46e-8a1f-49e3-99c3-dfc929263fa3", "address": "fa:16:3e:8d:51:0f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9205b46e-8a", "ovs_interfaceid": "9205b46e-8a1f-49e3-99c3-dfc929263fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:07:16.381952 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:51:0f,bridge_name='br-int',has_traffic_filtering=True,id=9205b46e-8a1f-49e3-99c3-dfc929263fa3,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9205b46e-8a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:07:16.382248 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:51:0f,bridge_name='br-int',has_traffic_filtering=True,id=9205b46e-8a1f-49e3-99c3-dfc929263fa3,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9205b46e-8a') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:07:16.382248 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:16.382495 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:07:16.382754 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:07:16.383359 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:16.383485 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa95a7cc-c286-51dc-90e7-590898a673fe', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:07:16.385466 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:07:16.388667 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:16.388791 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9205b46e-8a, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:07:16.389063 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9205b46e-8a, col_values=(('qos', UUID('2b9a3822-577e-454a-bcc5-f639c5e001d2')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:07:16.389203 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9205b46e-8a, col_values=(('external_ids', {'iface-id': '9205b46e-8a1f-49e3-99c3-dfc929263fa3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:51:0f', 'vm-uuid': '48bfd06f-62f4-4691-bf98-2426e359a90e'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:07:16.390067 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:16.391176 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:07:16.396814 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:16.397460 np0000001577 nova-compute[98319]: INFO os_vif [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:51:0f,bridge_name='br-int',has_traffic_filtering=True,id=9205b46e-8a1f-49e3-99c3-dfc929263fa3,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9205b46e-8a')
May 28 01:07:16.437659 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:16.633377 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-c6115a1c-f2d5-4358-941e-776472b7862b req-319ffe0d-3b48-4057-91c9-628d2796ba95 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:16.766132 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00039414000002579996 future=<Future at 0x7c988c089730 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:07:16.766461 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:07:16.766932 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Emitting event <LifecycleEvent: 1779930421.7656376, 1c35ef60-298f-47f3-99a0-c9de2bd34c55 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:07:16.769196 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] VM Stopped (Lifecycle Event)
May 28 01:07:16.770401 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-c6115a1c-f2d5-4358-941e-776472b7862b req-319ffe0d-3b48-4057-91c9-628d2796ba95 service nova] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Updated VIF entry in instance network info cache for port 9205b46e-8a1f-49e3-99c3-dfc929263fa3. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:07:16.770656 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-c6115a1c-f2d5-4358-941e-776472b7862b req-319ffe0d-3b48-4057-91c9-628d2796ba95 service nova] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Updating instance_info_cache with network_info: [{"id": "9205b46e-8a1f-49e3-99c3-dfc929263fa3", "address": "fa:16:3e:8d:51:0f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9205b46e-8a", "ovs_interfaceid": "9205b46e-8a1f-49e3-99c3-dfc929263fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:07:16.992291 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-de602c92-9cbe-4a8f-b031-c1027651b00a req-9aa9a588-35ff-418d-b6de-a5f6143f76c0 service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Received event network-changed-cc1de356-c44a-46bf-bb87-d123239afbe7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:07:16.992423 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-de602c92-9cbe-4a8f-b031-c1027651b00a req-9aa9a588-35ff-418d-b6de-a5f6143f76c0 service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Refreshing instance network info cache due to event network-changed-cc1de356-c44a-46bf-bb87-d123239afbe7. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:07:16.992914 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-de602c92-9cbe-4a8f-b031-c1027651b00a req-9aa9a588-35ff-418d-b6de-a5f6143f76c0 service nova] Acquiring lock "refresh_cache-1e7c5308-80cc-4991-8626-2ba32fa09acf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:07:16.992914 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-de602c92-9cbe-4a8f-b031-c1027651b00a req-9aa9a588-35ff-418d-b6de-a5f6143f76c0 service nova] Acquired lock "refresh_cache-1e7c5308-80cc-4991-8626-2ba32fa09acf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:07:16.992914 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-de602c92-9cbe-4a8f-b031-c1027651b00a req-9aa9a588-35ff-418d-b6de-a5f6143f76c0 service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Refreshing network info cache for port cc1de356-c44a-46bf-bb87-d123239afbe7 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:07:17.275749 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 1c35ef60-298f-47f3-99a0-c9de2bd34c55] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:07:17.275749 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c6115a1c-f2d5-4358-941e-776472b7862b req-319ffe0d-3b48-4057-91c9-628d2796ba95 service nova] Releasing lock "refresh_cache-48bfd06f-62f4-4691-bf98-2426e359a90e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:07:17.494974 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-de602c92-9cbe-4a8f-b031-c1027651b00a req-9aa9a588-35ff-418d-b6de-a5f6143f76c0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:17.769574 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-de602c92-9cbe-4a8f-b031-c1027651b00a req-9aa9a588-35ff-418d-b6de-a5f6143f76c0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:17.901559 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-de602c92-9cbe-4a8f-b031-c1027651b00a req-9aa9a588-35ff-418d-b6de-a5f6143f76c0 service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Updated VIF entry in instance network info cache for port cc1de356-c44a-46bf-bb87-d123239afbe7. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:07:17.901822 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-de602c92-9cbe-4a8f-b031-c1027651b00a req-9aa9a588-35ff-418d-b6de-a5f6143f76c0 service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Updating instance_info_cache with network_info: [{"id": "cc1de356-c44a-46bf-bb87-d123239afbe7", "address": "fa:16:3e:05:9d:ed", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1de356-c4", "ovs_interfaceid": "cc1de356-c44a-46bf-bb87-d123239afbe7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:07:17.918731 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:07:17.918866 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:07:17.919010 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] No VIF found with MAC fa:16:3e:8d:51:0f, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:07:17.919492 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Using config drive
May 28 01:07:18.403640 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-de602c92-9cbe-4a8f-b031-c1027651b00a req-9aa9a588-35ff-418d-b6de-a5f6143f76c0 service nova] Releasing lock "refresh_cache-1e7c5308-80cc-4991-8626-2ba32fa09acf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:07:18.425080 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:18.532454 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Creating config drive at /opt/stack/data/nova/instances/48bfd06f-62f4-4691-bf98-2426e359a90e/disk.config
May 28 01:07:18.535951 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/48bfd06f-62f4-4691-bf98-2426e359a90e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyz85wj0d {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:07:18.589051 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/48bfd06f-62f4-4691-bf98-2426e359a90e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyz85wj0d" returned: 0 in 0.053s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:07:18.971833 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:19.002806 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:19.008656 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:19.092664 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:19.176532 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1c7aaa49-1ef6-4b38-9851-27d4673e2e7d req-dfb7d4e9-5bf6-4a06-997e-35fde83016e1 service nova] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Received event network-vif-plugged-9205b46e-8a1f-49e3-99c3-dfc929263fa3 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:07:19.177074 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1c7aaa49-1ef6-4b38-9851-27d4673e2e7d req-dfb7d4e9-5bf6-4a06-997e-35fde83016e1 service nova] Acquiring lock "48bfd06f-62f4-4691-bf98-2426e359a90e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:19.177366 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1c7aaa49-1ef6-4b38-9851-27d4673e2e7d req-dfb7d4e9-5bf6-4a06-997e-35fde83016e1 service nova] Lock "48bfd06f-62f4-4691-bf98-2426e359a90e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:19.177727 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1c7aaa49-1ef6-4b38-9851-27d4673e2e7d req-dfb7d4e9-5bf6-4a06-997e-35fde83016e1 service nova] Lock "48bfd06f-62f4-4691-bf98-2426e359a90e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:19.177727 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1c7aaa49-1ef6-4b38-9851-27d4673e2e7d req-dfb7d4e9-5bf6-4a06-997e-35fde83016e1 service nova] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Processing event network-vif-plugged-9205b46e-8a1f-49e3-99c3-dfc929263fa3 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:07:19.346372 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:19.350001 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:19.353497 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:19.375389 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:19.872152 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:07:19.874178 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930439.8737445, 48bfd06f-62f4-4691-bf98-2426e359a90e => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:07:19.874526 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] VM Started (Lifecycle Event)
May 28 01:07:19.875909 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:07:19.878662 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Instance spawned successfully.
May 28 01:07:19.878992 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:07:20.377920 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:07:20.381646 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:07:20.388367 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:07:20.388646 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:07:20.389043 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:07:20.389452 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:07:20.389785 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:07:20.390128 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:07:20.886482 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:07:20.888564 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930440.886565, 48bfd06f-62f4-4691-bf98-2426e359a90e => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:07:20.888564 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] VM Paused (Lifecycle Event)
May 28 01:07:20.897074 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Took 6.36 seconds to spawn the instance on the hypervisor.
May 28 01:07:20.897204 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:07:21.127226 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Acquiring lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:21.127491 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:21.240775 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9b29049d-4e70-435b-aae2-7ecabc52cd8b req-8a3b0848-ac43-4d8a-b8cf-a0291fe027a8 service nova] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Received event network-vif-plugged-9205b46e-8a1f-49e3-99c3-dfc929263fa3 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:07:21.241759 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9b29049d-4e70-435b-aae2-7ecabc52cd8b req-8a3b0848-ac43-4d8a-b8cf-a0291fe027a8 service nova] Acquiring lock "48bfd06f-62f4-4691-bf98-2426e359a90e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:21.241759 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9b29049d-4e70-435b-aae2-7ecabc52cd8b req-8a3b0848-ac43-4d8a-b8cf-a0291fe027a8 service nova] Lock "48bfd06f-62f4-4691-bf98-2426e359a90e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:21.241759 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9b29049d-4e70-435b-aae2-7ecabc52cd8b req-8a3b0848-ac43-4d8a-b8cf-a0291fe027a8 service nova] Lock "48bfd06f-62f4-4691-bf98-2426e359a90e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:21.241759 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9b29049d-4e70-435b-aae2-7ecabc52cd8b req-8a3b0848-ac43-4d8a-b8cf-a0291fe027a8 service nova] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] No waiting events found dispatching network-vif-plugged-9205b46e-8a1f-49e3-99c3-dfc929263fa3 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:07:21.241759 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-9b29049d-4e70-435b-aae2-7ecabc52cd8b req-8a3b0848-ac43-4d8a-b8cf-a0291fe027a8 service nova] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Received unexpected event network-vif-plugged-9205b46e-8a1f-49e3-99c3-dfc929263fa3 for instance with vm_state active and task_state None.
May 28 01:07:21.389115 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:07:21.390695 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930441.3904927, 48bfd06f-62f4-4691-bf98-2426e359a90e => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:07:21.390826 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] VM Resumed (Lifecycle Event)
May 28 01:07:21.398190 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:21.406084 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Took 11.89 seconds to build instance.
May 28 01:07:21.438442 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:21.631194 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lazy-loading 'flavor' on Instance uuid a9179c5a-9c48-4d9a-9a7a-3e4baa721bba {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:07:21.892957 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:07:21.895094 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:07:21.907416 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46b27375-f24a-4412-929c-6369f1dd05b1 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "48bfd06f-62f4-4691-bf98-2426e359a90e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.410s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:22.134689 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Ignoring supplied device name: /dev/vdb
May 28 01:07:22.636865 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:22.867007 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2fbb8162-162b-4c4c-8247-4ef0afdd3c98 req-aad0e5c9-3f37-4ce7-af74-efaf0867b5fd service nova] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Received event network-changed-9205b46e-8a1f-49e3-99c3-dfc929263fa3 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:07:22.867123 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2fbb8162-162b-4c4c-8247-4ef0afdd3c98 req-aad0e5c9-3f37-4ce7-af74-efaf0867b5fd service nova] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Refreshing instance network info cache due to event network-changed-9205b46e-8a1f-49e3-99c3-dfc929263fa3. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:07:22.867271 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2fbb8162-162b-4c4c-8247-4ef0afdd3c98 req-aad0e5c9-3f37-4ce7-af74-efaf0867b5fd service nova] Acquiring lock "refresh_cache-48bfd06f-62f4-4691-bf98-2426e359a90e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:07:22.867358 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2fbb8162-162b-4c4c-8247-4ef0afdd3c98 req-aad0e5c9-3f37-4ce7-af74-efaf0867b5fd service nova] Acquired lock "refresh_cache-48bfd06f-62f4-4691-bf98-2426e359a90e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:07:22.867470 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-2fbb8162-162b-4c4c-8247-4ef0afdd3c98 req-aad0e5c9-3f37-4ce7-af74-efaf0867b5fd service nova] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Refreshing network info cache for port 9205b46e-8a1f-49e3-99c3-dfc929263fa3 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:07:23.371383 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-2fbb8162-162b-4c4c-8247-4ef0afdd3c98 req-aad0e5c9-3f37-4ce7-af74-efaf0867b5fd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:23.690285 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-2fbb8162-162b-4c4c-8247-4ef0afdd3c98 req-aad0e5c9-3f37-4ce7-af74-efaf0867b5fd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:23.710792 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Acquiring lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:23.713566 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:23.713566 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Attaching volume bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18 to /dev/vdb
May 28 01:07:23.755389 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:07:23.766386 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:07:23.790599 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:07:23.824042 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-2fbb8162-162b-4c4c-8247-4ef0afdd3c98 req-aad0e5c9-3f37-4ce7-af74-efaf0867b5fd service nova] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Updated VIF entry in instance network info cache for port 9205b46e-8a1f-49e3-99c3-dfc929263fa3. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:07:23.824527 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-2fbb8162-162b-4c4c-8247-4ef0afdd3c98 req-aad0e5c9-3f37-4ce7-af74-efaf0867b5fd service nova] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Updating instance_info_cache with network_info: [{"id": "9205b46e-8a1f-49e3-99c3-dfc929263fa3", "address": "fa:16:3e:8d:51:0f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9205b46e-8a", "ovs_interfaceid": "9205b46e-8a1f-49e3-99c3-dfc929263fa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:07:23.832490 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:07:23.832813 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:07:23.841322 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:07:23.842873 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe49:4d05', 'fe80::e873:f8ff:fed0:1522', 'fe80::fc16:3eff:fe49:8123', 'fe80::fc16:3eff:fef5:a89f', 'fe80::e071:f2ff:feee:4293', 'fe80::fc16:3eff:fe2f:5139', 'fe80::cc21:ccff:fe37:683c', 'fe80::fc16:3eff:fec5:8a5', 'fe80::80fb:7dff:feff:ce54', 'fe80::fc16:3eff:fe05:9ded', 'fe80::84b7:d3ff:feed:4f01', 'fe80::fc16:3eff:fe8d:510f', 'fe80::49a:a7ff:fef7:c9e8'] 
May 28 01:07:23.843019 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:07:23.843171 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:07:23.843455 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:07:23.843840 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Updating existing volume attachment record: 8e3c829b-9a61-4780-82e4-188df2839a74 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:07:24.327536 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2fbb8162-162b-4c4c-8247-4ef0afdd3c98 req-aad0e5c9-3f37-4ce7-af74-efaf0867b5fd service nova] Releasing lock "refresh_cache-48bfd06f-62f4-4691-bf98-2426e359a90e" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:07:24.392502 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:07:24.392831 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18', 'iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:07:24.392962 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:07:24.393323 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:07:24.393527 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18', 'iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:07:24.404694 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:07:24.405342 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:07:24.406387 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:07:24.406616 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:07:24.406908 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:07:24.407317 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:07:24.417118 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:07:24.417118 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:24.421968 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:07:24.421968 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:24.431098 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18] added
May 28 01:07:24.431098 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:07:24.431098 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:07:24.431098 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:07:24.431098 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:07:24.431098 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:07:24.431098 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:24.431461 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:07:24.431461 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0248(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:07:24.431643 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:07:24.433571 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18] added
May 28 01:07:24.433571 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:07:24.433571 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:07:24.433571 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:07:24.433571 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:07:24.433571 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:07:24.433571 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:24.433758 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:07:24.433950 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0268(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:07:24.434102 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:07:25.432136 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:07:25.434460 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:07:25.446126 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:07:25.446126 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:07:25.451405 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:07:25.451405 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:25.458994 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:25.465409 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:25.474005 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:25.474005 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:25.474005 np0000001577 nova-compute[98319]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:07:25.474005 np0000001577 nova-compute[98319]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:07:25.474005 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:07:25.474322 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:25.474322 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:25.474322 np0000001577 nova-compute[98319]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:07:25.474322 np0000001577 nova-compute[98319]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:07:25.474322 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:07:25.478755 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:25.478755 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:25.478755 np0000001577 nova-compute[98319]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:07:25.478755 np0000001577 nova-compute[98319]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:07:25.478755 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:07:25.478884 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:25.478884 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:25.478884 np0000001577 nova-compute[98319]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:07:25.478884 np0000001577 nova-compute[98319]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:07:25.478884 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:07:25.511741 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18, portal: 192.168.40.100,3260]
May 28 01:07:25.511741 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18, portal: 192.168.40.100,3260] successful.
May 28 01:07:25.511741 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:25.516743 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18, portal: 192.168.50.100,3260]
May 28 01:07:25.516743 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18, portal: 192.168.50.100,3260] successful.
May 28 01:07:25.516743 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:25.525216 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:25.530086 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:25.545579 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:25.545579 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:25.545579 np0000001577 nova-compute[98319]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:07:25.545579 np0000001577 nova-compute[98319]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:07:25.545579 np0000001577 nova-compute[98319]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18 (non-flash)
May 28 01:07:25.545579 np0000001577 nova-compute[98319]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18 (non-flash)
May 28 01:07:25.545579 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:07:25.545798 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:25.545798 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:25.545798 np0000001577 nova-compute[98319]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:07:25.545798 np0000001577 nova-compute[98319]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:07:25.545798 np0000001577 nova-compute[98319]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18 (non-flash)
May 28 01:07:25.545798 np0000001577 nova-compute[98319]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18 (non-flash)
May 28 01:07:25.545798 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:07:25.545917 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:07:25.546021 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:07:25.546714 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] HCTL ('7', '-', '-', 0) found on session 122 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:07:25.546822 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:07:25.553757 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:25.553757 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:25.553757 np0000001577 nova-compute[98319]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:07:25.553757 np0000001577 nova-compute[98319]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:07:25.553757 np0000001577 nova-compute[98319]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18 (non-flash)
May 28 01:07:25.553757 np0000001577 nova-compute[98319]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18 (non-flash)
May 28 01:07:25.553757 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:07:25.553994 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:25.553994 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:25.553994 np0000001577 nova-compute[98319]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:07:25.553994 np0000001577 nova-compute[98319]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:07:25.553994 np0000001577 nova-compute[98319]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18 (non-flash)
May 28 01:07:25.553994 np0000001577 nova-compute[98319]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18 (non-flash)
May 28 01:07:25.553994 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:07:25.554114 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.147s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:07:25.554208 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:07:25.554827 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] HCTL ('8', '-', '-', 0) found on session 123 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:07:25.554905 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:07:25.565809 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Searching for a device in session 122 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:07:25.565809 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:07:25.574834 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Searching for a device in session 123 and hctl ['8', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:07:26.399233 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:26.438936 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:26.572780 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Searching for a device in session 123 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:07:26.573036 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:07:27.425416 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Found WWN 330000000dd52e85f for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:07:27.425586 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:07:27.425746 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '330000000dd52e85f', 'path': '/dev/dm-0', 'multipath_id': '330000000dd52e85f'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:07:27.425879 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000dd52e85f', 'path': '/dev/dm-0', 'multipath_id': '330000000dd52e85f'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:07:27.428333 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lazy-loading 'flavor' on Instance uuid a9179c5a-9c48-4d9a-9a7a-3e4baa721bba {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:07:27.931369 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Attempting to attach volume bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:07:27.932568 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:07:27.932568 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:07:27.932568 np0000001577 nova-compute[98319]:   <alias name="ua-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18"/>
May 28 01:07:27.932568 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 28 01:07:27.932568 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:07:27.932568 np0000001577 nova-compute[98319]:   <serial>bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18</serial>
May 28 01:07:27.932568 np0000001577 nova-compute[98319]: </disk>
May 28 01:07:27.932568 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:07:29.580278 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:07:29.580667 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:07:29.580667 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:07:29.580667 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] No VIF found with MAC fa:16:3e:2f:51:39, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:07:31.129768 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6f488ce6-4be5-4691-a1d9-c2b66b20058a tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.419s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:31.184876 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7967f9ed-2932-47f7-81de-01fd2cf1032d req-cddf4739-0e67-4ac4-8b88-24e361d91fab service nova] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Received event volume-extended-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:07:31.401835 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:31.441114 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:31.686575 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7967f9ed-2932-47f7-81de-01fd2cf1032d req-cddf4739-0e67-4ac4-8b88-24e361d91fab service nova] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Handling volume-extended event for volume bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18 {{(pid=98319) extend_volume /opt/stack/nova/nova/compute/manager.py:11836}}
May 28 01:07:32.188750 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-7967f9ed-2932-47f7-81de-01fd2cf1032d req-cddf4739-0e67-4ac4-8b88-24e361d91fab service nova] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Cinder extended volume bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18; extending it to detect new size
May 28 01:07:32.730886 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [req-7967f9ed-2932-47f7-81de-01fd2cf1032d req-cddf4739-0e67-4ac4-8b88-24e361d91fab service nova] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] calling os-brick to extend iSCSI Volume {{(pid=98319) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:88}}
May 28 01:07:32.731198 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [req-7967f9ed-2932-47f7-81de-01fd2cf1032d req-cddf4739-0e67-4ac4-8b88-24e361d91fab service nova] ==> extend_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18', 'iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}), 'kwargs': {}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:07:32.731401 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [req-7967f9ed-2932-47f7-81de-01fd2cf1032d req-cddf4739-0e67-4ac4-8b88-24e361d91fab service nova] Acquiring lock "extend_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:07:32.731857 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [req-7967f9ed-2932-47f7-81de-01fd2cf1032d req-cddf4739-0e67-4ac4-8b88-24e361d91fab service nova] Lock "extend_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:07:32.732195 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [req-7967f9ed-2932-47f7-81de-01fd2cf1032d req-cddf4739-0e67-4ac4-8b88-24e361d91fab service nova] Extend volume for {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18', 'iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}
May 28 01:07:32.732317 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [req-7967f9ed-2932-47f7-81de-01fd2cf1032d req-cddf4739-0e67-4ac4-8b88-24e361d91fab service nova] Multipath discovery for iSCSI enabled
May 28 01:07:32.732530 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [req-7967f9ed-2932-47f7-81de-01fd2cf1032d req-cddf4739-0e67-4ac4-8b88-24e361d91fab service nova] Found paths for volume ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18-lun-0']
May 28 01:07:32.732690 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [req-7967f9ed-2932-47f7-81de-01fd2cf1032d req-cddf4739-0e67-4ac4-8b88-24e361d91fab service nova] Checking paths are valid ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18-lun-0'] {{(pid=98319) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:711}}
May 28 01:07:32.751062 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [req-7967f9ed-2932-47f7-81de-01fd2cf1032d req-cddf4739-0e67-4ac4-8b88-24e361d91fab service nova] extend volume ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18-lun-0'] {{(pid=98319) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:718}}
May 28 01:07:32.751327 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [req-7967f9ed-2932-47f7-81de-01fd2cf1032d req-cddf4739-0e67-4ac4-8b88-24e361d91fab service nova] Running cmd (subprocess): lsscsi {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:07:32.798063 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [req-7967f9ed-2932-47f7-81de-01fd2cf1032d req-cddf4739-0e67-4ac4-8b88-24e361d91fab service nova] CMD "lsscsi" returned: 0 in 0.046s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:07:32.798677 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [req-7967f9ed-2932-47f7-81de-01fd2cf1032d req-cddf4739-0e67-4ac4-8b88-24e361d91fab service nova] dev_info={'device': '/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18-lun-0', 'host': '7', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98319) get_device_info /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:201}}
May 28 01:07:32.799006 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [req-7967f9ed-2932-47f7-81de-01fd2cf1032d req-cddf4739-0e67-4ac4-8b88-24e361d91fab service nova] Volume device info = {'device': '/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18-lun-0', 'host': '7', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98319) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:722}}
May 28 01:07:32.808612 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [req-7967f9ed-2932-47f7-81de-01fd2cf1032d req-cddf4739-0e67-4ac4-8b88-24e361d91fab service nova] Starting size: 1073741824 {{(pid=98319) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:733}}
May 28 01:07:32.831793 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [req-7967f9ed-2932-47f7-81de-01fd2cf1032d req-cddf4739-0e67-4ac4-8b88-24e361d91fab service nova] volume size after scsi device rescan 2147483648 {{(pid=98319) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:739}}
May 28 01:07:32.832068 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [req-7967f9ed-2932-47f7-81de-01fd2cf1032d req-cddf4739-0e67-4ac4-8b88-24e361d91fab service nova] Running cmd (subprocess): lsscsi {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:07:32.889050 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [req-7967f9ed-2932-47f7-81de-01fd2cf1032d req-cddf4739-0e67-4ac4-8b88-24e361d91fab service nova] CMD "lsscsi" returned: 0 in 0.056s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:07:32.889737 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [req-7967f9ed-2932-47f7-81de-01fd2cf1032d req-cddf4739-0e67-4ac4-8b88-24e361d91fab service nova] dev_info={'device': '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18-lun-0', 'host': '8', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98319) get_device_info /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:201}}
May 28 01:07:32.890028 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [req-7967f9ed-2932-47f7-81de-01fd2cf1032d req-cddf4739-0e67-4ac4-8b88-24e361d91fab service nova] Volume device info = {'device': '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18-lun-0', 'host': '8', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98319) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:722}}
May 28 01:07:32.901343 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [req-7967f9ed-2932-47f7-81de-01fd2cf1032d req-cddf4739-0e67-4ac4-8b88-24e361d91fab service nova] Starting size: 1073741824 {{(pid=98319) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:733}}
May 28 01:07:32.927670 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [req-7967f9ed-2932-47f7-81de-01fd2cf1032d req-cddf4739-0e67-4ac4-8b88-24e361d91fab service nova] volume size after scsi device rescan 2147483648 {{(pid=98319) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:739}}
May 28 01:07:32.937857 np0000001577 nova-compute[98319]: INFO os_brick.initiator.linuxscsi [req-7967f9ed-2932-47f7-81de-01fd2cf1032d req-cddf4739-0e67-4ac4-8b88-24e361d91fab service nova] Find Multipath device file for volume WWN 330000000dd52e85f
May 28 01:07:32.938072 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [req-7967f9ed-2932-47f7-81de-01fd2cf1032d req-cddf4739-0e67-4ac4-8b88-24e361d91fab service nova] Checking to see if /dev/disk/by-id/dm-uuid-mpath-330000000dd52e85f exists yet. {{(pid=98319) wait_for_path /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:482}}
May 28 01:07:32.938374 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [req-7967f9ed-2932-47f7-81de-01fd2cf1032d req-cddf4739-0e67-4ac4-8b88-24e361d91fab service nova] /dev/disk/by-id/dm-uuid-mpath-330000000dd52e85f has shown up. {{(pid=98319) wait_for_path /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:489}}
May 28 01:07:32.961153 np0000001577 nova-compute[98319]: INFO os_brick.initiator.linuxscsi [req-7967f9ed-2932-47f7-81de-01fd2cf1032d req-cddf4739-0e67-4ac4-8b88-24e361d91fab service nova] mpath(/dev/disk/by-id/dm-uuid-mpath-330000000dd52e85f) current size 1073741824
May 28 01:07:32.978600 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "b1ae3969-7f8a-457a-aed8-539761a6d03e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:32.979423 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "b1ae3969-7f8a-457a-aed8-539761a6d03e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:33.009600 np0000001577 nova-compute[98319]: INFO os_brick.initiator.linuxscsi [req-7967f9ed-2932-47f7-81de-01fd2cf1032d req-cddf4739-0e67-4ac4-8b88-24e361d91fab service nova] mpath(/dev/disk/by-id/dm-uuid-mpath-330000000dd52e85f) new size 2147483648
May 28 01:07:33.009991 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [req-7967f9ed-2932-47f7-81de-01fd2cf1032d req-cddf4739-0e67-4ac4-8b88-24e361d91fab service nova] Lock "extend_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: held 0.278s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:07:33.010167 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [req-7967f9ed-2932-47f7-81de-01fd2cf1032d req-cddf4739-0e67-4ac4-8b88-24e361d91fab service nova] <== extend_volume: return (278ms) 2147483648 {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:07:33.010393 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [req-7967f9ed-2932-47f7-81de-01fd2cf1032d req-cddf4739-0e67-4ac4-8b88-24e361d91fab service nova] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Extend iSCSI Volume: new_size=2147483648 {{(pid=98319) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:90}}
May 28 01:07:33.015169 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [req-7967f9ed-2932-47f7-81de-01fd2cf1032d req-cddf4739-0e67-4ac4-8b88-24e361d91fab service nova] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Resizing target device /dev/dm-0 to 2147483648 {{(pid=98319) _resize_attached_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2945}}
May 28 01:07:33.483696 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lazy-loading 'flavor' on Instance uuid b1ae3969-7f8a-457a-aed8-539761a6d03e {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:07:33.951760 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Acquiring lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:33.951965 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:33.988045 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Ignoring supplied device name: /dev/vdb
May 28 01:07:34.197119 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "19c25c52-03a6-4665-ac3e-aa455fd99345" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:34.197242 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "19c25c52-03a6-4665-ac3e-aa455fd99345" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:34.197375 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "19c25c52-03a6-4665-ac3e-aa455fd99345-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:34.197494 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "19c25c52-03a6-4665-ac3e-aa455fd99345-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:34.197630 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "19c25c52-03a6-4665-ac3e-aa455fd99345-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:34.199776 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Terminating instance
May 28 01:07:34.454608 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Detaching volume bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18
May 28 01:07:34.490342 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "b1ae3969-7f8a-457a-aed8-539761a6d03e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:34.497903 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Attempting to driver detach volume bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18 from mountpoint /dev/vdb
May 28 01:07:34.502281 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Found disk vdb by alias ua-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:07:34.503523 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Found disk vdb by alias ua-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:07:34.503706 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Attempting to detach device vdb from instance a9179c5a-9c48-4d9a-9a7a-3e4baa721bba from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:07:34.504024 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:07:34.504024 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:07:34.504024 np0000001577 nova-compute[98319]:   <alias name="ua-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18"/>
May 28 01:07:34.504024 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 28 01:07:34.504024 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:07:34.504024 np0000001577 nova-compute[98319]:   <serial>bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18</serial>
May 28 01:07:34.504024 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:07:34.504024 np0000001577 nova-compute[98319]: </disk>
May 28 01:07:34.504024 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:07:34.513709 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Successfully detached device vdb from instance a9179c5a-9c48-4d9a-9a7a-3e4baa721bba from the persistent domain config.
May 28 01:07:34.513910 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] (1/8): Attempting to detach device vdb with device alias ua-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18 from instance a9179c5a-9c48-4d9a-9a7a-3e4baa721bba from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:07:34.514187 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:07:34.514187 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:07:34.514187 np0000001577 nova-compute[98319]:   <alias name="ua-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18"/>
May 28 01:07:34.514187 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 28 01:07:34.514187 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:07:34.514187 np0000001577 nova-compute[98319]:   <serial>bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18</serial>
May 28 01:07:34.514187 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:07:34.514187 np0000001577 nova-compute[98319]: </disk>
May 28 01:07:34.514187 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:07:34.702753 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:07:34.727132 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:34.740879 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:34.752874 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:34.927123 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:34.934849 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:34.993612 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a19b3d52-8d2d-42a7-85e9-63e3b961883e req-c9613a55-238c-4d44-9f36-bb8fa7ce2a4d service nova] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Received event network-vif-unplugged-c2f50d6d-6f06-4817-ab50-46a6b07ac6e2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:07:34.994009 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a19b3d52-8d2d-42a7-85e9-63e3b961883e req-c9613a55-238c-4d44-9f36-bb8fa7ce2a4d service nova] Acquiring lock "19c25c52-03a6-4665-ac3e-aa455fd99345-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:34.994147 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a19b3d52-8d2d-42a7-85e9-63e3b961883e req-c9613a55-238c-4d44-9f36-bb8fa7ce2a4d service nova] Lock "19c25c52-03a6-4665-ac3e-aa455fd99345-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:34.994263 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a19b3d52-8d2d-42a7-85e9-63e3b961883e req-c9613a55-238c-4d44-9f36-bb8fa7ce2a4d service nova] Lock "19c25c52-03a6-4665-ac3e-aa455fd99345-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:34.994369 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a19b3d52-8d2d-42a7-85e9-63e3b961883e req-c9613a55-238c-4d44-9f36-bb8fa7ce2a4d service nova] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] No waiting events found dispatching network-vif-unplugged-c2f50d6d-6f06-4817-ab50-46a6b07ac6e2 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:07:34.994474 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a19b3d52-8d2d-42a7-85e9-63e3b961883e req-c9613a55-238c-4d44-9f36-bb8fa7ce2a4d service nova] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Received event network-vif-unplugged-c2f50d6d-6f06-4817-ab50-46a6b07ac6e2 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:07:35.035886 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930455.0349157, a9179c5a-9c48-4d9a-9a7a-3e4baa721bba => ua-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:07:35.038603 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18 for instance a9179c5a-9c48-4d9a-9a7a-3e4baa721bba {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:07:35.041340 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Successfully detached device vdb from instance a9179c5a-9c48-4d9a-9a7a-3e4baa721bba from the live domain config.
May 28 01:07:35.043225 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:07:35.043225 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18', 'iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:07:35.043359 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:07:35.043591 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:07:35.044068 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18', 'iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:07:35.044068 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:07:35.072192 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:35.072192 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:35.072192 np0000001577 nova-compute[98319]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:07:35.072192 np0000001577 nova-compute[98319]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:07:35.072192 np0000001577 nova-compute[98319]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18 (non-flash)
May 28 01:07:35.072192 np0000001577 nova-compute[98319]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18 (non-flash)
May 28 01:07:35.072192 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:07:35.072475 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:35.072475 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:35.072475 np0000001577 nova-compute[98319]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:07:35.072475 np0000001577 nova-compute[98319]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:07:35.072475 np0000001577 nova-compute[98319]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18 (non-flash)
May 28 01:07:35.072475 np0000001577 nova-compute[98319]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18 (non-flash)
May 28 01:07:35.072475 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:07:35.072475 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac', '103'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474', '119'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474', '120'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18', '122'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18', '123')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:07:35.072695 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18', '122')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:07:35.073415 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18', '123')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:07:35.074061 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c9870466840>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18'): ({'sdc'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:07:35.074231 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:07:35.074465 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Flush multipath device 330000000dd52e85f {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:07:35.110118 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:07:35.148746 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.99966901400012 future=<Future at 0x7c984c7d3620 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:07:35.150305 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.998093873000016 future=<Future at 0x7c984c7d3620 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:07:35.150408 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.997954744000253 future=<Future at 0x7c984c7d3620 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:07:35.152243 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Instance destroyed successfully.
May 28 01:07:35.155395 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lazy-loading 'resources' on Instance uuid 19c25c52-03a6-4665-ac3e-aa455fd99345 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:07:35.157793 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:07:35.199347 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:07:35.199572 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:07:35.200510 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:07:35.212653 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:07:35.212894 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:07:35.224428 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:35.250955 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 122, target: iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18, portal: 192.168.40.100,3260]
May 28 01:07:35.250955 np0000001577 nova-compute[98319]: Logout of [sid: 122, target: iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18, portal: 192.168.40.100,3260] successful.
May 28 01:07:35.250955 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:35.266058 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:35.278271 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:35.306962 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 123, target: iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18, portal: 192.168.50.100,3260]
May 28 01:07:35.306962 np0000001577 nova-compute[98319]: Logout of [sid: 123, target: iqn.2023-03.storpool.com:os--volume-bd8f81f2-d4b4-4eaf-9b2e-5fd9e0c67f18, portal: 192.168.50.100,3260] successful.
May 28 01:07:35.306962 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:35.325363 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:35.325585 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:07:35.325697 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] <== disconnect_volume: return (282ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:07:35.325809 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:07:35.561936 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "b1ae3969-7f8a-457a-aed8-539761a6d03e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:35.564810 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "b1ae3969-7f8a-457a-aed8-539761a6d03e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:35.564810 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Attaching volume 3d6034b1-b4b2-4528-80b9-f3af53b32408 to /dev/vdb
May 28 01:07:35.658496 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1614040866',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1614040866',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpattern-image-snapshot-server-1614040866',id=50,image_ref='7137f17c-dc43-4144-8e21-3a7d7f7d7e9e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJU9yYW065PfXMeztEuE17kwrpdMzmLcl6/5/bF0WLE/z55Va5K+yZkgbZDwuamAi13h36qAewjx279aVTmJPpTuosXPuVHcMTW9JPTTEzds9KPbP5bofMYJpmhJToJfXw==',key_name='tempest-keypair-352056663',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:06:55Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='050f928f1ce449d6a447cd343dc4ff80',ramdisk_id='',reservation_id='r-kgobve0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1449742411',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1449742411',owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:06:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c803ddeaf4f4b3db07587419087b3b2',uuid=19c25c52-03a6-4665-ac3e-aa455fd99345,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2f50d6d-6f06-4817-ab50-46a6b07ac6e2", "address": "fa:16:3e:49:81:23", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f50d6d-6f", "ovs_interfaceid": "c2f50d6d-6f06-4817-ab50-46a6b07ac6e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:07:35.658665 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converting VIF {"id": "c2f50d6d-6f06-4817-ab50-46a6b07ac6e2", "address": "fa:16:3e:49:81:23", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f50d6d-6f", "ovs_interfaceid": "c2f50d6d-6f06-4817-ab50-46a6b07ac6e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:07:35.660637 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:81:23,bridge_name='br-int',has_traffic_filtering=True,id=c2f50d6d-6f06-4817-ab50-46a6b07ac6e2,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f50d6d-6f') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:07:35.661689 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:81:23,bridge_name='br-int',has_traffic_filtering=True,id=c2f50d6d-6f06-4817-ab50-46a6b07ac6e2,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f50d6d-6f') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:07:35.666807 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:35.666807 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2f50d6d-6f, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:07:35.668328 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:35.669797 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:07:35.671508 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:35.671667 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5e05ce39-ca5a-4b95-aaaf-8077a4131bc9) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:07:35.673176 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:07:35.677113 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:35.677113 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:07:35.680868 np0000001577 nova-compute[98319]: INFO os_vif [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:81:23,bridge_name='br-int',has_traffic_filtering=True,id=c2f50d6d-6f06-4817-ab50-46a6b07ac6e2,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f50d6d-6f')
May 28 01:07:35.681615 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:07:35.682430 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474', 'iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe6b70ee-a1a2-4174-beec-7239b6484474', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:07:35.682569 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:07:35.683604 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:07:35.684277 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474', 'iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe6b70ee-a1a2-4174-beec-7239b6484474', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:07:35.684444 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:07:35.685582 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:07:35.711944 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:35.711944 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:35.711944 np0000001577 nova-compute[98319]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:07:35.711944 np0000001577 nova-compute[98319]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:07:35.711944 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:07:35.712079 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:35.712079 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:35.712079 np0000001577 nova-compute[98319]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:07:35.712079 np0000001577 nova-compute[98319]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474 (non-flash)
May 28 01:07:35.712079 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:07:35.712310 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac', '103'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474', '119'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474', '120')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:07:35.712621 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474', '120')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:07:35.713526 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474', '119')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:07:35.714438 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c9884126fc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474'): ({'sde'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:07:35.722640 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Removing multipathed devices sde, sdh {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:07:35.723181 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Flush multipath device 330000000de79e3ec {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:07:35.725921 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:07:35.771095 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:07:35.771380 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:07:35.779076 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:07:35.780813 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:07:35.782032 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe49:4d05', 'fe80::e873:f8ff:fed0:1522', 'fe80::fc16:3eff:fef5:a89f', 'fe80::e071:f2ff:feee:4293', 'fe80::fc16:3eff:fe2f:5139', 'fe80::cc21:ccff:fe37:683c', 'fe80::fc16:3eff:fec5:8a5', 'fe80::80fb:7dff:feff:ce54', 'fe80::fc16:3eff:fe05:9ded', 'fe80::84b7:d3ff:feed:4f01', 'fe80::fc16:3eff:fe8d:510f', 'fe80::49a:a7ff:fef7:c9e8'] 
May 28 01:07:35.782165 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:07:35.782272 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:07:35.782493 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:07:35.782727 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Updating existing volume attachment record: 0fd3a863-1314-4f21-b2bf-ed7ad7340644 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:07:35.813930 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:07:35.863966 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Checking to see if SCSI volumes sde, sdh have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:07:35.865564 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] SCSI volumes sde, sdh have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:07:35.866136 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Checking to see if device paths {'sde', 'sdh'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:07:35.878822 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lazy-loading 'flavor' on Instance uuid a9179c5a-9c48-4d9a-9a7a-3e4baa721bba {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:07:35.880888 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Device paths {'sde', 'sdh'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:07:35.881417 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:07:35.891865 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:35.929591 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 120, target: iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474, portal: 192.168.40.100,3260]
May 28 01:07:35.929591 np0000001577 nova-compute[98319]: Logout of [sid: 120, target: iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474, portal: 192.168.40.100,3260] successful.
May 28 01:07:35.929591 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:35.944506 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:35.955453 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:35.993478 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 119, target: iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474, portal: 192.168.50.100,3260]
May 28 01:07:35.993478 np0000001577 nova-compute[98319]: Logout of [sid: 119, target: iqn.2023-03.storpool.com:os--volume-fe6b70ee-a1a2-4174-beec-7239b6484474, portal: 192.168.50.100,3260] successful.
May 28 01:07:35.993478 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:36.006525 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:36.006851 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:07:36.006978 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] <== disconnect_volume: return (324ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:07:36.007101 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:07:36.007395 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Deleting instance files /opt/stack/data/nova/instances/19c25c52-03a6-4665-ac3e-aa455fd99345_del
May 28 01:07:36.007976 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Deletion of /opt/stack/data/nova/instances/19c25c52-03a6-4665-ac3e-aa455fd99345_del complete
May 28 01:07:36.332091 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:07:36.332461 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408', 'iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3d6034b1-b4b2-4528-80b9-f3af53b32408', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:07:36.332715 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:07:36.333147 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:07:36.333444 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408', 'iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3d6034b1-b4b2-4528-80b9-f3af53b32408', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:07:36.344330 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:07:36.345119 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:07:36.345745 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:07:36.345899 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:07:36.346358 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:07:36.346598 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:07:36.355692 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:07:36.355692 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:36.365403 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:07:36.365403 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:36.368621 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408] added
May 28 01:07:36.368621 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:07:36.368621 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:07:36.368621 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:07:36.368621 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:07:36.368621 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:07:36.368621 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:36.368823 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:07:36.368912 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.023(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:07:36.369075 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:07:36.374221 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408] added
May 28 01:07:36.374221 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:07:36.374221 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:07:36.374221 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:07:36.374221 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:07:36.374221 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:07:36.374221 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:36.374365 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:07:36.374514 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.028(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:07:36.374654 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:07:36.443740 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:36.513986 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Took 1.81 seconds to destroy the instance on the hypervisor.
May 28 01:07:36.514752 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:07:36.515177 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:07:36.515406 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:07:36.515693 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:36.613805 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:36.826326 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Acquiring lock "5dafacc2-fb17-4781-8dda-8b9f21e57dee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:36.826795 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lock "5dafacc2-fb17-4781-8dda-8b9f21e57dee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:36.886073 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0c28b1f0-bf38-408f-90b8-45a145e02937 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.934s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:36.979775 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:07:37.052190 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6d68470d-79ca-4075-8358-b883cb31b137 req-79e482eb-bc29-4527-b7fe-0b494292aaaf service nova] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Received event network-vif-unplugged-c2f50d6d-6f06-4817-ab50-46a6b07ac6e2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:07:37.052366 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6d68470d-79ca-4075-8358-b883cb31b137 req-79e482eb-bc29-4527-b7fe-0b494292aaaf service nova] Acquiring lock "19c25c52-03a6-4665-ac3e-aa455fd99345-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:37.052730 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6d68470d-79ca-4075-8358-b883cb31b137 req-79e482eb-bc29-4527-b7fe-0b494292aaaf service nova] Lock "19c25c52-03a6-4665-ac3e-aa455fd99345-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:37.052730 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6d68470d-79ca-4075-8358-b883cb31b137 req-79e482eb-bc29-4527-b7fe-0b494292aaaf service nova] Lock "19c25c52-03a6-4665-ac3e-aa455fd99345-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:37.053098 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6d68470d-79ca-4075-8358-b883cb31b137 req-79e482eb-bc29-4527-b7fe-0b494292aaaf service nova] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] No waiting events found dispatching network-vif-unplugged-c2f50d6d-6f06-4817-ab50-46a6b07ac6e2 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:07:37.053212 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6d68470d-79ca-4075-8358-b883cb31b137 req-79e482eb-bc29-4527-b7fe-0b494292aaaf service nova] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Received event network-vif-unplugged-c2f50d6d-6f06-4817-ab50-46a6b07ac6e2 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:07:37.073624 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-883682e8-fb00-4f9e-8e6c-5a086cb3b24d req-50bd9a73-26ab-476a-a4d4-92bb74f96e63 service nova] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Received event network-vif-deleted-c2f50d6d-6f06-4817-ab50-46a6b07ac6e2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:07:37.073761 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-883682e8-fb00-4f9e-8e6c-5a086cb3b24d req-50bd9a73-26ab-476a-a4d4-92bb74f96e63 service nova] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Neutron deleted interface c2f50d6d-6f06-4817-ab50-46a6b07ac6e2; detaching it from the instance and deleting it from the info cache
May 28 01:07:37.076598 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-883682e8-fb00-4f9e-8e6c-5a086cb3b24d req-50bd9a73-26ab-476a-a4d4-92bb74f96e63 service nova] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Detach interface failed, port_id=c2f50d6d-6f06-4817-ab50-46a6b07ac6e2, reason: Instance 19c25c52-03a6-4665-ac3e-aa455fd99345 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:07:37.239375 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2ee6638b-3ad5-46e1-9e05-5ba8317ec9a4 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Acquiring lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:37.240581 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2ee6638b-3ad5-46e1-9e05-5ba8317ec9a4 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:37.240581 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2ee6638b-3ad5-46e1-9e05-5ba8317ec9a4 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Acquiring lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:37.240581 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2ee6638b-3ad5-46e1-9e05-5ba8317ec9a4 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:37.240581 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2ee6638b-3ad5-46e1-9e05-5ba8317ec9a4 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:37.241823 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-2ee6638b-3ad5-46e1-9e05-5ba8317ec9a4 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Terminating instance
May 28 01:07:37.330174 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lazy-loading 'flavor' on Instance uuid 5dafacc2-fb17-4781-8dda-8b9f21e57dee {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:07:37.369500 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:07:37.375049 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:07:37.381738 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:07:37.381738 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:07:37.390168 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:07:37.390168 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:37.395030 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:37.400583 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:37.406703 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:37.406703 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:37.406703 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:07:37.406815 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:37.406815 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:37.406815 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:07:37.411759 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:37.411759 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:37.411759 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:07:37.411906 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:37.411906 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:37.411906 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:07:37.435174 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408, portal: 192.168.40.100,3260]
May 28 01:07:37.435174 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408, portal: 192.168.40.100,3260] successful.
May 28 01:07:37.435174 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:37.447337 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:37.454033 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408, portal: 192.168.50.100,3260]
May 28 01:07:37.454033 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408, portal: 192.168.50.100,3260] successful.
May 28 01:07:37.454033 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:37.462626 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:37.462626 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:37.462626 np0000001577 nova-compute[98319]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:37.462626 np0000001577 nova-compute[98319]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:37.462626 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:07:37.462626 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:37.462626 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:37.462626 np0000001577 nova-compute[98319]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:37.462626 np0000001577 nova-compute[98319]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:37.462626 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:07:37.462626 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.115s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:07:37.462626 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:07:37.462626 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] HCTL ('7', '-', '-', 0) found on session 124 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:07:37.462626 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:07:37.470132 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:37.476512 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Searching for a device in session 124 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:07:37.476674 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3d6034b1-b4b2-4528-80b9-f3af53b32408', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:07:37.484557 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:37.484788 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:37.484947 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:37.485113 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Auditing locally available compute resources for np0000001577 (node: np0000001577) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 01:07:37.485910 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:37.485910 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:37.485910 np0000001577 nova-compute[98319]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:37.485910 np0000001577 nova-compute[98319]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:37.485910 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:07:37.486111 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:37.486111 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:37.486111 np0000001577 nova-compute[98319]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:37.486111 np0000001577 nova-compute[98319]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:37.486111 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:07:37.486428 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:07:37.486588 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:07:37.487299 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] HCTL ('8', '-', '-', 0) found on session 125 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:07:37.487410 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:07:37.503152 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Searching for a device in session 125 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:07:37.503368 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3d6034b1-b4b2-4528-80b9-f3af53b32408', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:07:37.520667 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:07:37.744557 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-2ee6638b-3ad5-46e1-9e05-5ba8317ec9a4 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:07:37.768363 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:37.785360 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:37.788671 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:37.810521 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:37.811223 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:38.022814 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Took 1.51 seconds to deallocate network for instance.
May 28 01:07:38.068053 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.99974053699998 future=<Future at 0x7c984c434b90 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:07:38.070113 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Instance destroyed successfully.
May 28 01:07:38.070464 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-2ee6638b-3ad5-46e1-9e05-5ba8317ec9a4 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lazy-loading 'resources' on Instance uuid a9179c5a-9c48-4d9a-9a7a-3e4baa721bba {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:07:38.335027 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lock "5dafacc2-fb17-4781-8dda-8b9f21e57dee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:38.346313 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:07:38.522334 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ae3969-7f8a-457a-aed8-539761a6d03e/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:07:38.575474 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-2ee6638b-3ad5-46e1-9e05-5ba8317ec9a4 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:06:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-993199777',display_name='tempest-VolumesExtendAttachedTest-instance-993199777',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumesextendattachedtest-instance-993199777',id=52,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6xzFjx6QJjsW9XuyE9Cg4jlFPZQxbND7n8MNeftmVkLHDC/fTIvnw3lo2P4BMbBOKE3a1z4KRcdXBUH3EkGf96eEPcQ96dYDV4/lP7mTjv9rF9tDCpvEtaaa9avDxEsQ==',key_name='tempest-keypair-1555826923',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:06:57Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7fd7e521412e4720ae46e6c810f6dbf4',ramdisk_id='',reservation_id='r-p3u0wi4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesExtendAttachedTest-1834466927',owner_user_name='tempest-VolumesExtendAttachedTest-1834466927-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:06:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9c8304f887443e7bc1e76215fb5417b',uuid=a9179c5a-9c48-4d9a-9a7a-3e4baa721bba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a", "address": "fa:16:3e:2f:51:39", "network": {"id": "358e1547-921f-470b-bc81-811a08eac4d8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1437976996-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fd7e521412e4720ae46e6c810f6dbf4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08875f6f-a4", "ovs_interfaceid": "08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:07:38.575768 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-2ee6638b-3ad5-46e1-9e05-5ba8317ec9a4 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Converting VIF {"id": "08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a", "address": "fa:16:3e:2f:51:39", "network": {"id": "358e1547-921f-470b-bc81-811a08eac4d8", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1437976996-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7fd7e521412e4720ae46e6c810f6dbf4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08875f6f-a4", "ovs_interfaceid": "08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:07:38.576932 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-2ee6638b-3ad5-46e1-9e05-5ba8317ec9a4 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:51:39,bridge_name='br-int',has_traffic_filtering=True,id=08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a,network=Network(358e1547-921f-470b-bc81-811a08eac4d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08875f6f-a4') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:07:38.577290 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-2ee6638b-3ad5-46e1-9e05-5ba8317ec9a4 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:51:39,bridge_name='br-int',has_traffic_filtering=True,id=08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a,network=Network(358e1547-921f-470b-bc81-811a08eac4d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08875f6f-a4') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:07:38.580023 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Took 0.56 seconds to detach 1 volumes for instance.
May 28 01:07:38.583334 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Deleting volume: fe6b70ee-a1a2-4174-beec-7239b6484474 {{(pid=98319) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 01:07:38.585646 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:38.586165 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08875f6f-a4, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:07:38.587400 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:38.588754 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:07:38.588754 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:38.589281 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:38.589465 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6f97d85f-c414-4d04-9b19-ab7cd1f0a2ae) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:07:38.589889 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:38.590338 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:07:38.590850 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:38.593330 np0000001577 nova-compute[98319]: INFO os_vif [None req-2ee6638b-3ad5-46e1-9e05-5ba8317ec9a4 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:51:39,bridge_name='br-int',has_traffic_filtering=True,id=08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a,network=Network(358e1547-921f-470b-bc81-811a08eac4d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08875f6f-a4')
May 28 01:07:38.593437 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2ee6638b-3ad5-46e1-9e05-5ba8317ec9a4 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Deleting instance files /opt/stack/data/nova/instances/a9179c5a-9c48-4d9a-9a7a-3e4baa721bba_del
May 28 01:07:38.594213 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2ee6638b-3ad5-46e1-9e05-5ba8317ec9a4 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Deletion of /opt/stack/data/nova/instances/a9179c5a-9c48-4d9a-9a7a-3e4baa721bba_del complete
May 28 01:07:38.633576 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ae3969-7f8a-457a-aed8-539761a6d03e/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:07:38.633994 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ae3969-7f8a-457a-aed8-539761a6d03e/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:07:38.729159 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ae3969-7f8a-457a-aed8-539761a6d03e/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:07:38.732926 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dafacc2-fb17-4781-8dda-8b9f21e57dee/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:07:38.816716 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dafacc2-fb17-4781-8dda-8b9f21e57dee/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:07:38.817182 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dafacc2-fb17-4781-8dda-8b9f21e57dee/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:07:38.901824 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dafacc2-fb17-4781-8dda-8b9f21e57dee/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:07:38.905156 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-6 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:07:38.906340 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000034, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/a9179c5a-9c48-4d9a-9a7a-3e4baa721bba/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/a9179c5a-9c48-4d9a-9a7a-3e4baa721bba/disk
May 28 01:07:38.907713 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48bfd06f-62f4-4691-bf98-2426e359a90e/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:07:38.986338 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48bfd06f-62f4-4691-bf98-2426e359a90e/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:07:38.986775 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48bfd06f-62f4-4691-bf98-2426e359a90e/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:07:39.082488 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48bfd06f-62f4-4691-bf98-2426e359a90e/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:07:39.086037 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:07:39.110579 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-2ee6638b-3ad5-46e1-9e05-5ba8317ec9a4 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Took 1.36 seconds to destroy the instance on the hypervisor.
May 28 01:07:39.110579 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-2ee6638b-3ad5-46e1-9e05-5ba8317ec9a4 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:07:39.110579 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:07:39.110579 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:07:39.111097 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:39.130385 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:39.130671 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:39.132992 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-cfc5d7e1-1ea6-459d-96d9-bb146c0636c7 req-66874bae-7148-4411-90dd-955be2ccdf41 service nova] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Received event network-vif-unplugged-08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:07:39.133217 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cfc5d7e1-1ea6-459d-96d9-bb146c0636c7 req-66874bae-7148-4411-90dd-955be2ccdf41 service nova] Acquiring lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:39.133436 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cfc5d7e1-1ea6-459d-96d9-bb146c0636c7 req-66874bae-7148-4411-90dd-955be2ccdf41 service nova] Lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:39.133609 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cfc5d7e1-1ea6-459d-96d9-bb146c0636c7 req-66874bae-7148-4411-90dd-955be2ccdf41 service nova] Lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:39.133771 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-cfc5d7e1-1ea6-459d-96d9-bb146c0636c7 req-66874bae-7148-4411-90dd-955be2ccdf41 service nova] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] No waiting events found dispatching network-vif-unplugged-08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:07:39.133929 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-cfc5d7e1-1ea6-459d-96d9-bb146c0636c7 req-66874bae-7148-4411-90dd-955be2ccdf41 service nova] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Received event network-vif-unplugged-08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:07:39.134065 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-cfc5d7e1-1ea6-459d-96d9-bb146c0636c7 req-66874bae-7148-4411-90dd-955be2ccdf41 service nova] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Received event network-vif-unplugged-08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:07:39.134215 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cfc5d7e1-1ea6-459d-96d9-bb146c0636c7 req-66874bae-7148-4411-90dd-955be2ccdf41 service nova] Acquiring lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:39.134395 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cfc5d7e1-1ea6-459d-96d9-bb146c0636c7 req-66874bae-7148-4411-90dd-955be2ccdf41 service nova] Lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:39.134534 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cfc5d7e1-1ea6-459d-96d9-bb146c0636c7 req-66874bae-7148-4411-90dd-955be2ccdf41 service nova] Lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:39.137589 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-cfc5d7e1-1ea6-459d-96d9-bb146c0636c7 req-66874bae-7148-4411-90dd-955be2ccdf41 service nova] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] No waiting events found dispatching network-vif-unplugged-08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:07:39.139709 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-cfc5d7e1-1ea6-459d-96d9-bb146c0636c7 req-66874bae-7148-4411-90dd-955be2ccdf41 service nova] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Received event network-vif-unplugged-08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:07:39.177956 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:39.179601 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:07:39.179986 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:07:39.268752 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:07:39.275205 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:07:39.276209 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:07:39.328647 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "env LANG=C uptime" returned: 0 in 0.052s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:07:39.329293 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Hypervisor/Node resource view: name=np0000001577 free_ram=11797MB free_disk=72.89504623413086GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 01:07:39.329473 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:39.362720 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Found WWN 3300000007a0d5ba0 for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:07:39.363289 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:07:39.363514 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '3300000007a0d5ba0', 'path': '/dev/dm-0', 'multipath_id': '3300000007a0d5ba0'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:07:39.363709 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007a0d5ba0', 'path': '/dev/dm-0', 'multipath_id': '3300000007a0d5ba0'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:07:39.370927 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lazy-loading 'flavor' on Instance uuid b1ae3969-7f8a-457a-aed8-539761a6d03e {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:07:39.392086 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Acquiring lock "5dafacc2-fb17-4781-8dda-8b9f21e57dee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:39.392086 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lock "5dafacc2-fb17-4781-8dda-8b9f21e57dee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:39.392086 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Attaching volume 27bfee5d-45df-4906-b49e-be21827c1f5b to /dev/vdb
May 28 01:07:39.433445 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:07:39.451960 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:07:39.475366 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:07:39.539668 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:07:39.539971 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:07:39.552041 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:07:39.554510 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe49:4d05', 'fe80::e873:f8ff:fed0:1522', 'fe80::fc16:3eff:fef5:a89f', 'fe80::e071:f2ff:feee:4293', 'fe80::fc16:3eff:fec5:8a5', 'fe80::80fb:7dff:feff:ce54', 'fe80::fc16:3eff:fe05:9ded', 'fe80::84b7:d3ff:feed:4f01', 'fe80::fc16:3eff:fe8d:510f', 'fe80::49a:a7ff:fef7:c9e8'] 
May 28 01:07:39.554647 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:07:39.554759 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:07:39.554979 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:07:39.555187 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Updating existing volume attachment record: a921a163-4c60-4a3a-bb74-90537c38b391 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:07:39.606159 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:07:39.606487 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:07:39.877127 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Attempting to attach volume 3d6034b1-b4b2-4528-80b9-f3af53b32408 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:07:39.879128 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:07:39.879128 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:07:39.879128 np0000001577 nova-compute[98319]:   <alias name="ua-3d6034b1-b4b2-4528-80b9-f3af53b32408"/>
May 28 01:07:39.879128 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 28 01:07:39.879128 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:07:39.879128 np0000001577 nova-compute[98319]:   <serial>3d6034b1-b4b2-4528-80b9-f3af53b32408</serial>
May 28 01:07:39.879128 np0000001577 nova-compute[98319]: </disk>
May 28 01:07:39.879128 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:07:40.110829 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:07:40.120447 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:07:40.121200 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b', 'iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27bfee5d-45df-4906-b49e-be21827c1f5b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:07:40.121200 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:07:40.121935 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:07:40.122207 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b', 'iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27bfee5d-45df-4906-b49e-be21827c1f5b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:07:40.124688 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:07:40.135260 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:07:40.136129 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:07:40.137505 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:07:40.137505 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:07:40.137505 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:07:40.137505 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:07:40.150698 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:07:40.150698 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:40.160323 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:07:40.160323 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:40.165474 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b] added
May 28 01:07:40.165474 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:07:40.165474 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:07:40.165474 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:07:40.165474 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:07:40.165474 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:07:40.165474 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:40.165857 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:07:40.165857 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0289(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:07:40.166025 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:07:40.173270 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b] added
May 28 01:07:40.173270 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:07:40.173270 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:07:40.173270 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:07:40.173270 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:07:40.173270 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:07:40.173270 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:40.173630 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:07:40.173630 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0362(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:07:40.173735 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:07:40.618656 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.488s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:40.620834 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.289s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:40.630353 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Took 1.52 seconds to deallocate network for instance.
May 28 01:07:40.666478 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Deleted allocations for instance 19c25c52-03a6-4665-ac3e-aa455fd99345
May 28 01:07:41.135479 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2ee6638b-3ad5-46e1-9e05-5ba8317ec9a4 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:41.166374 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:07:41.174138 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:07:41.178729 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c84f3b4b-0019-4009-b44b-69525062d410 req-4c1656d2-c1f4-4c2f-9e10-9bf5777a00ce service nova] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Received event network-vif-deleted-08875f6f-a4dd-4ed5-b86d-f2c60bc5da0a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:07:41.182443 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:07:41.182443 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:07:41.189812 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:07:41.189812 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:41.198415 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:41.205503 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:41.212781 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:41.212781 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:41.212781 np0000001577 nova-compute[98319]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:41.212781 np0000001577 nova-compute[98319]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:41.212781 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:07:41.212971 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:41.212971 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:41.212971 np0000001577 nova-compute[98319]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:41.212971 np0000001577 nova-compute[98319]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:41.212971 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:07:41.220359 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:41.220359 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:41.220359 np0000001577 nova-compute[98319]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:41.220359 np0000001577 nova-compute[98319]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:41.220359 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:07:41.220494 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:41.220494 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:41.220494 np0000001577 nova-compute[98319]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:41.220494 np0000001577 nova-compute[98319]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:41.220494 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:07:41.250661 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b, portal: 192.168.50.100,3260]
May 28 01:07:41.250661 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b, portal: 192.168.50.100,3260] successful.
May 28 01:07:41.250661 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:41.261874 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:41.267089 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b, portal: 192.168.40.100,3260]
May 28 01:07:41.267089 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b, portal: 192.168.40.100,3260] successful.
May 28 01:07:41.267089 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:41.276282 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:41.276282 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:41.276282 np0000001577 nova-compute[98319]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:41.276282 np0000001577 nova-compute[98319]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:41.276282 np0000001577 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b (non-flash)
May 28 01:07:41.276282 np0000001577 nova-compute[98319]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b (non-flash)
May 28 01:07:41.276282 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:07:41.276578 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:41.276578 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:41.276578 np0000001577 nova-compute[98319]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:41.276578 np0000001577 nova-compute[98319]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:41.276578 np0000001577 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b (non-flash)
May 28 01:07:41.276578 np0000001577 nova-compute[98319]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b (non-flash)
May 28 01:07:41.276578 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:07:41.276760 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:07:41.276819 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:07:41.277908 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:41.280649 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] HCTL ('9', '-', '-', 0) found on session 126 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:07:41.280649 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:07:41.292440 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:41.292440 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:41.292440 np0000001577 nova-compute[98319]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:41.292440 np0000001577 nova-compute[98319]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:41.292440 np0000001577 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b (non-flash)
May 28 01:07:41.292440 np0000001577 nova-compute[98319]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b (non-flash)
May 28 01:07:41.292440 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:07:41.292721 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:41.292721 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:41.292721 np0000001577 nova-compute[98319]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:41.292721 np0000001577 nova-compute[98319]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:41.292721 np0000001577 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b (non-flash)
May 28 01:07:41.292721 np0000001577 nova-compute[98319]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b (non-flash)
May 28 01:07:41.292721 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:07:41.292910 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.156s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:07:41.292910 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:07:41.296083 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] HCTL ('10', '-', '-', 0) found on session 127 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:07:41.296083 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:07:41.298922 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Searching for a device in session 126 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:07:41.298922 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '27bfee5d-45df-4906-b49e-be21827c1f5b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:07:41.306143 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Searching for a device in session 127 and hctl ['10', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:07:41.446302 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:41.521016 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:07:41.521161 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:07:41.521218 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:07:41.521353 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] No VIF found with MAC fa:16:3e:f5:a8:9f, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:07:41.675859 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bcca771d-5729-4ee2-9b28-9d879916a419 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "19c25c52-03a6-4665-ac3e-aa455fd99345" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.479s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:41.686069 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 36be2ae9-c375-4335-a421-cf92ea63e489 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:07:41.686166 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance b1ae3969-7f8a-457a-aed8-539761a6d03e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:07:41.686270 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance a9179c5a-9c48-4d9a-9a7a-3e4baa721bba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:07:41.686354 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 5dafacc2-fb17-4781-8dda-8b9f21e57dee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:07:41.686435 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 1e7c5308-80cc-4991-8626-2ba32fa09acf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:07:41.686513 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 48bfd06f-62f4-4691-bf98-2426e359a90e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:07:41.686696 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 01:07:41.686811 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Final resource view: name=np0000001577 phys_ram=24030MB used_ram=1664MB phys_disk=95GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:07:39 up 39 min,  2 users,  load average: 6.33, 6.45, 4.26\n', 'num_instances': '6', 'num_vm_active': '6', 'num_task_None': '5', 'num_os_type_None': '6', 'num_proj_050f928f1ce449d6a447cd343dc4ff80': '1', 'io_workload': '0', 'num_proj_f132ca2a48c44f6097340763039224c1': '1', 'num_task_deleting': '1', 'num_proj_7fd7e521412e4720ae46e6c810f6dbf4': '1', 'num_proj_2dd8820c03574b9d86542c61bf1fdc43': '1', 'num_proj_23578125da1e4bf2bb3d59281a0e261e': '1', 'num_proj_a430f0d6bcc84a29bc3e96514422896b': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 01:07:41.989228 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:07:41.989422 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:07:42.306587 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Searching for a device in session 127 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:07:42.306980 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27bfee5d-45df-4906-b49e-be21827c1f5b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:07:42.491568 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:07:42.998370 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Compute_service record updated for np0000001577:np0000001577 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 01:07:42.998574 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.380s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:42.998808 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2ee6638b-3ad5-46e1-9e05-5ba8317ec9a4 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.863s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:42.999720 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:07:43.061160 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6c3d88aa-3ec9-4bd5-a850-29a8bc97b9e7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "b1ae3969-7f8a-457a-aed8-539761a6d03e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.499s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:43.152335 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Found WWN 3300000007b86c156 for multipath device dm-3 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:07:43.152590 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:07:43.152725 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '3300000007b86c156', 'path': '/dev/dm-3', 'multipath_id': '3300000007b86c156'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:07:43.152834 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007b86c156', 'path': '/dev/dm-3', 'multipath_id': '3300000007b86c156'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:07:43.155802 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lazy-loading 'flavor' on Instance uuid 5dafacc2-fb17-4781-8dda-8b9f21e57dee {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:07:43.365223 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2ee6638b-3ad5-46e1-9e05-5ba8317ec9a4 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:07:43.365223 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-2ee6638b-3ad5-46e1-9e05-5ba8317ec9a4 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:07:43.483862 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "36be2ae9-c375-4335-a421-cf92ea63e489" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:43.484019 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "36be2ae9-c375-4335-a421-cf92ea63e489" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:43.484184 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "36be2ae9-c375-4335-a421-cf92ea63e489-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:43.484312 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "36be2ae9-c375-4335-a421-cf92ea63e489-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:43.484447 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "36be2ae9-c375-4335-a421-cf92ea63e489-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:43.486939 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Terminating instance
May 28 01:07:43.590584 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:43.658692 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Attempting to attach volume 27bfee5d-45df-4906-b49e-be21827c1f5b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:07:43.659904 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:07:43.659904 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:07:43.659904 np0000001577 nova-compute[98319]:   <alias name="ua-27bfee5d-45df-4906-b49e-be21827c1f5b"/>
May 28 01:07:43.659904 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-3"/>
May 28 01:07:43.659904 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:07:43.659904 np0000001577 nova-compute[98319]:   <serial>27bfee5d-45df-4906-b49e-be21827c1f5b</serial>
May 28 01:07:43.659904 np0000001577 nova-compute[98319]: </disk>
May 28 01:07:43.659904 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:07:43.869205 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-2ee6638b-3ad5-46e1-9e05-5ba8317ec9a4 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:07:43.995822 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:07:43.997701 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:07:43.998133 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:07:43.998133 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:07:43.998366 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:07:43.998534 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:07:43.998675 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:07:43.998818 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 01:07:43.999030 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.98 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:07:44.021104 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:44.023451 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:44.048155 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:44.050804 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:44.085260 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:44.167292 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-02bd79ab-0db2-4377-ab29-618e93b12c52 req-3e86f50b-1ae1-4eb0-9706-8f4365dbac34 service nova] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Received event network-vif-unplugged-8cf4ac4a-a821-414f-b4c5-cf06d543f090 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:07:44.167799 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-02bd79ab-0db2-4377-ab29-618e93b12c52 req-3e86f50b-1ae1-4eb0-9706-8f4365dbac34 service nova] Acquiring lock "36be2ae9-c375-4335-a421-cf92ea63e489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:44.167940 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-02bd79ab-0db2-4377-ab29-618e93b12c52 req-3e86f50b-1ae1-4eb0-9706-8f4365dbac34 service nova] Lock "36be2ae9-c375-4335-a421-cf92ea63e489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:44.168039 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-02bd79ab-0db2-4377-ab29-618e93b12c52 req-3e86f50b-1ae1-4eb0-9706-8f4365dbac34 service nova] Lock "36be2ae9-c375-4335-a421-cf92ea63e489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:44.168159 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-02bd79ab-0db2-4377-ab29-618e93b12c52 req-3e86f50b-1ae1-4eb0-9706-8f4365dbac34 service nova] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] No waiting events found dispatching network-vif-unplugged-8cf4ac4a-a821-414f-b4c5-cf06d543f090 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:07:44.168271 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-02bd79ab-0db2-4377-ab29-618e93b12c52 req-3e86f50b-1ae1-4eb0-9706-8f4365dbac34 service nova] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Received event network-vif-unplugged-8cf4ac4a-a821-414f-b4c5-cf06d543f090 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:07:44.318169 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999723514999914 future=<Future at 0x7c984c7d2960 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:07:44.321174 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Instance destroyed successfully.
May 28 01:07:44.321174 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lazy-loading 'resources' on Instance uuid 36be2ae9-c375-4335-a421-cf92ea63e489 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:07:44.373373 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2ee6638b-3ad5-46e1-9e05-5ba8317ec9a4 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.374s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:44.421508 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-2ee6638b-3ad5-46e1-9e05-5ba8317ec9a4 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Deleted allocations for instance a9179c5a-9c48-4d9a-9a7a-3e4baa721bba
May 28 01:07:44.822914 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:05:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1709932323',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1709932323',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpattern-volume-backed-server-1709932323',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEg/JvK7aO9JuiW+dJLhyl61WZn9UNxA8K+8igoa76/265jIzUINPBNGbtw6T4Igc046ehvcYHKeVzhpb4bmN6yPFdwExp54BG6xjn+UTTaDMeJRzBcZQluYk+1VKBAO7Q==',key_name='tempest-keypair-877231583',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:05:52Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='050f928f1ce449d6a447cd343dc4ff80',ramdisk_id='',reservation_id='r-hmwnkx3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1449742411',owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:05:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c803ddeaf4f4b3db07587419087b3b2',uuid=36be2ae9-c375-4335-a421-cf92ea63e489,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cf4ac4a-a821-414f-b4c5-cf06d543f090", "address": "fa:16:3e:49:4d:05", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf4ac4a-a8", "ovs_interfaceid": "8cf4ac4a-a821-414f-b4c5-cf06d543f090", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:07:44.823181 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converting VIF {"id": "8cf4ac4a-a821-414f-b4c5-cf06d543f090", "address": "fa:16:3e:49:4d:05", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf4ac4a-a8", "ovs_interfaceid": "8cf4ac4a-a821-414f-b4c5-cf06d543f090", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:07:44.823718 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:4d:05,bridge_name='br-int',has_traffic_filtering=True,id=8cf4ac4a-a821-414f-b4c5-cf06d543f090,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cf4ac4a-a8') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:07:44.823948 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:4d:05,bridge_name='br-int',has_traffic_filtering=True,id=8cf4ac4a-a821-414f-b4c5-cf06d543f090,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cf4ac4a-a8') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:07:44.825035 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:44.825237 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8cf4ac4a-a8, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:07:44.826123 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:44.826872 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:07:44.827091 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:44.827709 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:44.827873 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=af3cbbbe-9461-4c45-924a-7dab673cc98f) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:07:44.828300 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:44.828857 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:07:44.830319 np0000001577 nova-compute[98319]: INFO os_vif [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:4d:05,bridge_name='br-int',has_traffic_filtering=True,id=8cf4ac4a-a821-414f-b4c5-cf06d543f090,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cf4ac4a-a8')
May 28 01:07:44.831577 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:07:44.831835 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac', 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '28977eca-9bcb-4827-ac8f-72d5f22c18ac', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:07:44.831970 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:07:44.832259 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:07:44.832538 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac', 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '28977eca-9bcb-4827-ac8f-72d5f22c18ac', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:07:44.832680 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:07:44.855750 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:44.855750 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:44.855750 np0000001577 nova-compute[98319]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:44.855750 np0000001577 nova-compute[98319]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:44.855750 np0000001577 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b (non-flash)
May 28 01:07:44.855750 np0000001577 nova-compute[98319]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b (non-flash)
May 28 01:07:44.855750 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:07:44.856132 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:44.856132 np0000001577 nova-compute[98319]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac (non-flash)
May 28 01:07:44.856132 np0000001577 nova-compute[98319]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:44.856132 np0000001577 nova-compute[98319]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:44.856132 np0000001577 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b (non-flash)
May 28 01:07:44.856132 np0000001577 nova-compute[98319]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b (non-flash)
May 28 01:07:44.856132 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:07:44.856132 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408', '124'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408', '125'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b', '126'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b', '127')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:07:44.856132 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac', '102')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:07:44.857146 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac', '103')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:07:44.857858 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c984c50ade0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac'): ({'sdg'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:07:44.858050 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Removing multipathed devices sdf, sdg {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:07:44.858275 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Flush multipath device 33000000009bf1d1a {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:07:44.935513 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:07:44.991861 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:07:45.027651 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:07:45.027766 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:07:45.028518 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:07:45.038099 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:07:45.038263 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:07:45.047657 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:45.075305 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 102, target: iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac, portal: 192.168.40.100,3260]
May 28 01:07:45.075305 np0000001577 nova-compute[98319]: Logout of [sid: 102, target: iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac, portal: 192.168.40.100,3260] successful.
May 28 01:07:45.075305 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:45.088832 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:45.097351 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:45.123058 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 103, target: iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac, portal: 192.168.50.100,3260]
May 28 01:07:45.123058 np0000001577 nova-compute[98319]: Logout of [sid: 103, target: iqn.2023-03.storpool.com:os--volume-28977eca-9bcb-4827-ac8f-72d5f22c18ac, portal: 192.168.50.100,3260] successful.
May 28 01:07:45.123058 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:45.135736 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:45.135904 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:07:45.136008 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] <== disconnect_volume: return (304ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:07:45.136108 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:07:45.136357 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Deleting instance files /opt/stack/data/nova/instances/36be2ae9-c375-4335-a421-cf92ea63e489_del
May 28 01:07:45.136834 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Deletion of /opt/stack/data/nova/instances/36be2ae9-c375-4335-a421-cf92ea63e489_del complete
May 28 01:07:45.295633 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:07:45.295772 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:07:45.295899 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:07:45.295955 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] No VIF found with MAC fa:16:3e:c5:08:a5, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:07:45.430430 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2ee6638b-3ad5-46e1-9e05-5ba8317ec9a4 tempest-VolumesExtendAttachedTest-1834466927 tempest-VolumesExtendAttachedTest-1834466927-project-member] Lock "a9179c5a-9c48-4d9a-9a7a-3e4baa721bba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.191s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:45.642297 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Took 1.65 seconds to destroy the instance on the hypervisor.
May 28 01:07:45.642958 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:07:45.643370 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:07:45.643435 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:07:45.643685 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:45.729346 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:45.978325 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:07:45.978639 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 52.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:07:46.194782 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6c6fa01e-8291-43e5-8a60-8fea05737162 req-088a3592-0a62-46e4-b926-49ff2769717f service nova] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Received event network-vif-deleted-8cf4ac4a-a821-414f-b4c5-cf06d543f090 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:07:46.194924 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-6c6fa01e-8291-43e5-8a60-8fea05737162 req-088a3592-0a62-46e4-b926-49ff2769717f service nova] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Neutron deleted interface 8cf4ac4a-a821-414f-b4c5-cf06d543f090; detaching it from the instance and deleting it from the info cache
May 28 01:07:46.198902 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6c6fa01e-8291-43e5-8a60-8fea05737162 req-088a3592-0a62-46e4-b926-49ff2769717f service nova] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Detach interface failed, port_id=8cf4ac4a-a821-414f-b4c5-cf06d543f090, reason: Instance 36be2ae9-c375-4335-a421-cf92ea63e489 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:07:46.222723 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7e9beb9e-f8f5-478b-9396-f360c34082f6 req-81a47e9f-263c-4e39-87ac-6b7965990d1a service nova] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Received event network-vif-unplugged-8cf4ac4a-a821-414f-b4c5-cf06d543f090 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:07:46.222905 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7e9beb9e-f8f5-478b-9396-f360c34082f6 req-81a47e9f-263c-4e39-87ac-6b7965990d1a service nova] Acquiring lock "36be2ae9-c375-4335-a421-cf92ea63e489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:46.223105 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7e9beb9e-f8f5-478b-9396-f360c34082f6 req-81a47e9f-263c-4e39-87ac-6b7965990d1a service nova] Lock "36be2ae9-c375-4335-a421-cf92ea63e489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:46.223219 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7e9beb9e-f8f5-478b-9396-f360c34082f6 req-81a47e9f-263c-4e39-87ac-6b7965990d1a service nova] Lock "36be2ae9-c375-4335-a421-cf92ea63e489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:46.223592 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7e9beb9e-f8f5-478b-9396-f360c34082f6 req-81a47e9f-263c-4e39-87ac-6b7965990d1a service nova] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] No waiting events found dispatching network-vif-unplugged-8cf4ac4a-a821-414f-b4c5-cf06d543f090 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:07:46.223703 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7e9beb9e-f8f5-478b-9396-f360c34082f6 req-81a47e9f-263c-4e39-87ac-6b7965990d1a service nova] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Received event network-vif-unplugged-8cf4ac4a-a821-414f-b4c5-cf06d543f090 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:07:46.449505 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:46.579234 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:07:46.848186 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-44e8f285-2286-4435-b325-2cecd7817f78 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lock "5dafacc2-fb17-4781-8dda-8b9f21e57dee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.458s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:47.081598 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Took 1.44 seconds to deallocate network for instance.
May 28 01:07:47.504056 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Acquiring lock "5dafacc2-fb17-4781-8dda-8b9f21e57dee" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:47.504594 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lock "5dafacc2-fb17-4781-8dda-8b9f21e57dee" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:47.683152 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Took 0.60 seconds to detach 1 volumes for instance.
May 28 01:07:47.684860 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Deleting volume: 28977eca-9bcb-4827-ac8f-72d5f22c18ac {{(pid=98319) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 01:07:48.006946 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Detaching volume 27bfee5d-45df-4906-b49e-be21827c1f5b
May 28 01:07:48.050951 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Attempting to driver detach volume 27bfee5d-45df-4906-b49e-be21827c1f5b from mountpoint /dev/vdb
May 28 01:07:48.055538 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Found disk vdb by alias ua-27bfee5d-45df-4906-b49e-be21827c1f5b {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:07:48.056932 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Found disk vdb by alias ua-27bfee5d-45df-4906-b49e-be21827c1f5b {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:07:48.057093 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Attempting to detach device vdb from instance 5dafacc2-fb17-4781-8dda-8b9f21e57dee from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:07:48.057491 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:07:48.057491 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:07:48.057491 np0000001577 nova-compute[98319]:   <alias name="ua-27bfee5d-45df-4906-b49e-be21827c1f5b"/>
May 28 01:07:48.057491 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-3"/>
May 28 01:07:48.057491 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:07:48.057491 np0000001577 nova-compute[98319]:   <serial>27bfee5d-45df-4906-b49e-be21827c1f5b</serial>
May 28 01:07:48.057491 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:07:48.057491 np0000001577 nova-compute[98319]: </disk>
May 28 01:07:48.057491 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:07:48.063384 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Successfully detached device vdb from instance 5dafacc2-fb17-4781-8dda-8b9f21e57dee from the persistent domain config.
May 28 01:07:48.063601 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] (1/8): Attempting to detach device vdb with device alias ua-27bfee5d-45df-4906-b49e-be21827c1f5b from instance 5dafacc2-fb17-4781-8dda-8b9f21e57dee from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:07:48.063762 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:07:48.063762 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:07:48.063762 np0000001577 nova-compute[98319]:   <alias name="ua-27bfee5d-45df-4906-b49e-be21827c1f5b"/>
May 28 01:07:48.063762 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-3"/>
May 28 01:07:48.063762 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:07:48.063762 np0000001577 nova-compute[98319]:   <serial>27bfee5d-45df-4906-b49e-be21827c1f5b</serial>
May 28 01:07:48.063762 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:07:48.063762 np0000001577 nova-compute[98319]: </disk>
May 28 01:07:48.063762 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:07:48.222518 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:48.222690 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:48.478469 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:07:48.478740 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:07:48.566627 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930468.5663188, 5dafacc2-fb17-4781-8dda-8b9f21e57dee => ua-27bfee5d-45df-4906-b49e-be21827c1f5b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:07:48.567746 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-27bfee5d-45df-4906-b49e-be21827c1f5b for instance 5dafacc2-fb17-4781-8dda-8b9f21e57dee {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:07:48.569830 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Successfully detached device vdb from instance 5dafacc2-fb17-4781-8dda-8b9f21e57dee from the live domain config.
May 28 01:07:48.570777 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:07:48.571070 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b', 'iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27bfee5d-45df-4906-b49e-be21827c1f5b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:07:48.571196 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:07:48.571562 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:07:48.571841 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b', 'iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27bfee5d-45df-4906-b49e-be21827c1f5b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:07:48.571958 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:07:48.592366 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:48.592366 np0000001577 nova-compute[98319]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:48.592366 np0000001577 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b (non-flash)
May 28 01:07:48.592366 np0000001577 nova-compute[98319]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b (non-flash)
May 28 01:07:48.592366 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:07:48.592640 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] iscsi session list stdout=tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:48.592640 np0000001577 nova-compute[98319]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:48.592640 np0000001577 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b (non-flash)
May 28 01:07:48.592640 np0000001577 nova-compute[98319]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b (non-flash)
May 28 01:07:48.592640 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:07:48.592640 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408', '124'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408', '125'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b', '126'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b', '127')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:07:48.592800 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b', '127')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:07:48.593518 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b', '126')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:07:48.594135 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c9870464900>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b'): ({'sdd'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:07:48.594319 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Removing multipathed devices sde, sdd {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:07:48.594516 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Flush multipath device 3300000007b86c156 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:07:48.629028 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:07:48.673047 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:07:48.722791 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:07:48.722970 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:07:48.723890 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:07:48.734585 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:07:48.734859 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:07:48.745970 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:48.780328 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 127, target: iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b, portal: 192.168.40.100,3260]
May 28 01:07:48.780328 np0000001577 nova-compute[98319]: Logout of [sid: 127, target: iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b, portal: 192.168.40.100,3260] successful.
May 28 01:07:48.780328 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:48.793702 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:48.795444 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:48.807669 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:48.839712 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 126, target: iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b, portal: 192.168.50.100,3260]
May 28 01:07:48.839712 np0000001577 nova-compute[98319]: Logout of [sid: 126, target: iqn.2023-03.storpool.com:os--volume-27bfee5d-45df-4906-b49e-be21827c1f5b, portal: 192.168.50.100,3260] successful.
May 28 01:07:48.839712 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:48.853062 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:48.853267 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:07:48.853389 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] <== disconnect_volume: return (281ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:07:48.853532 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:07:48.984186 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:07:49.406965 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lazy-loading 'flavor' on Instance uuid 5dafacc2-fb17-4781-8dda-8b9f21e57dee {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:07:49.493472 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.271s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:49.560646 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Deleted allocations for instance 36be2ae9-c375-4335-a421-cf92ea63e489
May 28 01:07:49.829460 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:50.130472 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "b1ae3969-7f8a-457a-aed8-539761a6d03e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:50.130978 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "b1ae3969-7f8a-457a-aed8-539761a6d03e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:50.148855 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0004081319998476829 future=<Future at 0x7c984c7d3620 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:07:50.148930 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:07:50.150098 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=2.9187919670002884 future=<Future at 0x7c984c434b90 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:07:50.151048 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=2.9167148219999035 future=<Future at 0x7c984c434b90 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:07:50.151961 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Emitting event <LifecycleEvent: 1779930455.1483016, 19c25c52-03a6-4665-ac3e-aa455fd99345 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:07:50.152134 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] VM Stopped (Lifecycle Event)
May 28 01:07:50.201961 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "b1ae3969-7f8a-457a-aed8-539761a6d03e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:50.416500 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-59acb505-c9c5-4ba5-ac17-7e233ab98e1e tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lock "5dafacc2-fb17-4781-8dda-8b9f21e57dee" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.912s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:50.567727 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7b7885c2-eaf8-4a6f-bbf9-6e194479afaf tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "36be2ae9-c375-4335-a421-cf92ea63e489" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.084s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:50.652360 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Detaching volume 3d6034b1-b4b2-4528-80b9-f3af53b32408
May 28 01:07:50.654499 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 19c25c52-03a6-4665-ac3e-aa455fd99345] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:07:50.687761 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Attempting to driver detach volume 3d6034b1-b4b2-4528-80b9-f3af53b32408 from mountpoint /dev/vdb
May 28 01:07:50.691372 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Found disk vdb by alias ua-3d6034b1-b4b2-4528-80b9-f3af53b32408 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:07:50.692510 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Found disk vdb by alias ua-3d6034b1-b4b2-4528-80b9-f3af53b32408 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:07:50.692663 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Attempting to detach device vdb from instance b1ae3969-7f8a-457a-aed8-539761a6d03e from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:07:50.692898 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:07:50.692898 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:07:50.692898 np0000001577 nova-compute[98319]:   <alias name="ua-3d6034b1-b4b2-4528-80b9-f3af53b32408"/>
May 28 01:07:50.692898 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 28 01:07:50.692898 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:07:50.692898 np0000001577 nova-compute[98319]:   <serial>3d6034b1-b4b2-4528-80b9-f3af53b32408</serial>
May 28 01:07:50.692898 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:07:50.692898 np0000001577 nova-compute[98319]: </disk>
May 28 01:07:50.692898 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:07:50.699673 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Successfully detached device vdb from instance b1ae3969-7f8a-457a-aed8-539761a6d03e from the persistent domain config.
May 28 01:07:50.699845 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] (1/8): Attempting to detach device vdb with device alias ua-3d6034b1-b4b2-4528-80b9-f3af53b32408 from instance b1ae3969-7f8a-457a-aed8-539761a6d03e from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:07:50.700039 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:07:50.700039 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:07:50.700039 np0000001577 nova-compute[98319]:   <alias name="ua-3d6034b1-b4b2-4528-80b9-f3af53b32408"/>
May 28 01:07:50.700039 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 28 01:07:50.700039 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:07:50.700039 np0000001577 nova-compute[98319]:   <serial>3d6034b1-b4b2-4528-80b9-f3af53b32408</serial>
May 28 01:07:50.700039 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:07:50.700039 np0000001577 nova-compute[98319]: </disk>
May 28 01:07:50.700039 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:07:50.836832 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:51.186974 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3d6034b1-b4b2-4528-80b9-f3af53b32408 for instance b1ae3969-7f8a-457a-aed8-539761a6d03e {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:07:51.186974 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930471.186651, b1ae3969-7f8a-457a-aed8-539761a6d03e => ua-3d6034b1-b4b2-4528-80b9-f3af53b32408> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:07:51.188923 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Successfully detached device vdb from instance b1ae3969-7f8a-457a-aed8-539761a6d03e from the live domain config.
May 28 01:07:51.191563 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:07:51.191563 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408', 'iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3d6034b1-b4b2-4528-80b9-f3af53b32408', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:07:51.191563 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:07:51.191563 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:07:51.191563 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408', 'iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3d6034b1-b4b2-4528-80b9-f3af53b32408', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:07:51.191563 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:07:51.215442 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:51.215442 np0000001577 nova-compute[98319]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:51.215442 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:07:51.215605 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsi session list stdout=tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:51.215605 np0000001577 nova-compute[98319]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408 (non-flash)
May 28 01:07:51.215605 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:07:51.216567 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408', '124'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408', '125')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:07:51.216750 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408', '124')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:07:51.218368 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408', '125')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:07:51.218368 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c987056ccc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408'): ({'sdc'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:07:51.218692 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:07:51.218856 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Flush multipath device 3300000007a0d5ba0 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:07:51.269811 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:07:51.310021 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:07:51.349579 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:07:51.349579 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:07:51.349699 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:07:51.361112 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:07:51.361112 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:07:51.371637 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:51.406054 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 124, target: iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408, portal: 192.168.40.100,3260]
May 28 01:07:51.406054 np0000001577 nova-compute[98319]: Logout of [sid: 124, target: iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408, portal: 192.168.40.100,3260] successful.
May 28 01:07:51.406054 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:51.417278 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:51.426461 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:51.450153 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:51.456638 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 125, target: iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408, portal: 192.168.50.100,3260]
May 28 01:07:51.456638 np0000001577 nova-compute[98319]: Logout of [sid: 125, target: iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408, portal: 192.168.50.100,3260] successful.
May 28 01:07:51.456638 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:51.466682 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:51.466949 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:07:51.467096 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] <== disconnect_volume: return (276ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:07:51.467225 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:07:51.841981 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3ba453d2-37fa-4b44-ad44-cf63d4be8df5 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Acquiring lock "5dafacc2-fb17-4781-8dda-8b9f21e57dee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:51.842366 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3ba453d2-37fa-4b44-ad44-cf63d4be8df5 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lock "5dafacc2-fb17-4781-8dda-8b9f21e57dee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:51.842366 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3ba453d2-37fa-4b44-ad44-cf63d4be8df5 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Acquiring lock "5dafacc2-fb17-4781-8dda-8b9f21e57dee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:51.842445 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3ba453d2-37fa-4b44-ad44-cf63d4be8df5 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lock "5dafacc2-fb17-4781-8dda-8b9f21e57dee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:51.842528 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3ba453d2-37fa-4b44-ad44-cf63d4be8df5 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lock "5dafacc2-fb17-4781-8dda-8b9f21e57dee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:51.844178 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-3ba453d2-37fa-4b44-ad44-cf63d4be8df5 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Terminating instance
May 28 01:07:52.012468 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lazy-loading 'flavor' on Instance uuid b1ae3969-7f8a-457a-aed8-539761a6d03e {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:07:52.346622 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-3ba453d2-37fa-4b44-ad44-cf63d4be8df5 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:07:52.372579 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:52.375414 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:52.393994 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:52.397322 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:52.414721 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:52.419683 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:52.550836 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-93f65dab-086a-4d4d-aad0-7073361b2724 req-8c31bce2-d3dd-4e04-b4ac-b8b599097e80 service nova] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Received event network-vif-unplugged-fa7eeb89-fccc-45b2-ac90-b44568ff2c34 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:07:52.551083 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-93f65dab-086a-4d4d-aad0-7073361b2724 req-8c31bce2-d3dd-4e04-b4ac-b8b599097e80 service nova] Acquiring lock "5dafacc2-fb17-4781-8dda-8b9f21e57dee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:52.551141 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-93f65dab-086a-4d4d-aad0-7073361b2724 req-8c31bce2-d3dd-4e04-b4ac-b8b599097e80 service nova] Lock "5dafacc2-fb17-4781-8dda-8b9f21e57dee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:52.551278 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-93f65dab-086a-4d4d-aad0-7073361b2724 req-8c31bce2-d3dd-4e04-b4ac-b8b599097e80 service nova] Lock "5dafacc2-fb17-4781-8dda-8b9f21e57dee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:52.551928 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-93f65dab-086a-4d4d-aad0-7073361b2724 req-8c31bce2-d3dd-4e04-b4ac-b8b599097e80 service nova] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] No waiting events found dispatching network-vif-unplugged-fa7eeb89-fccc-45b2-ac90-b44568ff2c34 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:07:52.551928 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-93f65dab-086a-4d4d-aad0-7073361b2724 req-8c31bce2-d3dd-4e04-b4ac-b8b599097e80 service nova] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Received event network-vif-unplugged-fa7eeb89-fccc-45b2-ac90-b44568ff2c34 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:07:52.659783 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:52.668223 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:52.686268 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999696293999932 future=<Future at 0x7c98704d1730 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:07:52.687675 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Instance destroyed successfully.
May 28 01:07:52.688240 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-3ba453d2-37fa-4b44-ad44-cf63d4be8df5 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lazy-loading 'resources' on Instance uuid 5dafacc2-fb17-4781-8dda-8b9f21e57dee {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:07:53.017765 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-14eaab93-6425-4c29-a9e8-256c0465503f tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "b1ae3969-7f8a-457a-aed8-539761a6d03e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.887s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:53.018126 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "b1ae3969-7f8a-457a-aed8-539761a6d03e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.816s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:53.018182 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "b1ae3969-7f8a-457a-aed8-539761a6d03e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:53.018376 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "b1ae3969-7f8a-457a-aed8-539761a6d03e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:53.018504 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "b1ae3969-7f8a-457a-aed8-539761a6d03e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:53.020636 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Terminating instance
May 28 01:07:53.068070 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0002768969998214743 future=<Future at 0x7c984c434b90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:07:53.068158 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:07:53.068516 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=6.2496112169997105 future=<Future at 0x7c984c7d2960 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:07:53.068516 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=6.249527681000018 future=<Future at 0x7c984c7d2960 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:07:53.068795 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Emitting event <LifecycleEvent: 1779930458.0677001, a9179c5a-9c48-4d9a-9a7a-3e4baa721bba => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:07:53.068985 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] VM Stopped (Lifecycle Event)
May 28 01:07:53.190570 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-3ba453d2-37fa-4b44-ad44-cf63d4be8df5 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1445838070',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1445838070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testservervolumeattachscenariooldversion-server-1445838',id=53,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFzW5EnarGM8vFr4N+Ob9J7OTqJSitsFQTAl4ERV86+U83ksaNsAyasFT7VUoD6qyXQSTylO+6fT3TOevVEdkOWV/khD8BSukf3y6+GtuZObLM22Xr2grmnvzEq4sHAEA==',key_name='tempest-keypair-680236774',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:07:10Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2dd8820c03574b9d86542c61bf1fdc43',ramdisk_id='',reservation_id='r-fhrag7t9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1694940975',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:07:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4713b3cdaa0643a294fb14fda14d8e42',uuid=5dafacc2-fb17-4781-8dda-8b9f21e57dee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa7eeb89-fccc-45b2-ac90-b44568ff2c34", "address": "fa:16:3e:c5:08:a5", "network": {"id": "7c483e76-809a-4260-af12-f58188f6bd77", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-964714137-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2dd8820c03574b9d86542c61bf1fdc43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7eeb89-fc", "ovs_interfaceid": "fa7eeb89-fccc-45b2-ac90-b44568ff2c34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:07:53.190758 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3ba453d2-37fa-4b44-ad44-cf63d4be8df5 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Converting VIF {"id": "fa7eeb89-fccc-45b2-ac90-b44568ff2c34", "address": "fa:16:3e:c5:08:a5", "network": {"id": "7c483e76-809a-4260-af12-f58188f6bd77", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-964714137-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2dd8820c03574b9d86542c61bf1fdc43", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7eeb89-fc", "ovs_interfaceid": "fa7eeb89-fccc-45b2-ac90-b44568ff2c34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:07:53.191281 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3ba453d2-37fa-4b44-ad44-cf63d4be8df5 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:08:a5,bridge_name='br-int',has_traffic_filtering=True,id=fa7eeb89-fccc-45b2-ac90-b44568ff2c34,network=Network(7c483e76-809a-4260-af12-f58188f6bd77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa7eeb89-fc') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:07:53.191576 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-3ba453d2-37fa-4b44-ad44-cf63d4be8df5 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:08:a5,bridge_name='br-int',has_traffic_filtering=True,id=fa7eeb89-fccc-45b2-ac90-b44568ff2c34,network=Network(7c483e76-809a-4260-af12-f58188f6bd77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa7eeb89-fc') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:07:53.193502 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:53.193676 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa7eeb89-fc, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:07:53.195788 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:07:53.196233 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:53.196392 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8aa1c919-489d-49f2-8059-9bfa6770f5a7) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:07:53.196778 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:53.197212 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:07:53.197448 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:53.198992 np0000001577 nova-compute[98319]: INFO os_vif [None req-3ba453d2-37fa-4b44-ad44-cf63d4be8df5 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:08:a5,bridge_name='br-int',has_traffic_filtering=True,id=fa7eeb89-fccc-45b2-ac90-b44568ff2c34,network=Network(7c483e76-809a-4260-af12-f58188f6bd77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa7eeb89-fc')
May 28 01:07:53.199267 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3ba453d2-37fa-4b44-ad44-cf63d4be8df5 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Deleting instance files /opt/stack/data/nova/instances/5dafacc2-fb17-4781-8dda-8b9f21e57dee_del
May 28 01:07:53.199957 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3ba453d2-37fa-4b44-ad44-cf63d4be8df5 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Deletion of /opt/stack/data/nova/instances/5dafacc2-fb17-4781-8dda-8b9f21e57dee_del complete
May 28 01:07:53.523345 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:07:53.541854 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:53.545510 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:53.565649 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:53.569153 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:53.571402 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: a9179c5a-9c48-4d9a-9a7a-3e4baa721bba] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:07:53.598142 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:53.706768 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-3ba453d2-37fa-4b44-ad44-cf63d4be8df5 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Took 1.36 seconds to destroy the instance on the hypervisor.
May 28 01:07:53.707160 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-3ba453d2-37fa-4b44-ad44-cf63d4be8df5 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:07:53.707589 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:07:53.707724 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:07:53.708001 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:53.771082 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:53.843417 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999741479000022 future=<Future at 0x7c984c5cabd0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:07:53.845192 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Instance destroyed successfully.
May 28 01:07:53.845635 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lazy-loading 'resources' on Instance uuid b1ae3969-7f8a-457a-aed8-539761a6d03e {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:07:54.183179 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a28a2f29-b6cf-4aaa-b6b5-b06db4613fc4 req-01b53679-cbbd-403c-be94-75c0b7215126 service nova] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Received event network-vif-deleted-fa7eeb89-fccc-45b2-ac90-b44568ff2c34 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:07:54.183539 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-a28a2f29-b6cf-4aaa-b6b5-b06db4613fc4 req-01b53679-cbbd-403c-be94-75c0b7215126 service nova] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Neutron deleted interface fa7eeb89-fccc-45b2-ac90-b44568ff2c34; detaching it from the instance and deleting it from the info cache
May 28 01:07:54.184824 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a28a2f29-b6cf-4aaa-b6b5-b06db4613fc4 req-01b53679-cbbd-403c-be94-75c0b7215126 service nova] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Detach interface failed, port_id=fa7eeb89-fccc-45b2-ac90-b44568ff2c34, reason: Instance 5dafacc2-fb17-4781-8dda-8b9f21e57dee could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:07:54.347797 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:06:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-453420150',display_name='tempest-VolumesSnapshotTestJSON-instance-453420150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumessnapshottestjson-instance-453420150',id=51,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNlYLnV8wBRlh6eYOjhRBpA7YA/QVstPxrilQA72A7sR7I3nreOzCGddDeuX7fKr77wcEdf5feNwsjyD8Lb3i9MPrO/aNUtK27NRumlAzYN5u+3aKEQdbuQpi/2ovi5zA==',key_name='tempest-keypair-339709474',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:06:55Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f132ca2a48c44f6097340763039224c1',ramdisk_id='',reservation_id='r-s8yhrga7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1352681167',owner_user_name='tempest-VolumesSnapshotTestJSON-1352681167-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:06:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf90ea61781a41ca91d0d5266f37cae4',uuid=b1ae3969-7f8a-457a-aed8-539761a6d03e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99bb5945-b1ef-41b0-bda0-bc7d698b2789", "address": "fa:16:3e:f5:a8:9f", "network": {"id": "c24d30f5-c7e1-4457-bdc3-ef51ebdf3991", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-116184687-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f132ca2a48c44f6097340763039224c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb5945-b1", "ovs_interfaceid": "99bb5945-b1ef-41b0-bda0-bc7d698b2789", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:07:54.348044 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Converting VIF {"id": "99bb5945-b1ef-41b0-bda0-bc7d698b2789", "address": "fa:16:3e:f5:a8:9f", "network": {"id": "c24d30f5-c7e1-4457-bdc3-ef51ebdf3991", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-116184687-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f132ca2a48c44f6097340763039224c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bb5945-b1", "ovs_interfaceid": "99bb5945-b1ef-41b0-bda0-bc7d698b2789", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:07:54.348804 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:a8:9f,bridge_name='br-int',has_traffic_filtering=True,id=99bb5945-b1ef-41b0-bda0-bc7d698b2789,network=Network(c24d30f5-c7e1-4457-bdc3-ef51ebdf3991),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bb5945-b1') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:07:54.349100 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:a8:9f,bridge_name='br-int',has_traffic_filtering=True,id=99bb5945-b1ef-41b0-bda0-bc7d698b2789,network=Network(c24d30f5-c7e1-4457-bdc3-ef51ebdf3991),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bb5945-b1') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:07:54.350004 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:54.350171 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99bb5945-b1, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:07:54.351048 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:54.351926 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:07:54.352173 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:54.352792 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:54.352933 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=761540e4-02f3-49d6-ae4e-db1bb64d8fcc) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:07:54.353331 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:54.353776 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:07:54.354017 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:54.355783 np0000001577 nova-compute[98319]: INFO os_vif [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:a8:9f,bridge_name='br-int',has_traffic_filtering=True,id=99bb5945-b1ef-41b0-bda0-bc7d698b2789,network=Network(c24d30f5-c7e1-4457-bdc3-ef51ebdf3991),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bb5945-b1')
May 28 01:07:54.357031 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:07:54.357316 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408', 'iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3d6034b1-b4b2-4528-80b9-f3af53b32408', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:07:54.357475 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:07:54.357820 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:07:54.358085 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408', 'iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3d6034b1-b4b2-4528-80b9-f3af53b32408', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:07:54.358253 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:07:54.368576 np0000001577 nova-compute[98319]: WARNING os_brick.initiator.connectors.iscsi [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
May 28 01:07:54.368576 np0000001577 nova-compute[98319]: 
May 28 01:07:54.377745 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 01:07:54.377745 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:07:54.377873 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 01:07:54.377873 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:07:54.377933 np0000001577 nova-compute[98319]: WARNING os_brick.initiator.connectors.iscsi [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 01:07:54.377933 np0000001577 nova-compute[98319]: 
May 28 01:07:54.378012 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Sessions list: [] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:07:54.378102 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408, 0): [] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:07:54.378186 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408') {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 01:07:54.378290 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408, 0): [] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:07:54.378377 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d6034b1-b4b2-4528-80b9-f3af53b32408') {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 01:07:54.378479 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c9870584f40>, {}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:07:54.378588 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Disconnecting from: [] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:07:54.378754 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.021s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:07:54.378845 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] <== disconnect_volume: return (21ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:07:54.378957 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:07:54.379203 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Deleting instance files /opt/stack/data/nova/instances/b1ae3969-7f8a-457a-aed8-539761a6d03e_del
May 28 01:07:54.379873 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Deletion of /opt/stack/data/nova/instances/b1ae3969-7f8a-457a-aed8-539761a6d03e_del complete
May 28 01:07:54.609769 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "1e7c5308-80cc-4991-8626-2ba32fa09acf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:54.609984 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:54.629953 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-09baa643-c923-46bb-94b3-e0ca04b7ae58 req-a0c7390e-eff3-4467-8dff-b5a532d74cd0 service nova] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Received event network-vif-unplugged-fa7eeb89-fccc-45b2-ac90-b44568ff2c34 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:07:54.630443 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-09baa643-c923-46bb-94b3-e0ca04b7ae58 req-a0c7390e-eff3-4467-8dff-b5a532d74cd0 service nova] Acquiring lock "5dafacc2-fb17-4781-8dda-8b9f21e57dee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:54.630678 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-09baa643-c923-46bb-94b3-e0ca04b7ae58 req-a0c7390e-eff3-4467-8dff-b5a532d74cd0 service nova] Lock "5dafacc2-fb17-4781-8dda-8b9f21e57dee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:54.630854 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-09baa643-c923-46bb-94b3-e0ca04b7ae58 req-a0c7390e-eff3-4467-8dff-b5a532d74cd0 service nova] Lock "5dafacc2-fb17-4781-8dda-8b9f21e57dee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:54.631000 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-09baa643-c923-46bb-94b3-e0ca04b7ae58 req-a0c7390e-eff3-4467-8dff-b5a532d74cd0 service nova] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] No waiting events found dispatching network-vif-unplugged-fa7eeb89-fccc-45b2-ac90-b44568ff2c34 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:07:54.631151 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-09baa643-c923-46bb-94b3-e0ca04b7ae58 req-a0c7390e-eff3-4467-8dff-b5a532d74cd0 service nova] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Received event network-vif-unplugged-fa7eeb89-fccc-45b2-ac90-b44568ff2c34 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:07:54.631300 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-09baa643-c923-46bb-94b3-e0ca04b7ae58 req-a0c7390e-eff3-4467-8dff-b5a532d74cd0 service nova] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Received event network-vif-unplugged-99bb5945-b1ef-41b0-bda0-bc7d698b2789 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:07:54.631452 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-09baa643-c923-46bb-94b3-e0ca04b7ae58 req-a0c7390e-eff3-4467-8dff-b5a532d74cd0 service nova] Acquiring lock "b1ae3969-7f8a-457a-aed8-539761a6d03e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:54.631636 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-09baa643-c923-46bb-94b3-e0ca04b7ae58 req-a0c7390e-eff3-4467-8dff-b5a532d74cd0 service nova] Lock "b1ae3969-7f8a-457a-aed8-539761a6d03e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:54.631746 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-09baa643-c923-46bb-94b3-e0ca04b7ae58 req-a0c7390e-eff3-4467-8dff-b5a532d74cd0 service nova] Lock "b1ae3969-7f8a-457a-aed8-539761a6d03e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:54.631887 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-09baa643-c923-46bb-94b3-e0ca04b7ae58 req-a0c7390e-eff3-4467-8dff-b5a532d74cd0 service nova] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] No waiting events found dispatching network-vif-unplugged-99bb5945-b1ef-41b0-bda0-bc7d698b2789 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:07:54.632025 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-09baa643-c923-46bb-94b3-e0ca04b7ae58 req-a0c7390e-eff3-4467-8dff-b5a532d74cd0 service nova] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Received event network-vif-unplugged-99bb5945-b1ef-41b0-bda0-bc7d698b2789 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:07:54.632160 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-09baa643-c923-46bb-94b3-e0ca04b7ae58 req-a0c7390e-eff3-4467-8dff-b5a532d74cd0 service nova] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Received event network-vif-unplugged-99bb5945-b1ef-41b0-bda0-bc7d698b2789 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:07:54.632330 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-09baa643-c923-46bb-94b3-e0ca04b7ae58 req-a0c7390e-eff3-4467-8dff-b5a532d74cd0 service nova] Acquiring lock "b1ae3969-7f8a-457a-aed8-539761a6d03e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:54.632671 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-09baa643-c923-46bb-94b3-e0ca04b7ae58 req-a0c7390e-eff3-4467-8dff-b5a532d74cd0 service nova] Lock "b1ae3969-7f8a-457a-aed8-539761a6d03e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:54.632819 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-09baa643-c923-46bb-94b3-e0ca04b7ae58 req-a0c7390e-eff3-4467-8dff-b5a532d74cd0 service nova] Lock "b1ae3969-7f8a-457a-aed8-539761a6d03e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:54.632934 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-09baa643-c923-46bb-94b3-e0ca04b7ae58 req-a0c7390e-eff3-4467-8dff-b5a532d74cd0 service nova] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] No waiting events found dispatching network-vif-unplugged-99bb5945-b1ef-41b0-bda0-bc7d698b2789 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:07:54.633121 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-09baa643-c923-46bb-94b3-e0ca04b7ae58 req-a0c7390e-eff3-4467-8dff-b5a532d74cd0 service nova] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Received event network-vif-unplugged-99bb5945-b1ef-41b0-bda0-bc7d698b2789 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:07:54.635022 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:07:54.715693 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:54.884804 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Took 1.36 seconds to destroy the instance on the hypervisor.
May 28 01:07:54.885728 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:07:54.885922 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:07:54.886027 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:07:54.886279 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:54.950482 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:07:55.113043 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lazy-loading 'flavor' on Instance uuid 1e7c5308-80cc-4991-8626-2ba32fa09acf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:07:55.136330 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Took 1.43 seconds to deallocate network for instance.
May 28 01:07:55.248427 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:55.648342 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3ba453d2-37fa-4b44-ad44-cf63d4be8df5 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:55.648522 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3ba453d2-37fa-4b44-ad44-cf63d4be8df5 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:55.841264 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:07:55.870466 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3ba453d2-37fa-4b44-ad44-cf63d4be8df5 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:07:55.870650 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-3ba453d2-37fa-4b44-ad44-cf63d4be8df5 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:07:56.120631 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:56.160355 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "9e7ca386-dbea-461e-9cf2-7e135bd3758d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:56.160522 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "9e7ca386-dbea-461e-9cf2-7e135bd3758d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:56.221290 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:56.343317 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Took 1.46 seconds to deallocate network for instance.
May 28 01:07:56.358527 np0000001577 nova-compute[98319]: WARNING nova.volume.cinder [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Attachment 0fd3a863-1314-4f21-b2bf-ed7ad7340644 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 0fd3a863-1314-4f21-b2bf-ed7ad7340644. (HTTP 404) (Request-ID: req-549fff19-08ba-4e54-8194-493ec82ce7b0)
May 28 01:07:56.358862 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Took 0.02 seconds to detach 1 volumes for instance.
May 28 01:07:56.372753 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-3ba453d2-37fa-4b44-ad44-cf63d4be8df5 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:07:56.462185 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:56.662403 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:07:56.679361 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a9e5773f-41b7-4263-bd8f-4c5d87b126e3 req-fa3f73f3-0139-4cd9-9397-ee25a081621a service nova] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Received event network-vif-deleted-99bb5945-b1ef-41b0-bda0-bc7d698b2789 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:07:56.863216 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:56.878247 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3ba453d2-37fa-4b44-ad44-cf63d4be8df5 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.230s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:56.879871 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.017s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:56.946647 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-3ba453d2-37fa-4b44-ad44-cf63d4be8df5 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Deleted allocations for instance 5dafacc2-fb17-4781-8dda-8b9f21e57dee
May 28 01:07:57.107837 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:07:57.108072 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:07:57.169873 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "1e7c5308-80cc-4991-8626-2ba32fa09acf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:57.170087 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:57.170191 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Attaching volume 67905ec9-510f-4af0-85fe-adc6bcc8505f to /dev/vdb
May 28 01:07:57.205256 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:57.209865 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:07:57.220282 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:07:57.241046 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:07:57.282099 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:07:57.282402 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:07:57.290328 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:07:57.291299 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe05:9ded', 'fe80::84b7:d3ff:feed:4f01', 'fe80::fc16:3eff:fe8d:510f', 'fe80::49a:a7ff:fef7:c9e8'] 
May 28 01:07:57.291423 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:07:57.291525 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:07:57.291774 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] <== get_connector_properties: return (82ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:07:57.291995 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Updating existing volume attachment record: f9edfbbe-9f96-4f12-9b27-4267c09f92b3 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:07:57.611207 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:07:57.833650 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:07:57.834001 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67905ec9-510f-4af0-85fe-adc6bcc8505f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:07:57.834137 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:07:57.834558 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:07:57.834750 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67905ec9-510f-4af0-85fe-adc6bcc8505f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:07:57.847713 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:07:57.848371 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:07:57.848862 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:07:57.849103 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:07:57.849695 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:07:57.849695 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:07:57.859404 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:07:57.859404 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:57.864060 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:07:57.864060 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:57.870463 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f] added
May 28 01:07:57.870463 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:07:57.870463 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:07:57.870463 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:07:57.870463 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:07:57.870463 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:07:57.870463 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:57.870686 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:07:57.870875 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0217(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:07:57.871011 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:07:57.874209 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f] added
May 28 01:07:57.874209 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:07:57.874209 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:07:57.874209 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:07:57.874209 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:07:57.874209 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:07:57.874209 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:57.874402 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:07:57.874520 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0249(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:07:57.874691 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:07:57.955556 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3ba453d2-37fa-4b44-ad44-cf63d4be8df5 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975 tempest-TestServerVolumeAttachScenarioOldVersion-1694940975-project-member] Lock "5dafacc2-fb17-4781-8dda-8b9f21e57dee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.113s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:58.117815 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.238s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:58.119535 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.913s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:58.122460 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:07:58.122599 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Claim successful on node np0000001577
May 28 01:07:58.161540 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Deleted allocations for instance b1ae3969-7f8a-457a-aed8-539761a6d03e
May 28 01:07:58.871478 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:07:58.876000 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:07:58.884593 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:07:58.884593 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:07:58.890781 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:07:58.890781 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:58.896686 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:58.903664 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:58.909763 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 01:07:58.909763 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:07:58.909847 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 01:07:58.909847 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:07:58.909915 np0000001577 nova-compute[98319]: WARNING os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 01:07:58.909915 np0000001577 nova-compute[98319]: 
May 28 01:07:58.921814 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 01:07:58.921814 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:07:58.922014 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 01:07:58.922014 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:07:58.922140 np0000001577 nova-compute[98319]: WARNING os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 01:07:58.922140 np0000001577 nova-compute[98319]: 
May 28 01:07:58.934404 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f, portal: 192.168.40.100,3260]
May 28 01:07:58.934404 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f, portal: 192.168.40.100,3260] successful.
May 28 01:07:58.934404 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:58.946229 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:58.956496 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f, portal: 192.168.50.100,3260]
May 28 01:07:58.956496 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f, portal: 192.168.50.100,3260] successful.
May 28 01:07:58.956496 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:58.957116 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:07:58.957116 np0000001577 nova-compute[98319]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:07:58.957116 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:07:58.957513 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsi session list stdout=tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:07:58.957513 np0000001577 nova-compute[98319]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:07:58.957513 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:07:58.957846 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.109s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:07:58.957946 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:07:58.958399 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] HCTL ('7', '-', '-', 0) found on session 128 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:07:58.958499 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:07:58.967999 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:07:58.977129 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Searching for a device in session 128 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:07:58.977129 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67905ec9-510f-4af0-85fe-adc6bcc8505f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:07:58.979525 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:07:58.979525 np0000001577 nova-compute[98319]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:07:58.979525 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:07:58.979661 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsi session list stdout=tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:07:58.979661 np0000001577 nova-compute[98319]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:07:58.979661 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:07:58.979862 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.131s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:07:58.979963 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:07:58.980379 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] HCTL ('8', '-', '-', 0) found on session 129 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:07:58.980464 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:07:58.999696 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Searching for a device in session 129 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:07:58.999696 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '67905ec9-510f-4af0-85fe-adc6bcc8505f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:07:59.169447 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-615fa268-2ad7-4d0d-a17a-da0d86b433c7 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "b1ae3969-7f8a-457a-aed8-539761a6d03e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.151s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:07:59.318340 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00044005400013702456 future=<Future at 0x7c984c7d2960 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:07:59.318912 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:07:59.319010 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=8.366909702000157 future=<Future at 0x7c98704d1730 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:07:59.319089 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=8.366832528000032 future=<Future at 0x7c98704d1730 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:07:59.321022 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Emitting event <LifecycleEvent: 1779930464.3177993, 36be2ae9-c375-4335-a421-cf92ea63e489 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:07:59.321165 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] VM Stopped (Lifecycle Event)
May 28 01:07:59.326200 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:07:59.326200 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:07:59.355062 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:07:59.402065 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "48bfd06f-62f4-4691-bf98-2426e359a90e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:07:59.402464 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "48bfd06f-62f4-4691-bf98-2426e359a90e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:07:59.823256 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 36be2ae9-c375-4335-a421-cf92ea63e489] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:07:59.827484 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:07:59.849310 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:07:59.905461 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lazy-loading 'flavor' on Instance uuid 48bfd06f-62f4-4691-bf98-2426e359a90e {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:08:00.333058 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.215s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:00.333327 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:08:00.457116 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:00.838432 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:08:00.838736 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:08:00.839099 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:00.839419 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:00.868791 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Found WWN 330000000405a0c5e for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:08:00.869009 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:08:00.869143 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000405a0c5e', 'path': '/dev/dm-0', 'multipath_id': '330000000405a0c5e'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:08:00.869258 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000405a0c5e', 'path': '/dev/dm-0', 'multipath_id': '330000000405a0c5e'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:08:00.871391 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lazy-loading 'flavor' on Instance uuid 1e7c5308-80cc-4991-8626-2ba32fa09acf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:08:00.911139 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c803ddeaf4f4b3db07587419087b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050f928f1ce449d6a447cd343dc4ff80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:08:00.913179 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "48bfd06f-62f4-4691-bf98-2426e359a90e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:01.342646 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:08:01.373719 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Attempting to attach volume 67905ec9-510f-4af0-85fe-adc6bcc8505f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:08:01.374974 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:08:01.374974 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:08:01.374974 np0000001577 nova-compute[98319]:   <alias name="ua-67905ec9-510f-4af0-85fe-adc6bcc8505f"/>
May 28 01:08:01.374974 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 28 01:08:01.374974 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:08:01.374974 np0000001577 nova-compute[98319]:   <serial>67905ec9-510f-4af0-85fe-adc6bcc8505f</serial>
May 28 01:08:01.374974 np0000001577 nova-compute[98319]: </disk>
May 28 01:08:01.374974 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:08:01.433145 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Successfully created port: 4138127d-166a-4844-b2a4-426d5014fc37 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:08:01.465521 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:01.847663 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:08:01.870917 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Successfully updated port: 4138127d-166a-4844-b2a4-426d5014fc37 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:08:01.926149 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f9459a55-7d5d-4ddf-9b24-feb56fd99bd4 req-bb782262-e858-4023-b775-e0728f96701d service nova] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Received event network-changed-4138127d-166a-4844-b2a4-426d5014fc37 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:08:01.926923 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f9459a55-7d5d-4ddf-9b24-feb56fd99bd4 req-bb782262-e858-4023-b775-e0728f96701d service nova] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Refreshing instance network info cache due to event network-changed-4138127d-166a-4844-b2a4-426d5014fc37. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:08:01.927191 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f9459a55-7d5d-4ddf-9b24-feb56fd99bd4 req-bb782262-e858-4023-b775-e0728f96701d service nova] Acquiring lock "refresh_cache-9e7ca386-dbea-461e-9cf2-7e135bd3758d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:08:01.927397 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f9459a55-7d5d-4ddf-9b24-feb56fd99bd4 req-bb782262-e858-4023-b775-e0728f96701d service nova] Acquired lock "refresh_cache-9e7ca386-dbea-461e-9cf2-7e135bd3758d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:08:01.928266 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-f9459a55-7d5d-4ddf-9b24-feb56fd99bd4 req-bb782262-e858-4023-b775-e0728f96701d service nova] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Refreshing network info cache for port 4138127d-166a-4844-b2a4-426d5014fc37 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:08:01.970249 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "48bfd06f-62f4-4691-bf98-2426e359a90e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:01.970433 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "48bfd06f-62f4-4691-bf98-2426e359a90e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:01.970594 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Attaching volume 46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 to /dev/vdb
May 28 01:08:02.006188 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:08:02.016511 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:08:02.036999 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:02.071118 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:02.083352 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:08:02.084325 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:08:02.092810 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:08:02.093568 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe05:9ded', 'fe80::84b7:d3ff:feed:4f01', 'fe80::fc16:3eff:fe8d:510f', 'fe80::49a:a7ff:fef7:c9e8'] 
May 28 01:08:02.093568 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:08:02.093568 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:08:02.093784 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:08:02.093995 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Updating existing volume attachment record: fb75dc4a-b95f-456c-9956-7ecc2f0666ef {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:08:02.352135 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Booting with volume 408b306f-e263-4cfa-a888-735b63628858 at /dev/vda
May 28 01:08:02.373066 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "refresh_cache-9e7ca386-dbea-461e-9cf2-7e135bd3758d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:08:02.388076 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:08:02.397825 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:08:02.415184 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:02.432578 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-f9459a55-7d5d-4ddf-9b24-feb56fd99bd4 req-bb782262-e858-4023-b775-e0728f96701d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:02.455985 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:08:02.456305 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:08:02.463690 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:08:02.464681 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe05:9ded', 'fe80::84b7:d3ff:feed:4f01', 'fe80::fc16:3eff:fe8d:510f', 'fe80::49a:a7ff:fef7:c9e8'] 
May 28 01:08:02.464817 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:08:02.464989 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:08:02.465267 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] <== get_connector_properties: return (77ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:08:02.465495 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Updating existing volume attachment record: 3beef254-357e-4c22-9d16-5f04496754a6 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:08:02.499917 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-f9459a55-7d5d-4ddf-9b24-feb56fd99bd4 req-bb782262-e858-4023-b775-e0728f96701d service nova] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:08:02.634048 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-f9459a55-7d5d-4ddf-9b24-feb56fd99bd4 req-bb782262-e858-4023-b775-e0728f96701d service nova] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:08:02.661234 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 'iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '48bfd06f-62f4-4691-bf98-2426e359a90e', 'attached_at': '', 'detached_at': '', 'volume_id': '46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 'serial': '46a8593c-4b06-4b04-a8a1-ccc55cdf51e3'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 01:08:02.663787 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:08:02.664104 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 'iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:08:02.664252 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:08:03.027371 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:08:03.027716 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:08:03.027716 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:08:03.027857 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] No VIF found with MAC fa:16:3e:05:9d:ed, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:08:03.116206 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.452s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:08:03.116474 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 'iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:08:03.130932 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:08:03.131594 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:08:03.132151 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:08:03.132401 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:08:03.133101 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:08:03.133101 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:08:03.135776 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f9459a55-7d5d-4ddf-9b24-feb56fd99bd4 req-bb782262-e858-4023-b775-e0728f96701d service nova] Releasing lock "refresh_cache-9e7ca386-dbea-461e-9cf2-7e135bd3758d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:08:03.137374 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquired lock "refresh_cache-9e7ca386-dbea-461e-9cf2-7e135bd3758d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:08:03.137374 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:08:03.145310 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:08:03.145310 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:03.151058 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:08:03.151058 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:03.157790 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3] added
May 28 01:08:03.157790 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:08:03.157790 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:08:03.157790 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:08:03.157790 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:08:03.157790 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:08:03.157790 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:03.158798 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:08:03.158798 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0262(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:08:03.158798 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:08:03.163514 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3] added
May 28 01:08:03.163514 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:08:03.163514 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:08:03.163514 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:08:03.163514 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:08:03.163514 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:08:03.163514 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:03.163695 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:08:03.163817 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0309(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:08:03.163995 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:08:03.714775 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:08:03.865631 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:03.993603 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Updating instance_info_cache with network_info: [{"id": "4138127d-166a-4844-b2a4-426d5014fc37", "address": "fa:16:3e:f1:a3:d9", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4138127d-16", "ovs_interfaceid": "4138127d-166a-4844-b2a4-426d5014fc37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:08:04.159388 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:08:04.164412 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:08:04.173194 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:08:04.173194 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:08:04.182426 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:08:04.182426 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:04.189362 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:04.197000 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:04.209164 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:04.209164 np0000001577 nova-compute[98319]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:04.209164 np0000001577 nova-compute[98319]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8fc8b77-a8f1-4a75-91df-d7d526698a3b (non-flash)
May 28 01:08:04.209164 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:08:04.209301 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsi session list stdout=tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:04.209301 np0000001577 nova-compute[98319]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:04.209301 np0000001577 nova-compute[98319]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8fc8b77-a8f1-4a75-91df-d7d526698a3b (non-flash)
May 28 01:08:04.209301 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:08:04.228114 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:04.228114 np0000001577 nova-compute[98319]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:04.228114 np0000001577 nova-compute[98319]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8fc8b77-a8f1-4a75-91df-d7d526698a3b (non-flash)
May 28 01:08:04.228114 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:08:04.228250 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsi session list stdout=tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:04.228250 np0000001577 nova-compute[98319]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:04.228250 np0000001577 nova-compute[98319]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8fc8b77-a8f1-4a75-91df-d7d526698a3b (non-flash)
May 28 01:08:04.228250 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:08:04.258381 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3, portal: 192.168.50.100,3260]
May 28 01:08:04.258381 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3, portal: 192.168.50.100,3260] successful.
May 28 01:08:04.258381 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:04.271973 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:04.276191 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3, portal: 192.168.40.100,3260]
May 28 01:08:04.276191 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3, portal: 192.168.40.100,3260] successful.
May 28 01:08:04.276191 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:04.292790 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:04.292790 np0000001577 nova-compute[98319]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:04.292790 np0000001577 nova-compute[98319]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8fc8b77-a8f1-4a75-91df-d7d526698a3b (non-flash)
May 28 01:08:04.292790 np0000001577 nova-compute[98319]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:04.292790 np0000001577 nova-compute[98319]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:04.292790 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:08:04.293018 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsi session list stdout=tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:04.293018 np0000001577 nova-compute[98319]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:04.293018 np0000001577 nova-compute[98319]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8fc8b77-a8f1-4a75-91df-d7d526698a3b (non-flash)
May 28 01:08:04.293018 np0000001577 nova-compute[98319]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:04.293018 np0000001577 nova-compute[98319]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:04.293018 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:08:04.293196 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.160s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:08:04.293537 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:08:04.294134 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] HCTL ('10', '-', '-', 0) found on session 131 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:08:04.294262 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:08:04.294928 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:04.317759 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:04.317759 np0000001577 nova-compute[98319]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:04.317759 np0000001577 nova-compute[98319]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8fc8b77-a8f1-4a75-91df-d7d526698a3b (non-flash)
May 28 01:08:04.317759 np0000001577 nova-compute[98319]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:04.317759 np0000001577 nova-compute[98319]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:04.317759 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:08:04.317759 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsi session list stdout=tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:04.317759 np0000001577 nova-compute[98319]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:04.317759 np0000001577 nova-compute[98319]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8fc8b77-a8f1-4a75-91df-d7d526698a3b (non-flash)
May 28 01:08:04.317759 np0000001577 nova-compute[98319]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:04.317759 np0000001577 nova-compute[98319]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:04.317759 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:08:04.317759 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:08:04.317759 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:08:04.317759 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] HCTL ('11', '-', '-', 0) found on session 132 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:08:04.317759 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:08:04.317759 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Searching for a device in session 131 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:08:04.317759 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:08:04.353384 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Searching for a device in session 132 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:08:04.353384 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:08:04.356444 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:04.495976 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Releasing lock "refresh_cache-9e7ca386-dbea-461e-9cf2-7e135bd3758d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:08:04.496234 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Instance network_info: |[{"id": "4138127d-166a-4844-b2a4-426d5014fc37", "address": "fa:16:3e:f1:a3:d9", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4138127d-16", "ovs_interfaceid": "4138127d-166a-4844-b2a4-426d5014fc37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:08:04.553933 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:08:04.556357 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:08:04.556666 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Creating image(s)
May 28 01:08:04.557006 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:08:04.557165 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Ensure instance console log exists: /opt/stack/data/nova/instances/9e7ca386-dbea-461e-9cf2-7e135bd3758d/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:08:04.558539 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:04.558750 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:04.558914 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:04.560175 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Start _get_guest_xml network_info=[{"id": "4138127d-166a-4844-b2a4-426d5014fc37", "address": "fa:16:3e:f1:a3:d9", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4138127d-16", "ovs_interfaceid": "4138127d-166a-4844-b2a4-426d5014fc37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '408b306f-e263-4cfa-a888-735b63628858', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '9e7ca386-dbea-461e-9cf2-7e135bd3758d', 'attached_at': '', 'detached_at': '', 'volume_id': '408b306f-e263-4cfa-a888-735b63628858', 'serial': '408b306f-e263-4cfa-a888-735b63628858'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '3beef254-357e-4c22-9d16-5f04496754a6', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:08:04.562341 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:08:04.563429 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-813060794', uuid='9e7ca386-dbea-461e-9cf2-7e135bd3758d'), owner=OwnerMeta(userid='0c803ddeaf4f4b3db07587419087b3b2', username='tempest-TestVolumeBootPattern-1449742411-project-member', projectid='050f928f1ce449d6a447cd343dc4ff80', projectname='tempest-TestVolumeBootPattern-1449742411'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4138127d-166a-4844-b2a4-426d5014fc37", "address": "fa:16:3e:f1:a3:d9", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4138127d-16", "ovs_interfaceid": "4138127d-166a-4844-b2a4-426d5014fc37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930484.5630782) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:08:04.564672 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:08:04.565005 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:08:04.565764 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:08:04.565919 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:08:04.566841 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:08:04.567104 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:08:04.567372 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:08:04.567488 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:08:04.567632 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:08:04.567729 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:08:04.567847 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:08:04.568049 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:08:04.568147 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:08:04.568271 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:08:04.568403 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:08:04.568633 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:08:04.578493 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-118d8150-df31-4531-b15d-73040a809801 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.408s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:04.585068 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:08:04.585326 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '408b306f-e263-4cfa-a888-735b63628858', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:08:04.585476 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:08:05.013887 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-270b4fdb-21d4-467f-ae9e-49d709310c4a tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "1e7c5308-80cc-4991-8626-2ba32fa09acf" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:05.014018 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-270b4fdb-21d4-467f-ae9e-49d709310c4a tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:05.014139 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-270b4fdb-21d4-467f-ae9e-49d709310c4a tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:08:05.016429 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-270b4fdb-21d4-467f-ae9e-49d709310c4a tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98319) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 28 01:08:05.016840 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-270b4fdb-21d4-467f-ae9e-49d709310c4a tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lazy-loading 'flavor' on Instance uuid 1e7c5308-80cc-4991-8626-2ba32fa09acf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:08:05.132972 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:08:05.613455 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:06.064947 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:06.076741 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:06.090162 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:06.099979 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:06.124733 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:06.149615 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Found WWN 330000000f9621094 for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:08:06.149856 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:08:06.152044 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.566s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:08:06.152044 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '408b306f-e263-4cfa-a888-735b63628858', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:08:06.155326 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] <== connect_volume: return (3490ms) {'type': 'block', 'scsi_wwn': '330000000f9621094', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '330000000f9621094'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:08:06.155488 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f9621094', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '330000000f9621094'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:08:06.159170 np0000001577 nova-compute[98319]: WARNING stevedore.named [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 01:08:06.159391 np0000001577 nova-compute[98319]: WARNING castellan.key_manager [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:08:06.159527 np0000001577 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:08:06.159999 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x7c984c6df080>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 'iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': '48bfd06f-62f4-4691-bf98-2426e359a90e', 'attached_at': '', 'detached_at': '', 'volume_id': '46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 'serial': '46a8593c-4b06-4b04-a8a1-ccc55cdf51e3'} {{(pid=98319) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 01:08:06.160138 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98319) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 28 01:08:06.160259 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors.luks [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] opening encrypted volume /dev/dm-1 {{(pid=98319) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 28 01:08:06.167322 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:08:06.167991 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:08:06.169294 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:08:06.169558 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:08:06.169922 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:08:06.170103 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:08:06.180194 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:08:06.180194 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:06.195318 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:08:06.195318 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:06.196008 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858] added
May 28 01:08:06.196008 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:08:06.196008 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:08:06.196008 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:08:06.196008 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:08:06.196008 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:08:06.196008 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:06.196190 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:08:06.196357 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0268(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:08:06.196474 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:08:06.205816 np0000001577 nova-compute[98319]: WARNING os_brick.encryptors.luks [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 28 01:08:06.205984 np0000001577 nova-compute[98319]: INFO os_brick.encryptors.luks [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] /dev/dm-1 is not a valid LUKS device; formatting device for first use
May 28 01:08:06.206101 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors.luks [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] formatting encrypted volume /dev/dm-1 {{(pid=98319) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 28 01:08:06.208296 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858] added
May 28 01:08:06.208296 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:08:06.208296 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:08:06.208296 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:08:06.208296 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:08:06.208296 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:08:06.208296 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:06.208296 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:08:06.208296 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0379(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:08:06.208296 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:08:06.295133 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-381a9d13-1575-44c4-8cad-894f600feb9f req-15670b94-fe54-40a5-9656-92cdc6b5912c service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Received event network-vif-unplugged-cc1de356-c44a-46bf-bb87-d123239afbe7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:08:06.295376 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-381a9d13-1575-44c4-8cad-894f600feb9f req-15670b94-fe54-40a5-9656-92cdc6b5912c service nova] Acquiring lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:06.295840 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-381a9d13-1575-44c4-8cad-894f600feb9f req-15670b94-fe54-40a5-9656-92cdc6b5912c service nova] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:06.295840 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-381a9d13-1575-44c4-8cad-894f600feb9f req-15670b94-fe54-40a5-9656-92cdc6b5912c service nova] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:06.296033 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-381a9d13-1575-44c4-8cad-894f600feb9f req-15670b94-fe54-40a5-9656-92cdc6b5912c service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] No waiting events found dispatching network-vif-unplugged-cc1de356-c44a-46bf-bb87-d123239afbe7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:08:06.296153 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-381a9d13-1575-44c4-8cad-894f600feb9f req-15670b94-fe54-40a5-9656-92cdc6b5912c service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Received unexpected event network-vif-unplugged-cc1de356-c44a-46bf-bb87-d123239afbe7 for instance with vm_state active and task_state powering-off.
May 28 01:08:06.333746 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:06.339378 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:06.368368 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999676778999856 future=<Future at 0x7c984c6b4560 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:08:06.370462 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Instance destroyed successfully.
May 28 01:08:06.371023 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-270b4fdb-21d4-467f-ae9e-49d709310c4a tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lazy-loading 'numa_topology' on Instance uuid 1e7c5308-80cc-4991-8626-2ba32fa09acf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:08:06.465899 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:06.875979 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-270b4fdb-21d4-467f-ae9e-49d709310c4a tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Object Instance<1e7c5308-80cc-4991-8626-2ba32fa09acf> lazy-loaded attributes: flavor,numa_topology {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:08:06.876341 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-270b4fdb-21d4-467f-ae9e-49d709310c4a tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:08:07.196886 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:08:07.208502 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:08:07.217353 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "d5e4832e-32b9-44a7-92b8-6fa82e642515" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:07.217575 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "d5e4832e-32b9-44a7-92b8-6fa82e642515" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:08:07.220489 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:08:07.220489 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:08:07.229118 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:08:07.229118 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:07.236556 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:07.248815 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:07.256008 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:07.256008 np0000001577 nova-compute[98319]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:07.256008 np0000001577 nova-compute[98319]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8fc8b77-a8f1-4a75-91df-d7d526698a3b (non-flash)
May 28 01:08:07.256008 np0000001577 nova-compute[98319]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:07.256008 np0000001577 nova-compute[98319]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:07.256008 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:08:07.256879 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:07.256879 np0000001577 nova-compute[98319]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:07.256879 np0000001577 nova-compute[98319]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8fc8b77-a8f1-4a75-91df-d7d526698a3b (non-flash)
May 28 01:08:07.256879 np0000001577 nova-compute[98319]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:07.256879 np0000001577 nova-compute[98319]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:07.256879 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:08:07.265169 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:07.265169 np0000001577 nova-compute[98319]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:07.265169 np0000001577 nova-compute[98319]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8fc8b77-a8f1-4a75-91df-d7d526698a3b (non-flash)
May 28 01:08:07.265169 np0000001577 nova-compute[98319]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:07.265169 np0000001577 nova-compute[98319]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:07.265169 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:08:07.265391 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:07.265391 np0000001577 nova-compute[98319]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:07.265391 np0000001577 nova-compute[98319]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8fc8b77-a8f1-4a75-91df-d7d526698a3b (non-flash)
May 28 01:08:07.265391 np0000001577 nova-compute[98319]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:07.265391 np0000001577 nova-compute[98319]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:07.265391 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:08:07.304615 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858, portal: 192.168.40.100,3260]
May 28 01:08:07.304615 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858, portal: 192.168.40.100,3260] successful.
May 28 01:08:07.304615 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:07.315697 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858, portal: 192.168.50.100,3260]
May 28 01:08:07.315697 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858, portal: 192.168.50.100,3260] successful.
May 28 01:08:07.315697 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:07.324189 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:07.325228 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:07.330677 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:07.344761 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:07.344761 np0000001577 nova-compute[98319]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:07.344761 np0000001577 nova-compute[98319]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8fc8b77-a8f1-4a75-91df-d7d526698a3b (non-flash)
May 28 01:08:07.344761 np0000001577 nova-compute[98319]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:07.344761 np0000001577 nova-compute[98319]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:07.344761 np0000001577 nova-compute[98319]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:07.344761 np0000001577 nova-compute[98319]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:07.344761 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:08:07.345362 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:07.345362 np0000001577 nova-compute[98319]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:07.345362 np0000001577 nova-compute[98319]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8fc8b77-a8f1-4a75-91df-d7d526698a3b (non-flash)
May 28 01:08:07.345362 np0000001577 nova-compute[98319]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:07.345362 np0000001577 nova-compute[98319]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:07.345362 np0000001577 nova-compute[98319]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:07.345362 np0000001577 nova-compute[98319]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:07.345362 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:08:07.345362 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:08:07.345362 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:08:07.354083 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] HCTL ('12', '-', '-', 0) found on session 133 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:08:07.355990 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:08:07.357807 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:07.357807 np0000001577 nova-compute[98319]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:07.357807 np0000001577 nova-compute[98319]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8fc8b77-a8f1-4a75-91df-d7d526698a3b (non-flash)
May 28 01:08:07.357807 np0000001577 nova-compute[98319]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:07.357807 np0000001577 nova-compute[98319]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:07.357807 np0000001577 nova-compute[98319]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:07.357807 np0000001577 nova-compute[98319]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:07.357807 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:08:07.358574 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:07.358574 np0000001577 nova-compute[98319]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:07.358574 np0000001577 nova-compute[98319]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8fc8b77-a8f1-4a75-91df-d7d526698a3b (non-flash)
May 28 01:08:07.358574 np0000001577 nova-compute[98319]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:07.358574 np0000001577 nova-compute[98319]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:07.358574 np0000001577 nova-compute[98319]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:07.358574 np0000001577 nova-compute[98319]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:07.358574 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:08:07.359272 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.189s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:08:07.359397 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:08:07.360934 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] HCTL ('13', '-', '-', 0) found on session 134 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:08:07.361096 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:08:07.375246 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching for a device in session 133 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:08:07.375246 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '408b306f-e263-4cfa-a888-735b63628858', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:08:07.381635 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching for a device in session 134 and hctl ['13', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:08:07.386613 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-270b4fdb-21d4-467f-ae9e-49d709310c4a tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.372s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:07.686362 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0004000129997621116 future=<Future at 0x7c98704d1730 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:08:07.686976 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] Emitting event <LifecycleEvent: 1779930472.6858625, 5dafacc2-fb17-4781-8dda-8b9f21e57dee => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:08:07.687263 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] VM Stopped (Lifecycle Event)
May 28 01:08:07.688430 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:08:07.688864 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=1.1543778160003058 future=<Future at 0x7c984c5cabd0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:08:07.688864 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=1.1542734310000924 future=<Future at 0x7c984c5cabd0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:08:07.721502 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:08:07.859907 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lazy-loading 'flavor' on Instance uuid 1e7c5308-80cc-4991-8626-2ba32fa09acf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:08:08.192399 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-c0a41af7-b817-44b0-9f8a-15b9dd79602a tempest-VolumesActionsTest-955634415 tempest-VolumesActionsTest-955634415-project-member] [instance: 5dafacc2-fb17-4781-8dda-8b9f21e57dee] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:08:08.276742 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:08.277804 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:08.281473 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:08:08.281615 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Claim successful on node np0000001577
May 28 01:08:08.368766 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "refresh_cache-1e7c5308-80cc-4991-8626-2ba32fa09acf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:08:08.368766 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquired lock "refresh_cache-1e7c5308-80cc-4991-8626-2ba32fa09acf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:08:08.368766 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:08:08.368766 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lazy-loading 'info_cache' on Instance uuid 1e7c5308-80cc-4991-8626-2ba32fa09acf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:08:08.373578 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4f16012c-fc0c-479c-aebe-57d4fd611afa req-c9441894-8958-4305-9bc4-aa6e0d12e6bb service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Received event network-vif-unplugged-cc1de356-c44a-46bf-bb87-d123239afbe7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:08:08.374399 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4f16012c-fc0c-479c-aebe-57d4fd611afa req-c9441894-8958-4305-9bc4-aa6e0d12e6bb service nova] Acquiring lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:08.375067 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4f16012c-fc0c-479c-aebe-57d4fd611afa req-c9441894-8958-4305-9bc4-aa6e0d12e6bb service nova] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:08.375067 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4f16012c-fc0c-479c-aebe-57d4fd611afa req-c9441894-8958-4305-9bc4-aa6e0d12e6bb service nova] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:08.375067 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4f16012c-fc0c-479c-aebe-57d4fd611afa req-c9441894-8958-4305-9bc4-aa6e0d12e6bb service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] No waiting events found dispatching network-vif-unplugged-cc1de356-c44a-46bf-bb87-d123239afbe7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:08:08.375340 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-4f16012c-fc0c-479c-aebe-57d4fd611afa req-c9441894-8958-4305-9bc4-aa6e0d12e6bb service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Received unexpected event network-vif-unplugged-cc1de356-c44a-46bf-bb87-d123239afbe7 for instance with vm_state stopped and task_state powering-on.
May 28 01:08:08.381994 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching for a device in session 134 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:08:08.382317 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '408b306f-e263-4cfa-a888-735b63628858', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:08:08.845891 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0027288219998808927 future=<Future at 0x7c984c5cabd0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:08:08.845963 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:08:08.846046 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=12.521840369000074 future=<Future at 0x7c984c6b4560 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:08:08.846112 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=12.521770979999928 future=<Future at 0x7c984c6b4560 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:08:08.846628 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] Emitting event <LifecycleEvent: 1779930473.8430843, b1ae3969-7f8a-457a-aed8-539761a6d03e => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:08:08.847266 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] VM Stopped (Lifecycle Event)
May 28 01:08:08.871925 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Object Instance<1e7c5308-80cc-4991-8626-2ba32fa09acf> lazy-loaded attributes: flavor,info_cache {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:08:09.192946 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Found WWN 3300000005024929f for multipath device dm-2 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:08:09.193296 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:08:09.193326 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] <== connect_volume: return (4607ms) {'type': 'block', 'scsi_wwn': '3300000005024929f', 'path': '/dev/dm-2', 'multipath_id': '3300000005024929f'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:08:09.193453 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005024929f', 'path': '/dev/dm-2', 'multipath_id': '3300000005024929f'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:08:09.350967 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0cb69a5b-d6c5-43ec-b6b5-8068afaf91b8 tempest-ImageDependencyTests-312985465 tempest-ImageDependencyTests-312985465-project-member] [instance: b1ae3969-7f8a-457a-aed8-539761a6d03e] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:08:09.359612 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:09.374009 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:09.554498 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:08:09.554808 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:08:09.701069 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:07:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-813060794',display_name='tempest-TestVolumeBootPattern-server-813060794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpattern-server-813060794',id=56,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLDywRMt1gYjzqU0nLt38yv/dkf6iz5rhLwqujx5EHrUiUYa0LEwAEl6oAEMxfnED+yXkyyB7J9zFdusIexML2cYEzV2m5bo9N6+7QjUI/1FFtVJ+XDyI2kpbVbncy1iQ==',key_name='tempest-TestVolumeBootPattern-1635525277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='050f928f1ce449d6a447cd343dc4ff80',ramdisk_id='',reservation_id='r-ab975sup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1449742411',owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:08:02Z,user_data=None,user_id='0c803ddeaf4f4b3db07587419087b3b2',uuid=9e7ca386-dbea-461e-9cf2-7e135bd3758d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4138127d-166a-4844-b2a4-426d5014fc37", "address": "fa:16:3e:f1:a3:d9", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4138127d-16", "ovs_interfaceid": "4138127d-166a-4844-b2a4-426d5014fc37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:08:09.701295 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converting VIF {"id": "4138127d-166a-4844-b2a4-426d5014fc37", "address": "fa:16:3e:f1:a3:d9", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4138127d-16", "ovs_interfaceid": "4138127d-166a-4844-b2a4-426d5014fc37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:08:09.701782 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:a3:d9,bridge_name='br-int',has_traffic_filtering=True,id=4138127d-166a-4844-b2a4-426d5014fc37,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4138127d-16') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:08:09.710915 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e7ca386-dbea-461e-9cf2-7e135bd3758d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:08:09.790873 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:09.964937 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Updating instance_info_cache with network_info: [{"id": "cc1de356-c44a-46bf-bb87-d123239afbe7", "address": "fa:16:3e:05:9d:ed", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1de356-c4", "ovs_interfaceid": "cc1de356-c44a-46bf-bb87-d123239afbe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:08:10.057627 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:08:10.225774 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] End _get_guest_xml xml=<domain type="qemu">
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:   <uuid>9e7ca386-dbea-461e-9cf2-7e135bd3758d</uuid>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:   <name>instance-00000038</name>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestVolumeBootPattern-server-813060794</nova:name>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:08:04</nova:creationTime>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       <nova:image uuid="">
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:         <nova:user uuid="0c803ddeaf4f4b3db07587419087b3b2">tempest-TestVolumeBootPattern-1449742411-project-member</nova:user>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:         <nova:project uuid="050f928f1ce449d6a447cd343dc4ff80">tempest-TestVolumeBootPattern-1449742411</nova:project>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:         <nova:port uuid="4138127d-166a-4844-b2a4-426d5014fc37">
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:     <system>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       <entry name="serial">9e7ca386-dbea-461e-9cf2-7e135bd3758d</entry>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       <entry name="uuid">9e7ca386-dbea-461e-9cf2-7e135bd3758d</entry>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:     </system>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:   <os>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:   </os>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:   <features>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:   </features>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:   <devices>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/9e7ca386-dbea-461e-9cf2-7e135bd3758d/disk.config"/>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:     </disk>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       <alias name="ua-408b306f-e263-4cfa-a888-735b63628858"/>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-2"/>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       <serial>408b306f-e263-4cfa-a888-735b63628858</serial>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:     </disk>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:f1:a3:d9"/>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       <target dev="tap4138127d-16"/>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:     </interface>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/9e7ca386-dbea-461e-9cf2-7e135bd3758d/console.log" append="off"/>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:     </serial>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:     <video>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:     </video>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:     </rng>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:   </devices>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]: </domain>
May 28 01:08:10.225774 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:08:10.228081 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Preparing to wait for external event network-vif-plugged-4138127d-166a-4844-b2a4-426d5014fc37 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:08:10.228081 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "9e7ca386-dbea-461e-9cf2-7e135bd3758d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:10.228081 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "9e7ca386-dbea-461e-9cf2-7e135bd3758d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:10.228081 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "9e7ca386-dbea-461e-9cf2-7e135bd3758d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:10.230121 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:07:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-813060794',display_name='tempest-TestVolumeBootPattern-server-813060794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpattern-server-813060794',id=56,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLDywRMt1gYjzqU0nLt38yv/dkf6iz5rhLwqujx5EHrUiUYa0LEwAEl6oAEMxfnED+yXkyyB7J9zFdusIexML2cYEzV2m5bo9N6+7QjUI/1FFtVJ+XDyI2kpbVbncy1iQ==',key_name='tempest-TestVolumeBootPattern-1635525277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='050f928f1ce449d6a447cd343dc4ff80',ramdisk_id='',reservation_id='r-ab975sup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1449742411',owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:08:02Z,user_data=None,user_id='0c803ddeaf4f4b3db07587419087b3b2',uuid=9e7ca386-dbea-461e-9cf2-7e135bd3758d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4138127d-166a-4844-b2a4-426d5014fc37", "address": "fa:16:3e:f1:a3:d9", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4138127d-16", "ovs_interfaceid": "4138127d-166a-4844-b2a4-426d5014fc37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:08:10.230352 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converting VIF {"id": "4138127d-166a-4844-b2a4-426d5014fc37", "address": "fa:16:3e:f1:a3:d9", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4138127d-16", "ovs_interfaceid": "4138127d-166a-4844-b2a4-426d5014fc37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:08:10.231046 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:a3:d9,bridge_name='br-int',has_traffic_filtering=True,id=4138127d-166a-4844-b2a4-426d5014fc37,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4138127d-16') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:08:10.231389 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:a3:d9,bridge_name='br-int',has_traffic_filtering=True,id=4138127d-166a-4844-b2a4-426d5014fc37,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4138127d-16') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:08:10.232574 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:10.232574 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:08:10.233712 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:08:10.235563 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:10.236135 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ecb94467-9c96-5187-8921-9ceec53f313b', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:08:10.237469 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:10.237783 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:08:10.242897 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:10.245355 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:10.245630 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4138127d-16, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:08:10.246079 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4138127d-16, col_values=(('qos', UUID('47dafb9b-1ccf-4e00-88bf-97b786db0055')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:08:10.246324 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4138127d-16, col_values=(('external_ids', {'iface-id': '4138127d-166a-4844-b2a4-426d5014fc37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:a3:d9', 'vm-uuid': '9e7ca386-dbea-461e-9cf2-7e135bd3758d'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:08:10.247874 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:10.248637 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:08:10.259106 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:10.263036 np0000001577 nova-compute[98319]: INFO os_vif [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:a3:d9,bridge_name='br-int',has_traffic_filtering=True,id=4138127d-166a-4844-b2a4-426d5014fc37,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4138127d-16')
May 28 01:08:10.467770 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Releasing lock "refresh_cache-1e7c5308-80cc-4991-8626-2ba32fa09acf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:08:10.567477 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.290s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:10.568466 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:08:10.820084 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:11.075812 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:08:11.077354 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:08:11.080265 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:11.087644 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:11.229569 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf90ea61781a41ca91d0d5266f37cae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f132ca2a48c44f6097340763039224c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:08:11.469272 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:11.516454 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Instance destroyed successfully.
May 28 01:08:11.518028 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lazy-loading 'numa_topology' on Instance uuid 1e7c5308-80cc-4991-8626-2ba32fa09acf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:08:11.595629 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:08:11.814744 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:08:11.814904 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:08:11.815051 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] No VIF found with MAC fa:16:3e:f1:a3:d9, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:08:11.815562 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Using config drive
May 28 01:08:11.893170 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Successfully created port: 4e4212ac-6f4f-42f5-aae7-409c2ef76f02 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:08:12.020235 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Object Instance<1e7c5308-80cc-4991-8626-2ba32fa09acf> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:08:12.020482 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lazy-loading 'resources' on Instance uuid 1e7c5308-80cc-4991-8626-2ba32fa09acf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:08:12.099893 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:08:12.321058 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:12.476773 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Creating config drive at /opt/stack/data/nova/instances/9e7ca386-dbea-461e-9cf2-7e135bd3758d/disk.config
May 28 01:08:12.479674 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9e7ca386-dbea-461e-9cf2-7e135bd3758d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7srojzdm {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:12.523651 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Object Instance<1e7c5308-80cc-4991-8626-2ba32fa09acf> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:08:12.525833 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:07:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1575785918',display_name='tempest-AttachVolumeTestJSON-server-1575785918',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumetestjson-server-1575785918',id=54,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQqj5ulFm44LqcwStG35x3hx4kF2OHc+g0tTlOd4Z/Xec3CPwxGXUEAq08Fq2dSZhFKLMTCPF7EJ6q4KRfVK6ZgmNMJOJWZlgopXWPXQJWBjVOvQj1zQw9ZKwPgeXE7Hw==',key_name='tempest-keypair-749432862',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:07:15Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='23578125da1e4bf2bb3d59281a0e261e',ramdisk_id='',reservation_id='r-8bk45cr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1682604103',owner_user_name='tempest-AttachVolumeTestJSON-1682604103-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:08:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d68bbf62c74dd2bfe638f00ef6aa3d',uuid=1e7c5308-80cc-4991-8626-2ba32fa09acf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "cc1de356-c44a-46bf-bb87-d123239afbe7", "address": "fa:16:3e:05:9d:ed", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1de356-c4", "ovs_interfaceid": "cc1de356-c44a-46bf-bb87-d123239afbe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:08:12.525833 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Converting VIF {"id": "cc1de356-c44a-46bf-bb87-d123239afbe7", "address": "fa:16:3e:05:9d:ed", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1de356-c4", "ovs_interfaceid": "cc1de356-c44a-46bf-bb87-d123239afbe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:08:12.526379 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=cc1de356-c44a-46bf-bb87-d123239afbe7,network=Network(02f45984-182d-4648-ab01-d4773a271319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc1de356-c4') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:08:12.527151 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=cc1de356-c44a-46bf-bb87-d123239afbe7,network=Network(02f45984-182d-4648-ab01-d4773a271319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc1de356-c4') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:08:12.529186 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:12.529421 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc1de356-c4, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:08:12.534263 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9e7ca386-dbea-461e-9cf2-7e135bd3758d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7srojzdm" returned: 0 in 0.054s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:08:12.544384 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:12.544384 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:08:12.558986 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:12.562645 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:12.562645 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5afbd613-f3bb-46db-bbdd-7822551797d0) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:08:12.562645 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:12.562645 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:08:12.566090 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:12.568240 np0000001577 nova-compute[98319]: INFO os_vif [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=cc1de356-c44a-46bf-bb87-d123239afbe7,network=Network(02f45984-182d-4648-ab01-d4773a271319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc1de356-c4')
May 28 01:08:12.570331 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:08:12.570907 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67905ec9-510f-4af0-85fe-adc6bcc8505f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:08:12.571283 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:08:12.571916 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:08:12.572386 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67905ec9-510f-4af0-85fe-adc6bcc8505f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:08:12.572853 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:08:12.612628 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:12.612628 np0000001577 nova-compute[98319]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:12.612628 np0000001577 nova-compute[98319]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8fc8b77-a8f1-4a75-91df-d7d526698a3b (non-flash)
May 28 01:08:12.612628 np0000001577 nova-compute[98319]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:12.612628 np0000001577 nova-compute[98319]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:12.612628 np0000001577 nova-compute[98319]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:12.612628 np0000001577 nova-compute[98319]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:12.612628 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:08:12.612628 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsi session list stdout=tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:12.612628 np0000001577 nova-compute[98319]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:12.612628 np0000001577 nova-compute[98319]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8fc8b77-a8f1-4a75-91df-d7d526698a3b (non-flash)
May 28 01:08:12.612628 np0000001577 nova-compute[98319]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:12.612628 np0000001577 nova-compute[98319]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:12.612628 np0000001577 nova-compute[98319]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:12.612628 np0000001577 nova-compute[98319]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:12.612628 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:08:12.612628 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', '128'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', '129'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8fc8b77-a8f1-4a75-91df-d7d526698a3b', '130'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', '131'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', '132'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', '133'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', '134')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:08:12.612628 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', '128')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:08:12.613181 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', '129')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:08:12.616908 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c98704647c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f'): ({'sdc'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:08:12.618350 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:08:12.618350 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Flush multipath device 330000000405a0c5e {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:08:12.653978 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:08:12.674845 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Successfully updated port: 4e4212ac-6f4f-42f5-aae7-409c2ef76f02 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:08:12.710139 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:08:12.732502 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e40d7ce4-c612-45d2-9f98-4921d5ce8f67 req-0d4c54b4-8680-456b-9293-13911ccbba33 service nova] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Received event network-changed-4e4212ac-6f4f-42f5-aae7-409c2ef76f02 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:08:12.732831 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e40d7ce4-c612-45d2-9f98-4921d5ce8f67 req-0d4c54b4-8680-456b-9293-13911ccbba33 service nova] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Refreshing instance network info cache due to event network-changed-4e4212ac-6f4f-42f5-aae7-409c2ef76f02. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:08:12.733011 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e40d7ce4-c612-45d2-9f98-4921d5ce8f67 req-0d4c54b4-8680-456b-9293-13911ccbba33 service nova] Acquiring lock "refresh_cache-d5e4832e-32b9-44a7-92b8-6fa82e642515" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:08:12.733104 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e40d7ce4-c612-45d2-9f98-4921d5ce8f67 req-0d4c54b4-8680-456b-9293-13911ccbba33 service nova] Acquired lock "refresh_cache-d5e4832e-32b9-44a7-92b8-6fa82e642515" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:08:12.733246 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-e40d7ce4-c612-45d2-9f98-4921d5ce8f67 req-0d4c54b4-8680-456b-9293-13911ccbba33 service nova] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Refreshing network info cache for port 4e4212ac-6f4f-42f5-aae7-409c2ef76f02 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:08:12.762005 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:08:12.762312 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:08:12.763769 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:08:12.777433 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:08:12.777433 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:08:12.789486 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:12.828642 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 128, target: iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f, portal: 192.168.40.100,3260]
May 28 01:08:12.828642 np0000001577 nova-compute[98319]: Logout of [sid: 128, target: iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f, portal: 192.168.40.100,3260] successful.
May 28 01:08:12.828642 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:12.845902 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:12.858043 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:12.894169 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 129, target: iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f, portal: 192.168.50.100,3260]
May 28 01:08:12.894169 np0000001577 nova-compute[98319]: Logout of [sid: 129, target: iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f, portal: 192.168.50.100,3260] successful.
May 28 01:08:12.894169 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:12.910088 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:12.910274 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:08:12.910625 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] <== disconnect_volume: return (339ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:08:12.910920 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:08:12.917991 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Start _get_guest_xml network_info=[{"id": "cc1de356-c44a-46bf-bb87-d123239afbe7", "address": "fa:16:3e:05:9d:ed", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1de356-c4", "ovs_interfaceid": "cc1de356-c44a-46bf-bb87-d123239afbe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67905ec9-510f-4af0-85fe-adc6bcc8505f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, 'status': 'reserved', 'instance': '1e7c5308-80cc-4991-8626-2ba32fa09acf', 'attached_at': '', 'detached_at': '', 'volume_id': '67905ec9-510f-4af0-85fe-adc6bcc8505f', 'serial': '67905ec9-510f-4af0-85fe-adc6bcc8505f'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'f9edfbbe-9f96-4f12-9b27-4267c09f92b3', 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:08:12.926850 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:08:12.928261 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-1575785918', uuid='1e7c5308-80cc-4991-8626-2ba32fa09acf'), owner=OwnerMeta(userid='60d68bbf62c74dd2bfe638f00ef6aa3d', username='tempest-AttachVolumeTestJSON-1682604103-project-member', projectid='23578125da1e4bf2bb3d59281a0e261e', projectname='tempest-AttachVolumeTestJSON-1682604103'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cc1de356-c44a-46bf-bb87-d123239afbe7", "address": "fa:16:3e:05:9d:ed", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1de356-c4", "ovs_interfaceid": "cc1de356-c44a-46bf-bb87-d123239afbe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930492.9276223) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:08:12.933561 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:08:12.933762 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:08:12.938389 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:08:12.938389 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:08:12.938389 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:08:12.938389 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:08:12.938389 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:08:12.938389 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:08:12.938389 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:08:12.938389 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:08:12.938389 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:08:12.938389 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:08:12.938389 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:08:12.938389 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:08:12.938389 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:08:12.938389 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:08:12.938389 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1e7c5308-80cc-4991-8626-2ba32fa09acf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:08:12.984794 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:13.015299 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:13.104581 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:13.115047 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:08:13.116169 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:08:13.116402 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Creating image(s)
May 28 01:08:13.116997 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5e4832e-32b9-44a7-92b8-6fa82e642515/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:13.121630 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "/opt/stack/data/nova/instances/d5e4832e-32b9-44a7-92b8-6fa82e642515/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:13.123560 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "/opt/stack/data/nova/instances/d5e4832e-32b9-44a7-92b8-6fa82e642515/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:13.123560 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:08:13.126775 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:08:13.128139 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:13.180039 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "refresh_cache-d5e4832e-32b9-44a7-92b8-6fa82e642515" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:08:13.217840 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:08:13.218453 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:13.219061 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:13.219633 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:08:13.223343 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:08:13.223689 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:13.246115 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-e40d7ce4-c612-45d2-9f98-4921d5ce8f67 req-0d4c54b4-8680-456b-9293-13911ccbba33 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:13.310479 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:13.322261 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.098s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:08:13.323661 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/d5e4832e-32b9-44a7-92b8-6fa82e642515/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:13.376056 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-e40d7ce4-c612-45d2-9f98-4921d5ce8f67 req-0d4c54b4-8680-456b-9293-13911ccbba33 service nova] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:08:13.385841 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:13.390428 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/d5e4832e-32b9-44a7-92b8-6fa82e642515/disk 1073741824" returned: 0 in 0.066s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:08:13.390711 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.172s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:13.393937 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:13.393937 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:13.430656 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:13.489631 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Object Instance<1e7c5308-80cc-4991-8626-2ba32fa09acf> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:08:13.501146 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.108s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:08:13.502861 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5e4832e-32b9-44a7-92b8-6fa82e642515/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:08:13.503659 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e4832e-32b9-44a7-92b8-6fa82e642515/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:13.505954 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk.config --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:13.613895 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e4832e-32b9-44a7-92b8-6fa82e642515/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:08:13.615166 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Cannot resize image /opt/stack/data/nova/instances/d5e4832e-32b9-44a7-92b8-6fa82e642515/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:08:13.617425 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:08:13.617818 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Ensure instance console log exists: /opt/stack/data/nova/instances/d5e4832e-32b9-44a7-92b8-6fa82e642515/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:08:13.618849 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:13.618849 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:13.618971 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:13.626115 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk.config --force-share --output=json" returned: 0 in 0.120s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:08:13.626848 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:13.627105 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "/opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:13.629258 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "/opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:13.631417 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:08:13.631927 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67905ec9-510f-4af0-85fe-adc6bcc8505f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:08:13.632946 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:08:13.639961 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-e40d7ce4-c612-45d2-9f98-4921d5ce8f67 req-0d4c54b4-8680-456b-9293-13911ccbba33 service nova] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:08:13.892695 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930493.892311, 9e7ca386-dbea-461e-9cf2-7e135bd3758d => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:08:13.892864 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] VM Started (Lifecycle Event)
May 28 01:08:14.144862 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e40d7ce4-c612-45d2-9f98-4921d5ce8f67 req-0d4c54b4-8680-456b-9293-13911ccbba33 service nova] Releasing lock "refresh_cache-d5e4832e-32b9-44a7-92b8-6fa82e642515" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:08:14.145785 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquired lock "refresh_cache-d5e4832e-32b9-44a7-92b8-6fa82e642515" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:08:14.145942 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:08:14.395372 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:08:14.402958 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930494.4026442, 9e7ca386-dbea-461e-9cf2-7e135bd3758d => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:08:14.403171 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] VM Paused (Lifecycle Event)
May 28 01:08:14.714285 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:08:14.850042 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-89f4e4b4-e113-4e98-a2c8-29664ae08921 req-4f306683-a215-47bb-b654-c5f744cb377a service nova] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Received event network-vif-plugged-4138127d-166a-4844-b2a4-426d5014fc37 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:08:14.850315 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-89f4e4b4-e113-4e98-a2c8-29664ae08921 req-4f306683-a215-47bb-b654-c5f744cb377a service nova] Acquiring lock "9e7ca386-dbea-461e-9cf2-7e135bd3758d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:14.850517 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-89f4e4b4-e113-4e98-a2c8-29664ae08921 req-4f306683-a215-47bb-b654-c5f744cb377a service nova] Lock "9e7ca386-dbea-461e-9cf2-7e135bd3758d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:14.852445 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-89f4e4b4-e113-4e98-a2c8-29664ae08921 req-4f306683-a215-47bb-b654-c5f744cb377a service nova] Lock "9e7ca386-dbea-461e-9cf2-7e135bd3758d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:14.852670 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-89f4e4b4-e113-4e98-a2c8-29664ae08921 req-4f306683-a215-47bb-b654-c5f744cb377a service nova] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Processing event network-vif-plugged-4138127d-166a-4844-b2a4-426d5014fc37 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:08:14.853217 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-89f4e4b4-e113-4e98-a2c8-29664ae08921 req-4f306683-a215-47bb-b654-c5f744cb377a service nova] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Received event network-vif-plugged-4138127d-166a-4844-b2a4-426d5014fc37 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:08:14.853217 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-89f4e4b4-e113-4e98-a2c8-29664ae08921 req-4f306683-a215-47bb-b654-c5f744cb377a service nova] Acquiring lock "9e7ca386-dbea-461e-9cf2-7e135bd3758d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:14.853217 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-89f4e4b4-e113-4e98-a2c8-29664ae08921 req-4f306683-a215-47bb-b654-c5f744cb377a service nova] Lock "9e7ca386-dbea-461e-9cf2-7e135bd3758d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:14.853300 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-89f4e4b4-e113-4e98-a2c8-29664ae08921 req-4f306683-a215-47bb-b654-c5f744cb377a service nova] Lock "9e7ca386-dbea-461e-9cf2-7e135bd3758d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:14.853442 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-89f4e4b4-e113-4e98-a2c8-29664ae08921 req-4f306683-a215-47bb-b654-c5f744cb377a service nova] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] No waiting events found dispatching network-vif-plugged-4138127d-166a-4844-b2a4-426d5014fc37 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:08:14.853570 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-89f4e4b4-e113-4e98-a2c8-29664ae08921 req-4f306683-a215-47bb-b654-c5f744cb377a service nova] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Received unexpected event network-vif-plugged-4138127d-166a-4844-b2a4-426d5014fc37 for instance with vm_state building and task_state spawning.
May 28 01:08:14.855458 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:08:14.861075 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:08:14.866153 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Instance spawned successfully.
May 28 01:08:14.867636 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:08:14.909482 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:08:14.911536 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930494.911235, 9e7ca386-dbea-461e-9cf2-7e135bd3758d => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:08:14.911714 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] VM Resumed (Lifecycle Event)
May 28 01:08:14.918713 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:15.075094 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Updating instance_info_cache with network_info: [{"id": "4e4212ac-6f4f-42f5-aae7-409c2ef76f02", "address": "fa:16:3e:55:fb:7f", "network": {"id": "c24d30f5-c7e1-4457-bdc3-ef51ebdf3991", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-116184687-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f132ca2a48c44f6097340763039224c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4212ac-6f", "ovs_interfaceid": "4e4212ac-6f4f-42f5-aae7-409c2ef76f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:08:15.378981 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:08:15.379132 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:08:15.379515 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:08:15.380101 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:08:15.380445 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:08:15.380720 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:08:15.417003 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:08:15.418716 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:08:15.577433 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Releasing lock "refresh_cache-d5e4832e-32b9-44a7-92b8-6fa82e642515" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:08:15.577785 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Instance network_info: |[{"id": "4e4212ac-6f4f-42f5-aae7-409c2ef76f02", "address": "fa:16:3e:55:fb:7f", "network": {"id": "c24d30f5-c7e1-4457-bdc3-ef51ebdf3991", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-116184687-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f132ca2a48c44f6097340763039224c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4212ac-6f", "ovs_interfaceid": "4e4212ac-6f4f-42f5-aae7-409c2ef76f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:08:15.580258 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Start _get_guest_xml network_info=[{"id": "4e4212ac-6f4f-42f5-aae7-409c2ef76f02", "address": "fa:16:3e:55:fb:7f", "network": {"id": "c24d30f5-c7e1-4457-bdc3-ef51ebdf3991", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-116184687-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f132ca2a48c44f6097340763039224c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4212ac-6f", "ovs_interfaceid": "4e4212ac-6f4f-42f5-aae7-409c2ef76f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:08:15.585251 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:08:15.586514 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-144048780', uuid='d5e4832e-32b9-44a7-92b8-6fa82e642515'), owner=OwnerMeta(userid='bf90ea61781a41ca91d0d5266f37cae4', username='tempest-VolumesSnapshotTestJSON-1352681167-project-member', projectid='f132ca2a48c44f6097340763039224c1', projectname='tempest-VolumesSnapshotTestJSON-1352681167'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4e4212ac-6f4f-42f5-aae7-409c2ef76f02", "address": "fa:16:3e:55:fb:7f", "network": {"id": "c24d30f5-c7e1-4457-bdc3-ef51ebdf3991", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-116184687-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f132ca2a48c44f6097340763039224c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4212ac-6f", "ovs_interfaceid": "4e4212ac-6f4f-42f5-aae7-409c2ef76f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930495.5860999) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:08:15.587602 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:08:15.587918 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:08:15.589081 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:08:15.589265 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:08:15.590878 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:08:15.593312 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:08:15.593471 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:08:15.593569 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:08:15.593693 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:08:15.593768 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:08:15.593865 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:08:15.594052 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:08:15.594153 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:08:15.594280 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:08:15.594385 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:08:15.594576 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:08:15.611157 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-144048780',display_name='tempest-VolumesSnapshotTestJSON-instance-144048780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumessnapshottestjson-instance-144048780',id=57,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/JAIBcLZ1O7ipAtDDV8VvEpLMfzMS0x6gK0sK235y7mpOg7VOEi2sGuvoK6ssr01zPu8nitJ5XVN58flFTMPT9EkUGGeoLN6edRNO+ivd0a2004wHoT84Fy5b1Tjiexw==',key_name='tempest-keypair-377288747',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f132ca2a48c44f6097340763039224c1',ramdisk_id='',reservation_id='r-jpdih90k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1352681167',owner_user_name='tempest-VolumesSnapshotTestJSON-1352681167-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:08:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf90ea61781a41ca91d0d5266f37cae4',uuid=d5e4832e-32b9-44a7-92b8-6fa82e642515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e4212ac-6f4f-42f5-aae7-409c2ef76f02", "address": "fa:16:3e:55:fb:7f", "network": {"id": "c24d30f5-c7e1-4457-bdc3-ef51ebdf3991", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-116184687-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f132ca2a48c44f6097340763039224c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4212ac-6f", "ovs_interfaceid": "4e4212ac-6f4f-42f5-aae7-409c2ef76f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:08:15.611393 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Converting VIF {"id": "4e4212ac-6f4f-42f5-aae7-409c2ef76f02", "address": "fa:16:3e:55:fb:7f", "network": {"id": "c24d30f5-c7e1-4457-bdc3-ef51ebdf3991", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-116184687-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f132ca2a48c44f6097340763039224c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4212ac-6f", "ovs_interfaceid": "4e4212ac-6f4f-42f5-aae7-409c2ef76f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:08:15.614985 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:fb:7f,bridge_name='br-int',has_traffic_filtering=True,id=4e4212ac-6f4f-42f5-aae7-409c2ef76f02,network=Network(c24d30f5-c7e1-4457-bdc3-ef51ebdf3991),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4212ac-6f') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:08:15.615594 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lazy-loading 'pci_devices' on Instance uuid d5e4832e-32b9-44a7-92b8-6fa82e642515 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:08:15.692249 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.060s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:08:15.692249 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67905ec9-510f-4af0-85fe-adc6bcc8505f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:08:15.704706 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:08:15.705661 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:08:15.705998 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:08:15.706641 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:08:15.706738 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:08:15.707905 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:08:15.720427 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:08:15.720427 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:15.730691 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:08:15.730691 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:15.741441 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f] added
May 28 01:08:15.741441 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:08:15.741441 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:08:15.741441 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:08:15.741441 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:08:15.741441 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:08:15.741441 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:15.741441 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:08:15.741441 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0349(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:08:15.741441 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:08:15.743333 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f] added
May 28 01:08:15.743333 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:08:15.743333 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:08:15.743333 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:08:15.743333 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:08:15.743333 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:08:15.743333 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:15.743504 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:08:15.743684 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.037(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:08:15.743810 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:08:15.888561 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Took 11.33 seconds to spawn the instance on the hypervisor.
May 28 01:08:15.888561 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:08:15.921145 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:08:16.003912 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors.luks [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] opening encrypted volume /dev/dm-1 {{(pid=98319) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 28 01:08:16.120755 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] End _get_guest_xml xml=<domain type="qemu">
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:   <uuid>d5e4832e-32b9-44a7-92b8-6fa82e642515</uuid>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:   <name>instance-00000039</name>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-144048780</nova:name>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:08:15</nova:creationTime>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:         <nova:user uuid="bf90ea61781a41ca91d0d5266f37cae4">tempest-VolumesSnapshotTestJSON-1352681167-project-member</nova:user>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:         <nova:project uuid="f132ca2a48c44f6097340763039224c1">tempest-VolumesSnapshotTestJSON-1352681167</nova:project>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:         <nova:port uuid="4e4212ac-6f4f-42f5-aae7-409c2ef76f02">
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:     <system>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       <entry name="serial">d5e4832e-32b9-44a7-92b8-6fa82e642515</entry>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       <entry name="uuid">d5e4832e-32b9-44a7-92b8-6fa82e642515</entry>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:     </system>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:   <os>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:   </os>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:   <features>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:   </features>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:   <devices>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/d5e4832e-32b9-44a7-92b8-6fa82e642515/disk"/>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:     </disk>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/d5e4832e-32b9-44a7-92b8-6fa82e642515/disk.config"/>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:     </disk>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:55:fb:7f"/>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       <target dev="tap4e4212ac-6f"/>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:     </interface>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/d5e4832e-32b9-44a7-92b8-6fa82e642515/console.log" append="off"/>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:     </serial>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:     <video>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:     </video>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:     </rng>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:   </devices>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]: </domain>
May 28 01:08:16.120755 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:08:16.122599 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Preparing to wait for external event network-vif-plugged-4e4212ac-6f4f-42f5-aae7-409c2ef76f02 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:08:16.122599 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "d5e4832e-32b9-44a7-92b8-6fa82e642515-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:16.122599 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "d5e4832e-32b9-44a7-92b8-6fa82e642515-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:16.122599 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "d5e4832e-32b9-44a7-92b8-6fa82e642515-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:16.122599 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-144048780',display_name='tempest-VolumesSnapshotTestJSON-instance-144048780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumessnapshottestjson-instance-144048780',id=57,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/JAIBcLZ1O7ipAtDDV8VvEpLMfzMS0x6gK0sK235y7mpOg7VOEi2sGuvoK6ssr01zPu8nitJ5XVN58flFTMPT9EkUGGeoLN6edRNO+ivd0a2004wHoT84Fy5b1Tjiexw==',key_name='tempest-keypair-377288747',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f132ca2a48c44f6097340763039224c1',ramdisk_id='',reservation_id='r-jpdih90k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1352681167',owner_user_name='tempest-VolumesSnapshotTestJSON-1352681167-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:08:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf90ea61781a41ca91d0d5266f37cae4',uuid=d5e4832e-32b9-44a7-92b8-6fa82e642515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e4212ac-6f4f-42f5-aae7-409c2ef76f02", "address": "fa:16:3e:55:fb:7f", "network": {"id": "c24d30f5-c7e1-4457-bdc3-ef51ebdf3991", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-116184687-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f132ca2a48c44f6097340763039224c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4212ac-6f", "ovs_interfaceid": "4e4212ac-6f4f-42f5-aae7-409c2ef76f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:08:16.122599 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Converting VIF {"id": "4e4212ac-6f4f-42f5-aae7-409c2ef76f02", "address": "fa:16:3e:55:fb:7f", "network": {"id": "c24d30f5-c7e1-4457-bdc3-ef51ebdf3991", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-116184687-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f132ca2a48c44f6097340763039224c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4212ac-6f", "ovs_interfaceid": "4e4212ac-6f4f-42f5-aae7-409c2ef76f02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:08:16.122599 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:fb:7f,bridge_name='br-int',has_traffic_filtering=True,id=4e4212ac-6f4f-42f5-aae7-409c2ef76f02,network=Network(c24d30f5-c7e1-4457-bdc3-ef51ebdf3991),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4212ac-6f') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:08:16.122599 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:fb:7f,bridge_name='br-int',has_traffic_filtering=True,id=4e4212ac-6f4f-42f5-aae7-409c2ef76f02,network=Network(c24d30f5-c7e1-4457-bdc3-ef51ebdf3991),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4212ac-6f') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:08:16.132978 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:16.132978 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:08:16.132978 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:08:16.133881 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:16.133881 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '08a3a4a6-fbb3-5983-b193-141feaf831c3', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:08:16.147802 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:16.152862 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:08:16.156967 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:16.157178 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e4212ac-6f, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:08:16.157588 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e4212ac-6f, col_values=(('qos', UUID('3cf5bc0b-9d3f-4fb3-b355-c77faaa286f4')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:08:16.157754 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e4212ac-6f, col_values=(('external_ids', {'iface-id': '4e4212ac-6f4f-42f5-aae7-409c2ef76f02', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:fb:7f', 'vm-uuid': 'd5e4832e-32b9-44a7-92b8-6fa82e642515'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:08:16.159040 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:16.160901 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:08:16.166163 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:16.167253 np0000001577 nova-compute[98319]: INFO os_vif [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:fb:7f,bridge_name='br-int',has_traffic_filtering=True,id=4e4212ac-6f4f-42f5-aae7-409c2ef76f02,network=Network(c24d30f5-c7e1-4457-bdc3-ef51ebdf3991),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4212ac-6f')
May 28 01:08:16.407054 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Took 19.24 seconds to build instance.
May 28 01:08:16.470795 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:16.742868 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:08:16.744578 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:08:16.756120 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:08:16.756120 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:08:16.762365 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:08:16.762365 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:16.772471 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:16.778381 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:16.793266 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8fc8b77-a8f1-4a75-91df-d7d526698a3b (non-flash)
May 28 01:08:16.793266 np0000001577 nova-compute[98319]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:16.793266 np0000001577 nova-compute[98319]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:16.793266 np0000001577 nova-compute[98319]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:16.793266 np0000001577 nova-compute[98319]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:16.793266 np0000001577 nova-compute[98319]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c4f63605-7019-4aea-8877-95ceaff7136c (non-flash)
May 28 01:08:16.793266 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:08:16.793495 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsi session list stdout=tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8fc8b77-a8f1-4a75-91df-d7d526698a3b (non-flash)
May 28 01:08:16.793495 np0000001577 nova-compute[98319]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:16.793495 np0000001577 nova-compute[98319]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:16.793495 np0000001577 nova-compute[98319]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:16.793495 np0000001577 nova-compute[98319]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:16.793495 np0000001577 nova-compute[98319]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c4f63605-7019-4aea-8877-95ceaff7136c (non-flash)
May 28 01:08:16.793495 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:08:16.802567 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8fc8b77-a8f1-4a75-91df-d7d526698a3b (non-flash)
May 28 01:08:16.802567 np0000001577 nova-compute[98319]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:16.802567 np0000001577 nova-compute[98319]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:16.802567 np0000001577 nova-compute[98319]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:16.802567 np0000001577 nova-compute[98319]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:16.802567 np0000001577 nova-compute[98319]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c4f63605-7019-4aea-8877-95ceaff7136c (non-flash)
May 28 01:08:16.802567 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:08:16.802567 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsi session list stdout=tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8fc8b77-a8f1-4a75-91df-d7d526698a3b (non-flash)
May 28 01:08:16.802567 np0000001577 nova-compute[98319]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:16.802567 np0000001577 nova-compute[98319]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:16.802567 np0000001577 nova-compute[98319]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:16.802567 np0000001577 nova-compute[98319]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:16.802567 np0000001577 nova-compute[98319]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c4f63605-7019-4aea-8877-95ceaff7136c (non-flash)
May 28 01:08:16.802567 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:08:16.847507 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f, portal: 192.168.40.100,3260]
May 28 01:08:16.847507 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f, portal: 192.168.40.100,3260] successful.
May 28 01:08:16.847507 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:16.855571 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f, portal: 192.168.50.100,3260]
May 28 01:08:16.855571 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f, portal: 192.168.50.100,3260] successful.
May 28 01:08:16.855571 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:16.862051 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:16.868741 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:16.886977 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8fc8b77-a8f1-4a75-91df-d7d526698a3b (non-flash)
May 28 01:08:16.886977 np0000001577 nova-compute[98319]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:16.886977 np0000001577 nova-compute[98319]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:16.886977 np0000001577 nova-compute[98319]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:16.886977 np0000001577 nova-compute[98319]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:16.886977 np0000001577 nova-compute[98319]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c4f63605-7019-4aea-8877-95ceaff7136c (non-flash)
May 28 01:08:16.886977 np0000001577 nova-compute[98319]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:16.886977 np0000001577 nova-compute[98319]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:16.886977 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:08:16.886977 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsi session list stdout=tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8fc8b77-a8f1-4a75-91df-d7d526698a3b (non-flash)
May 28 01:08:16.886977 np0000001577 nova-compute[98319]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:16.886977 np0000001577 nova-compute[98319]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:16.886977 np0000001577 nova-compute[98319]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:16.886977 np0000001577 nova-compute[98319]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:16.886977 np0000001577 nova-compute[98319]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c4f63605-7019-4aea-8877-95ceaff7136c (non-flash)
May 28 01:08:16.886977 np0000001577 nova-compute[98319]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:16.886977 np0000001577 nova-compute[98319]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:16.886977 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:08:16.890887 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "4d7b37c7-b091-44f7-a330-4e55e2b1e348" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:16.891650 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:08:16.892117 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:08:16.892456 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "4d7b37c7-b091-44f7-a330-4e55e2b1e348" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:16.894583 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] HCTL ('8', '-', '-', 0) found on session 136 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:08:16.896012 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:08:16.913298 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8fc8b77-a8f1-4a75-91df-d7d526698a3b (non-flash)
May 28 01:08:16.913298 np0000001577 nova-compute[98319]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:16.913298 np0000001577 nova-compute[98319]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:16.913298 np0000001577 nova-compute[98319]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:16.913298 np0000001577 nova-compute[98319]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:16.913298 np0000001577 nova-compute[98319]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c4f63605-7019-4aea-8877-95ceaff7136c (non-flash)
May 28 01:08:16.913298 np0000001577 nova-compute[98319]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:16.913298 np0000001577 nova-compute[98319]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:16.913298 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:08:16.913857 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "9e7ca386-dbea-461e-9cf2-7e135bd3758d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.753s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:16.914098 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsi session list stdout=tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8fc8b77-a8f1-4a75-91df-d7d526698a3b (non-flash)
May 28 01:08:16.914098 np0000001577 nova-compute[98319]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:16.914098 np0000001577 nova-compute[98319]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:16.914098 np0000001577 nova-compute[98319]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:16.914098 np0000001577 nova-compute[98319]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:16.914098 np0000001577 nova-compute[98319]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c4f63605-7019-4aea-8877-95ceaff7136c (non-flash)
May 28 01:08:16.914098 np0000001577 nova-compute[98319]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:16.914098 np0000001577 nova-compute[98319]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:16.914098 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:08:16.914463 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.208s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:08:16.920778 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:08:16.920778 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] HCTL ('14', '-', '-', 0) found on session 137 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:08:16.920778 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:08:16.924396 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Searching for a device in session 136 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:08:16.924761 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67905ec9-510f-4af0-85fe-adc6bcc8505f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:08:16.945905 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Searching for a device in session 137 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:08:16.945905 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '67905ec9-510f-4af0-85fe-adc6bcc8505f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:08:17.395180 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:08:17.700619 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:08:17.700619 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:08:17.700619 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] No VIF found with MAC fa:16:3e:55:fb:7f, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:08:17.700619 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Using config drive
May 28 01:08:17.707998 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:08:17.875873 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-339ab1e4-bced-45b0-bc56-ed45dbdfd395 req-40f880d9-1ae1-4f47-a281-955c1466e685 service nova] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Received event network-changed-4138127d-166a-4844-b2a4-426d5014fc37 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:08:17.875995 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-339ab1e4-bced-45b0-bc56-ed45dbdfd395 req-40f880d9-1ae1-4f47-a281-955c1466e685 service nova] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Refreshing instance network info cache due to event network-changed-4138127d-166a-4844-b2a4-426d5014fc37. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:08:17.876136 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-339ab1e4-bced-45b0-bc56-ed45dbdfd395 req-40f880d9-1ae1-4f47-a281-955c1466e685 service nova] Acquiring lock "refresh_cache-9e7ca386-dbea-461e-9cf2-7e135bd3758d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:08:17.876237 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-339ab1e4-bced-45b0-bc56-ed45dbdfd395 req-40f880d9-1ae1-4f47-a281-955c1466e685 service nova] Acquired lock "refresh_cache-9e7ca386-dbea-461e-9cf2-7e135bd3758d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:08:17.876334 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-339ab1e4-bced-45b0-bc56-ed45dbdfd395 req-40f880d9-1ae1-4f47-a281-955c1466e685 service nova] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Refreshing network info cache for port 4138127d-166a-4844-b2a4-426d5014fc37 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:08:17.944656 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:17.944815 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:17.947625 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:08:17.947747 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Claim successful on node np0000001577
May 28 01:08:18.206924 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:18.307338 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Creating config drive at /opt/stack/data/nova/instances/d5e4832e-32b9-44a7-92b8-6fa82e642515/disk.config
May 28 01:08:18.311046 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d5e4832e-32b9-44a7-92b8-6fa82e642515/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplu3e369n {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:18.367046 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d5e4832e-32b9-44a7-92b8-6fa82e642515/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplu3e369n" returned: 0 in 0.056s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:08:18.381510 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-339ab1e4-bced-45b0-bc56-ed45dbdfd395 req-40f880d9-1ae1-4f47-a281-955c1466e685 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:18.400236 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lazy-loading 'flavor' on Instance uuid 48bfd06f-62f4-4691-bf98-2426e359a90e {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:08:18.724605 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Found WWN 330000000405a0c5e for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:08:18.724992 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:08:18.725100 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] <== connect_volume: return (5093ms) {'type': 'block', 'scsi_wwn': '330000000405a0c5e', 'path': '/dev/dm-0', 'multipath_id': '330000000405a0c5e'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:08:18.725240 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000405a0c5e', 'path': '/dev/dm-0', 'multipath_id': '330000000405a0c5e'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:08:18.771272 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-339ab1e4-bced-45b0-bc56-ed45dbdfd395 req-40f880d9-1ae1-4f47-a281-955c1466e685 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:18.826437 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:18.851388 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:18.903905 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Attempting to attach volume 46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:08:18.910002 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:08:18.910002 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:08:18.910002 np0000001577 nova-compute[98319]:   <alias name="ua-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3"/>
May 28 01:08:18.910002 np0000001577 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 28 01:08:18.910002 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:08:18.910002 np0000001577 nova-compute[98319]:   <serial>46a8593c-4b06-4b04-a8a1-ccc55cdf51e3</serial>
May 28 01:08:18.910002 np0000001577 nova-compute[98319]: </disk>
May 28 01:08:18.910002 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:08:18.949472 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:18.970760 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-339ab1e4-bced-45b0-bc56-ed45dbdfd395 req-40f880d9-1ae1-4f47-a281-955c1466e685 service nova] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Updated VIF entry in instance network info cache for port 4138127d-166a-4844-b2a4-426d5014fc37. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:08:18.970913 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-339ab1e4-bced-45b0-bc56-ed45dbdfd395 req-40f880d9-1ae1-4f47-a281-955c1466e685 service nova] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Updating instance_info_cache with network_info: [{"id": "4138127d-166a-4844-b2a4-426d5014fc37", "address": "fa:16:3e:f1:a3:d9", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4138127d-16", "ovs_interfaceid": "4138127d-166a-4844-b2a4-426d5014fc37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:08:19.224294 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:19.225974 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:19.228495 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:19.233002 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:07:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1575785918',display_name='tempest-AttachVolumeTestJSON-server-1575785918',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumetestjson-server-1575785918',id=54,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQqj5ulFm44LqcwStG35x3hx4kF2OHc+g0tTlOd4Z/Xec3CPwxGXUEAq08Fq2dSZhFKLMTCPF7EJ6q4KRfVK6ZgmNMJOJWZlgopXWPXQJWBjVOvQj1zQw9ZKwPgeXE7Hw==',key_name='tempest-keypair-749432862',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:07:15Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='23578125da1e4bf2bb3d59281a0e261e',ramdisk_id='',reservation_id='r-8bk45cr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1682604103',owner_user_name='tempest-AttachVolumeTestJSON-1682604103-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:08:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d68bbf62c74dd2bfe638f00ef6aa3d',uuid=1e7c5308-80cc-4991-8626-2ba32fa09acf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "cc1de356-c44a-46bf-bb87-d123239afbe7", "address": "fa:16:3e:05:9d:ed", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1de356-c4", "ovs_interfaceid": "cc1de356-c44a-46bf-bb87-d123239afbe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:08:19.234640 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Converting VIF {"id": "cc1de356-c44a-46bf-bb87-d123239afbe7", "address": "fa:16:3e:05:9d:ed", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1de356-c4", "ovs_interfaceid": "cc1de356-c44a-46bf-bb87-d123239afbe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:08:19.235382 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=cc1de356-c44a-46bf-bb87-d123239afbe7,network=Network(02f45984-182d-4648-ab01-d4773a271319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc1de356-c4') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:08:19.237258 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e7c5308-80cc-4991-8626-2ba32fa09acf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:08:19.252970 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:19.265943 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:08:19.265943 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:08:19.298322 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-32379bd1-0f65-4ab1-9129-21281b5ade33 req-a8e15aad-9c5f-4567-a86c-6cc2488ea5d3 service nova] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Received event network-vif-plugged-4e4212ac-6f4f-42f5-aae7-409c2ef76f02 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:08:19.303690 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-32379bd1-0f65-4ab1-9129-21281b5ade33 req-a8e15aad-9c5f-4567-a86c-6cc2488ea5d3 service nova] Acquiring lock "d5e4832e-32b9-44a7-92b8-6fa82e642515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:19.303690 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-32379bd1-0f65-4ab1-9129-21281b5ade33 req-a8e15aad-9c5f-4567-a86c-6cc2488ea5d3 service nova] Lock "d5e4832e-32b9-44a7-92b8-6fa82e642515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:19.303690 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-32379bd1-0f65-4ab1-9129-21281b5ade33 req-a8e15aad-9c5f-4567-a86c-6cc2488ea5d3 service nova] Lock "d5e4832e-32b9-44a7-92b8-6fa82e642515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:19.303690 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-32379bd1-0f65-4ab1-9129-21281b5ade33 req-a8e15aad-9c5f-4567-a86c-6cc2488ea5d3 service nova] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Processing event network-vif-plugged-4e4212ac-6f4f-42f5-aae7-409c2ef76f02 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:08:19.473211 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-339ab1e4-bced-45b0-bc56-ed45dbdfd395 req-40f880d9-1ae1-4f47-a281-955c1466e685 service nova] Releasing lock "refresh_cache-9e7ca386-dbea-461e-9cf2-7e135bd3758d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:08:19.741760 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930499.7413087, d5e4832e-32b9-44a7-92b8-6fa82e642515 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:08:19.742646 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:08:19.742821 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Object Instance<1e7c5308-80cc-4991-8626-2ba32fa09acf> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:08:19.743930 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] VM Started (Lifecycle Event)
May 28 01:08:19.745091 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] End _get_guest_xml xml=<domain type="qemu">
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:   <uuid>1e7c5308-80cc-4991-8626-2ba32fa09acf</uuid>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:   <name>instance-00000036</name>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <nova:name>tempest-AttachVolumeTestJSON-server-1575785918</nova:name>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:08:12</nova:creationTime>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:         <nova:user uuid="60d68bbf62c74dd2bfe638f00ef6aa3d">tempest-AttachVolumeTestJSON-1682604103-project-member</nova:user>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:         <nova:project uuid="23578125da1e4bf2bb3d59281a0e261e">tempest-AttachVolumeTestJSON-1682604103</nova:project>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:         <nova:port uuid="cc1de356-c44a-46bf-bb87-d123239afbe7">
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:     <system>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <entry name="serial">1e7c5308-80cc-4991-8626-2ba32fa09acf</entry>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <entry name="uuid">1e7c5308-80cc-4991-8626-2ba32fa09acf</entry>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:     </system>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:   <os>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:   </os>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:   <features>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:   </features>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:   <devices>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk"/>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:     </disk>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk.config"/>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:     </disk>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <alias name="ua-67905ec9-510f-4af0-85fe-adc6bcc8505f"/>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-0"/>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <serial>67905ec9-510f-4af0-85fe-adc6bcc8505f</serial>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:     </disk>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:05:9d:ed"/>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <target dev="tapcc1de356-c4"/>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:     </interface>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/console.log" append="off"/>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:     </serial>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:     <video>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:     </video>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:     </rng>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:   </devices>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]: </domain>
May 28 01:08:19.745091 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:08:19.747405 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:08:19.747405 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:19.771187 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:08:19.777574 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Instance spawned successfully.
May 28 01:08:19.781194 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:08:19.838144 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:08:19.838500 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:19.921572 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:08:19.921997 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:08:19.922678 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1e7c5308-80cc-4991-8626-2ba32fa09acf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:08:20.262437 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:08:20.265850 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:08:20.283236 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.338s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:20.283851 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:08:20.297563 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:08:20.297563 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:08:20.297563 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:08:20.297563 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:08:20.297563 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:08:20.297563 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:08:20.424868 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Object Instance<1e7c5308-80cc-4991-8626-2ba32fa09acf> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:08:20.425201 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:20.520278 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.095s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:08:20.520830 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:08:20.521143 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:20.604244 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:08:20.604415 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:08:20.604615 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:08:20.604689 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] No VIF found with MAC fa:16:3e:8d:51:0f, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:08:20.633762 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:08:20.634169 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Cannot resize image /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:08:20.634415 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lazy-loading 'migration_context' on Instance uuid 1e7c5308-80cc-4991-8626-2ba32fa09acf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:08:20.770867 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:08:20.771522 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930500.7710228, d5e4832e-32b9-44a7-92b8-6fa82e642515 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:08:20.771522 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] VM Paused (Lifecycle Event)
May 28 01:08:20.792939 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:08:20.793137 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:08:20.793861 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:20.793981 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:20.802747 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Took 7.69 seconds to spawn the instance on the hypervisor.
May 28 01:08:20.802747 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:08:20.881448 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9258145be7414d88accbdb4802619956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f49e31415146d281ba6b462016d5d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:08:21.138459 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Object Instance<1e7c5308-80cc-4991-8626-2ba32fa09acf> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:08:21.139631 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:07:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1575785918',display_name='tempest-AttachVolumeTestJSON-server-1575785918',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumetestjson-server-1575785918',id=54,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQqj5ulFm44LqcwStG35x3hx4kF2OHc+g0tTlOd4Z/Xec3CPwxGXUEAq08Fq2dSZhFKLMTCPF7EJ6q4KRfVK6ZgmNMJOJWZlgopXWPXQJWBjVOvQj1zQw9ZKwPgeXE7Hw==',key_name='tempest-keypair-749432862',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:07:15Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='23578125da1e4bf2bb3d59281a0e261e',ramdisk_id='',reservation_id='r-8bk45cr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1682604103',owner_user_name='tempest-AttachVolumeTestJSON-1682604103-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:08:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d68bbf62c74dd2bfe638f00ef6aa3d',uuid=1e7c5308-80cc-4991-8626-2ba32fa09acf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "cc1de356-c44a-46bf-bb87-d123239afbe7", "address": "fa:16:3e:05:9d:ed", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1de356-c4", "ovs_interfaceid": "cc1de356-c44a-46bf-bb87-d123239afbe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:08:21.139814 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Converting VIF {"id": "cc1de356-c44a-46bf-bb87-d123239afbe7", "address": "fa:16:3e:05:9d:ed", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1de356-c4", "ovs_interfaceid": "cc1de356-c44a-46bf-bb87-d123239afbe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:08:21.140384 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=cc1de356-c44a-46bf-bb87-d123239afbe7,network=Network(02f45984-182d-4648-ab01-d4773a271319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc1de356-c4') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:08:21.140625 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=cc1de356-c44a-46bf-bb87-d123239afbe7,network=Network(02f45984-182d-4648-ab01-d4773a271319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc1de356-c4') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:08:21.141083 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:21.141405 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:08:21.141745 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:08:21.145962 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:21.146314 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cac515f6-6dde-52e3-b94a-a44740fd1d11', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:08:21.147129 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:21.147848 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:08:21.148174 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:21.150392 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:21.150578 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc1de356-c4, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:08:21.150911 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc1de356-c4, col_values=(('qos', UUID('e22b0dec-e0d3-4807-9091-c9f35f4a4348')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:08:21.151069 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc1de356-c4, col_values=(('external_ids', {'iface-id': 'cc1de356-c44a-46bf-bb87-d123239afbe7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:9d:ed', 'vm-uuid': '1e7c5308-80cc-4991-8626-2ba32fa09acf'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:08:21.151915 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:21.153039 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:08:21.158202 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:21.159230 np0000001577 nova-compute[98319]: INFO os_vif [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=cc1de356-c44a-46bf-bb87-d123239afbe7,network=Network(02f45984-182d-4648-ab01-d4773a271319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc1de356-c4')
May 28 01:08:21.275139 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:08:21.279541 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930501.279322, d5e4832e-32b9-44a7-92b8-6fa82e642515 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:08:21.279721 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] VM Resumed (Lifecycle Event)
May 28 01:08:21.296740 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:08:21.314656 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Took 13.09 seconds to build instance.
May 28 01:08:21.367518 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-89957ddc-4d11-49fb-a89b-ef688b55633f req-1ee50522-4109-4c5c-86e2-723f865650b6 service nova] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Received event network-vif-plugged-4e4212ac-6f4f-42f5-aae7-409c2ef76f02 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:08:21.367730 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-89957ddc-4d11-49fb-a89b-ef688b55633f req-1ee50522-4109-4c5c-86e2-723f865650b6 service nova] Acquiring lock "d5e4832e-32b9-44a7-92b8-6fa82e642515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:21.367903 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-89957ddc-4d11-49fb-a89b-ef688b55633f req-1ee50522-4109-4c5c-86e2-723f865650b6 service nova] Lock "d5e4832e-32b9-44a7-92b8-6fa82e642515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:21.368295 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-89957ddc-4d11-49fb-a89b-ef688b55633f req-1ee50522-4109-4c5c-86e2-723f865650b6 service nova] Lock "d5e4832e-32b9-44a7-92b8-6fa82e642515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:21.368295 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-89957ddc-4d11-49fb-a89b-ef688b55633f req-1ee50522-4109-4c5c-86e2-723f865650b6 service nova] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] No waiting events found dispatching network-vif-plugged-4e4212ac-6f4f-42f5-aae7-409c2ef76f02 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:08:21.368595 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-89957ddc-4d11-49fb-a89b-ef688b55633f req-1ee50522-4109-4c5c-86e2-723f865650b6 service nova] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Received unexpected event network-vif-plugged-4e4212ac-6f4f-42f5-aae7-409c2ef76f02 for instance with vm_state active and task_state None.
May 28 01:08:21.369788 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0018587330000627844 future=<Future at 0x7c984c6b4560 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:08:21.371372 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:08:21.371372 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Emitting event <LifecycleEvent: 1779930486.367828, 1e7c5308-80cc-4991-8626-2ba32fa09acf => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:08:21.371372 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] VM Stopped (Lifecycle Event)
May 28 01:08:21.380400 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Successfully created port: bb9312b6-5458-47c9-aac1-0cccedf5d70b {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:08:21.472803 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:21.612471 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:21.641692 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:21.768631 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:21.781743 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:08:21.791673 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:08:21.805296 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:08:21.817977 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-76e8eb20-3b71-400b-b530-13596cb7edca tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "d5e4832e-32b9-44a7-92b8-6fa82e642515" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.600s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:21.877675 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:08:21.901141 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8dae6c4b-4501-4b4f-bfa3-d5189c7287bb req-f81d497b-3899-49d5-9cf6-2254ecf250b7 service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Received event network-vif-plugged-cc1de356-c44a-46bf-bb87-d123239afbe7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:08:21.903399 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8dae6c4b-4501-4b4f-bfa3-d5189c7287bb req-f81d497b-3899-49d5-9cf6-2254ecf250b7 service nova] Acquiring lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:21.903399 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8dae6c4b-4501-4b4f-bfa3-d5189c7287bb req-f81d497b-3899-49d5-9cf6-2254ecf250b7 service nova] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:21.903597 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8dae6c4b-4501-4b4f-bfa3-d5189c7287bb req-f81d497b-3899-49d5-9cf6-2254ecf250b7 service nova] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:21.903713 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8dae6c4b-4501-4b4f-bfa3-d5189c7287bb req-f81d497b-3899-49d5-9cf6-2254ecf250b7 service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] No waiting events found dispatching network-vif-plugged-cc1de356-c44a-46bf-bb87-d123239afbe7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:08:21.903825 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-8dae6c4b-4501-4b4f-bfa3-d5189c7287bb req-f81d497b-3899-49d5-9cf6-2254ecf250b7 service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Received unexpected event network-vif-plugged-cc1de356-c44a-46bf-bb87-d123239afbe7 for instance with vm_state stopped and task_state powering-on.
May 28 01:08:21.954931 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Successfully updated port: bb9312b6-5458-47c9-aac1-0cccedf5d70b {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:08:22.022151 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:22.024423 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:22.031679 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:22.056313 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:22.182931 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-560636c2-2844-4405-b22e-7fa6517fd37f tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "48bfd06f-62f4-4691-bf98-2426e359a90e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.212s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:22.458319 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "refresh_cache-4d7b37c7-b091-44f7-a330-4e55e2b1e348" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:08:22.458319 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquired lock "refresh_cache-4d7b37c7-b091-44f7-a330-4e55e2b1e348" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:08:22.458319 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:08:22.494494 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "48bfd06f-62f4-4691-bf98-2426e359a90e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:22.495651 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "48bfd06f-62f4-4691-bf98-2426e359a90e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:22.585898 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Instance event wait completed in 0 seconds for  {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:08:22.586682 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930502.586334, 1e7c5308-80cc-4991-8626-2ba32fa09acf => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:08:22.586968 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] VM Resumed (Lifecycle Event)
May 28 01:08:22.589458 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Instance rebooted successfully.
May 28 01:08:22.817645 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:08:22.818775 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:08:22.819011 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Creating image(s)
May 28 01:08:22.819504 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "/opt/stack/data/nova/instances/4d7b37c7-b091-44f7-a330-4e55e2b1e348/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:22.819678 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "/opt/stack/data/nova/instances/4d7b37c7-b091-44f7-a330-4e55e2b1e348/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:22.820216 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "/opt/stack/data/nova/instances/4d7b37c7-b091-44f7-a330-4e55e2b1e348/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:22.820699 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:08:22.824025 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:08:22.824987 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:22.915767 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:08:22.916212 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:22.916689 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:22.917136 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:08:22.919787 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:08:22.920230 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:22.999758 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Detaching volume 46a8593c-4b06-4b04-a8a1-ccc55cdf51e3
May 28 01:08:23.001842 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.082s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:08:23.002172 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/4d7b37c7-b091-44f7-a330-4e55e2b1e348/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:23.034773 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:08:23.067427 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/4d7b37c7-b091-44f7-a330-4e55e2b1e348/disk 1073741824" returned: 0 in 0.065s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:08:23.068474 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Attempting to driver detach volume 46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 from mountpoint /dev/vdb
May 28 01:08:23.068843 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.152s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:23.069113 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:23.099259 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:08:23.110309 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:08:23.136153 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 'iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': '48bfd06f-62f4-4691-bf98-2426e359a90e', 'attached_at': '', 'detached_at': '', 'volume_id': '46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 'serial': '46a8593c-4b06-4b04-a8a1-ccc55cdf51e3'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 01:08:23.139918 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Found disk vdb by alias ua-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:08:23.140968 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Found disk vdb by alias ua-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:08:23.141112 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Attempting to detach device vdb from instance 48bfd06f-62f4-4691-bf98-2426e359a90e from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:08:23.141389 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:08:23.141389 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:08:23.141389 np0000001577 nova-compute[98319]:   <alias name="ua-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3"/>
May 28 01:08:23.141389 np0000001577 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 28 01:08:23.141389 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:08:23.141389 np0000001577 nova-compute[98319]:   <serial>46a8593c-4b06-4b04-a8a1-ccc55cdf51e3</serial>
May 28 01:08:23.141389 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:08:23.141389 np0000001577 nova-compute[98319]: </disk>
May 28 01:08:23.141389 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:08:23.149154 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Successfully detached device vdb from instance 48bfd06f-62f4-4691-bf98-2426e359a90e from the persistent domain config.
May 28 01:08:23.149409 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] (1/8): Attempting to detach device vdb with device alias ua-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 from instance 48bfd06f-62f4-4691-bf98-2426e359a90e from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:08:23.149638 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:08:23.149638 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:08:23.149638 np0000001577 nova-compute[98319]:   <alias name="ua-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3"/>
May 28 01:08:23.149638 np0000001577 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 28 01:08:23.149638 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:08:23.149638 np0000001577 nova-compute[98319]:   <serial>46a8593c-4b06-4b04-a8a1-ccc55cdf51e3</serial>
May 28 01:08:23.149638 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:08:23.149638 np0000001577 nova-compute[98319]: </disk>
May 28 01:08:23.149638 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:08:23.164095 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.095s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:08:23.164889 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4d7b37c7-b091-44f7-a330-4e55e2b1e348/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:08:23.165101 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d7b37c7-b091-44f7-a330-4e55e2b1e348/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:23.262966 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:23.271420 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d7b37c7-b091-44f7-a330-4e55e2b1e348/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:08:23.271771 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Cannot resize image /opt/stack/data/nova/instances/4d7b37c7-b091-44f7-a330-4e55e2b1e348/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:08:23.273065 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:08:23.273065 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Ensure instance console log exists: /opt/stack/data/nova/instances/4d7b37c7-b091-44f7-a330-4e55e2b1e348/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:08:23.273065 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:23.273065 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:23.273065 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:23.408005 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Updating instance_info_cache with network_info: [{"id": "bb9312b6-5458-47c9-aac1-0cccedf5d70b", "address": "fa:16:3e:ab:f4:27", "network": {"id": "8bf5903d-3155-48fb-98dd-859e96b349d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1733749547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92f49e31415146d281ba6b462016d5d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb9312b6-54", "ovs_interfaceid": "bb9312b6-5458-47c9-aac1-0cccedf5d70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:08:23.443807 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-dcb079f2-b49d-4984-b33d-94d313aff465 req-605713b0-21c2-4897-ac50-c395b88cbd67 service nova] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Received event network-changed-bb9312b6-5458-47c9-aac1-0cccedf5d70b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:08:23.444421 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-dcb079f2-b49d-4984-b33d-94d313aff465 req-605713b0-21c2-4897-ac50-c395b88cbd67 service nova] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Refreshing instance network info cache due to event network-changed-bb9312b6-5458-47c9-aac1-0cccedf5d70b. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:08:23.444421 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dcb079f2-b49d-4984-b33d-94d313aff465 req-605713b0-21c2-4897-ac50-c395b88cbd67 service nova] Acquiring lock "refresh_cache-4d7b37c7-b091-44f7-a330-4e55e2b1e348" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:08:23.612747 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] During sync_power_state the instance has a pending task (powering-on). Skip.
May 28 01:08:23.613235 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930503.6129704, 1e7c5308-80cc-4991-8626-2ba32fa09acf => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:08:23.613422 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] VM Started (Lifecycle Event)
May 28 01:08:23.679381 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 for instance 48bfd06f-62f4-4691-bf98-2426e359a90e {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:08:23.910252 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Releasing lock "refresh_cache-4d7b37c7-b091-44f7-a330-4e55e2b1e348" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:08:23.910703 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Instance network_info: |[{"id": "bb9312b6-5458-47c9-aac1-0cccedf5d70b", "address": "fa:16:3e:ab:f4:27", "network": {"id": "8bf5903d-3155-48fb-98dd-859e96b349d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1733749547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92f49e31415146d281ba6b462016d5d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb9312b6-54", "ovs_interfaceid": "bb9312b6-5458-47c9-aac1-0cccedf5d70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:08:23.912524 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Start _get_guest_xml network_info=[{"id": "bb9312b6-5458-47c9-aac1-0cccedf5d70b", "address": "fa:16:3e:ab:f4:27", "network": {"id": "8bf5903d-3155-48fb-98dd-859e96b349d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1733749547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92f49e31415146d281ba6b462016d5d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb9312b6-54", "ovs_interfaceid": "bb9312b6-5458-47c9-aac1-0cccedf5d70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:08:23.913858 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dcb079f2-b49d-4984-b33d-94d313aff465 req-605713b0-21c2-4897-ac50-c395b88cbd67 service nova] Acquired lock "refresh_cache-4d7b37c7-b091-44f7-a330-4e55e2b1e348" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:08:23.913858 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-dcb079f2-b49d-4984-b33d-94d313aff465 req-605713b0-21c2-4897-ac50-c395b88cbd67 service nova] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Refreshing network info cache for port bb9312b6-5458-47c9-aac1-0cccedf5d70b {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:08:23.915357 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:08:23.916598 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-TestStampPattern-server-810281881', uuid='4d7b37c7-b091-44f7-a330-4e55e2b1e348'), owner=OwnerMeta(userid='9258145be7414d88accbdb4802619956', username='tempest-TestStampPattern-1316789919-project-member', projectid='92f49e31415146d281ba6b462016d5d4', projectname='tempest-TestStampPattern-1316789919'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "bb9312b6-5458-47c9-aac1-0cccedf5d70b", "address": "fa:16:3e:ab:f4:27", "network": {"id": "8bf5903d-3155-48fb-98dd-859e96b349d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1733749547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92f49e31415146d281ba6b462016d5d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb9312b6-54", "ovs_interfaceid": "bb9312b6-5458-47c9-aac1-0cccedf5d70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930503.916272) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:08:23.917763 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:08:23.918331 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:08:23.920591 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:08:23.920771 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:08:23.921812 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:08:23.922083 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:08:23.922224 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:08:23.922312 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:08:23.922459 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:08:23.922571 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:08:23.922674 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:08:23.922933 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:08:23.923024 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:08:23.923126 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:08:23.923278 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:08:23.923426 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:08:23.936035 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:08:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-810281881',display_name='tempest-TestStampPattern-server-810281881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-teststamppattern-server-810281881',id=58,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY7LZ57I2hyMdKVO08J6JSzhqiI0ZTtKrP9nyz1z53fPuESHxKL03vnaQuF8H5q84b516fImHzGWaVzsCTjOGesM9ULlqWAaR2gPi+wEj2GKOu9g0fSmRD2xOlCcqeMHw==',key_name='tempest-TestStampPattern-1233377666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92f49e31415146d281ba6b462016d5d4',ramdisk_id='',reservation_id='r-i8r70j4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1316789919',owner_user_name='tempest-TestStampPattern-1316789919-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:08:22Z,user_data=None,user_id='9258145be7414d88accbdb4802619956',uuid=4d7b37c7-b091-44f7-a330-4e55e2b1e348,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb9312b6-5458-47c9-aac1-0cccedf5d70b", "address": "fa:16:3e:ab:f4:27", "network": {"id": "8bf5903d-3155-48fb-98dd-859e96b349d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1733749547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92f49e31415146d281ba6b462016d5d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb9312b6-54", "ovs_interfaceid": "bb9312b6-5458-47c9-aac1-0cccedf5d70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:08:23.936294 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Converting VIF {"id": "bb9312b6-5458-47c9-aac1-0cccedf5d70b", "address": "fa:16:3e:ab:f4:27", "network": {"id": "8bf5903d-3155-48fb-98dd-859e96b349d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1733749547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92f49e31415146d281ba6b462016d5d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb9312b6-54", "ovs_interfaceid": "bb9312b6-5458-47c9-aac1-0cccedf5d70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:08:23.936725 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:f4:27,bridge_name='br-int',has_traffic_filtering=True,id=bb9312b6-5458-47c9-aac1-0cccedf5d70b,network=Network(8bf5903d-3155-48fb-98dd-859e96b349d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb9312b6-54') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:08:23.937351 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d7b37c7-b091-44f7-a330-4e55e2b1e348 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:08:23.973329 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2051562a-1b56-4358-ad02-1061cfb6e63c req-6892f83e-be8e-414d-9fdc-3c8bf35e5927 service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Received event network-vif-plugged-cc1de356-c44a-46bf-bb87-d123239afbe7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:08:23.974038 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2051562a-1b56-4358-ad02-1061cfb6e63c req-6892f83e-be8e-414d-9fdc-3c8bf35e5927 service nova] Acquiring lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:23.974179 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2051562a-1b56-4358-ad02-1061cfb6e63c req-6892f83e-be8e-414d-9fdc-3c8bf35e5927 service nova] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:23.974295 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2051562a-1b56-4358-ad02-1061cfb6e63c req-6892f83e-be8e-414d-9fdc-3c8bf35e5927 service nova] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:23.974414 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2051562a-1b56-4358-ad02-1061cfb6e63c req-6892f83e-be8e-414d-9fdc-3c8bf35e5927 service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] No waiting events found dispatching network-vif-plugged-cc1de356-c44a-46bf-bb87-d123239afbe7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:08:23.974523 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-2051562a-1b56-4358-ad02-1061cfb6e63c req-6892f83e-be8e-414d-9fdc-3c8bf35e5927 service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Received unexpected event network-vif-plugged-cc1de356-c44a-46bf-bb87-d123239afbe7 for instance with vm_state stopped and task_state powering-on.
May 28 01:08:23.974633 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2051562a-1b56-4358-ad02-1061cfb6e63c req-6892f83e-be8e-414d-9fdc-3c8bf35e5927 service nova] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Received event network-changed-4e4212ac-6f4f-42f5-aae7-409c2ef76f02 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:08:23.974855 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2051562a-1b56-4358-ad02-1061cfb6e63c req-6892f83e-be8e-414d-9fdc-3c8bf35e5927 service nova] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Refreshing instance network info cache due to event network-changed-4e4212ac-6f4f-42f5-aae7-409c2ef76f02. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:08:23.974855 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2051562a-1b56-4358-ad02-1061cfb6e63c req-6892f83e-be8e-414d-9fdc-3c8bf35e5927 service nova] Acquiring lock "refresh_cache-d5e4832e-32b9-44a7-92b8-6fa82e642515" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:08:23.974979 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2051562a-1b56-4358-ad02-1061cfb6e63c req-6892f83e-be8e-414d-9fdc-3c8bf35e5927 service nova] Acquired lock "refresh_cache-d5e4832e-32b9-44a7-92b8-6fa82e642515" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:08:23.974979 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-2051562a-1b56-4358-ad02-1061cfb6e63c req-6892f83e-be8e-414d-9fdc-3c8bf35e5927 service nova] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Refreshing network info cache for port 4e4212ac-6f4f-42f5-aae7-409c2ef76f02 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:08:24.105486 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:08:24.105648 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:08:24.105735 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:08:24.105829 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] No VIF found with MAC fa:16:3e:05:9d:ed, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:08:24.106216 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ba76d923-f8c6-468e-a15e-bd89384d3cde tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:08:24.115969 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:08:24.131930 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:08:24.418759 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-dcb079f2-b49d-4984-b33d-94d313aff465 req-605713b0-21c2-4897-ac50-c395b88cbd67 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:24.440511 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] End _get_guest_xml xml=<domain type="qemu">
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:   <uuid>4d7b37c7-b091-44f7-a330-4e55e2b1e348</uuid>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:   <name>instance-0000003a</name>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestStampPattern-server-810281881</nova:name>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:08:23</nova:creationTime>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:         <nova:user uuid="9258145be7414d88accbdb4802619956">tempest-TestStampPattern-1316789919-project-member</nova:user>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:         <nova:project uuid="92f49e31415146d281ba6b462016d5d4">tempest-TestStampPattern-1316789919</nova:project>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:         <nova:port uuid="bb9312b6-5458-47c9-aac1-0cccedf5d70b">
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:     <system>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       <entry name="serial">4d7b37c7-b091-44f7-a330-4e55e2b1e348</entry>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       <entry name="uuid">4d7b37c7-b091-44f7-a330-4e55e2b1e348</entry>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:     </system>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:   <os>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:   </os>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:   <features>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:   </features>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:   <devices>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/4d7b37c7-b091-44f7-a330-4e55e2b1e348/disk"/>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:     </disk>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/4d7b37c7-b091-44f7-a330-4e55e2b1e348/disk.config"/>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:     </disk>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:ab:f4:27"/>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       <target dev="tapbb9312b6-54"/>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:     </interface>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/4d7b37c7-b091-44f7-a330-4e55e2b1e348/console.log" append="off"/>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:     </serial>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:     <video>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:     </video>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:     </rng>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:   </devices>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]: </domain>
May 28 01:08:24.440511 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:08:24.446276 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Preparing to wait for external event network-vif-plugged-bb9312b6-5458-47c9-aac1-0cccedf5d70b {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:08:24.446276 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "4d7b37c7-b091-44f7-a330-4e55e2b1e348-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:24.446276 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "4d7b37c7-b091-44f7-a330-4e55e2b1e348-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:24.446276 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "4d7b37c7-b091-44f7-a330-4e55e2b1e348-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:24.446276 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:08:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-810281881',display_name='tempest-TestStampPattern-server-810281881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-teststamppattern-server-810281881',id=58,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY7LZ57I2hyMdKVO08J6JSzhqiI0ZTtKrP9nyz1z53fPuESHxKL03vnaQuF8H5q84b516fImHzGWaVzsCTjOGesM9ULlqWAaR2gPi+wEj2GKOu9g0fSmRD2xOlCcqeMHw==',key_name='tempest-TestStampPattern-1233377666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92f49e31415146d281ba6b462016d5d4',ramdisk_id='',reservation_id='r-i8r70j4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1316789919',owner_user_name='tempest-TestStampPattern-1316789919-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:08:22Z,user_data=None,user_id='9258145be7414d88accbdb4802619956',uuid=4d7b37c7-b091-44f7-a330-4e55e2b1e348,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb9312b6-5458-47c9-aac1-0cccedf5d70b", "address": "fa:16:3e:ab:f4:27", "network": {"id": "8bf5903d-3155-48fb-98dd-859e96b349d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1733749547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92f49e31415146d281ba6b462016d5d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb9312b6-54", "ovs_interfaceid": "bb9312b6-5458-47c9-aac1-0cccedf5d70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:08:24.446276 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Converting VIF {"id": "bb9312b6-5458-47c9-aac1-0cccedf5d70b", "address": "fa:16:3e:ab:f4:27", "network": {"id": "8bf5903d-3155-48fb-98dd-859e96b349d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1733749547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92f49e31415146d281ba6b462016d5d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb9312b6-54", "ovs_interfaceid": "bb9312b6-5458-47c9-aac1-0cccedf5d70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:08:24.446276 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:f4:27,bridge_name='br-int',has_traffic_filtering=True,id=bb9312b6-5458-47c9-aac1-0cccedf5d70b,network=Network(8bf5903d-3155-48fb-98dd-859e96b349d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb9312b6-54') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:08:24.446276 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:f4:27,bridge_name='br-int',has_traffic_filtering=True,id=bb9312b6-5458-47c9-aac1-0cccedf5d70b,network=Network(8bf5903d-3155-48fb-98dd-859e96b349d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb9312b6-54') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:08:24.447303 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:24.449272 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:08:24.450096 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:08:24.453600 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:24.456797 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d311b24-42c4-5eca-984e-f14903cc5bd9', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:08:24.460658 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:08:24.467944 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:24.469562 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb9312b6-54, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:08:24.470014 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbb9312b6-54, col_values=(('qos', UUID('188382e0-6aeb-4a3e-8908-f1387b88631a')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:08:24.470232 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbb9312b6-54, col_values=(('external_ids', {'iface-id': 'bb9312b6-5458-47c9-aac1-0cccedf5d70b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:f4:27', 'vm-uuid': '4d7b37c7-b091-44f7-a330-4e55e2b1e348'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:08:24.475816 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:08:24.480761 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-2051562a-1b56-4358-ad02-1061cfb6e63c req-6892f83e-be8e-414d-9fdc-3c8bf35e5927 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:24.482869 np0000001577 nova-compute[98319]: INFO os_vif [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:f4:27,bridge_name='br-int',has_traffic_filtering=True,id=bb9312b6-5458-47c9-aac1-0cccedf5d70b,network=Network(8bf5903d-3155-48fb-98dd-859e96b349d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb9312b6-54')
May 28 01:08:24.636459 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] During sync_power_state the instance has a pending task (powering-on). Skip.
May 28 01:08:24.637015 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930504.6366212, 48bfd06f-62f4-4691-bf98-2426e359a90e => ua-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:08:24.642483 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Successfully detached device vdb from instance 48bfd06f-62f4-4691-bf98-2426e359a90e from the live domain config.
May 28 01:08:24.646098 np0000001577 nova-compute[98319]: WARNING stevedore.named [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 01:08:24.646704 np0000001577 nova-compute[98319]: WARNING castellan.key_manager [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:08:24.646704 np0000001577 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:08:24.648934 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x7c984c6df2f0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 'iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': '48bfd06f-62f4-4691-bf98-2426e359a90e', 'attached_at': '', 'detached_at': '', 'volume_id': '46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 'serial': '46a8593c-4b06-4b04-a8a1-ccc55cdf51e3'} {{(pid=98319) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 01:08:24.649235 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors.luks [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] closing encrypted volume /dev/dm-5 {{(pid=98319) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:207}}
May 28 01:08:24.680750 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:08:24.681417 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 'iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:08:24.682214 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:08:24.682607 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:08:24.682963 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 'iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:08:24.683143 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:08:24.726563 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:24.726563 np0000001577 nova-compute[98319]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:24.726563 np0000001577 nova-compute[98319]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:24.726563 np0000001577 nova-compute[98319]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:24.726563 np0000001577 nova-compute[98319]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c4f63605-7019-4aea-8877-95ceaff7136c (non-flash)
May 28 01:08:24.726563 np0000001577 nova-compute[98319]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:24.726563 np0000001577 nova-compute[98319]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:24.726563 np0000001577 nova-compute[98319]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8fc8b77-a8f1-4a75-91df-d7d526698a3b (non-flash)
May 28 01:08:24.726563 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:08:24.726815 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsi session list stdout=tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:24.726815 np0000001577 nova-compute[98319]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3 (non-flash)
May 28 01:08:24.726815 np0000001577 nova-compute[98319]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:24.726815 np0000001577 nova-compute[98319]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:24.726815 np0000001577 nova-compute[98319]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c4f63605-7019-4aea-8877-95ceaff7136c (non-flash)
May 28 01:08:24.726815 np0000001577 nova-compute[98319]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:24.726815 np0000001577 nova-compute[98319]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:24.726815 np0000001577 nova-compute[98319]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8fc8b77-a8f1-4a75-91df-d7d526698a3b (non-flash)
May 28 01:08:24.726815 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:08:24.726987 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', '131'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', '132'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', '133'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', '134'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c4f63605-7019-4aea-8877-95ceaff7136c', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', '136'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', '137'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8fc8b77-a8f1-4a75-91df-d7d526698a3b', '138')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:08:24.727145 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', '132')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:08:24.728394 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3', '131')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:08:24.729621 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c9870309f80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3'): ({'sde'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:08:24.731634 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Removing multipathed devices sdf, sde {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:08:24.736082 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Flush multipath device 330000000f9621094 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:08:24.769882 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:08:24.807103 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-dcb079f2-b49d-4984-b33d-94d313aff465 req-605713b0-21c2-4897-ac50-c395b88cbd67 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:24.815059 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:08:24.868609 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:08:24.868889 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] SCSI volumes sdf, sde have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:08:24.871644 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:08:24.882086 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:08:24.882319 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:08:24.898143 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:24.928818 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 132, target: iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3, portal: 192.168.40.100,3260]
May 28 01:08:24.928818 np0000001577 nova-compute[98319]: Logout of [sid: 132, target: iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3, portal: 192.168.40.100,3260] successful.
May 28 01:08:24.928818 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:24.932215 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-2051562a-1b56-4358-ad02-1061cfb6e63c req-6892f83e-be8e-414d-9fdc-3c8bf35e5927 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:24.950328 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:24.963047 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:24.989119 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-dcb079f2-b49d-4984-b33d-94d313aff465 req-605713b0-21c2-4897-ac50-c395b88cbd67 service nova] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Updated VIF entry in instance network info cache for port bb9312b6-5458-47c9-aac1-0cccedf5d70b. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:08:24.989344 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-dcb079f2-b49d-4984-b33d-94d313aff465 req-605713b0-21c2-4897-ac50-c395b88cbd67 service nova] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Updating instance_info_cache with network_info: [{"id": "bb9312b6-5458-47c9-aac1-0cccedf5d70b", "address": "fa:16:3e:ab:f4:27", "network": {"id": "8bf5903d-3155-48fb-98dd-859e96b349d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1733749547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92f49e31415146d281ba6b462016d5d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb9312b6-54", "ovs_interfaceid": "bb9312b6-5458-47c9-aac1-0cccedf5d70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:08:25.006454 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 131, target: iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3, portal: 192.168.50.100,3260]
May 28 01:08:25.006454 np0000001577 nova-compute[98319]: Logout of [sid: 131, target: iqn.2023-03.storpool.com:os--volume-46a8593c-4b06-4b04-a8a1-ccc55cdf51e3, portal: 192.168.50.100,3260] successful.
May 28 01:08:25.006454 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:25.029570 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:25.030489 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:08:25.030489 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] <== disconnect_volume: return (348ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:08:25.030489 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:08:25.101403 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-2051562a-1b56-4358-ad02-1061cfb6e63c req-6892f83e-be8e-414d-9fdc-3c8bf35e5927 service nova] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Updated VIF entry in instance network info cache for port 4e4212ac-6f4f-42f5-aae7-409c2ef76f02. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:08:25.101403 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-2051562a-1b56-4358-ad02-1061cfb6e63c req-6892f83e-be8e-414d-9fdc-3c8bf35e5927 service nova] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Updating instance_info_cache with network_info: [{"id": "4e4212ac-6f4f-42f5-aae7-409c2ef76f02", "address": "fa:16:3e:55:fb:7f", "network": {"id": "c24d30f5-c7e1-4457-bdc3-ef51ebdf3991", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-116184687-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f132ca2a48c44f6097340763039224c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4212ac-6f", "ovs_interfaceid": "4e4212ac-6f4f-42f5-aae7-409c2ef76f02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:08:25.491222 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dcb079f2-b49d-4984-b33d-94d313aff465 req-605713b0-21c2-4897-ac50-c395b88cbd67 service nova] Releasing lock "refresh_cache-4d7b37c7-b091-44f7-a330-4e55e2b1e348" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:08:25.598735 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lazy-loading 'flavor' on Instance uuid 48bfd06f-62f4-4691-bf98-2426e359a90e {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:08:25.603648 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2051562a-1b56-4358-ad02-1061cfb6e63c req-6892f83e-be8e-414d-9fdc-3c8bf35e5927 service nova] Releasing lock "refresh_cache-d5e4832e-32b9-44a7-92b8-6fa82e642515" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:08:26.025151 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:08:26.025151 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:08:26.025151 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] No VIF found with MAC fa:16:3e:ab:f4:27, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:08:26.025151 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Using config drive
May 28 01:08:26.479372 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:26.535017 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:26.607935 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ea601797-e716-4eee-b721-9e5ebd61e697 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "48bfd06f-62f4-4691-bf98-2426e359a90e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.113s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:26.665537 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Creating config drive at /opt/stack/data/nova/instances/4d7b37c7-b091-44f7-a330-4e55e2b1e348/disk.config
May 28 01:08:26.668765 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4d7b37c7-b091-44f7-a330-4e55e2b1e348/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7zk2be4s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:26.733285 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4d7b37c7-b091-44f7-a330-4e55e2b1e348/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7zk2be4s" returned: 0 in 0.064s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:08:26.854245 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-808ce3ec-6f12-4586-bb0d-133b0b3cbfc0 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "48bfd06f-62f4-4691-bf98-2426e359a90e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:26.854596 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-808ce3ec-6f12-4586-bb0d-133b0b3cbfc0 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "48bfd06f-62f4-4691-bf98-2426e359a90e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:26.854596 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-808ce3ec-6f12-4586-bb0d-133b0b3cbfc0 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "48bfd06f-62f4-4691-bf98-2426e359a90e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:26.854742 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-808ce3ec-6f12-4586-bb0d-133b0b3cbfc0 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "48bfd06f-62f4-4691-bf98-2426e359a90e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:26.854826 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-808ce3ec-6f12-4586-bb0d-133b0b3cbfc0 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "48bfd06f-62f4-4691-bf98-2426e359a90e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:26.872967 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-808ce3ec-6f12-4586-bb0d-133b0b3cbfc0 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Terminating instance
May 28 01:08:27.190375 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:27.221363 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:27.332387 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:27.385043 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-808ce3ec-6f12-4586-bb0d-133b0b3cbfc0 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:08:27.395648 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-57ad1e3e-0457-4679-844c-80b8b03d7791 req-8d25f1df-1d25-42bb-b916-02434087d414 service nova] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Received event network-vif-plugged-bb9312b6-5458-47c9-aac1-0cccedf5d70b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:08:27.395648 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-57ad1e3e-0457-4679-844c-80b8b03d7791 req-8d25f1df-1d25-42bb-b916-02434087d414 service nova] Acquiring lock "4d7b37c7-b091-44f7-a330-4e55e2b1e348-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:27.395648 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-57ad1e3e-0457-4679-844c-80b8b03d7791 req-8d25f1df-1d25-42bb-b916-02434087d414 service nova] Lock "4d7b37c7-b091-44f7-a330-4e55e2b1e348-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:27.402212 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-57ad1e3e-0457-4679-844c-80b8b03d7791 req-8d25f1df-1d25-42bb-b916-02434087d414 service nova] Lock "4d7b37c7-b091-44f7-a330-4e55e2b1e348-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:27.403088 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-57ad1e3e-0457-4679-844c-80b8b03d7791 req-8d25f1df-1d25-42bb-b916-02434087d414 service nova] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Processing event network-vif-plugged-bb9312b6-5458-47c9-aac1-0cccedf5d70b {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:08:27.411091 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:27.436750 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:27.566774 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-af539651-dbdc-4edb-ae9d-13cb77d14d34 req-f9d69595-abf2-4f67-a0f9-1900153ac601 service nova] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Received event network-vif-unplugged-9205b46e-8a1f-49e3-99c3-dfc929263fa3 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:08:27.566947 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-af539651-dbdc-4edb-ae9d-13cb77d14d34 req-f9d69595-abf2-4f67-a0f9-1900153ac601 service nova] Acquiring lock "48bfd06f-62f4-4691-bf98-2426e359a90e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:27.567157 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-af539651-dbdc-4edb-ae9d-13cb77d14d34 req-f9d69595-abf2-4f67-a0f9-1900153ac601 service nova] Lock "48bfd06f-62f4-4691-bf98-2426e359a90e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:27.567382 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-af539651-dbdc-4edb-ae9d-13cb77d14d34 req-f9d69595-abf2-4f67-a0f9-1900153ac601 service nova] Lock "48bfd06f-62f4-4691-bf98-2426e359a90e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:27.567445 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-af539651-dbdc-4edb-ae9d-13cb77d14d34 req-f9d69595-abf2-4f67-a0f9-1900153ac601 service nova] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] No waiting events found dispatching network-vif-unplugged-9205b46e-8a1f-49e3-99c3-dfc929263fa3 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:08:27.572807 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-af539651-dbdc-4edb-ae9d-13cb77d14d34 req-f9d69595-abf2-4f67-a0f9-1900153ac601 service nova] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Received event network-vif-unplugged-9205b46e-8a1f-49e3-99c3-dfc929263fa3 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:08:27.701413 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:27.726683 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999645109000085 future=<Future at 0x7c9870547590 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:08:27.726683 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:27.726683 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.998053659000107 future=<Future at 0x7c9870547590 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:08:27.726683 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.997200011000132 future=<Future at 0x7c9870547590 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:08:27.735458 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Instance destroyed successfully.
May 28 01:08:27.737456 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-808ce3ec-6f12-4586-bb0d-133b0b3cbfc0 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lazy-loading 'resources' on Instance uuid 48bfd06f-62f4-4691-bf98-2426e359a90e {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:08:27.823927 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:27.835236 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:27.836822 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:27.861308 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:27.866636 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:27.954693 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:27.980966 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:28.191325 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:08:28.191884 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930508.191126, 4d7b37c7-b091-44f7-a330-4e55e2b1e348 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:08:28.191884 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] VM Started (Lifecycle Event)
May 28 01:08:28.193929 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:08:28.196929 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Instance spawned successfully.
May 28 01:08:28.197902 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:08:28.249965 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-808ce3ec-6f12-4586-bb0d-133b0b3cbfc0 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:07:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1829593862',display_name='tempest-TestEncryptedCinderVolumes-server-1829593862',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testencryptedcindervolumes-server-1829593862',id=55,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrmWHf8duJgWSyLYGvzhKVCPBx/McbpzQLqrrmbNM+uny8PX8YfdE3Zh3IGK41HXnF6HUj2qs1a/bPPx0H6w0SdF7pU7A2XSDGpiS0Laf5uvZsnFgG5rdiOvLlyI7Ljxw==',key_name='tempest-keypair-1102120832',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:07:20Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a430f0d6bcc84a29bc3e96514422896b',ramdisk_id='',reservation_id='r-uirmo1q0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-2086871542',owner_user_name='tempest-TestEncryptedCinderVolumes-2086871542-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:07:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbae7974478d45b3908aaaa5b4408e26',uuid=48bfd06f-62f4-4691-bf98-2426e359a90e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9205b46e-8a1f-49e3-99c3-dfc929263fa3", "address": "fa:16:3e:8d:51:0f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9205b46e-8a", "ovs_interfaceid": "9205b46e-8a1f-49e3-99c3-dfc929263fa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:08:28.251428 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-808ce3ec-6f12-4586-bb0d-133b0b3cbfc0 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converting VIF {"id": "9205b46e-8a1f-49e3-99c3-dfc929263fa3", "address": "fa:16:3e:8d:51:0f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9205b46e-8a", "ovs_interfaceid": "9205b46e-8a1f-49e3-99c3-dfc929263fa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:08:28.258303 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-808ce3ec-6f12-4586-bb0d-133b0b3cbfc0 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:51:0f,bridge_name='br-int',has_traffic_filtering=True,id=9205b46e-8a1f-49e3-99c3-dfc929263fa3,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9205b46e-8a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:08:28.259935 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-808ce3ec-6f12-4586-bb0d-133b0b3cbfc0 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:51:0f,bridge_name='br-int',has_traffic_filtering=True,id=9205b46e-8a1f-49e3-99c3-dfc929263fa3,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9205b46e-8a') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:08:28.269609 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:28.270024 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9205b46e-8a, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:08:28.271406 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:28.273010 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:08:28.276227 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:28.276509 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b9a3822-577e-454a-bcc5-f639c5e001d2) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:08:28.277058 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:28.277711 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:08:28.281711 np0000001577 nova-compute[98319]: INFO os_vif [None req-808ce3ec-6f12-4586-bb0d-133b0b3cbfc0 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:51:0f,bridge_name='br-int',has_traffic_filtering=True,id=9205b46e-8a1f-49e3-99c3-dfc929263fa3,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9205b46e-8a')
May 28 01:08:28.281992 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-808ce3ec-6f12-4586-bb0d-133b0b3cbfc0 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Deleting instance files /opt/stack/data/nova/instances/48bfd06f-62f4-4691-bf98-2426e359a90e_del
May 28 01:08:28.282933 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-808ce3ec-6f12-4586-bb0d-133b0b3cbfc0 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Deletion of /opt/stack/data/nova/instances/48bfd06f-62f4-4691-bf98-2426e359a90e_del complete
May 28 01:08:28.697268 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:08:28.702400 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:08:28.707922 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:08:28.707922 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:08:28.707922 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:08:28.707922 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:08:28.707922 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:08:28.707922 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:08:28.789484 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-808ce3ec-6f12-4586-bb0d-133b0b3cbfc0 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Took 1.40 seconds to destroy the instance on the hypervisor.
May 28 01:08:28.790138 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-808ce3ec-6f12-4586-bb0d-133b0b3cbfc0 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:08:28.790509 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:08:28.790656 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:08:28.790899 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:28.924254 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:29.211124 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:08:29.211662 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930509.2112653, 4d7b37c7-b091-44f7-a330-4e55e2b1e348 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:08:29.211662 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] VM Paused (Lifecycle Event)
May 28 01:08:29.215570 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Took 6.40 seconds to spawn the instance on the hypervisor.
May 28 01:08:29.215570 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:08:29.461485 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7bac0d6b-feb3-40ae-9849-f7dd53fa5bbc req-91594886-9a7e-40ac-a5eb-42c707b128b3 service nova] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Received event network-vif-plugged-bb9312b6-5458-47c9-aac1-0cccedf5d70b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:08:29.465339 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7bac0d6b-feb3-40ae-9849-f7dd53fa5bbc req-91594886-9a7e-40ac-a5eb-42c707b128b3 service nova] Acquiring lock "4d7b37c7-b091-44f7-a330-4e55e2b1e348-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:29.465339 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7bac0d6b-feb3-40ae-9849-f7dd53fa5bbc req-91594886-9a7e-40ac-a5eb-42c707b128b3 service nova] Lock "4d7b37c7-b091-44f7-a330-4e55e2b1e348-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:29.465339 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7bac0d6b-feb3-40ae-9849-f7dd53fa5bbc req-91594886-9a7e-40ac-a5eb-42c707b128b3 service nova] Lock "4d7b37c7-b091-44f7-a330-4e55e2b1e348-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:29.465339 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7bac0d6b-feb3-40ae-9849-f7dd53fa5bbc req-91594886-9a7e-40ac-a5eb-42c707b128b3 service nova] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] No waiting events found dispatching network-vif-plugged-bb9312b6-5458-47c9-aac1-0cccedf5d70b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:08:29.465339 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-7bac0d6b-feb3-40ae-9849-f7dd53fa5bbc req-91594886-9a7e-40ac-a5eb-42c707b128b3 service nova] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Received unexpected event network-vif-plugged-bb9312b6-5458-47c9-aac1-0cccedf5d70b for instance with vm_state active and task_state None.
May 28 01:08:29.465339 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c5449f1b-687e-412b-86f2-c518a751362b req-4bcf3b2a-894a-48cb-83d0-45c2a59346f1 service nova] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Received event network-vif-deleted-9205b46e-8a1f-49e3-99c3-dfc929263fa3 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:08:29.465339 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-c5449f1b-687e-412b-86f2-c518a751362b req-4bcf3b2a-894a-48cb-83d0-45c2a59346f1 service nova] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Neutron deleted interface 9205b46e-8a1f-49e3-99c3-dfc929263fa3; detaching it from the instance and deleting it from the info cache
May 28 01:08:29.468914 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c5449f1b-687e-412b-86f2-c518a751362b req-4bcf3b2a-894a-48cb-83d0-45c2a59346f1 service nova] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Detach interface failed, port_id=9205b46e-8a1f-49e3-99c3-dfc929263fa3, reason: Instance 48bfd06f-62f4-4691-bf98-2426e359a90e could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:08:29.649428 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-00613074-6dae-40f9-8fb5-71e003a13356 req-bd8389c9-b8f0-43c9-8b2e-44bb8ff4061c service nova] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Received event network-vif-unplugged-9205b46e-8a1f-49e3-99c3-dfc929263fa3 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:08:29.649694 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-00613074-6dae-40f9-8fb5-71e003a13356 req-bd8389c9-b8f0-43c9-8b2e-44bb8ff4061c service nova] Acquiring lock "48bfd06f-62f4-4691-bf98-2426e359a90e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:29.649809 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-00613074-6dae-40f9-8fb5-71e003a13356 req-bd8389c9-b8f0-43c9-8b2e-44bb8ff4061c service nova] Lock "48bfd06f-62f4-4691-bf98-2426e359a90e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:29.649926 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-00613074-6dae-40f9-8fb5-71e003a13356 req-bd8389c9-b8f0-43c9-8b2e-44bb8ff4061c service nova] Lock "48bfd06f-62f4-4691-bf98-2426e359a90e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:29.652470 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-00613074-6dae-40f9-8fb5-71e003a13356 req-bd8389c9-b8f0-43c9-8b2e-44bb8ff4061c service nova] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] No waiting events found dispatching network-vif-unplugged-9205b46e-8a1f-49e3-99c3-dfc929263fa3 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:08:29.652470 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-00613074-6dae-40f9-8fb5-71e003a13356 req-bd8389c9-b8f0-43c9-8b2e-44bb8ff4061c service nova] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Received event network-vif-unplugged-9205b46e-8a1f-49e3-99c3-dfc929263fa3 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:08:29.719231 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:08:29.725100 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930509.7248418, 4d7b37c7-b091-44f7-a330-4e55e2b1e348 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:08:29.725219 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] VM Resumed (Lifecycle Event)
May 28 01:08:29.731113 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Took 11.83 seconds to build instance.
May 28 01:08:29.920302 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:08:30.227304 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:08:30.230737 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:08:30.232233 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0526e611-ecca-435b-90c4-e6dd2d053190 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "4d7b37c7-b091-44f7-a330-4e55e2b1e348" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.341s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:30.424466 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Took 1.63 seconds to deallocate network for instance.
May 28 01:08:30.956177 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-808ce3ec-6f12-4586-bb0d-133b0b3cbfc0 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:30.956338 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-808ce3ec-6f12-4586-bb0d-133b0b3cbfc0 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:31.215861 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-808ce3ec-6f12-4586-bb0d-133b0b3cbfc0 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:08:31.215965 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-808ce3ec-6f12-4586-bb0d-133b0b3cbfc0 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:08:31.481425 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:31.718536 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-808ce3ec-6f12-4586-bb0d-133b0b3cbfc0 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:08:32.200282 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-db53e98b-a9e8-4cf5-b102-24a94178b08a req-54c04c97-7428-4113-a105-b0ca3f2780e7 service nova] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Received event network-changed-bb9312b6-5458-47c9-aac1-0cccedf5d70b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:08:32.200395 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-db53e98b-a9e8-4cf5-b102-24a94178b08a req-54c04c97-7428-4113-a105-b0ca3f2780e7 service nova] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Refreshing instance network info cache due to event network-changed-bb9312b6-5458-47c9-aac1-0cccedf5d70b. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:08:32.200840 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-db53e98b-a9e8-4cf5-b102-24a94178b08a req-54c04c97-7428-4113-a105-b0ca3f2780e7 service nova] Acquiring lock "refresh_cache-4d7b37c7-b091-44f7-a330-4e55e2b1e348" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:08:32.201282 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-db53e98b-a9e8-4cf5-b102-24a94178b08a req-54c04c97-7428-4113-a105-b0ca3f2780e7 service nova] Acquired lock "refresh_cache-4d7b37c7-b091-44f7-a330-4e55e2b1e348" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:08:32.201424 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-db53e98b-a9e8-4cf5-b102-24a94178b08a req-54c04c97-7428-4113-a105-b0ca3f2780e7 service nova] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Refreshing network info cache for port bb9312b6-5458-47c9-aac1-0cccedf5d70b {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:08:32.228068 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-808ce3ec-6f12-4586-bb0d-133b0b3cbfc0 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.272s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:32.284980 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-808ce3ec-6f12-4586-bb0d-133b0b3cbfc0 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Deleted allocations for instance 48bfd06f-62f4-4691-bf98-2426e359a90e
May 28 01:08:32.703795 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-db53e98b-a9e8-4cf5-b102-24a94178b08a req-54c04c97-7428-4113-a105-b0ca3f2780e7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:33.083838 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-db53e98b-a9e8-4cf5-b102-24a94178b08a req-54c04c97-7428-4113-a105-b0ca3f2780e7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:33.232688 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-db53e98b-a9e8-4cf5-b102-24a94178b08a req-54c04c97-7428-4113-a105-b0ca3f2780e7 service nova] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Updated VIF entry in instance network info cache for port bb9312b6-5458-47c9-aac1-0cccedf5d70b. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:08:33.232924 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-db53e98b-a9e8-4cf5-b102-24a94178b08a req-54c04c97-7428-4113-a105-b0ca3f2780e7 service nova] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Updating instance_info_cache with network_info: [{"id": "bb9312b6-5458-47c9-aac1-0cccedf5d70b", "address": "fa:16:3e:ab:f4:27", "network": {"id": "8bf5903d-3155-48fb-98dd-859e96b349d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1733749547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92f49e31415146d281ba6b462016d5d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb9312b6-54", "ovs_interfaceid": "bb9312b6-5458-47c9-aac1-0cccedf5d70b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:08:33.278783 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:33.311025 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-808ce3ec-6f12-4586-bb0d-133b0b3cbfc0 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "48bfd06f-62f4-4691-bf98-2426e359a90e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.457s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:33.734639 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-db53e98b-a9e8-4cf5-b102-24a94178b08a req-54c04c97-7428-4113-a105-b0ca3f2780e7 service nova] Releasing lock "refresh_cache-4d7b37c7-b091-44f7-a330-4e55e2b1e348" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:08:36.482242 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:37.621947 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "412ac56c-f524-46c2-91eb-fa4672db46a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:37.622459 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:37.978234 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:08:37.978575 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:08:38.123888 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:08:38.280006 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:38.666907 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:38.667289 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:38.670357 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:08:38.670528 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Claim successful on node np0000001577
May 28 01:08:38.977973 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:08:39.482693 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:39.929569 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:08:39.929979 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:08:40.432138 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:08:40.937671 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.270s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:40.938666 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.455s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:40.938902 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:08:40.940878 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:40.941120 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Auditing locally available compute resources for np0000001577 (node: np0000001577) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 01:08:41.445961 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:08:41.446220 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:08:41.446454 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:41.446730 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:41.483121 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:41.518133 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fbae7974478d45b3908aaaa5b4408e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a430f0d6bcc84a29bc3e96514422896b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:08:41.948958 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:08:41.980713 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:08:41.982118 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d7b37c7-b091-44f7-a330-4e55e2b1e348/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:42.001828 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Successfully created port: 4e4e8646-56c4-4135-b704-3eda00177287 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:08:42.072976 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d7b37c7-b091-44f7-a330-4e55e2b1e348/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:08:42.073372 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d7b37c7-b091-44f7-a330-4e55e2b1e348/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:42.160534 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d7b37c7-b091-44f7-a330-4e55e2b1e348/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:08:42.166520 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e4832e-32b9-44a7-92b8-6fa82e642515/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:42.267030 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e4832e-32b9-44a7-92b8-6fa82e642515/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:08:42.267645 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e4832e-32b9-44a7-92b8-6fa82e642515/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:42.353575 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5e4832e-32b9-44a7-92b8-6fa82e642515/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:08:42.358041 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:42.442751 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Successfully updated port: 4e4e8646-56c4-4135-b704-3eda00177287 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:08:42.444590 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:08:42.446477 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:42.460340 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:08:42.503949 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a0a8df3f-97d5-4af5-b914-b0d7a1e0ae08 req-46ca2aed-54e9-4ad3-a03e-6b3ec01832ea service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Received event network-changed-4e4e8646-56c4-4135-b704-3eda00177287 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:08:42.504100 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a0a8df3f-97d5-4af5-b914-b0d7a1e0ae08 req-46ca2aed-54e9-4ad3-a03e-6b3ec01832ea service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Refreshing instance network info cache due to event network-changed-4e4e8646-56c4-4135-b704-3eda00177287. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:08:42.505710 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a0a8df3f-97d5-4af5-b914-b0d7a1e0ae08 req-46ca2aed-54e9-4ad3-a03e-6b3ec01832ea service nova] Acquiring lock "refresh_cache-412ac56c-f524-46c2-91eb-fa4672db46a9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:08:42.505710 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a0a8df3f-97d5-4af5-b914-b0d7a1e0ae08 req-46ca2aed-54e9-4ad3-a03e-6b3ec01832ea service nova] Acquired lock "refresh_cache-412ac56c-f524-46c2-91eb-fa4672db46a9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:08:42.505710 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-a0a8df3f-97d5-4af5-b914-b0d7a1e0ae08 req-46ca2aed-54e9-4ad3-a03e-6b3ec01832ea service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Refreshing network info cache for port 4e4e8646-56c4-4135-b704-3eda00177287 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:08:42.533559 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:08:42.533915 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:08:42.538198 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:08:42.539083 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:42.583860 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "env LANG=C uptime" returned: 0 in 0.044s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:08:42.584496 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Hypervisor/Node resource view: name=np0000001577 free_ram=12227MB free_disk=72.89998245239258GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 01:08:42.584685 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:42.584907 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:42.724016 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0005049450001024525 future=<Future at 0x7c9870547590 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:08:42.724358 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:08:42.724789 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Emitting event <LifecycleEvent: 1779930507.7233906, 48bfd06f-62f4-4691-bf98-2426e359a90e => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:08:42.724978 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] VM Stopped (Lifecycle Event)
May 28 01:08:42.945666 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "refresh_cache-412ac56c-f524-46c2-91eb-fa4672db46a9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:08:43.006446 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-a0a8df3f-97d5-4af5-b914-b0d7a1e0ae08 req-46ca2aed-54e9-4ad3-a03e-6b3ec01832ea service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:43.083390 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-a0a8df3f-97d5-4af5-b914-b0d7a1e0ae08 req-46ca2aed-54e9-4ad3-a03e-6b3ec01832ea service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:08:43.229433 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 48bfd06f-62f4-4691-bf98-2426e359a90e] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:08:43.281808 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:43.326435 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-a0a8df3f-97d5-4af5-b914-b0d7a1e0ae08 req-46ca2aed-54e9-4ad3-a03e-6b3ec01832ea service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:08:43.473884 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:08:43.475002 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:08:43.475297 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Creating image(s)
May 28 01:08:43.476003 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "/opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:43.476197 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "/opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:43.476672 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "/opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:43.477423 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:08:43.480197 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:08:43.481207 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:43.569088 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.087s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:08:43.569678 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:43.570198 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:43.570824 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:08:43.574316 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:08:43.574794 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:43.660304 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 1e7c5308-80cc-4991-8626-2ba32fa09acf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:08:43.661702 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 9e7ca386-dbea-461e-9cf2-7e135bd3758d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:08:43.661702 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance d5e4832e-32b9-44a7-92b8-6fa82e642515 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:08:43.661702 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 4d7b37c7-b091-44f7-a330-4e55e2b1e348 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:08:43.661702 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 412ac56c-f524-46c2-91eb-fa4672db46a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:08:43.661702 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 01:08:43.661702 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Final resource view: name=np0000001577 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:08:42 up 40 min,  2 users,  load average: 5.41, 6.14, 4.30\n', 'num_instances': '5', 'num_vm_active': '4', 'num_task_None': '4', 'num_os_type_None': '5', 'num_proj_23578125da1e4bf2bb3d59281a0e261e': '1', 'io_workload': '1', 'num_proj_050f928f1ce449d6a447cd343dc4ff80': '1', 'num_proj_f132ca2a48c44f6097340763039224c1': '1', 'num_proj_92f49e31415146d281ba6b462016d5d4': '1', 'num_vm_building': '1', 'num_task_block_device_mapping': '1', 'num_proj_a430f0d6bcc84a29bc3e96514422896b': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 01:08:43.669633 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.095s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:08:43.670004 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:43.736609 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk 1073741824" returned: 0 in 0.066s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:08:43.736806 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.166s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:43.737028 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:43.828973 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a0a8df3f-97d5-4af5-b914-b0d7a1e0ae08 req-46ca2aed-54e9-4ad3-a03e-6b3ec01832ea service nova] Releasing lock "refresh_cache-412ac56c-f524-46c2-91eb-fa4672db46a9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:08:43.830018 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquired lock "refresh_cache-412ac56c-f524-46c2-91eb-fa4672db46a9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:08:43.830817 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:08:43.837567 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.100s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:08:43.838305 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Checking if we can resize image /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:08:43.838305 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:43.930570 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:08:43.930570 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Cannot resize image /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:08:43.930570 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:08:43.930570 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Ensure instance console log exists: /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:08:43.930570 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:43.930875 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:43.930875 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:44.057305 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:08:44.057619 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:08:44.438609 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:08:44.560603 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:08:44.586108 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:44.715104 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Updating instance_info_cache with network_info: [{"id": "4e4e8646-56c4-4135-b704-3eda00177287", "address": "fa:16:3e:d7:12:9f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e8646-56", "ovs_interfaceid": "4e4e8646-56c4-4135-b704-3eda00177287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:08:45.068564 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Compute_service record updated for np0000001577:np0000001577 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 01:08:45.068836 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.484s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:45.071338 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:08:45.218586 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Releasing lock "refresh_cache-412ac56c-f524-46c2-91eb-fa4672db46a9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:08:45.218875 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Instance network_info: |[{"id": "4e4e8646-56c4-4135-b704-3eda00177287", "address": "fa:16:3e:d7:12:9f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e8646-56", "ovs_interfaceid": "4e4e8646-56c4-4135-b704-3eda00177287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:08:45.220774 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Start _get_guest_xml network_info=[{"id": "4e4e8646-56c4-4135-b704-3eda00177287", "address": "fa:16:3e:d7:12:9f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e8646-56", "ovs_interfaceid": "4e4e8646-56c4-4135-b704-3eda00177287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:08:45.222815 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:08:45.224385 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1464485741', uuid='412ac56c-f524-46c2-91eb-fa4672db46a9'), owner=OwnerMeta(userid='fbae7974478d45b3908aaaa5b4408e26', username='tempest-TestEncryptedCinderVolumes-2086871542-project-member', projectid='a430f0d6bcc84a29bc3e96514422896b', projectname='tempest-TestEncryptedCinderVolumes-2086871542'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4e4e8646-56c4-4135-b704-3eda00177287", "address": "fa:16:3e:d7:12:9f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e8646-56", "ovs_interfaceid": "4e4e8646-56c4-4135-b704-3eda00177287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930525.2240405) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:08:45.225754 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:08:45.226057 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:08:45.226902 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:08:45.227051 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:08:45.228037 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:08:45.228335 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:08:45.228461 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:08:45.228565 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:08:45.228693 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:08:45.228778 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:08:45.228864 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:08:45.229036 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:08:45.229129 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:08:45.229245 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:08:45.229340 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:08:45.229448 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:08:45.239976 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1464485741',display_name='tempest-TestEncryptedCinderVolumes-server-1464485741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testencryptedcindervolumes-server-1464485741',id=59,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaxiVCL/oeyuc6Fn/LaDWPWiO7mXNOG+NJ+ojaTKJd77Zn7nrd05FgcX3093dXQNIvdpDxCbUKUzqvcTZNFcgRrrPUR46mHMo/POLXh0IP7v2hya+rwuFblpqAtbu1bbg==',key_name='tempest-keypair-1398822484',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a430f0d6bcc84a29bc3e96514422896b',ramdisk_id='',reservation_id='r-nu20f4t0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-2086871542',owner_user_name='tempest-TestEncryptedCinderVolumes-2086871542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:08:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbae7974478d45b3908aaaa5b4408e26',uuid=412ac56c-f524-46c2-91eb-fa4672db46a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e4e8646-56c4-4135-b704-3eda00177287", "address": "fa:16:3e:d7:12:9f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e8646-56", "ovs_interfaceid": "4e4e8646-56c4-4135-b704-3eda00177287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:08:45.240303 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converting VIF {"id": "4e4e8646-56c4-4135-b704-3eda00177287", "address": "fa:16:3e:d7:12:9f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e8646-56", "ovs_interfaceid": "4e4e8646-56c4-4135-b704-3eda00177287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:08:45.240928 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:12:9f,bridge_name='br-int',has_traffic_filtering=True,id=4e4e8646-56c4-4135-b704-3eda00177287,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e8646-56') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:08:45.241589 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lazy-loading 'pci_devices' on Instance uuid 412ac56c-f524-46c2-91eb-fa4672db46a9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:08:45.743954 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] End _get_guest_xml xml=<domain type="qemu">
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:   <uuid>412ac56c-f524-46c2-91eb-fa4672db46a9</uuid>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:   <name>instance-0000003b</name>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1464485741</nova:name>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:08:45</nova:creationTime>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:         <nova:user uuid="fbae7974478d45b3908aaaa5b4408e26">tempest-TestEncryptedCinderVolumes-2086871542-project-member</nova:user>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:         <nova:project uuid="a430f0d6bcc84a29bc3e96514422896b">tempest-TestEncryptedCinderVolumes-2086871542</nova:project>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:         <nova:port uuid="4e4e8646-56c4-4135-b704-3eda00177287">
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:     <system>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       <entry name="serial">412ac56c-f524-46c2-91eb-fa4672db46a9</entry>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       <entry name="uuid">412ac56c-f524-46c2-91eb-fa4672db46a9</entry>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:     </system>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:   <os>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:   </os>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:   <features>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:   </features>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:   <devices>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk"/>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:     </disk>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk.config"/>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:     </disk>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:d7:12:9f"/>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       <target dev="tap4e4e8646-56"/>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:     </interface>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/console.log" append="off"/>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:     </serial>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:     <video>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:     </video>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:     </rng>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:   </devices>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]: </domain>
May 28 01:08:45.743954 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:08:45.745926 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Preparing to wait for external event network-vif-plugged-4e4e8646-56c4-4135-b704-3eda00177287 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:08:45.745926 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:45.745926 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:45.745926 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:45.745926 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1464485741',display_name='tempest-TestEncryptedCinderVolumes-server-1464485741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testencryptedcindervolumes-server-1464485741',id=59,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaxiVCL/oeyuc6Fn/LaDWPWiO7mXNOG+NJ+ojaTKJd77Zn7nrd05FgcX3093dXQNIvdpDxCbUKUzqvcTZNFcgRrrPUR46mHMo/POLXh0IP7v2hya+rwuFblpqAtbu1bbg==',key_name='tempest-keypair-1398822484',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a430f0d6bcc84a29bc3e96514422896b',ramdisk_id='',reservation_id='r-nu20f4t0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-2086871542',owner_user_name='tempest-TestEncryptedCinderVolumes-2086871542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:08:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbae7974478d45b3908aaaa5b4408e26',uuid=412ac56c-f524-46c2-91eb-fa4672db46a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e4e8646-56c4-4135-b704-3eda00177287", "address": "fa:16:3e:d7:12:9f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e8646-56", "ovs_interfaceid": "4e4e8646-56c4-4135-b704-3eda00177287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:08:45.745926 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converting VIF {"id": "4e4e8646-56c4-4135-b704-3eda00177287", "address": "fa:16:3e:d7:12:9f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e8646-56", "ovs_interfaceid": "4e4e8646-56c4-4135-b704-3eda00177287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:08:45.745926 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:12:9f,bridge_name='br-int',has_traffic_filtering=True,id=4e4e8646-56c4-4135-b704-3eda00177287,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e8646-56') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:08:45.745926 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:12:9f,bridge_name='br-int',has_traffic_filtering=True,id=4e4e8646-56c4-4135-b704-3eda00177287,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e8646-56') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:08:45.746424 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:45.746462 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:08:45.746740 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:08:45.747492 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:45.747685 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3655c88f-41d6-5a9e-b4ef-7de38bc60c61', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:08:45.748348 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:45.749113 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:08:45.749850 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:45.752485 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:45.752612 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e4e8646-56, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:08:45.752886 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e4e8646-56, col_values=(('qos', UUID('5a217bf5-63ab-4466-ac6e-985edc14b48f')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:08:45.753046 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e4e8646-56, col_values=(('external_ids', {'iface-id': '4e4e8646-56c4-4135-b704-3eda00177287', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:12:9f', 'vm-uuid': '412ac56c-f524-46c2-91eb-fa4672db46a9'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:08:45.755064 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:45.755064 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:08:45.760457 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:45.760659 np0000001577 nova-compute[98319]: INFO os_vif [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:12:9f,bridge_name='br-int',has_traffic_filtering=True,id=4e4e8646-56c4-4135-b704-3eda00177287,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e8646-56')
May 28 01:08:46.071328 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:08:46.071661 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:08:46.071808 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:08:46.072013 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:08:46.072238 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:08:46.072448 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:08:46.072679 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:08:46.072812 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 01:08:46.073038 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 44.90 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:08:46.485228 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:47.277490 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:08:47.277898 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:08:47.277898 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] No VIF found with MAC fa:16:3e:d7:12:9f, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:08:47.278136 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Using config drive
May 28 01:08:47.782765 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:47.893460 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Creating config drive at /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk.config
May 28 01:08:47.897030 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpb_a0yclj {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:47.950563 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpb_a0yclj" returned: 0 in 0.051s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:08:48.400325 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:48.427970 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:48.507575 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:48.570287 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-948b6b48-09a9-4419-a8f2-65c00a299891 req-c28ec961-5923-4563-8e86-add71fc3b0ea service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Received event network-vif-plugged-4e4e8646-56c4-4135-b704-3eda00177287 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:08:48.570526 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-948b6b48-09a9-4419-a8f2-65c00a299891 req-c28ec961-5923-4563-8e86-add71fc3b0ea service nova] Acquiring lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:48.571048 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-948b6b48-09a9-4419-a8f2-65c00a299891 req-c28ec961-5923-4563-8e86-add71fc3b0ea service nova] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:48.571310 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-948b6b48-09a9-4419-a8f2-65c00a299891 req-c28ec961-5923-4563-8e86-add71fc3b0ea service nova] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:48.571524 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-948b6b48-09a9-4419-a8f2-65c00a299891 req-c28ec961-5923-4563-8e86-add71fc3b0ea service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Processing event network-vif-plugged-4e4e8646-56c4-4135-b704-3eda00177287 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:08:48.753070 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:48.758098 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:48.774488 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:48.776326 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:49.174279 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930529.173834, 412ac56c-f524-46c2-91eb-fa4672db46a9 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:08:49.174428 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] VM Started (Lifecycle Event)
May 28 01:08:49.176643 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:08:49.178947 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:08:49.181011 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Instance spawned successfully.
May 28 01:08:49.181281 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:08:49.678514 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:08:49.680265 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:08:49.687402 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:08:49.687635 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:08:49.687871 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:08:49.688076 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:08:49.688331 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:08:49.688564 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:08:50.183187 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:08:50.183650 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930530.1832774, 412ac56c-f524-46c2-91eb-fa4672db46a9 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:08:50.183650 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] VM Paused (Lifecycle Event)
May 28 01:08:50.193682 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Took 6.72 seconds to spawn the instance on the hypervisor.
May 28 01:08:50.193810 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:08:50.622296 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-af877565-8eb5-447a-bdd4-ae81294fbc3d req-282e507d-e354-4c7d-81dd-96146ff108e1 service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Received event network-vif-plugged-4e4e8646-56c4-4135-b704-3eda00177287 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:08:50.622478 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-af877565-8eb5-447a-bdd4-ae81294fbc3d req-282e507d-e354-4c7d-81dd-96146ff108e1 service nova] Acquiring lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:50.622628 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-af877565-8eb5-447a-bdd4-ae81294fbc3d req-282e507d-e354-4c7d-81dd-96146ff108e1 service nova] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:50.622841 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-af877565-8eb5-447a-bdd4-ae81294fbc3d req-282e507d-e354-4c7d-81dd-96146ff108e1 service nova] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:50.622942 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-af877565-8eb5-447a-bdd4-ae81294fbc3d req-282e507d-e354-4c7d-81dd-96146ff108e1 service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] No waiting events found dispatching network-vif-plugged-4e4e8646-56c4-4135-b704-3eda00177287 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:08:50.623052 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-af877565-8eb5-447a-bdd4-ae81294fbc3d req-282e507d-e354-4c7d-81dd-96146ff108e1 service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Received unexpected event network-vif-plugged-4e4e8646-56c4-4135-b704-3eda00177287 for instance with vm_state active and task_state None.
May 28 01:08:50.687962 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:08:50.689691 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930530.6895125, 412ac56c-f524-46c2-91eb-fa4672db46a9 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:08:50.689793 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] VM Resumed (Lifecycle Event)
May 28 01:08:50.703574 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Took 12.08 seconds to build instance.
May 28 01:08:50.755361 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:51.192690 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:08:51.194288 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:08:51.205539 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-519ca5dc-6f3c-4ee6-8b4d-3fafd62d2278 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.583s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:51.487329 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:51.836340 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f93ef9bc-d1b9-4ade-a949-c6e38ce42bab req-4e051b80-aa18-46ce-8820-04d876cf0f5c service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Received event network-changed-4e4e8646-56c4-4135-b704-3eda00177287 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:08:51.836807 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f93ef9bc-d1b9-4ade-a949-c6e38ce42bab req-4e051b80-aa18-46ce-8820-04d876cf0f5c service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Refreshing instance network info cache due to event network-changed-4e4e8646-56c4-4135-b704-3eda00177287. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:08:51.836979 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f93ef9bc-d1b9-4ade-a949-c6e38ce42bab req-4e051b80-aa18-46ce-8820-04d876cf0f5c service nova] Acquiring lock "refresh_cache-412ac56c-f524-46c2-91eb-fa4672db46a9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:08:51.837087 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f93ef9bc-d1b9-4ade-a949-c6e38ce42bab req-4e051b80-aa18-46ce-8820-04d876cf0f5c service nova] Acquired lock "refresh_cache-412ac56c-f524-46c2-91eb-fa4672db46a9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:08:51.837254 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-f93ef9bc-d1b9-4ade-a949-c6e38ce42bab req-4e051b80-aa18-46ce-8820-04d876cf0f5c service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Refreshing network info cache for port 4e4e8646-56c4-4135-b704-3eda00177287 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:08:52.339113 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-f93ef9bc-d1b9-4ade-a949-c6e38ce42bab req-4e051b80-aa18-46ce-8820-04d876cf0f5c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:52.648757 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-f93ef9bc-d1b9-4ade-a949-c6e38ce42bab req-4e051b80-aa18-46ce-8820-04d876cf0f5c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:52.760797 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-f93ef9bc-d1b9-4ade-a949-c6e38ce42bab req-4e051b80-aa18-46ce-8820-04d876cf0f5c service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Updated VIF entry in instance network info cache for port 4e4e8646-56c4-4135-b704-3eda00177287. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:08:52.761058 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-f93ef9bc-d1b9-4ade-a949-c6e38ce42bab req-4e051b80-aa18-46ce-8820-04d876cf0f5c service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Updating instance_info_cache with network_info: [{"id": "4e4e8646-56c4-4135-b704-3eda00177287", "address": "fa:16:3e:d7:12:9f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e8646-56", "ovs_interfaceid": "4e4e8646-56c4-4135-b704-3eda00177287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:08:53.263088 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f93ef9bc-d1b9-4ade-a949-c6e38ce42bab req-4e051b80-aa18-46ce-8820-04d876cf0f5c service nova] Releasing lock "refresh_cache-412ac56c-f524-46c2-91eb-fa4672db46a9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:08:54.821847 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "4d7b37c7-b091-44f7-a330-4e55e2b1e348" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:54.821847 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "4d7b37c7-b091-44f7-a330-4e55e2b1e348" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:54.993504 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "9e7ca386-dbea-461e-9cf2-7e135bd3758d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:54.993687 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "9e7ca386-dbea-461e-9cf2-7e135bd3758d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:54.993886 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "9e7ca386-dbea-461e-9cf2-7e135bd3758d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:54.994026 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "9e7ca386-dbea-461e-9cf2-7e135bd3758d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:54.994132 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "9e7ca386-dbea-461e-9cf2-7e135bd3758d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:54.996229 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Terminating instance
May 28 01:08:55.325950 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lazy-loading 'flavor' on Instance uuid 4d7b37c7-b091-44f7-a330-4e55e2b1e348 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:08:55.499092 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:08:55.525978 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:55.529023 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:55.548563 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:55.556196 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:55.577139 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:55.584653 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:55.672339 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8f2e36bf-851c-4e9a-911d-44a1fa7725df req-b4957a1c-68d8-47ce-a163-0fb05596781b service nova] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Received event network-vif-unplugged-4138127d-166a-4844-b2a4-426d5014fc37 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:08:55.672608 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8f2e36bf-851c-4e9a-911d-44a1fa7725df req-b4957a1c-68d8-47ce-a163-0fb05596781b service nova] Acquiring lock "9e7ca386-dbea-461e-9cf2-7e135bd3758d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:55.672769 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8f2e36bf-851c-4e9a-911d-44a1fa7725df req-b4957a1c-68d8-47ce-a163-0fb05596781b service nova] Lock "9e7ca386-dbea-461e-9cf2-7e135bd3758d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:55.672889 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8f2e36bf-851c-4e9a-911d-44a1fa7725df req-b4957a1c-68d8-47ce-a163-0fb05596781b service nova] Lock "9e7ca386-dbea-461e-9cf2-7e135bd3758d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:55.673010 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8f2e36bf-851c-4e9a-911d-44a1fa7725df req-b4957a1c-68d8-47ce-a163-0fb05596781b service nova] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] No waiting events found dispatching network-vif-unplugged-4138127d-166a-4844-b2a4-426d5014fc37 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:08:55.673150 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8f2e36bf-851c-4e9a-911d-44a1fa7725df req-b4957a1c-68d8-47ce-a163-0fb05596781b service nova] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Received event network-vif-unplugged-4138127d-166a-4844-b2a4-426d5014fc37 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:08:55.755562 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:55.824059 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999644298000021 future=<Future at 0x7c984c7e9bb0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:08:55.825254 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.99841294800035 future=<Future at 0x7c984c7e9bb0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:08:55.825386 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.998264812000343 future=<Future at 0x7c984c7e9bb0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:08:55.831053 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Instance destroyed successfully.
May 28 01:08:55.831570 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lazy-loading 'resources' on Instance uuid 9e7ca386-dbea-461e-9cf2-7e135bd3758d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:08:56.176503 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:08:56.335538 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "4d7b37c7-b091-44f7-a330-4e55e2b1e348" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:56.336560 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:07:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-813060794',display_name='tempest-TestVolumeBootPattern-server-813060794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpattern-server-813060794',id=56,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLDywRMt1gYjzqU0nLt38yv/dkf6iz5rhLwqujx5EHrUiUYa0LEwAEl6oAEMxfnED+yXkyyB7J9zFdusIexML2cYEzV2m5bo9N6+7QjUI/1FFtVJ+XDyI2kpbVbncy1iQ==',key_name='tempest-TestVolumeBootPattern-1635525277',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:08:15Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='050f928f1ce449d6a447cd343dc4ff80',ramdisk_id='',reservation_id='r-ab975sup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1449742411',owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:08:16Z,user_data=None,user_id='0c803ddeaf4f4b3db07587419087b3b2',uuid=9e7ca386-dbea-461e-9cf2-7e135bd3758d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4138127d-166a-4844-b2a4-426d5014fc37", "address": "fa:16:3e:f1:a3:d9", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4138127d-16", "ovs_interfaceid": "4138127d-166a-4844-b2a4-426d5014fc37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:08:56.336813 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converting VIF {"id": "4138127d-166a-4844-b2a4-426d5014fc37", "address": "fa:16:3e:f1:a3:d9", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4138127d-16", "ovs_interfaceid": "4138127d-166a-4844-b2a4-426d5014fc37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:08:56.337376 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:a3:d9,bridge_name='br-int',has_traffic_filtering=True,id=4138127d-166a-4844-b2a4-426d5014fc37,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4138127d-16') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:08:56.337599 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:a3:d9,bridge_name='br-int',has_traffic_filtering=True,id=4138127d-166a-4844-b2a4-426d5014fc37,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4138127d-16') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:08:56.339292 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:56.339675 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4138127d-16, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:08:56.340502 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:56.341287 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:08:56.341659 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:56.342303 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:56.342420 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=47dafb9b-1ccf-4e00-88bf-97b786db0055) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:08:56.342790 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:56.343239 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:08:56.343677 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:56.345131 np0000001577 nova-compute[98319]: INFO os_vif [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:a3:d9,bridge_name='br-int',has_traffic_filtering=True,id=4138127d-166a-4844-b2a4-426d5014fc37,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4138127d-16')
May 28 01:08:56.346363 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:08:56.346565 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '408b306f-e263-4cfa-a888-735b63628858', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:08:56.346695 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:08:56.488950 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:08:57.099880 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.753s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:08:57.100268 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '408b306f-e263-4cfa-a888-735b63628858', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:08:57.100372 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:08:57.120526 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:57.120526 np0000001577 nova-compute[98319]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:57.120526 np0000001577 nova-compute[98319]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:57.120526 np0000001577 nova-compute[98319]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:57.120526 np0000001577 nova-compute[98319]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31d706e2-e117-4a4b-af87-898a0160fddc (non-flash)
May 28 01:08:57.120526 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:08:57.120781 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:57.120781 np0000001577 nova-compute[98319]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:08:57.120781 np0000001577 nova-compute[98319]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:57.120781 np0000001577 nova-compute[98319]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:57.120781 np0000001577 nova-compute[98319]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31d706e2-e117-4a4b-af87-898a0160fddc (non-flash)
May 28 01:08:57.120781 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:08:57.120908 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', '133'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', '134'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', '136'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', '137'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31d706e2-e117-4a4b-af87-898a0160fddc', '140')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:08:57.121043 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', '133')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:08:57.123316 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', '134')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:08:57.123993 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c984c50a160>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858'): ({'sdh'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:08:57.124226 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Removing multipathed devices sdg, sdh {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:08:57.124431 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Flush multipath device 3300000005024929f {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:08:57.187777 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:08:57.233314 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:08:57.294752 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Checking to see if SCSI volumes sdg, sdh have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:08:57.294884 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] SCSI volumes sdg, sdh have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:08:57.295677 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Checking to see if device paths {'sdg', 'sdh'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:08:57.306240 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Device paths {'sdg', 'sdh'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:08:57.306405 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:08:57.315802 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:57.346749 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 133, target: iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858, portal: 192.168.40.100,3260]
May 28 01:08:57.346749 np0000001577 nova-compute[98319]: Logout of [sid: 133, target: iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858, portal: 192.168.40.100,3260] successful.
May 28 01:08:57.346749 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:57.359815 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:57.369960 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:57.383855 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "4d7b37c7-b091-44f7-a330-4e55e2b1e348" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:57.383855 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "4d7b37c7-b091-44f7-a330-4e55e2b1e348" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:57.383855 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Attaching volume 8442cc67-be8b-4ab5-b19c-99e61f047cbc to /dev/vdb
May 28 01:08:57.398045 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 134, target: iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858, portal: 192.168.50.100,3260]
May 28 01:08:57.398045 np0000001577 nova-compute[98319]: Logout of [sid: 134, target: iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858, portal: 192.168.50.100,3260] successful.
May 28 01:08:57.398045 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:57.415828 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:57.416018 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:08:57.416140 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] <== disconnect_volume: return (1069ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:08:57.416245 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:08:57.416503 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Deleting instance files /opt/stack/data/nova/instances/9e7ca386-dbea-461e-9cf2-7e135bd3758d_del
May 28 01:08:57.416951 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Deletion of /opt/stack/data/nova/instances/9e7ca386-dbea-461e-9cf2-7e135bd3758d_del complete
May 28 01:08:57.431996 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:08:57.441868 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:08:57.461868 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:08:57.501449 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:08:57.501748 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:08:57.511020 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:08:57.512230 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe55:fb7f', 'fe80::e071:f2ff:feee:4293', 'fe80::fc16:3eff:fe05:9ded', 'fe80::84b7:d3ff:feed:4f01', 'fe80::fc16:3eff:feab:f427', 'fe80::9c16:39ff:fe2e:9aef', 'fe80::fc16:3eff:fed7:129f', 'fe80::49a:a7ff:fef7:c9e8'] 
May 28 01:08:57.512388 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:08:57.512515 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:08:57.512795 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] <== get_connector_properties: return (81ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:08:57.513050 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Updating existing volume attachment record: 4a60b316-7491-4c02-bd55-628845dcedaa {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:08:57.730485 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-66b51d53-3973-4c84-bacc-773eafefa6a7 req-357dcd5c-bee8-452d-8317-290daaa2d3e7 service nova] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Received event network-vif-unplugged-4138127d-166a-4844-b2a4-426d5014fc37 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:08:57.730722 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-66b51d53-3973-4c84-bacc-773eafefa6a7 req-357dcd5c-bee8-452d-8317-290daaa2d3e7 service nova] Acquiring lock "9e7ca386-dbea-461e-9cf2-7e135bd3758d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:57.730980 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-66b51d53-3973-4c84-bacc-773eafefa6a7 req-357dcd5c-bee8-452d-8317-290daaa2d3e7 service nova] Lock "9e7ca386-dbea-461e-9cf2-7e135bd3758d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:57.731099 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-66b51d53-3973-4c84-bacc-773eafefa6a7 req-357dcd5c-bee8-452d-8317-290daaa2d3e7 service nova] Lock "9e7ca386-dbea-461e-9cf2-7e135bd3758d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:08:57.731401 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-66b51d53-3973-4c84-bacc-773eafefa6a7 req-357dcd5c-bee8-452d-8317-290daaa2d3e7 service nova] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] No waiting events found dispatching network-vif-unplugged-4138127d-166a-4844-b2a4-426d5014fc37 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:08:57.731598 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-66b51d53-3973-4c84-bacc-773eafefa6a7 req-357dcd5c-bee8-452d-8317-290daaa2d3e7 service nova] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Received event network-vif-unplugged-4138127d-166a-4844-b2a4-426d5014fc37 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:08:57.926302 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Took 2.43 seconds to destroy the instance on the hypervisor.
May 28 01:08:57.927308 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:08:57.927625 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:08:57.927755 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:08:57.928035 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:57.986790 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:08:58.068588 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:08:58.068889 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc', 'iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8442cc67-be8b-4ab5-b19c-99e61f047cbc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:08:58.069016 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:08:58.069347 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:08:58.069511 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc', 'iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8442cc67-be8b-4ab5-b19c-99e61f047cbc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:08:58.085125 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:08:58.085601 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:08:58.085778 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:08:58.086797 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:08:58.087339 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:08:58.087817 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:08:58.100780 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:08:58.100780 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:58.106320 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:08:58.106320 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:58.115566 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc] added
May 28 01:08:58.115566 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:08:58.115566 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:08:58.115566 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:08:58.115566 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:08:58.115566 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:08:58.115566 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:58.115566 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:08:58.115566 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0288(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:08:58.115566 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:08:58.119270 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc] added
May 28 01:08:58.119270 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:08:58.119270 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:08:58.119270 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:08:58.119270 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:08:58.119270 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:08:58.119270 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:58.119443 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:08:58.119593 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0318(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:08:58.119716 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:08:58.446891 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-579b3725-c784-4743-9110-9315f403afd9 req-01edc539-139a-46eb-8a90-058fa42845c2 service nova] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Received event network-vif-deleted-4138127d-166a-4844-b2a4-426d5014fc37 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:08:58.447416 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-579b3725-c784-4743-9110-9315f403afd9 req-01edc539-139a-46eb-8a90-058fa42845c2 service nova] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Neutron deleted interface 4138127d-166a-4844-b2a4-426d5014fc37; detaching it from the instance and deleting it from the info cache
May 28 01:08:58.449048 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-579b3725-c784-4743-9110-9315f403afd9 req-01edc539-139a-46eb-8a90-058fa42845c2 service nova] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Detach interface failed, port_id=4138127d-166a-4844-b2a4-426d5014fc37, reason: Instance 9e7ca386-dbea-461e-9cf2-7e135bd3758d could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:08:58.898436 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:08:58.965724 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "d5e4832e-32b9-44a7-92b8-6fa82e642515" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:08:58.965864 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "d5e4832e-32b9-44a7-92b8-6fa82e642515" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:08:59.115209 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:08:59.119981 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:08:59.129013 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:08:59.129013 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:08:59.137061 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:08:59.137061 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:59.141825 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:59.147834 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:59.157393 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:59.157393 np0000001577 nova-compute[98319]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:59.157393 np0000001577 nova-compute[98319]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31d706e2-e117-4a4b-af87-898a0160fddc (non-flash)
May 28 01:08:59.157393 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:08:59.157623 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsi session list stdout=tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:59.157623 np0000001577 nova-compute[98319]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:59.157623 np0000001577 nova-compute[98319]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31d706e2-e117-4a4b-af87-898a0160fddc (non-flash)
May 28 01:08:59.157623 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:08:59.162100 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:59.162100 np0000001577 nova-compute[98319]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:59.162100 np0000001577 nova-compute[98319]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31d706e2-e117-4a4b-af87-898a0160fddc (non-flash)
May 28 01:08:59.162100 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:08:59.162290 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsi session list stdout=tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:59.162290 np0000001577 nova-compute[98319]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:59.162290 np0000001577 nova-compute[98319]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31d706e2-e117-4a4b-af87-898a0160fddc (non-flash)
May 28 01:08:59.162290 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:08:59.191085 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc, portal: 192.168.40.100,3260]
May 28 01:08:59.191085 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc, portal: 192.168.40.100,3260] successful.
May 28 01:08:59.191085 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:59.200918 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc, portal: 192.168.50.100,3260]
May 28 01:08:59.200918 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc, portal: 192.168.50.100,3260] successful.
May 28 01:08:59.200918 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:59.201565 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:59.214976 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:08:59.218805 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:59.218805 np0000001577 nova-compute[98319]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:59.218805 np0000001577 nova-compute[98319]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31d706e2-e117-4a4b-af87-898a0160fddc (non-flash)
May 28 01:08:59.218805 np0000001577 nova-compute[98319]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc (non-flash)
May 28 01:08:59.218805 np0000001577 nova-compute[98319]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc (non-flash)
May 28 01:08:59.218805 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:08:59.218989 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsi session list stdout=tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:59.218989 np0000001577 nova-compute[98319]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:59.218989 np0000001577 nova-compute[98319]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31d706e2-e117-4a4b-af87-898a0160fddc (non-flash)
May 28 01:08:59.218989 np0000001577 nova-compute[98319]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc (non-flash)
May 28 01:08:59.218989 np0000001577 nova-compute[98319]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc (non-flash)
May 28 01:08:59.218989 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:08:59.219254 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.134s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:08:59.219390 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:08:59.220075 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] HCTL ('9', '-', '-', 0) found on session 141 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:08:59.220222 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:08:59.227021 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:59.227021 np0000001577 nova-compute[98319]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:59.227021 np0000001577 nova-compute[98319]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31d706e2-e117-4a4b-af87-898a0160fddc (non-flash)
May 28 01:08:59.227021 np0000001577 nova-compute[98319]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc (non-flash)
May 28 01:08:59.227021 np0000001577 nova-compute[98319]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc (non-flash)
May 28 01:08:59.227021 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:08:59.227261 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsi session list stdout=tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:59.227261 np0000001577 nova-compute[98319]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:08:59.227261 np0000001577 nova-compute[98319]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31d706e2-e117-4a4b-af87-898a0160fddc (non-flash)
May 28 01:08:59.227261 np0000001577 nova-compute[98319]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc (non-flash)
May 28 01:08:59.227261 np0000001577 nova-compute[98319]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc (non-flash)
May 28 01:08:59.227261 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:08:59.227366 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:08:59.227476 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:08:59.228135 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] HCTL ('10', '-', '-', 0) found on session 142 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:08:59.228239 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:08:59.240702 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Searching for a device in session 141 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:08:59.240702 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8442cc67-be8b-4ab5-b19c-99e61f047cbc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:08:59.260044 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Searching for a device in session 142 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:08:59.260044 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8442cc67-be8b-4ab5-b19c-99e61f047cbc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:08:59.403761 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Took 1.48 seconds to deallocate network for instance.
May 28 01:08:59.476774 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lazy-loading 'flavor' on Instance uuid d5e4832e-32b9-44a7-92b8-6fa82e642515 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:08:59.970315 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Took 0.57 seconds to detach 1 volumes for instance.
May 28 01:08:59.985480 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Ignoring supplied device name: /dev/vdb
May 28 01:09:00.088218 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:09:00.481741 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:00.481741 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:00.490430 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "d5e4832e-32b9-44a7-92b8-6fa82e642515" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.524s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:00.769512 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:09:00.769845 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:09:01.105364 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Found WWN 3300000008b5f4293 for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:09:01.105661 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:09:01.105867 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '3300000008b5f4293', 'path': '/dev/dm-1', 'multipath_id': '3300000008b5f4293'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:09:01.106004 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008b5f4293', 'path': '/dev/dm-1', 'multipath_id': '3300000008b5f4293'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:09:01.110586 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lazy-loading 'flavor' on Instance uuid 4d7b37c7-b091-44f7-a330-4e55e2b1e348 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:09:01.272525 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:09:01.344077 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:01.490712 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:01.536034 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "d5e4832e-32b9-44a7-92b8-6fa82e642515" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:01.536179 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "d5e4832e-32b9-44a7-92b8-6fa82e642515" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:01.536360 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Attaching volume a76dc713-7aa0-4459-b6c0-9fbdb003b385 to /dev/vdb
May 28 01:09:01.578763 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:09:01.590123 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:09:01.608464 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:01.623265 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Attempting to attach volume 8442cc67-be8b-4ab5-b19c-99e61f047cbc with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:09:01.628425 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:09:01.628425 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:09:01.628425 np0000001577 nova-compute[98319]:   <alias name="ua-8442cc67-be8b-4ab5-b19c-99e61f047cbc"/>
May 28 01:09:01.628425 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 28 01:09:01.628425 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:09:01.628425 np0000001577 nova-compute[98319]:   <serial>8442cc67-be8b-4ab5-b19c-99e61f047cbc</serial>
May 28 01:09:01.628425 np0000001577 nova-compute[98319]: </disk>
May 28 01:09:01.628425 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:09:01.649536 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:09:01.649781 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:09:01.656319 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "1e7c5308-80cc-4991-8626-2ba32fa09acf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:01.656486 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:01.658709 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:09:01.659789 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe55:fb7f', 'fe80::e071:f2ff:feee:4293', 'fe80::fc16:3eff:fe05:9ded', 'fe80::84b7:d3ff:feed:4f01', 'fe80::fc16:3eff:feab:f427', 'fe80::9c16:39ff:fe2e:9aef', 'fe80::fc16:3eff:fed7:129f', 'fe80::49a:a7ff:fef7:c9e8'] 
May 28 01:09:01.659963 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:09:01.660075 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:09:01.660190 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] <== get_connector_properties: return (81ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:09:01.660372 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Updating existing volume attachment record: bf67c7dc-d3c7-4179-9ced-a98ffa161eb3 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:09:01.778983 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.298s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:01.827060 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Deleted allocations for instance 9e7ca386-dbea-461e-9cf2-7e135bd3758d
May 28 01:09:02.162822 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Detaching volume 67905ec9-510f-4af0-85fe-adc6bcc8505f
May 28 01:09:02.195534 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Attempting to driver detach volume 67905ec9-510f-4af0-85fe-adc6bcc8505f from mountpoint /dev/vdb
May 28 01:09:02.203395 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Found disk vdb by alias ua-67905ec9-510f-4af0-85fe-adc6bcc8505f {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:09:02.205678 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Found disk vdb by alias ua-67905ec9-510f-4af0-85fe-adc6bcc8505f {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:09:02.205678 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Attempting to detach device vdb from instance 1e7c5308-80cc-4991-8626-2ba32fa09acf from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:09:02.205678 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:09:02.205678 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:09:02.205678 np0000001577 nova-compute[98319]:   <alias name="ua-67905ec9-510f-4af0-85fe-adc6bcc8505f"/>
May 28 01:09:02.205678 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 28 01:09:02.205678 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:09:02.205678 np0000001577 nova-compute[98319]:   <serial>67905ec9-510f-4af0-85fe-adc6bcc8505f</serial>
May 28 01:09:02.205678 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 01:09:02.205678 np0000001577 nova-compute[98319]: </disk>
May 28 01:09:02.205678 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:09:02.208673 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:09:02.209028 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385', 'iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a76dc713-7aa0-4459-b6c0-9fbdb003b385', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:09:02.209901 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:09:02.210964 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:09:02.211199 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385', 'iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a76dc713-7aa0-4459-b6c0-9fbdb003b385', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:09:02.211805 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Successfully detached device vdb from instance 1e7c5308-80cc-4991-8626-2ba32fa09acf from the persistent domain config.
May 28 01:09:02.212233 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] (1/8): Attempting to detach device vdb with device alias ua-67905ec9-510f-4af0-85fe-adc6bcc8505f from instance 1e7c5308-80cc-4991-8626-2ba32fa09acf from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:09:02.212478 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:09:02.212478 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:09:02.212478 np0000001577 nova-compute[98319]:   <alias name="ua-67905ec9-510f-4af0-85fe-adc6bcc8505f"/>
May 28 01:09:02.212478 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 28 01:09:02.212478 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:09:02.212478 np0000001577 nova-compute[98319]:   <serial>67905ec9-510f-4af0-85fe-adc6bcc8505f</serial>
May 28 01:09:02.212478 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 01:09:02.212478 np0000001577 nova-compute[98319]: </disk>
May 28 01:09:02.212478 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:09:02.222616 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:09:02.223082 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:09:02.223604 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:09:02.223771 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:09:02.224033 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:09:02.224608 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:09:02.236224 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:09:02.236224 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:02.241001 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:09:02.241001 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:02.247861 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385] added
May 28 01:09:02.247861 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:09:02.247861 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:09:02.247861 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:09:02.247861 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:09:02.247861 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:09:02.247861 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:02.248069 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:09:02.248343 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0239(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:09:02.248343 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:09:02.252443 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385] added
May 28 01:09:02.252443 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:09:02.252443 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:09:02.252443 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:09:02.252443 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:09:02.252443 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:09:02.252443 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:02.252638 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:09:02.252684 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0289(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:09:02.252898 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:09:02.695566 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930542.6951568, 1e7c5308-80cc-4991-8626-2ba32fa09acf => ua-67905ec9-510f-4af0-85fe-adc6bcc8505f> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:09:02.696474 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-67905ec9-510f-4af0-85fe-adc6bcc8505f for instance 1e7c5308-80cc-4991-8626-2ba32fa09acf {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:09:02.698647 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Successfully detached device vdb from instance 1e7c5308-80cc-4991-8626-2ba32fa09acf from the live domain config.
May 28 01:09:02.699598 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:09:02.699848 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67905ec9-510f-4af0-85fe-adc6bcc8505f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:09:02.699967 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:09:02.843712 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-35df3198-06d1-445c-a759-01d58b535736 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "9e7ca386-dbea-461e-9cf2-7e135bd3758d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.849s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:03.248744 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:09:03.253246 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:09:03.260024 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:09:03.260024 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:09:03.275296 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:09:03.275296 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:03.282025 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:09:03.282025 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:09:03.282025 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:09:03.282025 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] No VIF found with MAC fa:16:3e:ab:f4:27, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:09:03.286154 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:03.291390 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:03.300384 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:09:03.300384 np0000001577 nova-compute[98319]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:09:03.300384 np0000001577 nova-compute[98319]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc (non-flash)
May 28 01:09:03.300384 np0000001577 nova-compute[98319]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc (non-flash)
May 28 01:09:03.300384 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:09:03.300580 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsi session list stdout=tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:09:03.300580 np0000001577 nova-compute[98319]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:09:03.300580 np0000001577 nova-compute[98319]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc (non-flash)
May 28 01:09:03.300580 np0000001577 nova-compute[98319]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc (non-flash)
May 28 01:09:03.300580 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:09:03.305801 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:09:03.305801 np0000001577 nova-compute[98319]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:09:03.305801 np0000001577 nova-compute[98319]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc (non-flash)
May 28 01:09:03.305801 np0000001577 nova-compute[98319]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc (non-flash)
May 28 01:09:03.305801 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:09:03.305801 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsi session list stdout=tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:09:03.305801 np0000001577 nova-compute[98319]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:09:03.305801 np0000001577 nova-compute[98319]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc (non-flash)
May 28 01:09:03.305801 np0000001577 nova-compute[98319]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc (non-flash)
May 28 01:09:03.305801 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:09:03.326717 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385, portal: 192.168.50.100,3260]
May 28 01:09:03.326717 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385, portal: 192.168.50.100,3260] successful.
May 28 01:09:03.326717 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:03.337266 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:03.345394 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385, portal: 192.168.40.100,3260]
May 28 01:09:03.345394 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385, portal: 192.168.40.100,3260] successful.
May 28 01:09:03.345394 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:03.351284 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:09:03.351284 np0000001577 nova-compute[98319]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:09:03.351284 np0000001577 nova-compute[98319]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc (non-flash)
May 28 01:09:03.351284 np0000001577 nova-compute[98319]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc (non-flash)
May 28 01:09:03.351284 np0000001577 nova-compute[98319]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:03.351284 np0000001577 nova-compute[98319]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:03.351284 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:09:03.351466 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsi session list stdout=tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:09:03.351466 np0000001577 nova-compute[98319]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:09:03.351466 np0000001577 nova-compute[98319]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc (non-flash)
May 28 01:09:03.351466 np0000001577 nova-compute[98319]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc (non-flash)
May 28 01:09:03.351466 np0000001577 nova-compute[98319]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:03.351466 np0000001577 nova-compute[98319]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:03.351466 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:09:03.351654 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.128s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:09:03.351756 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:09:03.352490 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] HCTL ('7', '-', '-', 0) found on session 143 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:09:03.352722 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:09:03.360114 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:03.367131 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Searching for a device in session 143 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:09:03.367278 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a76dc713-7aa0-4459-b6c0-9fbdb003b385', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:09:03.375670 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:09:03.375670 np0000001577 nova-compute[98319]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:09:03.375670 np0000001577 nova-compute[98319]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc (non-flash)
May 28 01:09:03.375670 np0000001577 nova-compute[98319]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc (non-flash)
May 28 01:09:03.375670 np0000001577 nova-compute[98319]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:03.375670 np0000001577 nova-compute[98319]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:03.375670 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:09:03.375921 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsi session list stdout=tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:09:03.375921 np0000001577 nova-compute[98319]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:09:03.375921 np0000001577 nova-compute[98319]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc (non-flash)
May 28 01:09:03.375921 np0000001577 nova-compute[98319]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc (non-flash)
May 28 01:09:03.375921 np0000001577 nova-compute[98319]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:03.375921 np0000001577 nova-compute[98319]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:03.375921 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:09:03.376296 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:09:03.376460 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:09:03.378209 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] HCTL ('11', '-', '-', 0) found on session 144 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:09:03.378377 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:09:03.390384 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Searching for a device in session 144 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:09:03.390692 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a76dc713-7aa0-4459-b6c0-9fbdb003b385', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:09:04.045017 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "1e644f60-1f1f-4679-aec6-d1bbb3b69efe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:04.045420 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "1e644f60-1f1f-4679-aec6-d1bbb3b69efe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:04.224228 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:09:04.547059 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:09:04.821619 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f030e503-a987-4ca5-aa34-099e0284d51e tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "4d7b37c7-b091-44f7-a330-4e55e2b1e348" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.438s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:05.090203 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:05.090518 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:05.093117 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:09:05.093250 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Claim successful on node np0000001577
May 28 01:09:05.239288 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Found WWN 330000000f78e3f4b for multipath device dm-2 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:09:05.239834 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:09:05.240072 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '330000000f78e3f4b', 'path': '/dev/dm-2', 'multipath_id': '330000000f78e3f4b'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:09:05.240229 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f78e3f4b', 'path': '/dev/dm-2', 'multipath_id': '330000000f78e3f4b'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:09:05.240828 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.541s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:09:05.241162 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67905ec9-510f-4af0-85fe-adc6bcc8505f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:09:05.241325 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:09:05.244483 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lazy-loading 'flavor' on Instance uuid d5e4832e-32b9-44a7-92b8-6fa82e642515 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:09:05.265187 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:09:05.265187 np0000001577 nova-compute[98319]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:09:05.265187 np0000001577 nova-compute[98319]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc (non-flash)
May 28 01:09:05.265187 np0000001577 nova-compute[98319]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc (non-flash)
May 28 01:09:05.265187 np0000001577 nova-compute[98319]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:05.265187 np0000001577 nova-compute[98319]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:05.265187 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:09:05.265408 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsi session list stdout=tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:09:05.265408 np0000001577 nova-compute[98319]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f (non-flash)
May 28 01:09:05.265408 np0000001577 nova-compute[98319]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc (non-flash)
May 28 01:09:05.265408 np0000001577 nova-compute[98319]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc (non-flash)
May 28 01:09:05.265408 np0000001577 nova-compute[98319]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:05.265408 np0000001577 nova-compute[98319]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:05.265408 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:09:05.265408 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', '136'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', '137'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc', '141'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc', '142'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385', '143'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385', '144')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:09:05.265627 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', '136')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:09:05.266284 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f', '137')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:09:05.267110 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c988c01ff60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f'): ({'sdi'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:09:05.267282 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Removing multipathed devices sdc, sdi {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:09:05.267485 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Flush multipath device 330000000405a0c5e {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:09:05.299505 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:09:05.342934 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:09:05.392856 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Checking to see if SCSI volumes sdc, sdi have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:09:05.393031 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] SCSI volumes sdc, sdi have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:09:05.393799 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Checking to see if device paths {'sdc', 'sdi'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:09:05.405973 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Device paths {'sdc', 'sdi'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:09:05.406176 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:09:05.417915 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:05.449542 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 136, target: iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f, portal: 192.168.40.100,3260]
May 28 01:09:05.449542 np0000001577 nova-compute[98319]: Logout of [sid: 136, target: iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f, portal: 192.168.40.100,3260] successful.
May 28 01:09:05.449542 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:05.463670 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:05.474942 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:05.504394 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 137, target: iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f, portal: 192.168.50.100,3260]
May 28 01:09:05.504394 np0000001577 nova-compute[98319]: Logout of [sid: 137, target: iqn.2023-03.storpool.com:os--volume-67905ec9-510f-4af0-85fe-adc6bcc8505f, portal: 192.168.50.100,3260] successful.
May 28 01:09:05.504394 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:05.517362 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:05.517595 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:09:05.517708 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] <== disconnect_volume: return (2818ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:09:05.517815 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:09:05.746499 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Attempting to attach volume a76dc713-7aa0-4459-b6c0-9fbdb003b385 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:09:05.747843 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:09:05.747843 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:09:05.747843 np0000001577 nova-compute[98319]:   <alias name="ua-a76dc713-7aa0-4459-b6c0-9fbdb003b385"/>
May 28 01:09:05.747843 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-2"/>
May 28 01:09:05.747843 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:09:05.747843 np0000001577 nova-compute[98319]:   <serial>a76dc713-7aa0-4459-b6c0-9fbdb003b385</serial>
May 28 01:09:05.747843 np0000001577 nova-compute[98319]: </disk>
May 28 01:09:05.747843 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:09:06.059079 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lazy-loading 'flavor' on Instance uuid 1e7c5308-80cc-4991-8626-2ba32fa09acf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:09:06.344796 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:06.347231 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:09:06.347592 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:09:06.491680 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:06.850391 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:09:06.901322 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e9a8ce91-06b0-4ed2-8d1b-66b50c3e06fd tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "1e7c5308-80cc-4991-8626-2ba32fa09acf" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:07.067482 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-655a9596-cf44-43a2-8a68-9021916839d4 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.411s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:07.068404 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e9a8ce91-06b0-4ed2-8d1b-66b50c3e06fd tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.167s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:07.068669 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e9a8ce91-06b0-4ed2-8d1b-66b50c3e06fd tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:09:07.070868 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e9a8ce91-06b0-4ed2-8d1b-66b50c3e06fd tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98319) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 28 01:09:07.071436 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-e9a8ce91-06b0-4ed2-8d1b-66b50c3e06fd tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lazy-loading 'flavor' on Instance uuid 1e7c5308-80cc-4991-8626-2ba32fa09acf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:09:07.356210 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.266s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:07.356660 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:09:07.381362 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:09:07.381505 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:09:07.381637 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:09:07.381695 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] No VIF found with MAC fa:16:3e:55:fb:7f, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:09:07.862579 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:09:07.863039 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:09:07.863344 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:07.863597 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:07.930091 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c803ddeaf4f4b3db07587419087b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050f928f1ce449d6a447cd343dc4ff80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:09:08.100935 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:08.103323 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:08.122339 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:08.124902 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:08.147649 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:08.236223 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-bc7bc16d-9e51-4607-afec-c6d98a4cfd18 req-a19be7fd-8ef3-46da-ab8e-8ad31cb5a8e2 service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Received event network-vif-unplugged-cc1de356-c44a-46bf-bb87-d123239afbe7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:09:08.236464 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bc7bc16d-9e51-4607-afec-c6d98a4cfd18 req-a19be7fd-8ef3-46da-ab8e-8ad31cb5a8e2 service nova] Acquiring lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:08.236640 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bc7bc16d-9e51-4607-afec-c6d98a4cfd18 req-a19be7fd-8ef3-46da-ab8e-8ad31cb5a8e2 service nova] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:08.236824 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bc7bc16d-9e51-4607-afec-c6d98a4cfd18 req-a19be7fd-8ef3-46da-ab8e-8ad31cb5a8e2 service nova] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:08.236907 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-bc7bc16d-9e51-4607-afec-c6d98a4cfd18 req-a19be7fd-8ef3-46da-ab8e-8ad31cb5a8e2 service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] No waiting events found dispatching network-vif-unplugged-cc1de356-c44a-46bf-bb87-d123239afbe7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:09:08.237026 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-bc7bc16d-9e51-4607-afec-c6d98a4cfd18 req-a19be7fd-8ef3-46da-ab8e-8ad31cb5a8e2 service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Received unexpected event network-vif-unplugged-cc1de356-c44a-46bf-bb87-d123239afbe7 for instance with vm_state active and task_state powering-off.
May 28 01:09:08.366418 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:09:08.414578 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999707225999828 future=<Future at 0x7c984c6313d0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:09:08.416348 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Instance destroyed successfully.
May 28 01:09:08.416650 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-e9a8ce91-06b0-4ed2-8d1b-66b50c3e06fd tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lazy-loading 'numa_topology' on Instance uuid 1e7c5308-80cc-4991-8626-2ba32fa09acf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:09:08.421241 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Successfully created port: 53200c91-a0b8-4a29-a8f7-acc2ba51c3fe {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:09:08.438655 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "4d7b37c7-b091-44f7-a330-4e55e2b1e348" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:08.438822 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "4d7b37c7-b091-44f7-a330-4e55e2b1e348" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:08.831484 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Successfully updated port: 53200c91-a0b8-4a29-a8f7-acc2ba51c3fe {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:09:08.869152 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:09:08.923180 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-e9a8ce91-06b0-4ed2-8d1b-66b50c3e06fd tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Object Instance<1e7c5308-80cc-4991-8626-2ba32fa09acf> lazy-loaded attributes: flavor,numa_topology {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:09:08.923376 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e9a8ce91-06b0-4ed2-8d1b-66b50c3e06fd tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:09:08.932957 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-23fcde9f-8105-434b-9ec3-e0ffac7f41b6 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "d5e4832e-32b9-44a7-92b8-6fa82e642515" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.396s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:08.943944 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Detaching volume 8442cc67-be8b-4ab5-b19c-99e61f047cbc
May 28 01:09:08.978865 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Attempting to driver detach volume 8442cc67-be8b-4ab5-b19c-99e61f047cbc from mountpoint /dev/vdb
May 28 01:09:08.982356 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Found disk vdb by alias ua-8442cc67-be8b-4ab5-b19c-99e61f047cbc {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:09:08.983453 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Found disk vdb by alias ua-8442cc67-be8b-4ab5-b19c-99e61f047cbc {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:09:08.983576 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Attempting to detach device vdb from instance 4d7b37c7-b091-44f7-a330-4e55e2b1e348 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:09:08.983766 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:09:08.983766 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:09:08.983766 np0000001577 nova-compute[98319]:   <alias name="ua-8442cc67-be8b-4ab5-b19c-99e61f047cbc"/>
May 28 01:09:08.983766 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 28 01:09:08.983766 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:09:08.983766 np0000001577 nova-compute[98319]:   <serial>8442cc67-be8b-4ab5-b19c-99e61f047cbc</serial>
May 28 01:09:08.983766 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:09:08.983766 np0000001577 nova-compute[98319]: </disk>
May 28 01:09:08.983766 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:09:08.988505 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Successfully detached device vdb from instance 4d7b37c7-b091-44f7-a330-4e55e2b1e348 from the persistent domain config.
May 28 01:09:08.988637 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] (1/8): Attempting to detach device vdb with device alias ua-8442cc67-be8b-4ab5-b19c-99e61f047cbc from instance 4d7b37c7-b091-44f7-a330-4e55e2b1e348 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:09:08.988825 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:09:08.988825 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:09:08.988825 np0000001577 nova-compute[98319]:   <alias name="ua-8442cc67-be8b-4ab5-b19c-99e61f047cbc"/>
May 28 01:09:08.988825 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 28 01:09:08.988825 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:09:08.988825 np0000001577 nova-compute[98319]:   <serial>8442cc67-be8b-4ab5-b19c-99e61f047cbc</serial>
May 28 01:09:08.988825 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:09:08.988825 np0000001577 nova-compute[98319]: </disk>
May 28 01:09:08.988825 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:09:09.334131 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "refresh_cache-1e644f60-1f1f-4679-aec6-d1bbb3b69efe" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:09:09.334259 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquired lock "refresh_cache-1e644f60-1f1f-4679-aec6-d1bbb3b69efe" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:09:09.334334 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:09:09.373281 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Booting with volume 408b306f-e263-4cfa-a888-735b63628858 at /dev/vda
May 28 01:09:09.407192 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:09:09.417216 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:09:09.431990 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e9a8ce91-06b0-4ed2-8d1b-66b50c3e06fd tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.364s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:09.440567 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:09.469025 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930549.468056, 4d7b37c7-b091-44f7-a330-4e55e2b1e348 => ua-8442cc67-be8b-4ab5-b19c-99e61f047cbc> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:09:09.469647 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-8442cc67-be8b-4ab5-b19c-99e61f047cbc for instance 4d7b37c7-b091-44f7-a330-4e55e2b1e348 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:09:09.472286 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Successfully detached device vdb from instance 4d7b37c7-b091-44f7-a330-4e55e2b1e348 from the live domain config.
May 28 01:09:09.473337 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:09:09.473889 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc', 'iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8442cc67-be8b-4ab5-b19c-99e61f047cbc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:09:09.474032 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:09:09.474631 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:09:09.474938 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc', 'iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8442cc67-be8b-4ab5-b19c-99e61f047cbc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:09:09.475094 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:09:09.478097 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:09:09.478674 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:09:09.493573 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:09:09.493573 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe55:fb7f', 'fe80::e071:f2ff:feee:4293', 'fe80::fc16:3eff:feab:f427', 'fe80::9c16:39ff:fe2e:9aef', 'fe80::fc16:3eff:fed7:129f', 'fe80::49a:a7ff:fef7:c9e8'] 
May 28 01:09:09.493573 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:09:09.493573 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:09:09.493573 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:09:09.493976 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Updating existing volume attachment record: cceb926c-2d4a-411f-8d96-c2ed6d2f2875 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:09:09.499435 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc (non-flash)
May 28 01:09:09.499435 np0000001577 nova-compute[98319]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc (non-flash)
May 28 01:09:09.499435 np0000001577 nova-compute[98319]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:09.499435 np0000001577 nova-compute[98319]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:09.499435 np0000001577 nova-compute[98319]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31d706e2-e117-4a4b-af87-898a0160fddc (non-flash)
May 28 01:09:09.499435 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:09:09.499664 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsi session list stdout=tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc (non-flash)
May 28 01:09:09.499664 np0000001577 nova-compute[98319]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc (non-flash)
May 28 01:09:09.499664 np0000001577 nova-compute[98319]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:09.499664 np0000001577 nova-compute[98319]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:09.499664 np0000001577 nova-compute[98319]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31d706e2-e117-4a4b-af87-898a0160fddc (non-flash)
May 28 01:09:09.499664 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:09:09.499785 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc', '141'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc', '142'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385', '143'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385', '144'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31d706e2-e117-4a4b-af87-898a0160fddc', '145')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:09:09.499838 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc', '141')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:09:09.500838 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc', '142')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:09:09.501894 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c984c52ff60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc'): ({'sde'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:09:09.502109 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Removing multipathed devices sde, sdd {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:09:09.502331 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Flush multipath device 3300000008b5f4293 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:09:09.541949 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:09:09.591123 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:09:09.644224 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:09:09.644418 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:09:09.645584 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:09:09.656486 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:09:09.656718 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:09:09.666922 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:09.693963 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 141, target: iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc, portal: 192.168.40.100,3260]
May 28 01:09:09.693963 np0000001577 nova-compute[98319]: Logout of [sid: 141, target: iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc, portal: 192.168.40.100,3260] successful.
May 28 01:09:09.693963 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:09.707045 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:09.719793 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:09.751288 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 142, target: iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc, portal: 192.168.50.100,3260]
May 28 01:09:09.751288 np0000001577 nova-compute[98319]: Logout of [sid: 142, target: iqn.2023-03.storpool.com:os--volume-8442cc67-be8b-4ab5-b19c-99e61f047cbc, portal: 192.168.50.100,3260] successful.
May 28 01:09:09.751288 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:09.764508 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:09.764699 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:09:09.764826 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] <== disconnect_volume: return (291ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:09:09.764933 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:09:09.896731 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:09:10.043593 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:10.159231 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Updating instance_info_cache with network_info: [{"id": "53200c91-a0b8-4a29-a8f7-acc2ba51c3fe", "address": "fa:16:3e:46:94:e9", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53200c91-a0", "ovs_interfaceid": "53200c91-a0b8-4a29-a8f7-acc2ba51c3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:09:10.300541 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ec825476-f99f-4db4-9d79-f9b28ac0655a req-a491d2c8-3c96-4130-9db5-ed8ae5ed035b service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Received event network-vif-unplugged-cc1de356-c44a-46bf-bb87-d123239afbe7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:09:10.301244 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ec825476-f99f-4db4-9d79-f9b28ac0655a req-a491d2c8-3c96-4130-9db5-ed8ae5ed035b service nova] Acquiring lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:10.301477 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ec825476-f99f-4db4-9d79-f9b28ac0655a req-a491d2c8-3c96-4130-9db5-ed8ae5ed035b service nova] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:10.301673 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ec825476-f99f-4db4-9d79-f9b28ac0655a req-a491d2c8-3c96-4130-9db5-ed8ae5ed035b service nova] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:10.302240 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ec825476-f99f-4db4-9d79-f9b28ac0655a req-a491d2c8-3c96-4130-9db5-ed8ae5ed035b service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] No waiting events found dispatching network-vif-unplugged-cc1de356-c44a-46bf-bb87-d123239afbe7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:09:10.302521 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-ec825476-f99f-4db4-9d79-f9b28ac0655a req-a491d2c8-3c96-4130-9db5-ed8ae5ed035b service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Received unexpected event network-vif-unplugged-cc1de356-c44a-46bf-bb87-d123239afbe7 for instance with vm_state stopped and task_state powering-on.
May 28 01:09:10.302691 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ec825476-f99f-4db4-9d79-f9b28ac0655a req-a491d2c8-3c96-4130-9db5-ed8ae5ed035b service nova] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Received event network-changed-53200c91-a0b8-4a29-a8f7-acc2ba51c3fe {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:09:10.302768 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ec825476-f99f-4db4-9d79-f9b28ac0655a req-a491d2c8-3c96-4130-9db5-ed8ae5ed035b service nova] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Refreshing instance network info cache due to event network-changed-53200c91-a0b8-4a29-a8f7-acc2ba51c3fe. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:09:10.302873 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ec825476-f99f-4db4-9d79-f9b28ac0655a req-a491d2c8-3c96-4130-9db5-ed8ae5ed035b service nova] Acquiring lock "refresh_cache-1e644f60-1f1f-4679-aec6-d1bbb3b69efe" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:09:10.325118 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lazy-loading 'flavor' on Instance uuid 4d7b37c7-b091-44f7-a330-4e55e2b1e348 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:09:10.662499 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Releasing lock "refresh_cache-1e644f60-1f1f-4679-aec6-d1bbb3b69efe" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:09:10.662978 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Instance network_info: |[{"id": "53200c91-a0b8-4a29-a8f7-acc2ba51c3fe", "address": "fa:16:3e:46:94:e9", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53200c91-a0", "ovs_interfaceid": "53200c91-a0b8-4a29-a8f7-acc2ba51c3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:09:10.663270 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ec825476-f99f-4db4-9d79-f9b28ac0655a req-a491d2c8-3c96-4130-9db5-ed8ae5ed035b service nova] Acquired lock "refresh_cache-1e644f60-1f1f-4679-aec6-d1bbb3b69efe" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:09:10.663473 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-ec825476-f99f-4db4-9d79-f9b28ac0655a req-a491d2c8-3c96-4130-9db5-ed8ae5ed035b service nova] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Refreshing network info cache for port 53200c91-a0b8-4a29-a8f7-acc2ba51c3fe {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:09:10.692317 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lazy-loading 'flavor' on Instance uuid 1e7c5308-80cc-4991-8626-2ba32fa09acf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:09:10.824378 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00039051399971867795 future=<Future at 0x7c984c7e9bb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:09:10.824378 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:09:10.824378 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=12.589924874999724 future=<Future at 0x7c984c6313d0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:09:10.824378 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=12.589827003999744 future=<Future at 0x7c984c6313d0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:09:10.824791 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Emitting event <LifecycleEvent: 1779930535.8235407, 9e7ca386-dbea-461e-9cf2-7e135bd3758d => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:09:10.824967 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] VM Stopped (Lifecycle Event)
May 28 01:09:11.166336 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-ec825476-f99f-4db4-9d79-f9b28ac0655a req-a491d2c8-3c96-4130-9db5-ed8ae5ed035b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:11.199394 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "refresh_cache-1e7c5308-80cc-4991-8626-2ba32fa09acf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:09:11.199394 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquired lock "refresh_cache-1e7c5308-80cc-4991-8626-2ba32fa09acf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:09:11.203932 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:09:11.203932 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lazy-loading 'info_cache' on Instance uuid 1e7c5308-80cc-4991-8626-2ba32fa09acf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:09:11.333370 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 9e7ca386-dbea-461e-9cf2-7e135bd3758d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:09:11.335884 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-09abd650-61cc-4773-8e4f-c28e37e1a58a tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "4d7b37c7-b091-44f7-a330-4e55e2b1e348" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.897s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:11.347197 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:11.470068 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-ec825476-f99f-4db4-9d79-f9b28ac0655a req-a491d2c8-3c96-4130-9db5-ed8ae5ed035b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:11.492887 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:11.583453 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:09:11.584783 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:09:11.584989 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Creating image(s)
May 28 01:09:11.585299 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:09:11.585424 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Ensure instance console log exists: /opt/stack/data/nova/instances/1e644f60-1f1f-4679-aec6-d1bbb3b69efe/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:09:11.587071 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:11.587266 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:11.587395 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:11.587977 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Start _get_guest_xml network_info=[{"id": "53200c91-a0b8-4a29-a8f7-acc2ba51c3fe", "address": "fa:16:3e:46:94:e9", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53200c91-a0", "ovs_interfaceid": "53200c91-a0b8-4a29-a8f7-acc2ba51c3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '408b306f-e263-4cfa-a888-735b63628858', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '1e644f60-1f1f-4679-aec6-d1bbb3b69efe', 'attached_at': '', 'detached_at': '', 'volume_id': '408b306f-e263-4cfa-a888-735b63628858', 'serial': '408b306f-e263-4cfa-a888-735b63628858'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'cceb926c-2d4a-411f-8d96-c2ed6d2f2875', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:09:11.594178 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-ec825476-f99f-4db4-9d79-f9b28ac0655a req-a491d2c8-3c96-4130-9db5-ed8ae5ed035b service nova] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Updated VIF entry in instance network info cache for port 53200c91-a0b8-4a29-a8f7-acc2ba51c3fe. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:09:11.594449 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-ec825476-f99f-4db4-9d79-f9b28ac0655a req-a491d2c8-3c96-4130-9db5-ed8ae5ed035b service nova] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Updating instance_info_cache with network_info: [{"id": "53200c91-a0b8-4a29-a8f7-acc2ba51c3fe", "address": "fa:16:3e:46:94:e9", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53200c91-a0", "ovs_interfaceid": "53200c91-a0b8-4a29-a8f7-acc2ba51c3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:09:11.596352 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:09:11.598189 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1171060503', uuid='1e644f60-1f1f-4679-aec6-d1bbb3b69efe'), owner=OwnerMeta(userid='0c803ddeaf4f4b3db07587419087b3b2', username='tempest-TestVolumeBootPattern-1449742411-project-member', projectid='050f928f1ce449d6a447cd343dc4ff80', projectname='tempest-TestVolumeBootPattern-1449742411'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "53200c91-a0b8-4a29-a8f7-acc2ba51c3fe", "address": "fa:16:3e:46:94:e9", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53200c91-a0", "ovs_interfaceid": "53200c91-a0b8-4a29-a8f7-acc2ba51c3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930551.5975754) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:09:11.599344 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:09:11.599698 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:09:11.600580 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:09:11.600774 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:09:11.601772 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:09:11.602084 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:09:11.602266 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:09:11.602363 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:09:11.602467 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:09:11.602620 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:09:11.602852 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:09:11.602985 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:09:11.603106 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:09:11.603221 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:09:11.603323 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:09:11.603466 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:09:11.622597 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:09:11.622908 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '408b306f-e263-4cfa-a888-735b63628858', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:09:11.623065 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:09:11.623648 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:09:11.623895 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '408b306f-e263-4cfa-a888-735b63628858', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:09:11.635235 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:09:11.636687 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:09:11.637146 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:09:11.637360 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:09:11.638217 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:09:11.640221 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:09:11.649264 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:09:11.649264 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:11.654571 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:09:11.654571 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:11.662876 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858] added
May 28 01:09:11.662876 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:09:11.662876 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:09:11.662876 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:09:11.662876 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:09:11.662876 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:09:11.662876 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:11.663474 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:09:11.663474 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0259(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:09:11.663474 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:09:11.668469 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858] added
May 28 01:09:11.668469 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:09:11.668469 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:09:11.668469 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:09:11.668469 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:09:11.668469 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:09:11.668469 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:11.668694 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:09:11.668748 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0303(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:09:11.668884 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:09:11.703010 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Object Instance<1e7c5308-80cc-4991-8626-2ba32fa09acf> lazy-loaded attributes: flavor,info_cache {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:09:12.117949 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ec825476-f99f-4db4-9d79-f9b28ac0655a req-a491d2c8-3c96-4130-9db5-ed8ae5ed035b service nova] Releasing lock "refresh_cache-1e644f60-1f1f-4679-aec6-d1bbb3b69efe" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:09:12.211198 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:12.524458 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:12.641133 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Updating instance_info_cache with network_info: [{"id": "cc1de356-c44a-46bf-bb87-d123239afbe7", "address": "fa:16:3e:05:9d:ed", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1de356-c4", "ovs_interfaceid": "cc1de356-c44a-46bf-bb87-d123239afbe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:09:12.663894 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:09:12.669258 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:09:12.677570 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:09:12.677570 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:09:12.683307 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:09:12.683307 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:12.694994 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:12.696633 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:12.714684 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:12.714684 np0000001577 nova-compute[98319]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:12.714684 np0000001577 nova-compute[98319]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31d706e2-e117-4a4b-af87-898a0160fddc (non-flash)
May 28 01:09:12.714684 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:09:12.714684 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:12.714684 np0000001577 nova-compute[98319]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:12.714684 np0000001577 nova-compute[98319]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31d706e2-e117-4a4b-af87-898a0160fddc (non-flash)
May 28 01:09:12.714684 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:09:12.720057 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:12.720057 np0000001577 nova-compute[98319]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:12.720057 np0000001577 nova-compute[98319]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31d706e2-e117-4a4b-af87-898a0160fddc (non-flash)
May 28 01:09:12.720057 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:09:12.720230 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:12.720230 np0000001577 nova-compute[98319]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:12.720230 np0000001577 nova-compute[98319]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31d706e2-e117-4a4b-af87-898a0160fddc (non-flash)
May 28 01:09:12.720230 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:09:12.751050 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858, portal: 192.168.40.100,3260]
May 28 01:09:12.751050 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858, portal: 192.168.40.100,3260] successful.
May 28 01:09:12.751050 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:12.762243 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858, portal: 192.168.50.100,3260]
May 28 01:09:12.762243 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858, portal: 192.168.50.100,3260] successful.
May 28 01:09:12.762243 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:12.766935 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:12.777569 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:12.786435 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:12.786435 np0000001577 nova-compute[98319]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:12.786435 np0000001577 nova-compute[98319]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31d706e2-e117-4a4b-af87-898a0160fddc (non-flash)
May 28 01:09:12.786435 np0000001577 nova-compute[98319]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:12.786435 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:12.786435 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:09:12.786708 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:12.786708 np0000001577 nova-compute[98319]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:12.786708 np0000001577 nova-compute[98319]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31d706e2-e117-4a4b-af87-898a0160fddc (non-flash)
May 28 01:09:12.786708 np0000001577 nova-compute[98319]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:12.786708 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:12.786708 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:09:12.786886 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:09:12.786886 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:09:12.787561 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] HCTL ('9', '-', '-', 0) found on session 146 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:09:12.787666 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:09:12.792792 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:12.792792 np0000001577 nova-compute[98319]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:12.792792 np0000001577 nova-compute[98319]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31d706e2-e117-4a4b-af87-898a0160fddc (non-flash)
May 28 01:09:12.792792 np0000001577 nova-compute[98319]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:12.792792 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:12.792792 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:09:12.792979 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:12.792979 np0000001577 nova-compute[98319]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:12.792979 np0000001577 nova-compute[98319]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31d706e2-e117-4a4b-af87-898a0160fddc (non-flash)
May 28 01:09:12.792979 np0000001577 nova-compute[98319]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:12.792979 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:12.792979 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:09:12.793228 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:09:12.793296 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:09:12.793843 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] HCTL ('10', '-', '-', 0) found on session 147 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:09:12.793938 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:09:12.803641 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching for a device in session 146 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:09:12.803641 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '408b306f-e263-4cfa-a888-735b63628858', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:09:12.815060 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching for a device in session 147 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:09:12.815060 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '408b306f-e263-4cfa-a888-735b63628858', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:09:13.146976 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Releasing lock "refresh_cache-1e7c5308-80cc-4991-8626-2ba32fa09acf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:09:13.638774 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:09:14.032114 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-1e3ef1c9-1f5d-47f8-ae0c-f4570d5ffd2b tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:09:14.160110 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Instance destroyed successfully.
May 28 01:09:14.160486 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lazy-loading 'numa_topology' on Instance uuid 1e7c5308-80cc-4991-8626-2ba32fa09acf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:09:14.550318 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-1e3ef1c9-1f5d-47f8-ae0c-f4570d5ffd2b tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] instance snapshotting
May 28 01:09:14.630801 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "412ac56c-f524-46c2-91eb-fa4672db46a9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:14.631186 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:14.653360 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-1e3ef1c9-1f5d-47f8-ae0c-f4570d5ffd2b tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Beginning live snapshot process
May 28 01:09:14.655351 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Found WWN 3300000005024929f for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:09:14.656430 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:09:14.656612 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '3300000005024929f', 'path': '/dev/dm-0', 'multipath_id': '3300000005024929f'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:09:14.656718 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005024929f', 'path': '/dev/dm-0', 'multipath_id': '3300000005024929f'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:09:14.662443 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Object Instance<1e7c5308-80cc-4991-8626-2ba32fa09acf> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:09:14.664179 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lazy-loading 'resources' on Instance uuid 1e7c5308-80cc-4991-8626-2ba32fa09acf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:09:14.834380 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "d5e4832e-32b9-44a7-92b8-6fa82e642515" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:14.834539 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "d5e4832e-32b9-44a7-92b8-6fa82e642515" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:14.955328 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "d5e4832e-32b9-44a7-92b8-6fa82e642515" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:15.138567 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lazy-loading 'flavor' on Instance uuid 412ac56c-f524-46c2-91eb-fa4672db46a9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:09:15.161338 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:09:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1171060503',display_name='tempest-TestVolumeBootPattern-server-1171060503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpattern-server-1171060503',id=60,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLDywRMt1gYjzqU0nLt38yv/dkf6iz5rhLwqujx5EHrUiUYa0LEwAEl6oAEMxfnED+yXkyyB7J9zFdusIexML2cYEzV2m5bo9N6+7QjUI/1FFtVJ+XDyI2kpbVbncy1iQ==',key_name='tempest-TestVolumeBootPattern-1635525277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='050f928f1ce449d6a447cd343dc4ff80',ramdisk_id='',reservation_id='r-u2u145oc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1449742411',owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:09:09Z,user_data=None,user_id='0c803ddeaf4f4b3db07587419087b3b2',uuid=1e644f60-1f1f-4679-aec6-d1bbb3b69efe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53200c91-a0b8-4a29-a8f7-acc2ba51c3fe", "address": "fa:16:3e:46:94:e9", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53200c91-a0", "ovs_interfaceid": "53200c91-a0b8-4a29-a8f7-acc2ba51c3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:09:15.161338 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converting VIF {"id": "53200c91-a0b8-4a29-a8f7-acc2ba51c3fe", "address": "fa:16:3e:46:94:e9", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53200c91-a0", "ovs_interfaceid": "53200c91-a0b8-4a29-a8f7-acc2ba51c3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:09:15.161338 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:94:e9,bridge_name='br-int',has_traffic_filtering=True,id=53200c91-a0b8-4a29-a8f7-acc2ba51c3fe,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53200c91-a0') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:09:15.165178 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Object Instance<1e7c5308-80cc-4991-8626-2ba32fa09acf> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:09:15.166790 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e644f60-1f1f-4679-aec6-d1bbb3b69efe {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:09:15.166988 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:07:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1575785918',display_name='tempest-AttachVolumeTestJSON-server-1575785918',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumetestjson-server-1575785918',id=54,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQqj5ulFm44LqcwStG35x3hx4kF2OHc+g0tTlOd4Z/Xec3CPwxGXUEAq08Fq2dSZhFKLMTCPF7EJ6q4KRfVK6ZgmNMJOJWZlgopXWPXQJWBjVOvQj1zQw9ZKwPgeXE7Hw==',key_name='tempest-keypair-749432862',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:07:15Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='23578125da1e4bf2bb3d59281a0e261e',ramdisk_id='',reservation_id='r-8bk45cr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1682604103',owner_user_name='tempest-AttachVolumeTestJSON-1682604103-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:09:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d68bbf62c74dd2bfe638f00ef6aa3d',uuid=1e7c5308-80cc-4991-8626-2ba32fa09acf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "cc1de356-c44a-46bf-bb87-d123239afbe7", "address": "fa:16:3e:05:9d:ed", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1de356-c4", "ovs_interfaceid": "cc1de356-c44a-46bf-bb87-d123239afbe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:09:15.167349 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Converting VIF {"id": "cc1de356-c44a-46bf-bb87-d123239afbe7", "address": "fa:16:3e:05:9d:ed", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1de356-c4", "ovs_interfaceid": "cc1de356-c44a-46bf-bb87-d123239afbe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:09:15.167939 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=cc1de356-c44a-46bf-bb87-d123239afbe7,network=Network(02f45984-182d-4648-ab01-d4773a271319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc1de356-c4') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:09:15.168186 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=cc1de356-c44a-46bf-bb87-d123239afbe7,network=Network(02f45984-182d-4648-ab01-d4773a271319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc1de356-c4') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:09:15.169656 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:15.170759 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc1de356-c4, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:15.170825 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:15.171522 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:09:15.172975 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:15.174243 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:15.174814 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e22b0dec-e0d3-4807-9091-c9f35f4a4348) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:15.175171 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:15.175518 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:09:15.176238 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:15.179452 np0000001577 nova-compute[98319]: INFO os_vif [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=cc1de356-c44a-46bf-bb87-d123239afbe7,network=Network(02f45984-182d-4648-ab01-d4773a271319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc1de356-c4')
May 28 01:09:15.181881 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Start _get_guest_xml network_info=[{"id": "cc1de356-c44a-46bf-bb87-d123239afbe7", "address": "fa:16:3e:05:9d:ed", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1de356-c4", "ovs_interfaceid": "cc1de356-c44a-46bf-bb87-d123239afbe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:09:15.185607 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:09:15.186581 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-1575785918', uuid='1e7c5308-80cc-4991-8626-2ba32fa09acf'), owner=OwnerMeta(userid='60d68bbf62c74dd2bfe638f00ef6aa3d', username='tempest-AttachVolumeTestJSON-1682604103-project-member', projectid='23578125da1e4bf2bb3d59281a0e261e', projectname='tempest-AttachVolumeTestJSON-1682604103'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cc1de356-c44a-46bf-bb87-d123239afbe7", "address": "fa:16:3e:05:9d:ed", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1de356-c4", "ovs_interfaceid": "cc1de356-c44a-46bf-bb87-d123239afbe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930555.1863081) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:09:15.187756 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:09:15.188074 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:09:15.188939 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:09:15.189130 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:09:15.192447 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:09:15.192447 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:09:15.192447 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:09:15.192447 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:09:15.192447 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:09:15.192447 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:09:15.192447 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:09:15.192447 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:09:15.192447 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:09:15.192447 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:09:15.192447 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:09:15.192447 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:09:15.192447 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1e7c5308-80cc-4991-8626-2ba32fa09acf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:09:15.341498 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Detaching volume a76dc713-7aa0-4459-b6c0-9fbdb003b385
May 28 01:09:15.378339 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Attempting to driver detach volume a76dc713-7aa0-4459-b6c0-9fbdb003b385 from mountpoint /dev/vdb
May 28 01:09:15.378607 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Found disk vdb by alias ua-a76dc713-7aa0-4459-b6c0-9fbdb003b385 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:09:15.379536 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Found disk vdb by alias ua-a76dc713-7aa0-4459-b6c0-9fbdb003b385 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:09:15.379669 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Attempting to detach device vdb from instance d5e4832e-32b9-44a7-92b8-6fa82e642515 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:09:15.379944 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:09:15.379944 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:09:15.379944 np0000001577 nova-compute[98319]:   <alias name="ua-a76dc713-7aa0-4459-b6c0-9fbdb003b385"/>
May 28 01:09:15.379944 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-2"/>
May 28 01:09:15.379944 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:09:15.379944 np0000001577 nova-compute[98319]:   <serial>a76dc713-7aa0-4459-b6c0-9fbdb003b385</serial>
May 28 01:09:15.379944 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:09:15.379944 np0000001577 nova-compute[98319]: </disk>
May 28 01:09:15.379944 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:09:15.385728 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Successfully detached device vdb from instance d5e4832e-32b9-44a7-92b8-6fa82e642515 from the persistent domain config.
May 28 01:09:15.385728 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] (1/8): Attempting to detach device vdb with device alias ua-a76dc713-7aa0-4459-b6c0-9fbdb003b385 from instance d5e4832e-32b9-44a7-92b8-6fa82e642515 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:09:15.385728 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:09:15.385728 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:09:15.385728 np0000001577 nova-compute[98319]:   <alias name="ua-a76dc713-7aa0-4459-b6c0-9fbdb003b385"/>
May 28 01:09:15.385728 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-2"/>
May 28 01:09:15.385728 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:09:15.385728 np0000001577 nova-compute[98319]:   <serial>a76dc713-7aa0-4459-b6c0-9fbdb003b385</serial>
May 28 01:09:15.385728 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:09:15.385728 np0000001577 nova-compute[98319]: </disk>
May 28 01:09:15.385728 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:09:15.675718 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] End _get_guest_xml xml=<domain type="qemu">
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:   <uuid>1e644f60-1f1f-4679-aec6-d1bbb3b69efe</uuid>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:   <name>instance-0000003c</name>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestVolumeBootPattern-server-1171060503</nova:name>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:09:11</nova:creationTime>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       <nova:image uuid="">
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:         <nova:user uuid="0c803ddeaf4f4b3db07587419087b3b2">tempest-TestVolumeBootPattern-1449742411-project-member</nova:user>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:         <nova:project uuid="050f928f1ce449d6a447cd343dc4ff80">tempest-TestVolumeBootPattern-1449742411</nova:project>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:         <nova:port uuid="53200c91-a0b8-4a29-a8f7-acc2ba51c3fe">
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:     <system>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       <entry name="serial">1e644f60-1f1f-4679-aec6-d1bbb3b69efe</entry>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       <entry name="uuid">1e644f60-1f1f-4679-aec6-d1bbb3b69efe</entry>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:     </system>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:   <os>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:   </os>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:   <features>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:   </features>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:   <devices>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/1e644f60-1f1f-4679-aec6-d1bbb3b69efe/disk.config"/>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:     </disk>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       <alias name="ua-408b306f-e263-4cfa-a888-735b63628858"/>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-0"/>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       <serial>408b306f-e263-4cfa-a888-735b63628858</serial>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:     </disk>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:46:94:e9"/>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       <target dev="tap53200c91-a0"/>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:     </interface>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/1e644f60-1f1f-4679-aec6-d1bbb3b69efe/console.log" append="off"/>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:     </serial>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:     <video>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:     </video>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:     </rng>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:   </devices>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]: </domain>
May 28 01:09:15.675718 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:09:15.679154 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Preparing to wait for external event network-vif-plugged-53200c91-a0b8-4a29-a8f7-acc2ba51c3fe {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:09:15.679154 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "1e644f60-1f1f-4679-aec6-d1bbb3b69efe-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:15.679154 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "1e644f60-1f1f-4679-aec6-d1bbb3b69efe-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:15.679154 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "1e644f60-1f1f-4679-aec6-d1bbb3b69efe-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:15.679154 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:09:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1171060503',display_name='tempest-TestVolumeBootPattern-server-1171060503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpattern-server-1171060503',id=60,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLDywRMt1gYjzqU0nLt38yv/dkf6iz5rhLwqujx5EHrUiUYa0LEwAEl6oAEMxfnED+yXkyyB7J9zFdusIexML2cYEzV2m5bo9N6+7QjUI/1FFtVJ+XDyI2kpbVbncy1iQ==',key_name='tempest-TestVolumeBootPattern-1635525277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='050f928f1ce449d6a447cd343dc4ff80',ramdisk_id='',reservation_id='r-u2u145oc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1449742411',owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:09:09Z,user_data=None,user_id='0c803ddeaf4f4b3db07587419087b3b2',uuid=1e644f60-1f1f-4679-aec6-d1bbb3b69efe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53200c91-a0b8-4a29-a8f7-acc2ba51c3fe", "address": "fa:16:3e:46:94:e9", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53200c91-a0", "ovs_interfaceid": "53200c91-a0b8-4a29-a8f7-acc2ba51c3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:09:15.679154 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converting VIF {"id": "53200c91-a0b8-4a29-a8f7-acc2ba51c3fe", "address": "fa:16:3e:46:94:e9", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53200c91-a0", "ovs_interfaceid": "53200c91-a0b8-4a29-a8f7-acc2ba51c3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:09:15.679154 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:94:e9,bridge_name='br-int',has_traffic_filtering=True,id=53200c91-a0b8-4a29-a8f7-acc2ba51c3fe,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53200c91-a0') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:09:15.679154 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:94:e9,bridge_name='br-int',has_traffic_filtering=True,id=53200c91-a0b8-4a29-a8f7-acc2ba51c3fe,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53200c91-a0') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:09:15.679154 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:15.679154 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:15.679154 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:09:15.679760 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:15.679760 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e8fc7b08-570d-5357-9d6e-8322e1455fba', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:15.689948 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:15.690758 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:09:15.691713 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:15.695360 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:15.695360 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53200c91-a0, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:15.695360 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53200c91-a0, col_values=(('qos', UUID('f5048fce-6c73-4660-924a-63ad9376f074')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:15.695529 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53200c91-a0, col_values=(('external_ids', {'iface-id': '53200c91-a0b8-4a29-a8f7-acc2ba51c3fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:94:e9', 'vm-uuid': '1e644f60-1f1f-4679-aec6-d1bbb3b69efe'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:15.696168 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Object Instance<1e7c5308-80cc-4991-8626-2ba32fa09acf> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:09:15.706422 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:09:15.709165 np0000001577 nova-compute[98319]: INFO os_vif [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:94:e9,bridge_name='br-int',has_traffic_filtering=True,id=53200c91-a0b8-4a29-a8f7-acc2ba51c3fe,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53200c91-a0')
May 28 01:09:15.711953 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:07:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1575785918',display_name='tempest-AttachVolumeTestJSON-server-1575785918',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumetestjson-server-1575785918',id=54,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQqj5ulFm44LqcwStG35x3hx4kF2OHc+g0tTlOd4Z/Xec3CPwxGXUEAq08Fq2dSZhFKLMTCPF7EJ6q4KRfVK6ZgmNMJOJWZlgopXWPXQJWBjVOvQj1zQw9ZKwPgeXE7Hw==',key_name='tempest-keypair-749432862',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:07:15Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='23578125da1e4bf2bb3d59281a0e261e',ramdisk_id='',reservation_id='r-8bk45cr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1682604103',owner_user_name='tempest-AttachVolumeTestJSON-1682604103-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:09:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d68bbf62c74dd2bfe638f00ef6aa3d',uuid=1e7c5308-80cc-4991-8626-2ba32fa09acf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "cc1de356-c44a-46bf-bb87-d123239afbe7", "address": "fa:16:3e:05:9d:ed", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1de356-c4", "ovs_interfaceid": "cc1de356-c44a-46bf-bb87-d123239afbe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:09:15.712343 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Converting VIF {"id": "cc1de356-c44a-46bf-bb87-d123239afbe7", "address": "fa:16:3e:05:9d:ed", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1de356-c4", "ovs_interfaceid": "cc1de356-c44a-46bf-bb87-d123239afbe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:09:15.712825 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=cc1de356-c44a-46bf-bb87-d123239afbe7,network=Network(02f45984-182d-4648-ab01-d4773a271319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc1de356-c4') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:09:15.713257 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e7c5308-80cc-4991-8626-2ba32fa09acf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:09:15.872258 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930555.8718758, d5e4832e-32b9-44a7-92b8-6fa82e642515 => ua-a76dc713-7aa0-4459-b6c0-9fbdb003b385> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:09:15.873486 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-a76dc713-7aa0-4459-b6c0-9fbdb003b385 for instance d5e4832e-32b9-44a7-92b8-6fa82e642515 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:09:15.877581 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Successfully detached device vdb from instance d5e4832e-32b9-44a7-92b8-6fa82e642515 from the live domain config.
May 28 01:09:15.878581 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:09:15.878803 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385', 'iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a76dc713-7aa0-4459-b6c0-9fbdb003b385', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:09:15.878910 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:09:15.879215 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:09:15.879456 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385', 'iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a76dc713-7aa0-4459-b6c0-9fbdb003b385', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:09:15.879579 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:09:15.901672 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:15.901672 np0000001577 nova-compute[98319]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:15.901672 np0000001577 nova-compute[98319]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31d706e2-e117-4a4b-af87-898a0160fddc (non-flash)
May 28 01:09:15.901672 np0000001577 nova-compute[98319]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:15.901672 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:15.901672 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:09:15.902055 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsi session list stdout=tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:15.902055 np0000001577 nova-compute[98319]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385 (non-flash)
May 28 01:09:15.902055 np0000001577 nova-compute[98319]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31d706e2-e117-4a4b-af87-898a0160fddc (non-flash)
May 28 01:09:15.902055 np0000001577 nova-compute[98319]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:15.902055 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:15.902055 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:09:15.902055 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385', '143'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385', '144'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31d706e2-e117-4a4b-af87-898a0160fddc', '145'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', '146'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', '147')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:09:15.902055 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385', '144')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:09:15.902799 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385', '143')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:09:15.903441 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c987056f600>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385'): ({'sdb'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:09:15.903636 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Removing multipathed devices sdf, sdb {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:09:15.903838 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Flush multipath device 330000000f78e3f4b {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:09:15.949815 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:09:16.022180 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:09:16.073000 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Checking to see if SCSI volumes sdf, sdb have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:09:16.073156 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] SCSI volumes sdf, sdb have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:09:16.074031 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Checking to see if device paths {'sdf', 'sdb'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:09:16.084510 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Device paths {'sdf', 'sdb'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:09:16.084689 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:09:16.099568 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:16.133217 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 144, target: iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385, portal: 192.168.40.100,3260]
May 28 01:09:16.133217 np0000001577 nova-compute[98319]: Logout of [sid: 144, target: iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385, portal: 192.168.40.100,3260] successful.
May 28 01:09:16.133217 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:16.151579 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:16.154361 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.523s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:16.162520 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:16.167714 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1e3ef1c9-1f5d-47f8-ae0c-f4570d5ffd2b tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d7b37c7-b091-44f7-a330-4e55e2b1e348/disk --force-share --output=json -f qcow2 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:16.201300 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 143, target: iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385, portal: 192.168.50.100,3260]
May 28 01:09:16.201300 np0000001577 nova-compute[98319]: Logout of [sid: 143, target: iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385, portal: 192.168.50.100,3260] successful.
May 28 01:09:16.201300 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:16.218403 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Object Instance<1e7c5308-80cc-4991-8626-2ba32fa09acf> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:09:16.220308 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:16.221907 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:09:16.221907 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] <== disconnect_volume: return (342ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:09:16.221907 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:09:16.230611 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] End _get_guest_xml xml=<domain type="qemu">
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:   <uuid>1e7c5308-80cc-4991-8626-2ba32fa09acf</uuid>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:   <name>instance-00000036</name>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       <nova:name>tempest-AttachVolumeTestJSON-server-1575785918</nova:name>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:09:15</nova:creationTime>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:         <nova:user uuid="60d68bbf62c74dd2bfe638f00ef6aa3d">tempest-AttachVolumeTestJSON-1682604103-project-member</nova:user>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:         <nova:project uuid="23578125da1e4bf2bb3d59281a0e261e">tempest-AttachVolumeTestJSON-1682604103</nova:project>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:         <nova:port uuid="cc1de356-c44a-46bf-bb87-d123239afbe7">
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:     <system>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       <entry name="serial">1e7c5308-80cc-4991-8626-2ba32fa09acf</entry>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       <entry name="uuid">1e7c5308-80cc-4991-8626-2ba32fa09acf</entry>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:     </system>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:   <os>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:   </os>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:   <features>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:   </features>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:   <devices>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk"/>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:     </disk>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk.config"/>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:     </disk>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:05:9d:ed"/>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       <target dev="tapcc1de356-c4"/>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:     </interface>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/console.log" append="off"/>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:     </serial>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:     <video>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:     </video>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:     </rng>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:   </devices>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]: </domain>
May 28 01:09:16.230611 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:09:16.233294 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:16.290037 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1e3ef1c9-1f5d-47f8-ae0c-f4570d5ffd2b tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d7b37c7-b091-44f7-a330-4e55e2b1e348/disk --force-share --output=json -f qcow2" returned: 0 in 0.122s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:16.290566 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1e3ef1c9-1f5d-47f8-ae0c-f4570d5ffd2b tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d7b37c7-b091-44f7-a330-4e55e2b1e348/disk --force-share --output=json -f qcow2 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:16.327576 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:16.327576 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:16.380174 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1e3ef1c9-1f5d-47f8-ae0c-f4570d5ffd2b tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d7b37c7-b091-44f7-a330-4e55e2b1e348/disk --force-share --output=json -f qcow2" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:16.381242 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-1e3ef1c9-1f5d-47f8-ae0c-f4570d5ffd2b tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:09:16.387191 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-1e3ef1c9-1f5d-47f8-ae0c-f4570d5ffd2b tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:09:16.388033 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1e3ef1c9-1f5d-47f8-ae0c-f4570d5ffd2b tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:16.414077 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:16.415669 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1e7c5308-80cc-4991-8626-2ba32fa09acf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:09:16.480500 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1e3ef1c9-1f5d-47f8-ae0c-f4570d5ffd2b tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:16.480861 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1e3ef1c9-1f5d-47f8-ae0c-f4570d5ffd2b tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwk44ofdk/04c8ede8c93d4c7488e18bd63c6b4070.delta 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:16.496196 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:16.533463 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1e3ef1c9-1f5d-47f8-ae0c-f4570d5ffd2b tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwk44ofdk/04c8ede8c93d4c7488e18bd63c6b4070.delta 1073741824" returned: 0 in 0.052s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:16.533928 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-1e3ef1c9-1f5d-47f8-ae0c-f4570d5ffd2b tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Quiescing instance not available: QEMU guest agent is not enabled.
May 28 01:09:16.759611 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-1e3ef1c9-1f5d-47f8-ae0c-f4570d5ffd2b tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] COPY block job progress, current cursor: 0 final cursor: 76677120 {{(pid=98319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 28 01:09:16.798802 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lazy-loading 'flavor' on Instance uuid d5e4832e-32b9-44a7-92b8-6fa82e642515 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:09:16.921403 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Object Instance<1e7c5308-80cc-4991-8626-2ba32fa09acf> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:09:16.921403 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:17.013294 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.093s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:17.013713 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:09:17.013931 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:17.098724 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:17.099086 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Cannot resize image /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:09:17.099331 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lazy-loading 'migration_context' on Instance uuid 1e7c5308-80cc-4991-8626-2ba32fa09acf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:09:17.206425 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "412ac56c-f524-46c2-91eb-fa4672db46a9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:17.206855 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:17.206855 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Attaching volume f7725186-2460-4632-868e-1cb41674f3f0 to /dev/vdb
May 28 01:09:17.238617 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:09:17.238757 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:09:17.238845 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] No VIF found with MAC fa:16:3e:46:94:e9, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:09:17.239337 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Using config drive
May 28 01:09:17.241910 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:09:17.252247 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:09:17.261909 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-1e3ef1c9-1f5d-47f8-ae0c-f4570d5ffd2b tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] COPY block job progress, current cursor: 76677120 final cursor: 76677120 {{(pid=98319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 28 01:09:17.263559 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-1e3ef1c9-1f5d-47f8-ae0c-f4570d5ffd2b tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Skipping quiescing instance: QEMU guest agent is not enabled.
May 28 01:09:17.271311 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:17.308625 np0000001577 nova-compute[98319]: DEBUG nova.privsep.utils [None req-1e3ef1c9-1f5d-47f8-ae0c-f4570d5ffd2b tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 01:09:17.308975 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1e3ef1c9-1f5d-47f8-ae0c-f4570d5ffd2b tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwk44ofdk/04c8ede8c93d4c7488e18bd63c6b4070.delta /opt/stack/data/nova/instances/snapshots/tmpwk44ofdk/04c8ede8c93d4c7488e18bd63c6b4070 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:17.322808 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:09:17.323245 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:09:17.331858 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:09:17.334355 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe55:fb7f', 'fe80::e071:f2ff:feee:4293', 'fe80::fc16:3eff:feab:f427', 'fe80::9c16:39ff:fe2e:9aef', 'fe80::fc16:3eff:fed7:129f', 'fe80::49a:a7ff:fef7:c9e8'] 
May 28 01:09:17.334613 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:09:17.334688 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:09:17.335088 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] <== get_connector_properties: return (93ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:09:17.335517 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Updating existing volume attachment record: e7feee77-762c-41bd-bdda-cc47b51d3d96 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:09:17.486447 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1e3ef1c9-1f5d-47f8-ae0c-f4570d5ffd2b tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwk44ofdk/04c8ede8c93d4c7488e18bd63c6b4070.delta /opt/stack/data/nova/instances/snapshots/tmpwk44ofdk/04c8ede8c93d4c7488e18bd63c6b4070" returned: 0 in 0.177s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:17.490239 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-1e3ef1c9-1f5d-47f8-ae0c-f4570d5ffd2b tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Snapshot extracted, beginning image upload
May 28 01:09:17.602660 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Object Instance<1e7c5308-80cc-4991-8626-2ba32fa09acf> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:09:17.603603 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:07:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1575785918',display_name='tempest-AttachVolumeTestJSON-server-1575785918',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumetestjson-server-1575785918',id=54,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQqj5ulFm44LqcwStG35x3hx4kF2OHc+g0tTlOd4Z/Xec3CPwxGXUEAq08Fq2dSZhFKLMTCPF7EJ6q4KRfVK6ZgmNMJOJWZlgopXWPXQJWBjVOvQj1zQw9ZKwPgeXE7Hw==',key_name='tempest-keypair-749432862',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:07:15Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='23578125da1e4bf2bb3d59281a0e261e',ramdisk_id='',reservation_id='r-8bk45cr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1682604103',owner_user_name='tempest-AttachVolumeTestJSON-1682604103-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:09:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d68bbf62c74dd2bfe638f00ef6aa3d',uuid=1e7c5308-80cc-4991-8626-2ba32fa09acf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "cc1de356-c44a-46bf-bb87-d123239afbe7", "address": "fa:16:3e:05:9d:ed", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1de356-c4", "ovs_interfaceid": "cc1de356-c44a-46bf-bb87-d123239afbe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:09:17.603821 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Converting VIF {"id": "cc1de356-c44a-46bf-bb87-d123239afbe7", "address": "fa:16:3e:05:9d:ed", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1de356-c4", "ovs_interfaceid": "cc1de356-c44a-46bf-bb87-d123239afbe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:09:17.604385 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=cc1de356-c44a-46bf-bb87-d123239afbe7,network=Network(02f45984-182d-4648-ab01-d4773a271319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc1de356-c4') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:09:17.604618 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=cc1de356-c44a-46bf-bb87-d123239afbe7,network=Network(02f45984-182d-4648-ab01-d4773a271319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc1de356-c4') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:09:17.605025 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:17.605371 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:17.605743 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:09:17.606451 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:17.606620 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cac515f6-6dde-52e3-b94a-a44740fd1d11', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:17.607355 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:17.608599 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:09:17.613179 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:17.615026 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:17.615232 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc1de356-c4, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:17.615591 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc1de356-c4, col_values=(('qos', UUID('db623fc8-a64b-415c-be87-7016ac35770e')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:17.615749 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc1de356-c4, col_values=(('external_ids', {'iface-id': 'cc1de356-c44a-46bf-bb87-d123239afbe7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:9d:ed', 'vm-uuid': '1e7c5308-80cc-4991-8626-2ba32fa09acf'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:17.616463 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:17.617448 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:09:17.624809 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:17.625583 np0000001577 nova-compute[98319]: INFO os_vif [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=cc1de356-c44a-46bf-bb87-d123239afbe7,network=Network(02f45984-182d-4648-ab01-d4773a271319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc1de356-c4')
May 28 01:09:17.746875 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:17.808587 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-22b439b0-71ff-4dd7-b959-f2c6cea8fe08 tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "d5e4832e-32b9-44a7-92b8-6fa82e642515" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.974s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:17.809531 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "d5e4832e-32b9-44a7-92b8-6fa82e642515" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.854s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:17.809827 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "d5e4832e-32b9-44a7-92b8-6fa82e642515-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:17.810035 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "d5e4832e-32b9-44a7-92b8-6fa82e642515-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:17.810181 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "d5e4832e-32b9-44a7-92b8-6fa82e642515-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:17.812434 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Terminating instance
May 28 01:09:17.861466 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Creating config drive at /opt/stack/data/nova/instances/1e644f60-1f1f-4679-aec6-d1bbb3b69efe/disk.config
May 28 01:09:17.864836 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1e644f60-1f1f-4679-aec6-d1bbb3b69efe/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcofl1e92 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:17.913818 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7725186-2460-4632-868e-1cb41674f3f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '412ac56c-f524-46c2-91eb-fa4672db46a9', 'attached_at': '', 'detached_at': '', 'volume_id': 'f7725186-2460-4632-868e-1cb41674f3f0', 'serial': 'f7725186-2460-4632-868e-1cb41674f3f0'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 01:09:17.916930 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:09:17.917269 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7725186-2460-4632-868e-1cb41674f3f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:09:17.917488 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:09:17.917918 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:09:17.918113 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7725186-2460-4632-868e-1cb41674f3f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:09:17.918745 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1e644f60-1f1f-4679-aec6-d1bbb3b69efe/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcofl1e92" returned: 0 in 0.054s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:17.929250 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:09:17.929749 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:09:17.930039 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:09:17.930244 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:09:17.930595 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:09:17.930742 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:09:17.940225 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:09:17.940225 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:17.944141 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:09:17.944141 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:17.951138 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0] added
May 28 01:09:17.951138 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:09:17.951138 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:09:17.951138 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:09:17.951138 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:09:17.951138 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:09:17.951138 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:17.951344 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:09:17.951529 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0212(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:09:17.951727 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:09:17.956449 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0] added
May 28 01:09:17.956449 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:09:17.956449 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:09:17.956449 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:09:17.956449 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:09:17.956449 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:09:17.956449 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:17.956770 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:09:17.956813 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.026(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:09:17.956976 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:09:18.021688 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:18.050885 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:18.053946 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:18.192149 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:18.223248 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-49efc4af-4519-4952-a5a7-4ecb788c7ce1 req-cd083239-3eb1-47f6-a634-3ee470f628db service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Received event network-vif-plugged-cc1de356-c44a-46bf-bb87-d123239afbe7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:09:18.223600 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-49efc4af-4519-4952-a5a7-4ecb788c7ce1 req-cd083239-3eb1-47f6-a634-3ee470f628db service nova] Acquiring lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:18.223632 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-49efc4af-4519-4952-a5a7-4ecb788c7ce1 req-cd083239-3eb1-47f6-a634-3ee470f628db service nova] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:18.223759 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-49efc4af-4519-4952-a5a7-4ecb788c7ce1 req-cd083239-3eb1-47f6-a634-3ee470f628db service nova] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:18.223865 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-49efc4af-4519-4952-a5a7-4ecb788c7ce1 req-cd083239-3eb1-47f6-a634-3ee470f628db service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] No waiting events found dispatching network-vif-plugged-cc1de356-c44a-46bf-bb87-d123239afbe7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:09:18.224040 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-49efc4af-4519-4952-a5a7-4ecb788c7ce1 req-cd083239-3eb1-47f6-a634-3ee470f628db service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Received unexpected event network-vif-plugged-cc1de356-c44a-46bf-bb87-d123239afbe7 for instance with vm_state stopped and task_state powering-on.
May 28 01:09:18.316723 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:09:18.340095 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:18.342058 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:18.364840 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:18.382708 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:18.395711 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:18.396228 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:18.422451 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:18.434775 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:18.491985 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d72ab221-249e-4f40-bc5e-cd5bce17737a req-2091406d-d7a1-48ff-8ef1-1da685ede2e5 service nova] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Received event network-vif-unplugged-4e4212ac-6f4f-42f5-aae7-409c2ef76f02 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:09:18.492399 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d72ab221-249e-4f40-bc5e-cd5bce17737a req-2091406d-d7a1-48ff-8ef1-1da685ede2e5 service nova] Acquiring lock "d5e4832e-32b9-44a7-92b8-6fa82e642515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:18.492628 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d72ab221-249e-4f40-bc5e-cd5bce17737a req-2091406d-d7a1-48ff-8ef1-1da685ede2e5 service nova] Lock "d5e4832e-32b9-44a7-92b8-6fa82e642515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:18.492734 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d72ab221-249e-4f40-bc5e-cd5bce17737a req-2091406d-d7a1-48ff-8ef1-1da685ede2e5 service nova] Lock "d5e4832e-32b9-44a7-92b8-6fa82e642515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:18.492891 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d72ab221-249e-4f40-bc5e-cd5bce17737a req-2091406d-d7a1-48ff-8ef1-1da685ede2e5 service nova] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] No waiting events found dispatching network-vif-unplugged-4e4212ac-6f4f-42f5-aae7-409c2ef76f02 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:09:18.492954 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d72ab221-249e-4f40-bc5e-cd5bce17737a req-2091406d-d7a1-48ff-8ef1-1da685ede2e5 service nova] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Received event network-vif-unplugged-4e4212ac-6f4f-42f5-aae7-409c2ef76f02 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:09:18.526919 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:18.554243 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:18.585873 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:18.593511 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:18.729189 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:18.730171 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999736248999852 future=<Future at 0x7c988c041880 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:09:18.736209 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-76d4b5e8-ea18-404d-80c8-70272d4d9a4e req-e51bb862-180c-42ba-b065-a45ee55cca9e service nova] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Received event network-vif-plugged-53200c91-a0b8-4a29-a8f7-acc2ba51c3fe {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:09:18.736747 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Instance destroyed successfully.
May 28 01:09:18.738441 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76d4b5e8-ea18-404d-80c8-70272d4d9a4e req-e51bb862-180c-42ba-b065-a45ee55cca9e service nova] Acquiring lock "1e644f60-1f1f-4679-aec6-d1bbb3b69efe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:18.738441 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76d4b5e8-ea18-404d-80c8-70272d4d9a4e req-e51bb862-180c-42ba-b065-a45ee55cca9e service nova] Lock "1e644f60-1f1f-4679-aec6-d1bbb3b69efe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:18.738558 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76d4b5e8-ea18-404d-80c8-70272d4d9a4e req-e51bb862-180c-42ba-b065-a45ee55cca9e service nova] Lock "1e644f60-1f1f-4679-aec6-d1bbb3b69efe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:18.739575 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-76d4b5e8-ea18-404d-80c8-70272d4d9a4e req-e51bb862-180c-42ba-b065-a45ee55cca9e service nova] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Processing event network-vif-plugged-53200c91-a0b8-4a29-a8f7-acc2ba51c3fe {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:09:18.739575 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lazy-loading 'resources' on Instance uuid d5e4832e-32b9-44a7-92b8-6fa82e642515 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:09:18.952100 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:09:18.955604 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:18.957434 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:09:18.962469 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:09:18.969309 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:09:18.969309 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:09:18.977798 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:09:18.977798 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:18.986482 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:18.989884 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:18.992190 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:18.996946 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:18.999909 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:18.999909 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:18.999909 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:09:19.000032 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:19.000032 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:19.000032 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:09:19.005442 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:19.005442 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:19.005442 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:09:19.005630 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:19.005630 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:19.005630 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:09:19.036135 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0, portal: 192.168.40.100,3260]
May 28 01:09:19.036135 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0, portal: 192.168.40.100,3260] successful.
May 28 01:09:19.036135 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:19.051451 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:19.053041 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0, portal: 192.168.50.100,3260]
May 28 01:09:19.053041 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0, portal: 192.168.50.100,3260] successful.
May 28 01:09:19.053041 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:19.066001 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:19.066001 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:19.066001 np0000001577 nova-compute[98319]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:19.066001 np0000001577 nova-compute[98319]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:19.066001 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:09:19.066195 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:19.066195 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:19.066195 np0000001577 nova-compute[98319]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:19.066195 np0000001577 nova-compute[98319]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:19.066195 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:09:19.066434 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:09:19.066554 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:09:19.067415 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:19.067760 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] HCTL ('7', '-', '-', 0) found on session 148 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:09:19.067865 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:09:19.080684 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:19.080684 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:19.080684 np0000001577 nova-compute[98319]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:19.080684 np0000001577 nova-compute[98319]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:19.080684 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:09:19.080684 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:19.080684 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:19.080684 np0000001577 nova-compute[98319]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:19.080684 np0000001577 nova-compute[98319]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:19.080684 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:09:19.080920 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:09:19.081112 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:09:19.081527 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] HCTL ('8', '-', '-', 0) found on session 149 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:09:19.081632 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:09:19.089139 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Searching for a device in session 148 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:09:19.089418 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7725186-2460-4632-868e-1cb41674f3f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:09:19.096799 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Searching for a device in session 149 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:09:19.096799 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f7725186-2460-4632-868e-1cb41674f3f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:09:19.241579 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-144048780',display_name='tempest-VolumesSnapshotTestJSON-instance-144048780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumessnapshottestjson-instance-144048780',id=57,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/JAIBcLZ1O7ipAtDDV8VvEpLMfzMS0x6gK0sK235y7mpOg7VOEi2sGuvoK6ssr01zPu8nitJ5XVN58flFTMPT9EkUGGeoLN6edRNO+ivd0a2004wHoT84Fy5b1Tjiexw==',key_name='tempest-keypair-377288747',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:08:20Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f132ca2a48c44f6097340763039224c1',ramdisk_id='',reservation_id='r-jpdih90k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1352681167',owner_user_name='tempest-VolumesSnapshotTestJSON-1352681167-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:08:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf90ea61781a41ca91d0d5266f37cae4',uuid=d5e4832e-32b9-44a7-92b8-6fa82e642515,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e4212ac-6f4f-42f5-aae7-409c2ef76f02", "address": "fa:16:3e:55:fb:7f", "network": {"id": "c24d30f5-c7e1-4457-bdc3-ef51ebdf3991", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-116184687-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f132ca2a48c44f6097340763039224c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4212ac-6f", "ovs_interfaceid": "4e4212ac-6f4f-42f5-aae7-409c2ef76f02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:09:19.242238 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Converting VIF {"id": "4e4212ac-6f4f-42f5-aae7-409c2ef76f02", "address": "fa:16:3e:55:fb:7f", "network": {"id": "c24d30f5-c7e1-4457-bdc3-ef51ebdf3991", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-116184687-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f132ca2a48c44f6097340763039224c1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4212ac-6f", "ovs_interfaceid": "4e4212ac-6f4f-42f5-aae7-409c2ef76f02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:09:19.242374 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:fb:7f,bridge_name='br-int',has_traffic_filtering=True,id=4e4212ac-6f4f-42f5-aae7-409c2ef76f02,network=Network(c24d30f5-c7e1-4457-bdc3-ef51ebdf3991),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4212ac-6f') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:09:19.242613 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:fb:7f,bridge_name='br-int',has_traffic_filtering=True,id=4e4212ac-6f4f-42f5-aae7-409c2ef76f02,network=Network(c24d30f5-c7e1-4457-bdc3-ef51ebdf3991),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4212ac-6f') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:09:19.244721 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:19.244972 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e4212ac-6f, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:19.252712 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:19.253458 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:09:19.253980 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:19.254897 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:19.255057 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3cf5bc0b-9d3f-4fb3-b355-c77faaa286f4) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:19.255489 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:19.255954 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:09:19.256466 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:19.259089 np0000001577 nova-compute[98319]: INFO os_vif [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:fb:7f,bridge_name='br-int',has_traffic_filtering=True,id=4e4212ac-6f4f-42f5-aae7-409c2ef76f02,network=Network(c24d30f5-c7e1-4457-bdc3-ef51ebdf3991),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4212ac-6f')
May 28 01:09:19.261720 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:09:19.261720 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385', 'iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a76dc713-7aa0-4459-b6c0-9fbdb003b385', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:09:19.262132 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:09:19.369376 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Instance event wait completed in 0 seconds for  {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:09:19.370146 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Removed pending STOPPED event for 1e7c5308-80cc-4991-8626-2ba32fa09acf due to new event <LifecycleEvent: 1779930559.369792, 1e7c5308-80cc-4991-8626-2ba32fa09acf => Resumed> {{(pid=98319) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 01:09:19.370318 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930559.369792, 1e7c5308-80cc-4991-8626-2ba32fa09acf => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:09:19.370485 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] VM Resumed (Lifecycle Event)
May 28 01:09:19.374031 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Instance rebooted successfully.
May 28 01:09:19.443214 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:09:19.445325 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:09:19.447340 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Instance spawned successfully.
May 28 01:09:19.447633 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:09:19.873304 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:09:19.877823 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:09:19.930755 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:09:19.953460 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:09:19.953620 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:09:19.953788 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:09:19.953962 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:09:19.954206 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:09:19.954408 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:09:20.156905 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-1e3ef1c9-1f5d-47f8-ae0c-f4570d5ffd2b tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Snapshot image upload complete
May 28 01:09:20.157119 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-1e3ef1c9-1f5d-47f8-ae0c-f4570d5ffd2b tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Took 5.60 seconds to snapshot the instance on the hypervisor.
May 28 01:09:20.297795 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e758566b-8946-4d8d-b20c-b4dcbbc75e82 req-273d8fe3-5cc9-429c-a7f0-1975359b5d74 service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Received event network-vif-plugged-cc1de356-c44a-46bf-bb87-d123239afbe7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:09:20.299984 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e758566b-8946-4d8d-b20c-b4dcbbc75e82 req-273d8fe3-5cc9-429c-a7f0-1975359b5d74 service nova] Acquiring lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:20.300242 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e758566b-8946-4d8d-b20c-b4dcbbc75e82 req-273d8fe3-5cc9-429c-a7f0-1975359b5d74 service nova] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:20.300347 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e758566b-8946-4d8d-b20c-b4dcbbc75e82 req-273d8fe3-5cc9-429c-a7f0-1975359b5d74 service nova] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:20.300508 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e758566b-8946-4d8d-b20c-b4dcbbc75e82 req-273d8fe3-5cc9-429c-a7f0-1975359b5d74 service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] No waiting events found dispatching network-vif-plugged-cc1de356-c44a-46bf-bb87-d123239afbe7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:09:20.300669 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-e758566b-8946-4d8d-b20c-b4dcbbc75e82 req-273d8fe3-5cc9-429c-a7f0-1975359b5d74 service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Received unexpected event network-vif-plugged-cc1de356-c44a-46bf-bb87-d123239afbe7 for instance with vm_state stopped and task_state powering-on.
May 28 01:09:20.381770 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] During sync_power_state the instance has a pending task (powering-on). Skip.
May 28 01:09:20.383534 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930560.3833005, 1e7c5308-80cc-4991-8626-2ba32fa09acf => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:09:20.384328 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] VM Started (Lifecycle Event)
May 28 01:09:20.459529 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Took 8.88 seconds to spawn the instance on the hypervisor.
May 28 01:09:20.459781 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:09:20.581624 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6eaa2d93-a881-40b4-af8b-78a695de9d81 req-38ab2fb5-7ada-468a-88d7-87308668ef11 service nova] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Received event network-vif-unplugged-4e4212ac-6f4f-42f5-aae7-409c2ef76f02 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:09:20.588192 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6eaa2d93-a881-40b4-af8b-78a695de9d81 req-38ab2fb5-7ada-468a-88d7-87308668ef11 service nova] Acquiring lock "d5e4832e-32b9-44a7-92b8-6fa82e642515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:20.588407 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6eaa2d93-a881-40b4-af8b-78a695de9d81 req-38ab2fb5-7ada-468a-88d7-87308668ef11 service nova] Lock "d5e4832e-32b9-44a7-92b8-6fa82e642515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:20.588522 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6eaa2d93-a881-40b4-af8b-78a695de9d81 req-38ab2fb5-7ada-468a-88d7-87308668ef11 service nova] Lock "d5e4832e-32b9-44a7-92b8-6fa82e642515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:20.588667 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6eaa2d93-a881-40b4-af8b-78a695de9d81 req-38ab2fb5-7ada-468a-88d7-87308668ef11 service nova] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] No waiting events found dispatching network-vif-unplugged-4e4212ac-6f4f-42f5-aae7-409c2ef76f02 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:09:20.588776 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6eaa2d93-a881-40b4-af8b-78a695de9d81 req-38ab2fb5-7ada-468a-88d7-87308668ef11 service nova] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Received event network-vif-unplugged-4e4212ac-6f4f-42f5-aae7-409c2ef76f02 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:09:20.801256 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ef69f2e8-98b7-4e03-bced-0cb97c984a7d req-f071568f-f6f8-4ae7-a0a9-dd965bcc4bd7 service nova] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Received event network-vif-plugged-53200c91-a0b8-4a29-a8f7-acc2ba51c3fe {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:09:20.801256 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ef69f2e8-98b7-4e03-bced-0cb97c984a7d req-f071568f-f6f8-4ae7-a0a9-dd965bcc4bd7 service nova] Acquiring lock "1e644f60-1f1f-4679-aec6-d1bbb3b69efe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:20.801256 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ef69f2e8-98b7-4e03-bced-0cb97c984a7d req-f071568f-f6f8-4ae7-a0a9-dd965bcc4bd7 service nova] Lock "1e644f60-1f1f-4679-aec6-d1bbb3b69efe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:20.801256 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ef69f2e8-98b7-4e03-bced-0cb97c984a7d req-f071568f-f6f8-4ae7-a0a9-dd965bcc4bd7 service nova] Lock "1e644f60-1f1f-4679-aec6-d1bbb3b69efe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:20.801256 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ef69f2e8-98b7-4e03-bced-0cb97c984a7d req-f071568f-f6f8-4ae7-a0a9-dd965bcc4bd7 service nova] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] No waiting events found dispatching network-vif-plugged-53200c91-a0b8-4a29-a8f7-acc2ba51c3fe {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:09:20.801256 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-ef69f2e8-98b7-4e03-bced-0cb97c984a7d req-f071568f-f6f8-4ae7-a0a9-dd965bcc4bd7 service nova] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Received unexpected event network-vif-plugged-53200c91-a0b8-4a29-a8f7-acc2ba51c3fe for instance with vm_state active and task_state None.
May 28 01:09:20.886576 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:09:20.894021 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:09:20.895048 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:09:20.896658 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:09:20.896847 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] No VIF found with MAC fa:16:3e:05:9d:ed, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:09:20.897283 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-18f4a5e1-cb1d-4aac-a1e0-ebdb96bd02a7 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:09:20.951684 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Found WWN 330000000dd6bd600 for multipath device dm-2 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:09:20.952046 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:09:20.952984 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.691s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:09:20.953572 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385', 'iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a76dc713-7aa0-4459-b6c0-9fbdb003b385', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:09:20.953572 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:09:20.955481 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '330000000dd6bd600', 'path': '/dev/disk/by-id/os-brick+dev+dm-2', 'multipath_id': '330000000dd6bd600'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:09:20.955672 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000dd6bd600', 'path': '/dev/disk/by-id/os-brick+dev+dm-2', 'multipath_id': '330000000dd6bd600'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:09:20.958916 np0000001577 nova-compute[98319]: WARNING stevedore.named [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 01:09:20.959167 np0000001577 nova-compute[98319]: WARNING castellan.key_manager [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:09:20.959350 np0000001577 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:09:20.971261 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Took 15.92 seconds to build instance.
May 28 01:09:20.984808 np0000001577 nova-compute[98319]: WARNING os_brick.encryptors.luks [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 28 01:09:20.985258 np0000001577 nova-compute[98319]: WARNING stevedore.named [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 01:09:20.985436 np0000001577 nova-compute[98319]: WARNING castellan.key_manager [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:09:20.985616 np0000001577 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:09:20.986208 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x7c984c632120>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7725186-2460-4632-868e-1cb41674f3f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-2'}, 'status': 'reserved', 'instance': '412ac56c-f524-46c2-91eb-fa4672db46a9', 'attached_at': '', 'detached_at': '', 'volume_id': 'f7725186-2460-4632-868e-1cb41674f3f0', 'serial': 'f7725186-2460-4632-868e-1cb41674f3f0'} {{(pid=98319) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 01:09:20.986360 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors.luks [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] formatting encrypted volume /dev/dm-2 {{(pid=98319) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 28 01:09:20.986913 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:20.986913 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:20.986913 np0000001577 nova-compute[98319]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:20.986913 np0000001577 nova-compute[98319]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:20.986913 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:09:20.990849 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:20.990849 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:20.990849 np0000001577 nova-compute[98319]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:20.990849 np0000001577 nova-compute[98319]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:20.990849 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:09:20.990849 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', '146'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', '147'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', '148'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', '149')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:09:20.990849 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385, 0): [] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:09:20.990849 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385') {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 01:09:20.990849 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385, 0): [] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:09:20.990849 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a76dc713-7aa0-4459-b6c0-9fbdb003b385') {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 01:09:20.990849 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c987054c0e0>, {}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:09:20.990849 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Disconnecting from: [] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:09:20.990849 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.036s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:09:20.990849 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] <== disconnect_volume: return (1727ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:09:20.990849 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:09:20.990849 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Deleting instance files /opt/stack/data/nova/instances/d5e4832e-32b9-44a7-92b8-6fa82e642515_del
May 28 01:09:20.990849 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Deletion of /opt/stack/data/nova/instances/d5e4832e-32b9-44a7-92b8-6fa82e642515_del complete
May 28 01:09:21.398017 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] During sync_power_state the instance has a pending task (powering-on). Skip.
May 28 01:09:21.400518 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930561.398873, 1e644f60-1f1f-4679-aec6-d1bbb3b69efe => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:09:21.400518 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] VM Started (Lifecycle Event)
May 28 01:09:21.473270 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-19c0cdf6-cd3f-4344-aa43-7c19f1bd6774 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "1e644f60-1f1f-4679-aec6-d1bbb3b69efe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.428s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:21.499606 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:21.502740 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Took 3.18 seconds to destroy the instance on the hypervisor.
May 28 01:09:21.502740 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:09:21.502921 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:09:21.503033 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:09:21.503617 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:21.591329 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:21.848577 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "e5a3d695-94e9-4ad7-aa07-b6cc865b30a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:21.848577 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "e5a3d695-94e9-4ad7-aa07-b6cc865b30a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:21.906956 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:09:21.912139 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:09:22.349301 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:09:22.415506 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930562.4151683, 1e644f60-1f1f-4679-aec6-d1bbb3b69efe => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:09:22.415873 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] VM Paused (Lifecycle Event)
May 28 01:09:22.570170 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:09:22.654369 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6efd673b-f781-4f61-bc93-e6c1a34443bf req-2f602aea-bebb-4fd0-84fd-47f256502138 service nova] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Received event network-vif-deleted-4e4212ac-6f4f-42f5-aae7-409c2ef76f02 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:09:22.897770 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d018035b-5e9f-48b3-8805-aab70a2d0fff req-d5bc528e-ef65-4cee-983a-0a0b61c5c23b service nova] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Received event network-changed-53200c91-a0b8-4a29-a8f7-acc2ba51c3fe {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:09:22.897872 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d018035b-5e9f-48b3-8805-aab70a2d0fff req-d5bc528e-ef65-4cee-983a-0a0b61c5c23b service nova] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Refreshing instance network info cache due to event network-changed-53200c91-a0b8-4a29-a8f7-acc2ba51c3fe. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:09:22.898579 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d018035b-5e9f-48b3-8805-aab70a2d0fff req-d5bc528e-ef65-4cee-983a-0a0b61c5c23b service nova] Acquiring lock "refresh_cache-1e644f60-1f1f-4679-aec6-d1bbb3b69efe" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:09:22.898579 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d018035b-5e9f-48b3-8805-aab70a2d0fff req-d5bc528e-ef65-4cee-983a-0a0b61c5c23b service nova] Acquired lock "refresh_cache-1e644f60-1f1f-4679-aec6-d1bbb3b69efe" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:09:22.898579 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-d018035b-5e9f-48b3-8805-aab70a2d0fff req-d5bc528e-ef65-4cee-983a-0a0b61c5c23b service nova] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Refreshing network info cache for port 53200c91-a0b8-4a29-a8f7-acc2ba51c3fe {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:09:22.918205 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:22.918369 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:22.919340 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:09:22.921693 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:09:22.921814 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Claim successful on node np0000001577
May 28 01:09:22.925785 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930562.9254391, 1e644f60-1f1f-4679-aec6-d1bbb3b69efe => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:09:22.925940 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] VM Resumed (Lifecycle Event)
May 28 01:09:23.072431 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Took 1.57 seconds to deallocate network for instance.
May 28 01:09:23.094485 np0000001577 nova-compute[98319]: WARNING nova.volume.cinder [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Attachment bf67c7dc-d3c7-4179-9ced-a98ffa161eb3 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = bf67c7dc-d3c7-4179-9ced-a98ffa161eb3. (HTTP 404) (Request-ID: req-9af14f38-a1a1-4575-ab63-dddaa93df922)
May 28 01:09:23.094872 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Took 0.02 seconds to detach 1 volumes for instance.
May 28 01:09:23.400326 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-d018035b-5e9f-48b3-8805-aab70a2d0fff req-d5bc528e-ef65-4cee-983a-0a0b61c5c23b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:23.414975 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0006816730001446558 future=<Future at 0x7c984c6313d0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:09:23.415110 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:09:23.415234 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=10.314658393000173 future=<Future at 0x7c988c041880 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:09:23.415337 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=10.314551594000022 future=<Future at 0x7c988c041880 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:09:23.431072 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:09:23.435920 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:09:23.600633 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:23.678375 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-d018035b-5e9f-48b3-8805-aab70a2d0fff req-d5bc528e-ef65-4cee-983a-0a0b61c5c23b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:23.797695 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-d018035b-5e9f-48b3-8805-aab70a2d0fff req-d5bc528e-ef65-4cee-983a-0a0b61c5c23b service nova] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Updated VIF entry in instance network info cache for port 53200c91-a0b8-4a29-a8f7-acc2ba51c3fe. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:09:23.797985 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-d018035b-5e9f-48b3-8805-aab70a2d0fff req-d5bc528e-ef65-4cee-983a-0a0b61c5c23b service nova] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Updating instance_info_cache with network_info: [{"id": "53200c91-a0b8-4a29-a8f7-acc2ba51c3fe", "address": "fa:16:3e:46:94:e9", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53200c91-a0", "ovs_interfaceid": "53200c91-a0b8-4a29-a8f7-acc2ba51c3fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:09:24.196368 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:09:24.196810 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:09:24.255635 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:24.299864 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d018035b-5e9f-48b3-8805-aab70a2d0fff req-d5bc528e-ef65-4cee-983a-0a0b61c5c23b service nova] Releasing lock "refresh_cache-1e644f60-1f1f-4679-aec6-d1bbb3b69efe" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:09:24.699604 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:09:24.812567 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 01:09:24.812567 np0000001577 nova-compute[98319]:   <usage type="volume">
May 28 01:09:24.812567 np0000001577 nova-compute[98319]:     <volume>f7725186-2460-4632-868e-1cb41674f3f0</volume>
May 28 01:09:24.812567 np0000001577 nova-compute[98319]:   </usage>
May 28 01:09:24.812567 np0000001577 nova-compute[98319]: </secret>
May 28 01:09:24.812567 np0000001577 nova-compute[98319]:  {{(pid=98319) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 01:09:24.817697 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lazy-loading 'flavor' on Instance uuid 412ac56c-f524-46c2-91eb-fa4672db46a9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:09:25.205613 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.287s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:25.206523 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.605s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:25.206735 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:09:25.321403 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Attempting to attach volume f7725186-2460-4632-868e-1cb41674f3f0 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:09:25.323539 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:09:25.323539 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:09:25.323539 np0000001577 nova-compute[98319]:   <alias name="ua-f7725186-2460-4632-868e-1cb41674f3f0"/>
May 28 01:09:25.323539 np0000001577 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-2"/>
May 28 01:09:25.323539 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:09:25.323539 np0000001577 nova-compute[98319]:   <serial>f7725186-2460-4632-868e-1cb41674f3f0</serial>
May 28 01:09:25.323539 np0000001577 nova-compute[98319]:   <encryption format="luks">
May 28 01:09:25.323539 np0000001577 nova-compute[98319]:     <secret type="passphrase" uuid="59ae9dc3-ca5e-4764-bcdd-7f77e798f43b"/>
May 28 01:09:25.323539 np0000001577 nova-compute[98319]:   </encryption>
May 28 01:09:25.323539 np0000001577 nova-compute[98319]: </disk>
May 28 01:09:25.323539 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:09:25.490650 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:09:25.490834 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:09:25.711681 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:09:25.714576 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:09:25.714576 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:25.714576 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:25.796515 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9258145be7414d88accbdb4802619956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f49e31415146d281ba6b462016d5d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:09:25.993099 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:09:26.215431 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:09:26.379570 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Successfully created port: 78589b79-8f25-4f7e-a6c8-96e5a5c076b8 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:09:26.498926 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:26.501609 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.296s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:26.545233 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Deleted allocations for instance d5e4832e-32b9-44a7-92b8-6fa82e642515
May 28 01:09:26.718831 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:09:26.821376 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Successfully updated port: 78589b79-8f25-4f7e-a6c8-96e5a5c076b8 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:09:26.868036 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d75c72ba-ccc5-47af-bb5c-35985e34601a req-f3b60b97-a4c8-4bd2-ac6e-232b7d312b2f service nova] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Received event network-changed-78589b79-8f25-4f7e-a6c8-96e5a5c076b8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:09:26.869764 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d75c72ba-ccc5-47af-bb5c-35985e34601a req-f3b60b97-a4c8-4bd2-ac6e-232b7d312b2f service nova] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Refreshing instance network info cache due to event network-changed-78589b79-8f25-4f7e-a6c8-96e5a5c076b8. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:09:26.869982 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d75c72ba-ccc5-47af-bb5c-35985e34601a req-f3b60b97-a4c8-4bd2-ac6e-232b7d312b2f service nova] Acquiring lock "refresh_cache-e5a3d695-94e9-4ad7-aa07-b6cc865b30a1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:09:26.870209 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d75c72ba-ccc5-47af-bb5c-35985e34601a req-f3b60b97-a4c8-4bd2-ac6e-232b7d312b2f service nova] Acquired lock "refresh_cache-e5a3d695-94e9-4ad7-aa07-b6cc865b30a1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:09:26.870369 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-d75c72ba-ccc5-47af-bb5c-35985e34601a req-f3b60b97-a4c8-4bd2-ac6e-232b7d312b2f service nova] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Refreshing network info cache for port 78589b79-8f25-4f7e-a6c8-96e5a5c076b8 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:09:27.323362 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "refresh_cache-e5a3d695-94e9-4ad7-aa07-b6cc865b30a1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:09:27.372252 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-d75c72ba-ccc5-47af-bb5c-35985e34601a req-f3b60b97-a4c8-4bd2-ac6e-232b7d312b2f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:27.434361 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-d75c72ba-ccc5-47af-bb5c-35985e34601a req-f3b60b97-a4c8-4bd2-ac6e-232b7d312b2f service nova] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:09:27.552241 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-485e7e25-913e-4516-88cb-bb24163b0bfd tempest-VolumesSnapshotTestJSON-1352681167 tempest-VolumesSnapshotTestJSON-1352681167-project-member] Lock "d5e4832e-32b9-44a7-92b8-6fa82e642515" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.743s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:27.583925 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-d75c72ba-ccc5-47af-bb5c-35985e34601a req-f3b60b97-a4c8-4bd2-ac6e-232b7d312b2f service nova] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:09:27.728252 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:09:27.729099 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:09:27.729379 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Creating image(s)
May 28 01:09:27.730799 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "/opt/stack/data/nova/instances/e5a3d695-94e9-4ad7-aa07-b6cc865b30a1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:27.730799 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "/opt/stack/data/nova/instances/e5a3d695-94e9-4ad7-aa07-b6cc865b30a1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:27.731721 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "/opt/stack/data/nova/instances/e5a3d695-94e9-4ad7-aa07-b6cc865b30a1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:27.731721 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "b2e8ed768c78756a0a109a40397c8ad0d7171ec5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:27.732029 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "b2e8ed768c78756a0a109a40397c8ad0d7171ec5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:27.938306 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:09:27.938470 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:09:27.938580 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:09:27.938680 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] No VIF found with MAC fa:16:3e:d7:12:9f, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:09:28.085612 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d75c72ba-ccc5-47af-bb5c-35985e34601a req-f3b60b97-a4c8-4bd2-ac6e-232b7d312b2f service nova] Releasing lock "refresh_cache-e5a3d695-94e9-4ad7-aa07-b6cc865b30a1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:09:28.085870 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquired lock "refresh_cache-e5a3d695-94e9-4ad7-aa07-b6cc865b30a1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:09:28.086012 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:09:28.443096 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:09:28.447283 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:09:28.451568 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2e8ed768c78756a0a109a40397c8ad0d7171ec5.part --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:28.533951 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2e8ed768c78756a0a109a40397c8ad0d7171ec5.part --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:28.534924 np0000001577 nova-compute[98319]: DEBUG nova.virt.images [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] 0109a854-afbc-41f9-bf88-afd37822f089 was qcow2, converting to raw {{(pid=98319) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 01:09:28.538564 np0000001577 nova-compute[98319]: DEBUG nova.privsep.utils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 01:09:28.538564 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b2e8ed768c78756a0a109a40397c8ad0d7171ec5.part /opt/stack/data/nova/instances/_base/b2e8ed768c78756a0a109a40397c8ad0d7171ec5.converted {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:28.665291 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:09:28.671282 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b2e8ed768c78756a0a109a40397c8ad0d7171ec5.part /opt/stack/data/nova/instances/_base/b2e8ed768c78756a0a109a40397c8ad0d7171ec5.converted" returned: 0 in 0.135s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:28.684435 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2e8ed768c78756a0a109a40397c8ad0d7171ec5.converted --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:28.792563 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2e8ed768c78756a0a109a40397c8ad0d7171ec5.converted --force-share --output=json" returned: 0 in 0.108s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:28.795530 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "b2e8ed768c78756a0a109a40397c8ad0d7171ec5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.062s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:28.795530 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:09:28.797409 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:09:28.798636 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2e8ed768c78756a0a109a40397c8ad0d7171ec5 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:28.852933 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:28.892425 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2e8ed768c78756a0a109a40397c8ad0d7171ec5 --force-share --output=json" returned: 0 in 0.094s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:28.893217 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "b2e8ed768c78756a0a109a40397c8ad0d7171ec5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:28.893498 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "b2e8ed768c78756a0a109a40397c8ad0d7171ec5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:28.893953 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:09:28.896652 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:09:28.897062 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2e8ed768c78756a0a109a40397c8ad0d7171ec5 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:28.991239 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2e8ed768c78756a0a109a40397c8ad0d7171ec5 --force-share --output=json" returned: 0 in 0.094s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:28.994563 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b2e8ed768c78756a0a109a40397c8ad0d7171ec5,backing_fmt=raw /opt/stack/data/nova/instances/e5a3d695-94e9-4ad7-aa07-b6cc865b30a1/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:29.022275 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Updating instance_info_cache with network_info: [{"id": "78589b79-8f25-4f7e-a6c8-96e5a5c076b8", "address": "fa:16:3e:94:f6:22", "network": {"id": "8bf5903d-3155-48fb-98dd-859e96b349d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1733749547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92f49e31415146d281ba6b462016d5d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78589b79-8f", "ovs_interfaceid": "78589b79-8f25-4f7e-a6c8-96e5a5c076b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:09:29.056568 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b2e8ed768c78756a0a109a40397c8ad0d7171ec5,backing_fmt=raw /opt/stack/data/nova/instances/e5a3d695-94e9-4ad7-aa07-b6cc865b30a1/disk 1073741824" returned: 0 in 0.064s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:29.058247 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "b2e8ed768c78756a0a109a40397c8ad0d7171ec5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.164s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:29.058247 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2e8ed768c78756a0a109a40397c8ad0d7171ec5 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:29.148581 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2e8ed768c78756a0a109a40397c8ad0d7171ec5 --force-share --output=json" returned: 0 in 0.091s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:29.150382 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:09:29.150382 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Ensure instance console log exists: /opt/stack/data/nova/instances/e5a3d695-94e9-4ad7-aa07-b6cc865b30a1/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:09:29.150382 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:29.150382 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:29.150382 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:29.257313 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:29.526387 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Releasing lock "refresh_cache-e5a3d695-94e9-4ad7-aa07-b6cc865b30a1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:09:29.526808 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Instance network_info: |[{"id": "78589b79-8f25-4f7e-a6c8-96e5a5c076b8", "address": "fa:16:3e:94:f6:22", "network": {"id": "8bf5903d-3155-48fb-98dd-859e96b349d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1733749547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92f49e31415146d281ba6b462016d5d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78589b79-8f", "ovs_interfaceid": "78589b79-8f25-4f7e-a6c8-96e5a5c076b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:09:29.528486 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Start _get_guest_xml network_info=[{"id": "78589b79-8f25-4f7e-a6c8-96e5a5c076b8", "address": "fa:16:3e:94:f6:22", "network": {"id": "8bf5903d-3155-48fb-98dd-859e96b349d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1733749547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92f49e31415146d281ba6b462016d5d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78589b79-8f", "ovs_interfaceid": "78589b79-8f25-4f7e-a6c8-96e5a5c076b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='431851b0693207098eeb23d296471ea0',container_format='bare',created_at=2026-05-28T01:09:13Z,direct_url=<?>,disk_format='qcow2',id=0109a854-afbc-41f9-bf88-afd37822f089,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-285725083',owner='92f49e31415146d281ba6b462016d5d4',properties=ImageMetaProps,protected=<?>,size=53608448,status='active',tags=<?>,updated_at=2026-05-28T01:09:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0109a854-afbc-41f9-bf88-afd37822f089'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:09:29.533714 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:09:29.535608 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-TestStampPattern-server-1244396529', uuid='e5a3d695-94e9-4ad7-aa07-b6cc865b30a1'), owner=OwnerMeta(userid='9258145be7414d88accbdb4802619956', username='tempest-TestStampPattern-1316789919-project-member', projectid='92f49e31415146d281ba6b462016d5d4', projectname='tempest-TestStampPattern-1316789919'), image=ImageMeta(id='0109a854-afbc-41f9-bf88-afd37822f089', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio', 'img_owner_id': '92f49e31415146d281ba6b462016d5d4'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "78589b79-8f25-4f7e-a6c8-96e5a5c076b8", "address": "fa:16:3e:94:f6:22", "network": {"id": "8bf5903d-3155-48fb-98dd-859e96b349d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1733749547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92f49e31415146d281ba6b462016d5d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78589b79-8f", "ovs_interfaceid": "78589b79-8f25-4f7e-a6c8-96e5a5c076b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930569.5351136) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:09:29.538067 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:09:29.538558 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:09:29.539714 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:09:29.539956 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:09:29.541357 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:09:29.541887 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='431851b0693207098eeb23d296471ea0',container_format='bare',created_at=2026-05-28T01:09:13Z,direct_url=<?>,disk_format='qcow2',id=0109a854-afbc-41f9-bf88-afd37822f089,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-285725083',owner='92f49e31415146d281ba6b462016d5d4',properties=ImageMetaProps,protected=<?>,size=53608448,status='active',tags=<?>,updated_at=2026-05-28T01:09:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:09:29.542209 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:09:29.542409 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:09:29.542704 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:09:29.542876 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:09:29.543053 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:09:29.543360 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:09:29.543558 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:09:29.543749 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:09:29.546027 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:09:29.546291 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:09:29.553676 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-646a4bd0-880b-4c12-99ea-d1da68eb6f43 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.347s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:29.560344 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:09:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1244396529',display_name='tempest-TestStampPattern-server-1244396529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-teststamppattern-server-1244396529',id=61,image_ref='0109a854-afbc-41f9-bf88-afd37822f089',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY7LZ57I2hyMdKVO08J6JSzhqiI0ZTtKrP9nyz1z53fPuESHxKL03vnaQuF8H5q84b516fImHzGWaVzsCTjOGesM9ULlqWAaR2gPi+wEj2GKOu9g0fSmRD2xOlCcqeMHw==',key_name='tempest-TestStampPattern-1233377666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92f49e31415146d281ba6b462016d5d4',ramdisk_id='',reservation_id='r-54mtg7ux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='4d7b37c7-b091-44f7-a330-4e55e2b1e348',image_min_disk='1',image_min_ram='0',image_owner_id='92f49e31415146d281ba6b462016d5d4',image_owner_project_name='tempest-TestStampPattern-1316789919',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1316789919-project-member',image_user_id='9258145be7414d88accbdb4802619956',network_allocated='True',owner_project_name='tempest-TestStampPattern-1316789919',owner_user_name='tempest-TestStampPattern-1316789919-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:09:27Z,user_data=None,user_id='9258145be7414d88accbdb4802619956',uuid=e5a3d695-94e9-4ad7-aa07-b6cc865b30a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78589b79-8f25-4f7e-a6c8-96e5a5c076b8", "address": "fa:16:3e:94:f6:22", "network": {"id": "8bf5903d-3155-48fb-98dd-859e96b349d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1733749547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92f49e31415146d281ba6b462016d5d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78589b79-8f", "ovs_interfaceid": "78589b79-8f25-4f7e-a6c8-96e5a5c076b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:09:29.560777 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Converting VIF {"id": "78589b79-8f25-4f7e-a6c8-96e5a5c076b8", "address": "fa:16:3e:94:f6:22", "network": {"id": "8bf5903d-3155-48fb-98dd-859e96b349d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1733749547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92f49e31415146d281ba6b462016d5d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78589b79-8f", "ovs_interfaceid": "78589b79-8f25-4f7e-a6c8-96e5a5c076b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:09:29.562252 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:f6:22,bridge_name='br-int',has_traffic_filtering=True,id=78589b79-8f25-4f7e-a6c8-96e5a5c076b8,network=Network(8bf5903d-3155-48fb-98dd-859e96b349d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78589b79-8f') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:09:29.562878 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lazy-loading 'pci_devices' on Instance uuid e5a3d695-94e9-4ad7-aa07-b6cc865b30a1 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:09:30.068573 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] End _get_guest_xml xml=<domain type="qemu">
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:   <uuid>e5a3d695-94e9-4ad7-aa07-b6cc865b30a1</uuid>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:   <name>instance-0000003d</name>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestStampPattern-server-1244396529</nova:name>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:09:29</nova:creationTime>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:           <nova:property name="img_owner_id">92f49e31415146d281ba6b462016d5d4</nova:property>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:         <nova:user uuid="9258145be7414d88accbdb4802619956">tempest-TestStampPattern-1316789919-project-member</nova:user>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:         <nova:project uuid="92f49e31415146d281ba6b462016d5d4">tempest-TestStampPattern-1316789919</nova:project>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:         <nova:port uuid="78589b79-8f25-4f7e-a6c8-96e5a5c076b8">
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:     <system>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       <entry name="serial">e5a3d695-94e9-4ad7-aa07-b6cc865b30a1</entry>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       <entry name="uuid">e5a3d695-94e9-4ad7-aa07-b6cc865b30a1</entry>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:     </system>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:   <os>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:   </os>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:   <features>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:   </features>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:   <devices>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/e5a3d695-94e9-4ad7-aa07-b6cc865b30a1/disk"/>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:     </disk>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/e5a3d695-94e9-4ad7-aa07-b6cc865b30a1/disk.config"/>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:     </disk>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:94:f6:22"/>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       <target dev="tap78589b79-8f"/>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:     </interface>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/e5a3d695-94e9-4ad7-aa07-b6cc865b30a1/console.log" append="off"/>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:     </serial>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:     <video>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:     </video>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:     </rng>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:   </devices>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]: </domain>
May 28 01:09:30.068573 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:09:30.068573 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Preparing to wait for external event network-vif-plugged-78589b79-8f25-4f7e-a6c8-96e5a5c076b8 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:09:30.068573 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "e5a3d695-94e9-4ad7-aa07-b6cc865b30a1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:30.068573 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "e5a3d695-94e9-4ad7-aa07-b6cc865b30a1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:30.068573 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "e5a3d695-94e9-4ad7-aa07-b6cc865b30a1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:30.068573 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:09:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1244396529',display_name='tempest-TestStampPattern-server-1244396529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-teststamppattern-server-1244396529',id=61,image_ref='0109a854-afbc-41f9-bf88-afd37822f089',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY7LZ57I2hyMdKVO08J6JSzhqiI0ZTtKrP9nyz1z53fPuESHxKL03vnaQuF8H5q84b516fImHzGWaVzsCTjOGesM9ULlqWAaR2gPi+wEj2GKOu9g0fSmRD2xOlCcqeMHw==',key_name='tempest-TestStampPattern-1233377666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92f49e31415146d281ba6b462016d5d4',ramdisk_id='',reservation_id='r-54mtg7ux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='4d7b37c7-b091-44f7-a330-4e55e2b1e348',image_min_disk='1',image_min_ram='0',image_owner_id='92f49e31415146d281ba6b462016d5d4',image_owner_project_name='tempest-TestStampPattern-1316789919',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1316789919-project-member',image_user_id='9258145be7414d88accbdb4802619956',network_allocated='True',owner_project_name='tempest-TestStampPattern-1316789919',owner_user_name='tempest-TestStampPattern-1316789919-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:09:27Z,user_data=None,user_id='9258145be7414d88accbdb4802619956',uuid=e5a3d695-94e9-4ad7-aa07-b6cc865b30a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78589b79-8f25-4f7e-a6c8-96e5a5c076b8", "address": "fa:16:3e:94:f6:22", "network": {"id": "8bf5903d-3155-48fb-98dd-859e96b349d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1733749547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92f49e31415146d281ba6b462016d5d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78589b79-8f", "ovs_interfaceid": "78589b79-8f25-4f7e-a6c8-96e5a5c076b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:09:30.068573 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Converting VIF {"id": "78589b79-8f25-4f7e-a6c8-96e5a5c076b8", "address": "fa:16:3e:94:f6:22", "network": {"id": "8bf5903d-3155-48fb-98dd-859e96b349d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1733749547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92f49e31415146d281ba6b462016d5d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78589b79-8f", "ovs_interfaceid": "78589b79-8f25-4f7e-a6c8-96e5a5c076b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:09:30.071905 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:f6:22,bridge_name='br-int',has_traffic_filtering=True,id=78589b79-8f25-4f7e-a6c8-96e5a5c076b8,network=Network(8bf5903d-3155-48fb-98dd-859e96b349d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78589b79-8f') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:09:30.071905 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:f6:22,bridge_name='br-int',has_traffic_filtering=True,id=78589b79-8f25-4f7e-a6c8-96e5a5c076b8,network=Network(8bf5903d-3155-48fb-98dd-859e96b349d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78589b79-8f') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:09:30.072059 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:30.072287 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:30.072541 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:09:30.073259 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:30.073397 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '01891ac7-ccec-519a-a1db-d89c60f155a2', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:30.074568 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:30.075206 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:09:30.075540 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:30.077601 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:30.077727 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78589b79-8f, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:30.078231 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78589b79-8f, col_values=(('qos', UUID('bf340229-7439-4e89-896c-b4ed1c4ac1dd')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:30.078231 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78589b79-8f, col_values=(('external_ids', {'iface-id': '78589b79-8f25-4f7e-a6c8-96e5a5c076b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:f6:22', 'vm-uuid': 'e5a3d695-94e9-4ad7-aa07-b6cc865b30a1'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:30.079594 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:30.080368 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:09:30.086318 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:30.087836 np0000001577 nova-compute[98319]: INFO os_vif [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:f6:22,bridge_name='br-int',has_traffic_filtering=True,id=78589b79-8f25-4f7e-a6c8-96e5a5c076b8,network=Network(8bf5903d-3155-48fb-98dd-859e96b349d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78589b79-8f')
May 28 01:09:30.978210 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:09:30.978210 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98319) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 28 01:09:31.476365 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Stashing vm_state: active {{(pid=98319) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 28 01:09:31.482335 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:09:31.502630 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:31.614428 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:09:31.614535 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:09:31.614662 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] No VIF found with MAC fa:16:3e:94:f6:22, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:09:31.615099 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Using config drive
May 28 01:09:32.018453 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:32.018648 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:32.124242 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:32.234977 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Creating config drive at /opt/stack/data/nova/instances/e5a3d695-94e9-4ad7-aa07-b6cc865b30a1/disk.config
May 28 01:09:32.239146 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e5a3d695-94e9-4ad7-aa07-b6cc865b30a1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqrrhej8o {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:32.296515 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e5a3d695-94e9-4ad7-aa07-b6cc865b30a1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqrrhej8o" returned: 0 in 0.057s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:32.525566 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:09:32.525566 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Claim successful on node np0000001577
May 28 01:09:32.725339 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:32.747051 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:32.914957 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:32.918060 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:32.942473 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:32.957292 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-83ac7fc7-2703-47aa-8d9b-0e713c4a5393 req-887c2e7d-0e2c-49d2-95ef-502d00c908f0 service nova] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Received event network-vif-plugged-78589b79-8f25-4f7e-a6c8-96e5a5c076b8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:09:32.957292 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-83ac7fc7-2703-47aa-8d9b-0e713c4a5393 req-887c2e7d-0e2c-49d2-95ef-502d00c908f0 service nova] Acquiring lock "e5a3d695-94e9-4ad7-aa07-b6cc865b30a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:32.957292 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-83ac7fc7-2703-47aa-8d9b-0e713c4a5393 req-887c2e7d-0e2c-49d2-95ef-502d00c908f0 service nova] Lock "e5a3d695-94e9-4ad7-aa07-b6cc865b30a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:32.957292 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-83ac7fc7-2703-47aa-8d9b-0e713c4a5393 req-887c2e7d-0e2c-49d2-95ef-502d00c908f0 service nova] Lock "e5a3d695-94e9-4ad7-aa07-b6cc865b30a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:32.957292 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-83ac7fc7-2703-47aa-8d9b-0e713c4a5393 req-887c2e7d-0e2c-49d2-95ef-502d00c908f0 service nova] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Processing event network-vif-plugged-78589b79-8f25-4f7e-a6c8-96e5a5c076b8 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:09:33.031138 np0000001577 nova-compute[98319]: INFO nova.compute.resource_tracker [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Updating resource usage from migration 89c274ec-c439-4cb6-8e95-835338708472
May 28 01:09:33.355130 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:09:33.355130 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:09:33.535311 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930573.5348835, e5a3d695-94e9-4ad7-aa07-b6cc865b30a1 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:09:33.535729 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] VM Started (Lifecycle Event)
May 28 01:09:33.536901 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:09:33.545059 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:09:33.548678 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Instance spawned successfully.
May 28 01:09:33.549069 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:09:33.552268 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:09:33.552597 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:09:33.730312 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0004036969999106077 future=<Future at 0x7c988c041880 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:09:33.731729 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Emitting event <LifecycleEvent: 1779930558.7298236, d5e4832e-32b9-44a7-92b8-6fa82e642515 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:09:33.731729 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] VM Stopped (Lifecycle Event)
May 28 01:09:33.731895 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:09:33.859147 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:09:34.039596 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:09:34.042802 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:09:34.057889 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Took 6.33 seconds to spawn the instance on the hypervisor.
May 28 01:09:34.058322 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:09:34.234181 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-1d4aaaf1-0a35-4a8b-949e-ceff9ce675a3 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: d5e4832e-32b9-44a7-92b8-6fa82e642515] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:09:34.369443 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.351s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:34.369616 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Migrating
May 28 01:09:34.369814 np0000001577 nova-compute[98319]: DEBUG nova.compute.rpcapi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98319) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 01:09:34.546009 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:09:34.546508 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930574.5460985, e5a3d695-94e9-4ad7-aa07-b6cc865b30a1 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:09:34.546734 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] VM Paused (Lifecycle Event)
May 28 01:09:34.568145 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Took 11.71 seconds to build instance.
May 28 01:09:34.884774 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "refresh_cache-412ac56c-f524-46c2-91eb-fa4672db46a9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:09:34.885219 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquired lock "refresh_cache-412ac56c-f524-46c2-91eb-fa4672db46a9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:09:34.885327 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:09:34.981403 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:09:35.026362 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-745f243f-0500-4d31-8aac-801ff654bb0a req-e6ff077a-a9a0-41ef-b7a4-72d22e338a22 service nova] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Received event network-vif-plugged-78589b79-8f25-4f7e-a6c8-96e5a5c076b8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:09:35.026770 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-745f243f-0500-4d31-8aac-801ff654bb0a req-e6ff077a-a9a0-41ef-b7a4-72d22e338a22 service nova] Acquiring lock "e5a3d695-94e9-4ad7-aa07-b6cc865b30a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:35.026947 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-745f243f-0500-4d31-8aac-801ff654bb0a req-e6ff077a-a9a0-41ef-b7a4-72d22e338a22 service nova] Lock "e5a3d695-94e9-4ad7-aa07-b6cc865b30a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:35.027098 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-745f243f-0500-4d31-8aac-801ff654bb0a req-e6ff077a-a9a0-41ef-b7a4-72d22e338a22 service nova] Lock "e5a3d695-94e9-4ad7-aa07-b6cc865b30a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:35.027227 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-745f243f-0500-4d31-8aac-801ff654bb0a req-e6ff077a-a9a0-41ef-b7a4-72d22e338a22 service nova] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] No waiting events found dispatching network-vif-plugged-78589b79-8f25-4f7e-a6c8-96e5a5c076b8 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:09:35.027375 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-745f243f-0500-4d31-8aac-801ff654bb0a req-e6ff077a-a9a0-41ef-b7a4-72d22e338a22 service nova] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Received unexpected event network-vif-plugged-78589b79-8f25-4f7e-a6c8-96e5a5c076b8 for instance with vm_state active and task_state None.
May 28 01:09:35.050290 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:09:35.055256 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930575.0549045, e5a3d695-94e9-4ad7-aa07-b6cc865b30a1 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:09:35.055362 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] VM Resumed (Lifecycle Event)
May 28 01:09:35.071151 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "e5a3d695-94e9-4ad7-aa07-b6cc865b30a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.223s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:35.082632 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:35.387265 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:35.486314 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:09:35.549826 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c0dd8bb0-9594-4572-a671-2e04edf275bf req-8985f94d-e203-4f5b-a2a4-76cffb97db72 service nova] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Received event network-changed-78589b79-8f25-4f7e-a6c8-96e5a5c076b8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:09:35.550213 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c0dd8bb0-9594-4572-a671-2e04edf275bf req-8985f94d-e203-4f5b-a2a4-76cffb97db72 service nova] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Refreshing instance network info cache due to event network-changed-78589b79-8f25-4f7e-a6c8-96e5a5c076b8. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:09:35.550213 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c0dd8bb0-9594-4572-a671-2e04edf275bf req-8985f94d-e203-4f5b-a2a4-76cffb97db72 service nova] Acquiring lock "refresh_cache-e5a3d695-94e9-4ad7-aa07-b6cc865b30a1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:09:35.550213 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c0dd8bb0-9594-4572-a671-2e04edf275bf req-8985f94d-e203-4f5b-a2a4-76cffb97db72 service nova] Acquired lock "refresh_cache-e5a3d695-94e9-4ad7-aa07-b6cc865b30a1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:09:35.550341 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-c0dd8bb0-9594-4572-a671-2e04edf275bf req-8985f94d-e203-4f5b-a2a4-76cffb97db72 service nova] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Refreshing network info cache for port 78589b79-8f25-4f7e-a6c8-96e5a5c076b8 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:09:35.560057 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:09:35.561992 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:09:35.768925 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:35.872506 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Updating instance_info_cache with network_info: [{"id": "4e4e8646-56c4-4135-b704-3eda00177287", "address": "fa:16:3e:d7:12:9f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e8646-56", "ovs_interfaceid": "4e4e8646-56c4-4135-b704-3eda00177287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:09:36.052610 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-c0dd8bb0-9594-4572-a671-2e04edf275bf req-8985f94d-e203-4f5b-a2a4-76cffb97db72 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:36.374209 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Releasing lock "refresh_cache-412ac56c-f524-46c2-91eb-fa4672db46a9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:09:36.415051 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-c0dd8bb0-9594-4572-a671-2e04edf275bf req-8985f94d-e203-4f5b-a2a4-76cffb97db72 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:36.502492 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:36.522676 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-c0dd8bb0-9594-4572-a671-2e04edf275bf req-8985f94d-e203-4f5b-a2a4-76cffb97db72 service nova] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Updated VIF entry in instance network info cache for port 78589b79-8f25-4f7e-a6c8-96e5a5c076b8. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:09:36.522886 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-c0dd8bb0-9594-4572-a671-2e04edf275bf req-8985f94d-e203-4f5b-a2a4-76cffb97db72 service nova] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Updating instance_info_cache with network_info: [{"id": "78589b79-8f25-4f7e-a6c8-96e5a5c076b8", "address": "fa:16:3e:94:f6:22", "network": {"id": "8bf5903d-3155-48fb-98dd-859e96b349d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1733749547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92f49e31415146d281ba6b462016d5d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78589b79-8f", "ovs_interfaceid": "78589b79-8f25-4f7e-a6c8-96e5a5c076b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:09:37.024650 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c0dd8bb0-9594-4572-a671-2e04edf275bf req-8985f94d-e203-4f5b-a2a4-76cffb97db72 service nova] Releasing lock "refresh_cache-e5a3d695-94e9-4ad7-aa07-b6cc865b30a1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:09:37.885533 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Starting migrate_disk_and_power_off {{(pid=98319) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 28 01:09:37.906585 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:37.909741 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:37.931466 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:37.958985 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:38.065536 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-bc0118ca-9c78-4d9f-ba76-2b18163c2bfc req-c16af80c-7372-4b5d-a3ac-2ae55185768d service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Received event network-vif-unplugged-4e4e8646-56c4-4135-b704-3eda00177287 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:09:38.071488 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bc0118ca-9c78-4d9f-ba76-2b18163c2bfc req-c16af80c-7372-4b5d-a3ac-2ae55185768d service nova] Acquiring lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:38.071488 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bc0118ca-9c78-4d9f-ba76-2b18163c2bfc req-c16af80c-7372-4b5d-a3ac-2ae55185768d service nova] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:38.071488 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bc0118ca-9c78-4d9f-ba76-2b18163c2bfc req-c16af80c-7372-4b5d-a3ac-2ae55185768d service nova] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:38.071488 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-bc0118ca-9c78-4d9f-ba76-2b18163c2bfc req-c16af80c-7372-4b5d-a3ac-2ae55185768d service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] No waiting events found dispatching network-vif-unplugged-4e4e8646-56c4-4135-b704-3eda00177287 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:09:38.071488 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-bc0118ca-9c78-4d9f-ba76-2b18163c2bfc req-c16af80c-7372-4b5d-a3ac-2ae55185768d service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Received unexpected event network-vif-unplugged-4e4e8646-56c4-4135-b704-3eda00177287 for instance with vm_state active and task_state resize_migrating.
May 28 01:09:38.132684 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:38.194256 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:38.222789 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999703958999817 future=<Future at 0x7c987047c260 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:09:38.223295 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999198818999957 future=<Future at 0x7c987047c260 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:09:38.223467 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.99899405899987 future=<Future at 0x7c987047c260 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:09:38.224755 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Instance destroyed successfully.
May 28 01:09:38.225612 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1464485741',display_name='tempest-TestEncryptedCinderVolumes-server-1464485741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testencryptedcindervolumes-server-1464485741',id=59,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaxiVCL/oeyuc6Fn/LaDWPWiO7mXNOG+NJ+ojaTKJd77Zn7nrd05FgcX3093dXQNIvdpDxCbUKUzqvcTZNFcgRrrPUR46mHMo/POLXh0IP7v2hya+rwuFblpqAtbu1bbg==',key_name='tempest-keypair-1398822484',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:08:50Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a430f0d6bcc84a29bc3e96514422896b',ramdisk_id='',reservation_id='r-nu20f4t0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-2086871542',owner_user_name='tempest-TestEncryptedCinderVolumes-2086871542-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:09:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbae7974478d45b3908aaaa5b4408e26',uuid=412ac56c-f524-46c2-91eb-fa4672db46a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e4e8646-56c4-4135-b704-3eda00177287", "address": "fa:16:3e:d7:12:9f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "vif_mac": "fa:16:3e:d7:12:9f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e8646-56", "ovs_interfaceid": "4e4e8646-56c4-4135-b704-3eda00177287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:09:38.225776 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converting VIF {"id": "4e4e8646-56c4-4135-b704-3eda00177287", "address": "fa:16:3e:d7:12:9f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "vif_mac": "fa:16:3e:d7:12:9f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e8646-56", "ovs_interfaceid": "4e4e8646-56c4-4135-b704-3eda00177287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:09:38.226319 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:12:9f,bridge_name='br-int',has_traffic_filtering=True,id=4e4e8646-56c4-4135-b704-3eda00177287,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e8646-56') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:09:38.226514 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:12:9f,bridge_name='br-int',has_traffic_filtering=True,id=4e4e8646-56c4-4135-b704-3eda00177287,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e8646-56') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:09:38.228387 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:38.228387 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e4e8646-56, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:38.229590 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:38.229590 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:09:38.230314 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:38.231002 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:38.231002 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5a217bf5-63ab-4466-ac6e-985edc14b48f) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:38.231670 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:38.231670 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:09:38.232103 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:38.233581 np0000001577 nova-compute[98319]: INFO os_vif [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:12:9f,bridge_name='br-int',has_traffic_filtering=True,id=4e4e8646-56c4-4135-b704-3eda00177287,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e8646-56')
May 28 01:09:38.235992 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:09:38.236300 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7725186-2460-4632-868e-1cb41674f3f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:09:38.236517 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:09:38.237058 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:09:38.237390 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7725186-2460-4632-868e-1cb41674f3f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:09:38.237597 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:09:38.264258 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:38.264258 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:38.264258 np0000001577 nova-compute[98319]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:38.264258 np0000001577 nova-compute[98319]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:38.264258 np0000001577 nova-compute[98319]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:09:38.264258 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:09:38.264503 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:38.264503 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:38.264503 np0000001577 nova-compute[98319]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:38.264503 np0000001577 nova-compute[98319]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:38.264503 np0000001577 nova-compute[98319]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:09:38.264503 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:09:38.264503 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', '146'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', '147'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', '148'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', '149'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048', '150')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:09:38.264700 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', '148')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:09:38.265387 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', '149')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:09:38.266006 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c98704db7e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0'): ({'sdc'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:09:38.266197 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:09:38.266403 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Flush multipath device 330000000dd6bd600 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:09:38.300982 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:09:38.337026 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:09:38.386980 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:09:38.387252 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:09:38.388933 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:09:38.400225 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:09:38.400500 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:09:38.411412 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:38.442426 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 148, target: iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0, portal: 192.168.40.100,3260]
May 28 01:09:38.442426 np0000001577 nova-compute[98319]: Logout of [sid: 148, target: iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0, portal: 192.168.40.100,3260] successful.
May 28 01:09:38.442426 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:38.455611 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:38.466945 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:38.485194 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:09:38.485509 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:09:38.491266 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 149, target: iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0, portal: 192.168.50.100,3260]
May 28 01:09:38.491266 np0000001577 nova-compute[98319]: Logout of [sid: 149, target: iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0, portal: 192.168.50.100,3260] successful.
May 28 01:09:38.491266 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:38.504689 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:38.505742 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:09:38.505912 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] <== disconnect_volume: return (269ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:09:38.506090 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:09:38.509356 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:38.634116 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:38.634656 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:38.723221 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:38.723824 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] skipping disk /dev/disk/by-id/os-brick+dev+dm-2 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:09:38.724673 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9_resize/disk /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:38.819758 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CMD "cp -r /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9_resize/disk /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk" returned: 0 in 0.095s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:38.820220 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9_resize/disk.config /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk.config {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:38.860835 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CMD "cp -r /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9_resize/disk.config /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk.config" returned: 0 in 0.040s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:38.861240 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9_resize/disk.info /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk.info {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:38.903793 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CMD "cp -r /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9_resize/disk.info /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk.info" returned: 0 in 0.042s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:38.978046 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:09:39.485865 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:39.486471 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:39.486471 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:39.486471 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Auditing locally available compute resources for np0000001577 (node: np0000001577) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 01:09:40.001184 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:40.001436 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:40.066047 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Port 4e4e8646-56c4-4135-b704-3eda00177287 binding to destination host np0000001577 is already ACTIVE {{(pid=98319) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 01:09:40.133430 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2b131c5f-97c1-4180-bffc-04797af1956d req-77416413-e26a-4e5e-9b22-ee22c1559513 service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Received event network-vif-unplugged-4e4e8646-56c4-4135-b704-3eda00177287 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:09:40.133430 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2b131c5f-97c1-4180-bffc-04797af1956d req-77416413-e26a-4e5e-9b22-ee22c1559513 service nova] Acquiring lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:40.133430 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2b131c5f-97c1-4180-bffc-04797af1956d req-77416413-e26a-4e5e-9b22-ee22c1559513 service nova] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:40.133430 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2b131c5f-97c1-4180-bffc-04797af1956d req-77416413-e26a-4e5e-9b22-ee22c1559513 service nova] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:40.133430 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2b131c5f-97c1-4180-bffc-04797af1956d req-77416413-e26a-4e5e-9b22-ee22c1559513 service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] No waiting events found dispatching network-vif-unplugged-4e4e8646-56c4-4135-b704-3eda00177287 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:09:40.133430 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-2b131c5f-97c1-4180-bffc-04797af1956d req-77416413-e26a-4e5e-9b22-ee22c1559513 service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Received unexpected event network-vif-unplugged-4e4e8646-56c4-4135-b704-3eda00177287 for instance with vm_state active and task_state resize_migrating.
May 28 01:09:40.520966 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:40.606102 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:40.607307 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:40.694996 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:40.695344 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-2 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:09:40.699685 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:09:40.700944 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d7b37c7-b091-44f7-a330-4e55e2b1e348/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:40.782068 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d7b37c7-b091-44f7-a330-4e55e2b1e348/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:40.782673 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d7b37c7-b091-44f7-a330-4e55e2b1e348/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:40.872607 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d7b37c7-b091-44f7-a330-4e55e2b1e348/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:40.880291 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a3d695-94e9-4ad7-aa07-b6cc865b30a1/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:40.963947 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a3d695-94e9-4ad7-aa07-b6cc865b30a1/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:40.968413 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a3d695-94e9-4ad7-aa07-b6cc865b30a1/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:41.055110 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a3d695-94e9-4ad7-aa07-b6cc865b30a1/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:41.060702 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:41.083114 np0000001577 nova-compute[98319]: DEBUG nova.compute.rpcapi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98319) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 01:09:41.096318 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:41.096780 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:41.097068 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:41.153643 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:41.157564 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:41.244173 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:41.253573 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:09:41.253573 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:41.296848 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "env LANG=C uptime" returned: 0 in 0.044s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:41.297229 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Hypervisor/Node resource view: name=np0000001577 free_ram=12419MB free_disk=72.75017547607422GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 01:09:41.300347 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:41.300347 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:41.504215 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:42.113841 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:42.181825 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "refresh_cache-412ac56c-f524-46c2-91eb-fa4672db46a9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:09:42.181933 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquired lock "refresh_cache-412ac56c-f524-46c2-91eb-fa4672db46a9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:09:42.182068 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:09:42.261424 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Acquiring lock "227baa5d-04b6-44bc-bf06-412f2874f947" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:42.263041 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Lock "227baa5d-04b6-44bc-bf06-412f2874f947" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:42.310625 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Applying migration context for instance 412ac56c-f524-46c2-91eb-fa4672db46a9 as it has an incoming, in-progress migration 89c274ec-c439-4cb6-8e95-835338708472. Migration status is post-migrating {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 28 01:09:42.310625 np0000001577 nova-compute[98319]: INFO nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Updating resource usage from migration 89c274ec-c439-4cb6-8e95-835338708472
May 28 01:09:42.353144 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 1e7c5308-80cc-4991-8626-2ba32fa09acf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:09:42.353144 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 4d7b37c7-b091-44f7-a330-4e55e2b1e348 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:09:42.353144 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 1e644f60-1f1f-4679-aec6-d1bbb3b69efe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:09:42.353144 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance e5a3d695-94e9-4ad7-aa07-b6cc865b30a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:09:42.353144 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Migration 89c274ec-c439-4cb6-8e95-835338708472 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 28 01:09:42.353144 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 412ac56c-f524-46c2-91eb-fa4672db46a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:09:42.683896 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:42.766449 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:09:42.857568 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 227baa5d-04b6-44bc-bf06-412f2874f947 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 28 01:09:42.857568 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 01:09:42.857568 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Final resource view: name=np0000001577 phys_ram=24030MB used_ram=1664MB phys_disk=95GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:09:41 up 41 min,  2 users,  load average: 4.18, 5.66, 4.25\n', 'num_instances': '5', 'num_vm_active': '5', 'num_task_None': '4', 'num_os_type_None': '5', 'num_proj_23578125da1e4bf2bb3d59281a0e261e': '1', 'io_workload': '0', 'num_proj_92f49e31415146d281ba6b462016d5d4': '2', 'num_task_resize_migrated': '1', 'num_proj_a430f0d6bcc84a29bc3e96514422896b': '1', 'num_proj_050f928f1ce449d6a447cd343dc4ff80': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 01:09:42.983375 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:43.121114 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Updating instance_info_cache with network_info: [{"id": "4e4e8646-56c4-4135-b704-3eda00177287", "address": "fa:16:3e:d7:12:9f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e8646-56", "ovs_interfaceid": "4e4e8646-56c4-4135-b704-3eda00177287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:09:43.230298 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:09:43.230486 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:09:43.242018 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:43.307360 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:43.625568 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Releasing lock "refresh_cache-412ac56c-f524-46c2-91eb-fa4672db46a9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:09:43.732953 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:09:44.137708 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:09:44.150123 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:09:44.169753 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:44.221727 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:09:44.222042 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:09:44.234103 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:09:44.235072 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe46:94e9', 'fe80::e873:f8ff:fed0:1522', 'fe80::fc16:3eff:fe94:f622', 'fe80::fc16:3eff:feab:f427', 'fe80::9c16:39ff:fe2e:9aef', 'fe80::fc16:3eff:fe05:9ded', 'fe80::84b7:d3ff:feed:4f01'] 
May 28 01:09:44.235195 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:09:44.235299 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:09:44.235512 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:09:44.240152 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Compute_service record updated for np0000001577:np0000001577 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 01:09:44.240592 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.943s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:44.240946 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:09:44.241116 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Cleaning up deleted instances {{(pid=98319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 28 01:09:44.242840 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.936s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:44.247845 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:09:44.248383 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Claim successful on node np0000001577
May 28 01:09:44.669603 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-07d314cc-9ff0-4637-8ea5-df8d7bbd00df tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "1e7c5308-80cc-4991-8626-2ba32fa09acf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:44.669783 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-07d314cc-9ff0-4637-8ea5-df8d7bbd00df tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:44.669950 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-07d314cc-9ff0-4637-8ea5-df8d7bbd00df tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:44.670086 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-07d314cc-9ff0-4637-8ea5-df8d7bbd00df tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:44.670197 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-07d314cc-9ff0-4637-8ea5-df8d7bbd00df tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:44.672192 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-07d314cc-9ff0-4637-8ea5-df8d7bbd00df tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Terminating instance
May 28 01:09:44.746190 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] There are 0 instances to clean {{(pid=98319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 28 01:09:44.746449 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:09:44.905434 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:45.174712 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-07d314cc-9ff0-4637-8ea5-df8d7bbd00df tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:09:45.196309 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:45.199472 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:45.216319 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:45.228701 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:45.247409 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:45.250568 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:45.350766 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f9fe4e0b-7ea3-4d12-a38c-0333cb5b6585 req-3b0442a4-8e4e-4759-894f-ca9cb1fc3a07 service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Received event network-vif-unplugged-cc1de356-c44a-46bf-bb87-d123239afbe7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:09:45.351309 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f9fe4e0b-7ea3-4d12-a38c-0333cb5b6585 req-3b0442a4-8e4e-4759-894f-ca9cb1fc3a07 service nova] Acquiring lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:45.351612 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f9fe4e0b-7ea3-4d12-a38c-0333cb5b6585 req-3b0442a4-8e4e-4759-894f-ca9cb1fc3a07 service nova] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:45.351779 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f9fe4e0b-7ea3-4d12-a38c-0333cb5b6585 req-3b0442a4-8e4e-4759-894f-ca9cb1fc3a07 service nova] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:45.351825 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f9fe4e0b-7ea3-4d12-a38c-0333cb5b6585 req-3b0442a4-8e4e-4759-894f-ca9cb1fc3a07 service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] No waiting events found dispatching network-vif-unplugged-cc1de356-c44a-46bf-bb87-d123239afbe7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:09:45.351978 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f9fe4e0b-7ea3-4d12-a38c-0333cb5b6585 req-3b0442a4-8e4e-4759-894f-ca9cb1fc3a07 service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Received event network-vif-unplugged-cc1de356-c44a-46bf-bb87-d123239afbe7 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:09:45.400199 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Starting finish_migration {{(pid=98319) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 28 01:09:45.401161 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Instance directory exists: not creating {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 01:09:45.401329 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Creating image(s)
May 28 01:09:45.402145 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:45.499977 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.098s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:45.500521 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Checking if we can resize image /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:09:45.500921 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:45.532929 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.998996033000367 future=<Future at 0x7c988c025ee0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:09:45.535322 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Instance destroyed successfully.
May 28 01:09:45.536169 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-07d314cc-9ff0-4637-8ea5-df8d7bbd00df tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lazy-loading 'resources' on Instance uuid 1e7c5308-80cc-4991-8626-2ba32fa09acf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:09:45.606080 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:45.606481 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Cannot resize image /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:09:45.670160 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:09:45.670361 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:09:45.746637 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:09:45.746991 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:09:45.747356 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:09:45.747620 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 01:09:45.747914 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.23 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:09:45.978502 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:09:45.978791 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:09:45.979185 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:09:46.042579 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-07d314cc-9ff0-4637-8ea5-df8d7bbd00df tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:07:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1575785918',display_name='tempest-AttachVolumeTestJSON-server-1575785918',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumetestjson-server-1575785918',id=54,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQqj5ulFm44LqcwStG35x3hx4kF2OHc+g0tTlOd4Z/Xec3CPwxGXUEAq08Fq2dSZhFKLMTCPF7EJ6q4KRfVK6ZgmNMJOJWZlgopXWPXQJWBjVOvQj1zQw9ZKwPgeXE7Hw==',key_name='tempest-keypair-749432862',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:07:15Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23578125da1e4bf2bb3d59281a0e261e',ramdisk_id='',reservation_id='r-8bk45cr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1682604103',owner_user_name='tempest-AttachVolumeTestJSON-1682604103-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:09:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d68bbf62c74dd2bfe638f00ef6aa3d',uuid=1e7c5308-80cc-4991-8626-2ba32fa09acf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc1de356-c44a-46bf-bb87-d123239afbe7", "address": "fa:16:3e:05:9d:ed", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1de356-c4", "ovs_interfaceid": "cc1de356-c44a-46bf-bb87-d123239afbe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:09:46.042821 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-07d314cc-9ff0-4637-8ea5-df8d7bbd00df tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Converting VIF {"id": "cc1de356-c44a-46bf-bb87-d123239afbe7", "address": "fa:16:3e:05:9d:ed", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc1de356-c4", "ovs_interfaceid": "cc1de356-c44a-46bf-bb87-d123239afbe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:09:46.043483 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-07d314cc-9ff0-4637-8ea5-df8d7bbd00df tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=cc1de356-c44a-46bf-bb87-d123239afbe7,network=Network(02f45984-182d-4648-ab01-d4773a271319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc1de356-c4') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:09:46.043703 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-07d314cc-9ff0-4637-8ea5-df8d7bbd00df tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=cc1de356-c44a-46bf-bb87-d123239afbe7,network=Network(02f45984-182d-4648-ab01-d4773a271319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc1de356-c4') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:09:46.044866 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:46.045163 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc1de356-c4, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:46.047352 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:46.048630 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:09:46.049196 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:46.049369 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db623fc8-a64b-415c-be87-7016ac35770e) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:46.049909 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:46.050426 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:09:46.050716 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:46.052599 np0000001577 nova-compute[98319]: INFO os_vif [None req-07d314cc-9ff0-4637-8ea5-df8d7bbd00df tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:9d:ed,bridge_name='br-int',has_traffic_filtering=True,id=cc1de356-c44a-46bf-bb87-d123239afbe7,network=Network(02f45984-182d-4648-ab01-d4773a271319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc1de356-c4')
May 28 01:09:46.052871 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-07d314cc-9ff0-4637-8ea5-df8d7bbd00df tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Deleting instance files /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf_del
May 28 01:09:46.053592 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-07d314cc-9ff0-4637-8ea5-df8d7bbd00df tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Deletion of /opt/stack/data/nova/instances/1e7c5308-80cc-4991-8626-2ba32fa09acf_del complete
May 28 01:09:46.109490 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:09:46.109739 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Ensure instance console log exists: /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:09:46.110123 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:46.110349 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:46.110530 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:46.113850 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Start _get_guest_xml network_info=[{"id": "4e4e8646-56c4-4135-b704-3eda00177287", "address": "fa:16:3e:d7:12:9f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "vif_mac": "fa:16:3e:d7:12:9f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e8646-56", "ovs_interfaceid": "4e4e8646-56c4-4135-b704-3eda00177287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7725186-2460-4632-868e-1cb41674f3f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '412ac56c-f524-46c2-91eb-fa4672db46a9', 'attached_at': '2026-05-28T01:09:44.000000', 'detached_at': '', 'volume_id': 'f7725186-2460-4632-868e-1cb41674f3f0', 'serial': 'f7725186-2460-4632-868e-1cb41674f3f0'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '1eb06ea5-04cf-4c88-b7c7-cd9bd1c3b1b5', 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:09:46.116462 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:09:46.117945 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1464485741', uuid='412ac56c-f524-46c2-91eb-fa4672db46a9'), owner=OwnerMeta(userid='fbae7974478d45b3908aaaa5b4408e26', username='tempest-TestEncryptedCinderVolumes-2086871542-project-member', projectid='a430f0d6bcc84a29bc3e96514422896b', projectname='tempest-TestEncryptedCinderVolumes-2086871542'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='tempest-432593675', flavorid='8b42358f-2dca-49c1-af38-5dbf42c80807', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={}, swap=0), network_info=[{"id": "4e4e8646-56c4-4135-b704-3eda00177287", "address": "fa:16:3e:d7:12:9f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "vif_mac": "fa:16:3e:d7:12:9f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e8646-56", "ovs_interfaceid": "4e4e8646-56c4-4135-b704-3eda00177287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930586.1174793) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:09:46.119172 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:09:46.119619 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:09:46.120739 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:09:46.123648 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:09:46.125129 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:09:46.125568 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T01:09:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={},flavorid='8b42358f-2dca-49c1-af38-5dbf42c80807',id=13,is_public=True,memory_mb=192,name='tempest-432593675',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:09:46.125725 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:09:46.125816 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:09:46.126008 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:09:46.126191 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:09:46.126339 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:09:46.126586 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:09:46.126745 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:09:46.126917 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:09:46.127093 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:09:46.127274 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:09:46.139427 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk.config --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:46.175697 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:09:46.235500 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk.config --force-share --output=json" returned: 0 in 0.096s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:46.235967 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "/opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:46.236261 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "/opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:46.236743 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "/opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:46.237098 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:09:46.237511 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7725186-2460-4632-868e-1cb41674f3f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:09:46.237677 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:09:46.238059 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:09:46.238248 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7725186-2460-4632-868e-1cb41674f3f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:09:46.249783 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:09:46.250567 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:09:46.251093 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:09:46.251270 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:09:46.251708 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:09:46.251896 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:09:46.269855 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:09:46.269855 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:46.270463 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:09:46.270463 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:46.282686 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0] added
May 28 01:09:46.282686 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:09:46.282686 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:09:46.282686 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:09:46.282686 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:09:46.282686 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:09:46.282686 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:46.282934 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:09:46.283504 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0317(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:09:46.283699 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:09:46.286191 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0] added
May 28 01:09:46.286191 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:09:46.286191 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:09:46.286191 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:09:46.286191 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:09:46.286191 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:09:46.286191 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:46.286349 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:09:46.286563 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0346(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:09:46.286730 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:09:46.505966 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:46.561570 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-07d314cc-9ff0-4637-8ea5-df8d7bbd00df tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Took 1.39 seconds to destroy the instance on the hypervisor.
May 28 01:09:46.562130 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-07d314cc-9ff0-4637-8ea5-df8d7bbd00df tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:09:46.562290 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:09:46.562442 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:09:46.562805 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:46.653862 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:46.683371 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.440s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:46.683726 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:09:47.189004 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:09:47.189477 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:09:47.189477 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:47.189590 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:47.265347 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '982435d9a6494fbd8f260955ada95c32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11e4b1d73ecb40dfa464da2993358b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:09:47.284330 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:09:47.289194 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:09:47.298620 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:09:47.298620 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:09:47.306562 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:09:47.306562 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:47.311806 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:47.322091 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:47.326339 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:47.326339 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:47.326339 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:09:47.326477 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:47.326477 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:47.326477 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:09:47.335572 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:47.335572 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:47.335572 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:09:47.335572 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:47.335572 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:47.335572 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:09:47.360233 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0, portal: 192.168.40.100,3260]
May 28 01:09:47.360233 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0, portal: 192.168.40.100,3260] successful.
May 28 01:09:47.360233 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:47.369699 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:47.375760 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0, portal: 192.168.50.100,3260]
May 28 01:09:47.375760 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0, portal: 192.168.50.100,3260] successful.
May 28 01:09:47.375760 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:47.386175 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:47.386510 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:47.386510 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:47.386510 np0000001577 nova-compute[98319]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:47.386510 np0000001577 nova-compute[98319]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:47.386510 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:09:47.386761 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:47.386761 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:47.386761 np0000001577 nova-compute[98319]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:47.386761 np0000001577 nova-compute[98319]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:47.386761 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:09:47.386909 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.136s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:09:47.387005 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:09:47.389841 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] HCTL ('7', '-', '-', 0) found on session 151 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:09:47.389974 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:09:47.403277 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:47.403277 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:47.403277 np0000001577 nova-compute[98319]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:47.403277 np0000001577 nova-compute[98319]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:47.403277 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:09:47.403277 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:47.403277 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:47.403277 np0000001577 nova-compute[98319]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:47.403277 np0000001577 nova-compute[98319]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:47.403277 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:09:47.403277 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:09:47.403277 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:09:47.403277 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] HCTL ('8', '-', '-', 0) found on session 152 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:09:47.403277 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:09:47.414645 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Searching for a device in session 151 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:09:47.414645 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7725186-2460-4632-868e-1cb41674f3f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:09:47.422218 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Searching for a device in session 152 and hctl ['8', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:09:47.442522 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-bad4079e-2c12-4351-8334-a8401c5c709c req-dcb39291-f2d6-4a42-a6f8-cc8c9707caa7 service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Received event network-vif-unplugged-cc1de356-c44a-46bf-bb87-d123239afbe7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:09:47.443906 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bad4079e-2c12-4351-8334-a8401c5c709c req-dcb39291-f2d6-4a42-a6f8-cc8c9707caa7 service nova] Acquiring lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:47.443906 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bad4079e-2c12-4351-8334-a8401c5c709c req-dcb39291-f2d6-4a42-a6f8-cc8c9707caa7 service nova] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:47.443906 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bad4079e-2c12-4351-8334-a8401c5c709c req-dcb39291-f2d6-4a42-a6f8-cc8c9707caa7 service nova] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:47.443906 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-bad4079e-2c12-4351-8334-a8401c5c709c req-dcb39291-f2d6-4a42-a6f8-cc8c9707caa7 service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] No waiting events found dispatching network-vif-unplugged-cc1de356-c44a-46bf-bb87-d123239afbe7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:09:47.443906 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-bad4079e-2c12-4351-8334-a8401c5c709c req-dcb39291-f2d6-4a42-a6f8-cc8c9707caa7 service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Received event network-vif-unplugged-cc1de356-c44a-46bf-bb87-d123239afbe7 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:09:47.443906 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-bad4079e-2c12-4351-8334-a8401c5c709c req-dcb39291-f2d6-4a42-a6f8-cc8c9707caa7 service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Received event network-vif-deleted-cc1de356-c44a-46bf-bb87-d123239afbe7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:09:47.443906 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-bad4079e-2c12-4351-8334-a8401c5c709c req-dcb39291-f2d6-4a42-a6f8-cc8c9707caa7 service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Neutron deleted interface cc1de356-c44a-46bf-bb87-d123239afbe7; detaching it from the instance and deleting it from the info cache
May 28 01:09:47.448730 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-bad4079e-2c12-4351-8334-a8401c5c709c req-dcb39291-f2d6-4a42-a6f8-cc8c9707caa7 service nova] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Detach interface failed, port_id=cc1de356-c44a-46bf-bb87-d123239afbe7, reason: Instance 1e7c5308-80cc-4991-8626-2ba32fa09acf could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:09:47.536866 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:09:47.691764 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:09:47.711135 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Successfully created port: 6aa6ae79-94a7-4711-b0eb-c55753c3cae7 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:09:47.977931 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:09:47.978271 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:09:48.038953 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Took 1.48 seconds to deallocate network for instance.
May 28 01:09:48.084596 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:48.233799 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Successfully updated port: 6aa6ae79-94a7-4711-b0eb-c55753c3cae7 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:09:48.306583 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c174fec3-75c8-4b91-8820-67f57d212a8c req-d8c16d6c-087f-424f-96fc-bdedaa92b9f8 service nova] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Received event network-changed-6aa6ae79-94a7-4711-b0eb-c55753c3cae7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:09:48.306714 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c174fec3-75c8-4b91-8820-67f57d212a8c req-d8c16d6c-087f-424f-96fc-bdedaa92b9f8 service nova] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Refreshing instance network info cache due to event network-changed-6aa6ae79-94a7-4711-b0eb-c55753c3cae7. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:09:48.306895 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c174fec3-75c8-4b91-8820-67f57d212a8c req-d8c16d6c-087f-424f-96fc-bdedaa92b9f8 service nova] Acquiring lock "refresh_cache-227baa5d-04b6-44bc-bf06-412f2874f947" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:09:48.307007 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c174fec3-75c8-4b91-8820-67f57d212a8c req-d8c16d6c-087f-424f-96fc-bdedaa92b9f8 service nova] Acquired lock "refresh_cache-227baa5d-04b6-44bc-bf06-412f2874f947" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:09:48.307173 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-c174fec3-75c8-4b91-8820-67f57d212a8c req-d8c16d6c-087f-424f-96fc-bdedaa92b9f8 service nova] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Refreshing network info cache for port 6aa6ae79-94a7-4711-b0eb-c55753c3cae7 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:09:48.418393 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Searching for a device in session 152 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:09:48.418533 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f7725186-2460-4632-868e-1cb41674f3f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:09:48.544858 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-07d314cc-9ff0-4637-8ea5-df8d7bbd00df tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:48.546380 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-07d314cc-9ff0-4637-8ea5-df8d7bbd00df tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:48.696855 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:09:48.737181 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Acquiring lock "refresh_cache-227baa5d-04b6-44bc-bf06-412f2874f947" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:09:48.809683 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-c174fec3-75c8-4b91-8820-67f57d212a8c req-d8c16d6c-087f-424f-96fc-bdedaa92b9f8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:48.887377 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-c174fec3-75c8-4b91-8820-67f57d212a8c req-d8c16d6c-087f-424f-96fc-bdedaa92b9f8 service nova] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:09:48.921321 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-07d314cc-9ff0-4637-8ea5-df8d7bbd00df tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:09:48.921564 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-07d314cc-9ff0-4637-8ea5-df8d7bbd00df tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:09:49.055803 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-c174fec3-75c8-4b91-8820-67f57d212a8c req-d8c16d6c-087f-424f-96fc-bdedaa92b9f8 service nova] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:09:49.201903 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Booting with volume 652bf495-9b59-45b1-aacb-fc5f9d75e048 at /dev/vdb
May 28 01:09:49.255183 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:09:49.266897 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:09:49.267721 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Found WWN 330000000dd6bd600 for multipath device dm-2 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:09:49.268003 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:09:49.271622 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '330000000dd6bd600', 'path': '/dev/disk/by-id/os-brick+dev+dm-2', 'multipath_id': '330000000dd6bd600'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:09:49.271810 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000dd6bd600', 'path': '/dev/disk/by-id/os-brick+dev+dm-2', 'multipath_id': '330000000dd6bd600'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:09:49.289114 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:49.314575 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7725186-2460-4632-868e-1cb41674f3f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-2'}, 'status': 'attaching', 'instance': '412ac56c-f524-46c2-91eb-fa4672db46a9', 'attached_at': '2026-05-28T01:09:44.000000', 'detached_at': '', 'volume_id': 'f7725186-2460-4632-868e-1cb41674f3f0', 'serial': 'f7725186-2460-4632-868e-1cb41674f3f0'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 01:09:49.315623 np0000001577 nova-compute[98319]: WARNING stevedore.named [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 01:09:49.316204 np0000001577 nova-compute[98319]: WARNING castellan.key_manager [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:09:49.316277 np0000001577 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:09:49.330316 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:09:49.330776 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 01:09:49.330776 np0000001577 nova-compute[98319]:   <usage type="volume">
May 28 01:09:49.330776 np0000001577 nova-compute[98319]:     <volume>f7725186-2460-4632-868e-1cb41674f3f0</volume>
May 28 01:09:49.330776 np0000001577 nova-compute[98319]:   </usage>
May 28 01:09:49.330776 np0000001577 nova-compute[98319]: </secret>
May 28 01:09:49.330776 np0000001577 nova-compute[98319]:  {{(pid=98319) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 01:09:49.330985 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:09:49.342857 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:09:49.343744 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe46:94e9', 'fe80::e873:f8ff:fed0:1522', 'fe80::fc16:3eff:fe94:f622', 'fe80::fc16:3eff:feab:f427', 'fe80::9c16:39ff:fe2e:9aef'] 
May 28 01:09:49.343861 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:09:49.344005 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:09:49.344123 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:09:49.344347 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Updating existing volume attachment record: 05e6d388-662c-4c82-a9be-b6de246a87bb {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:09:49.425090 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-07d314cc-9ff0-4637-8ea5-df8d7bbd00df tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:09:49.558720 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c174fec3-75c8-4b91-8820-67f57d212a8c req-d8c16d6c-087f-424f-96fc-bdedaa92b9f8 service nova] Releasing lock "refresh_cache-227baa5d-04b6-44bc-bf06-412f2874f947" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:09:49.559358 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Acquired lock "refresh_cache-227baa5d-04b6-44bc-bf06-412f2874f947" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:09:49.559649 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:09:49.774861 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:49.841102 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1464485741',display_name='tempest-TestEncryptedCinderVolumes-server-1464485741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(13),hidden=False,host='np0000001577',hostname='tempest-testencryptedcindervolumes-server-1464485741',id=59,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=13,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaxiVCL/oeyuc6Fn/LaDWPWiO7mXNOG+NJ+ojaTKJd77Zn7nrd05FgcX3093dXQNIvdpDxCbUKUzqvcTZNFcgRrrPUR46mHMo/POLXh0IP7v2hya+rwuFblpqAtbu1bbg==',key_name='tempest-keypair-1398822484',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:08:50Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000001577',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a430f0d6bcc84a29bc3e96514422896b',ramdisk_id='',reservation_id='r-nu20f4t0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-2086871542',owner_user_name='tempest-TestEncryptedCinderVolumes-2086871542-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:09:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbae7974478d45b3908aaaa5b4408e26',uuid=412ac56c-f524-46c2-91eb-fa4672db46a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e4e8646-56c4-4135-b704-3eda00177287", "address": "fa:16:3e:d7:12:9f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "vif_mac": "fa:16:3e:d7:12:9f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e8646-56", "ovs_interfaceid": "4e4e8646-56c4-4135-b704-3eda00177287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:09:49.841333 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converting VIF {"id": "4e4e8646-56c4-4135-b704-3eda00177287", "address": "fa:16:3e:d7:12:9f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "vif_mac": "fa:16:3e:d7:12:9f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e8646-56", "ovs_interfaceid": "4e4e8646-56c4-4135-b704-3eda00177287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:09:49.841858 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:12:9f,bridge_name='br-int',has_traffic_filtering=True,id=4e4e8646-56c4-4135-b704-3eda00177287,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e8646-56') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:09:49.843559 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] End _get_guest_xml xml=<domain type="qemu">
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:   <uuid>412ac56c-f524-46c2-91eb-fa4672db46a9</uuid>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:   <name>instance-0000003b</name>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1464485741</nova:name>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:09:46</nova:creationTime>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <nova:flavor name="tempest-432593675" id="8b42358f-2dca-49c1-af38-5dbf42c80807">
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:         <nova:extraSpecs/>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:         <nova:user uuid="fbae7974478d45b3908aaaa5b4408e26">tempest-TestEncryptedCinderVolumes-2086871542-project-member</nova:user>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:         <nova:project uuid="a430f0d6bcc84a29bc3e96514422896b">tempest-TestEncryptedCinderVolumes-2086871542</nova:project>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:         <nova:port uuid="4e4e8646-56c4-4135-b704-3eda00177287">
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:     <system>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <entry name="serial">412ac56c-f524-46c2-91eb-fa4672db46a9</entry>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <entry name="uuid">412ac56c-f524-46c2-91eb-fa4672db46a9</entry>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:     </system>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:   <os>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:   </os>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:   <features>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:   </features>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:   <devices>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk"/>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:     </disk>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk.config"/>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:     </disk>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <alias name="ua-f7725186-2460-4632-868e-1cb41674f3f0"/>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-2"/>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <serial>f7725186-2460-4632-868e-1cb41674f3f0</serial>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <encryption format="luks">
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:         <secret type="passphrase" uuid="bb1c3a62-bfb8-4b94-96b0-756edde0c044"/>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       </encryption>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:     </disk>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:d7:12:9f"/>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <target dev="tap4e4e8646-56"/>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:     </interface>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/console.log" append="off"/>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:     </serial>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:     <video>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:     </video>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:     </rng>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:   </devices>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]: </domain>
May 28 01:09:49.843559 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:09:49.845444 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1464485741',display_name='tempest-TestEncryptedCinderVolumes-server-1464485741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(13),hidden=False,host='np0000001577',hostname='tempest-testencryptedcindervolumes-server-1464485741',id=59,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=13,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaxiVCL/oeyuc6Fn/LaDWPWiO7mXNOG+NJ+ojaTKJd77Zn7nrd05FgcX3093dXQNIvdpDxCbUKUzqvcTZNFcgRrrPUR46mHMo/POLXh0IP7v2hya+rwuFblpqAtbu1bbg==',key_name='tempest-keypair-1398822484',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:08:50Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000001577',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a430f0d6bcc84a29bc3e96514422896b',ramdisk_id='',reservation_id='r-nu20f4t0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-2086871542',owner_user_name='tempest-TestEncryptedCinderVolumes-2086871542-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:09:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbae7974478d45b3908aaaa5b4408e26',uuid=412ac56c-f524-46c2-91eb-fa4672db46a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e4e8646-56c4-4135-b704-3eda00177287", "address": "fa:16:3e:d7:12:9f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "vif_mac": "fa:16:3e:d7:12:9f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e8646-56", "ovs_interfaceid": "4e4e8646-56c4-4135-b704-3eda00177287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:09:49.845444 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converting VIF {"id": "4e4e8646-56c4-4135-b704-3eda00177287", "address": "fa:16:3e:d7:12:9f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "vif_mac": "fa:16:3e:d7:12:9f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e8646-56", "ovs_interfaceid": "4e4e8646-56c4-4135-b704-3eda00177287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:09:49.845444 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:12:9f,bridge_name='br-int',has_traffic_filtering=True,id=4e4e8646-56c4-4135-b704-3eda00177287,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e8646-56') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:09:49.845444 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:12:9f,bridge_name='br-int',has_traffic_filtering=True,id=4e4e8646-56c4-4135-b704-3eda00177287,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e8646-56') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:09:49.845444 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:49.845444 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:49.845700 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:09:49.846557 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:49.846648 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3655c88f-41d6-5a9e-b4ef-7de38bc60c61', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:49.847346 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:49.848192 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:09:49.849379 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:49.851006 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:49.851143 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e4e8646-56, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:49.851410 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e4e8646-56, col_values=(('qos', UUID('9cc02641-c274-4414-a3ba-4c9978fbd111')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:49.851558 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e4e8646-56, col_values=(('external_ids', {'iface-id': '4e4e8646-56c4-4135-b704-3eda00177287', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:12:9f', 'vm-uuid': '412ac56c-f524-46c2-91eb-fa4672db46a9'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:49.852185 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:49.853176 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:09:49.858129 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:49.858758 np0000001577 nova-compute[98319]: INFO os_vif [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:12:9f,bridge_name='br-int',has_traffic_filtering=True,id=4e4e8646-56c4-4135-b704-3eda00177287,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e8646-56')
May 28 01:09:49.932063 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-07d314cc-9ff0-4637-8ea5-df8d7bbd00df tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.386s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:49.974684 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-07d314cc-9ff0-4637-8ea5-df8d7bbd00df tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Deleted allocations for instance 1e7c5308-80cc-4991-8626-2ba32fa09acf
May 28 01:09:50.130051 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:09:50.276443 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:50.392070 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Updating instance_info_cache with network_info: [{"id": "6aa6ae79-94a7-4711-b0eb-c55753c3cae7", "address": "fa:16:3e:c1:3f:10", "network": {"id": "0d87381a-1454-4b59-b8c7-3a13e0fcd476", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1915607964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e4b1d73ecb40dfa464da2993358b3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa6ae79-94", "ovs_interfaceid": "6aa6ae79-94a7-4711-b0eb-c55753c3cae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:09:50.894695 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Releasing lock "refresh_cache-227baa5d-04b6-44bc-bf06-412f2874f947" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:09:50.894695 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Instance network_info: |[{"id": "6aa6ae79-94a7-4711-b0eb-c55753c3cae7", "address": "fa:16:3e:c1:3f:10", "network": {"id": "0d87381a-1454-4b59-b8c7-3a13e0fcd476", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1915607964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e4b1d73ecb40dfa464da2993358b3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa6ae79-94", "ovs_interfaceid": "6aa6ae79-94a7-4711-b0eb-c55753c3cae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:09:50.981806 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-07d314cc-9ff0-4637-8ea5-df8d7bbd00df tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "1e7c5308-80cc-4991-8626-2ba32fa09acf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.312s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:51.393805 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:09:51.394169 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:09:51.394169 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:09:51.394169 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] No VIF found with MAC fa:16:3e:d7:12:9f, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:09:51.394599 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Using config drive
May 28 01:09:51.450024 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:09:51.451094 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:09:51.451349 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Creating image(s)
May 28 01:09:51.451753 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Acquiring lock "/opt/stack/data/nova/instances/227baa5d-04b6-44bc-bf06-412f2874f947/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:51.454775 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Lock "/opt/stack/data/nova/instances/227baa5d-04b6-44bc-bf06-412f2874f947/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:51.455393 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Lock "/opt/stack/data/nova/instances/227baa5d-04b6-44bc-bf06-412f2874f947/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:51.456138 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:09:51.466583 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:09:51.467644 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:51.508663 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:51.561601 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.094s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:51.562509 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:51.563311 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:51.563519 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:09:51.568155 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:09:51.568692 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:51.671302 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.102s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:51.672100 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/227baa5d-04b6-44bc-bf06-412f2874f947/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:51.727563 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/227baa5d-04b6-44bc-bf06-412f2874f947/disk 1073741824" returned: 0 in 0.055s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:51.728329 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.165s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:51.728925 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:51.822410 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.093s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:51.822884 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Checking if we can resize image /opt/stack/data/nova/instances/227baa5d-04b6-44bc-bf06-412f2874f947/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:09:51.823171 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/227baa5d-04b6-44bc-bf06-412f2874f947/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:51.841126 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:51.868988 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:51.937870 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/227baa5d-04b6-44bc-bf06-412f2874f947/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:51.939005 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Cannot resize image /opt/stack/data/nova/instances/227baa5d-04b6-44bc-bf06-412f2874f947/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:09:51.941774 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:09:51.942058 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Ensure instance console log exists: /opt/stack/data/nova/instances/227baa5d-04b6-44bc-bf06-412f2874f947/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:09:51.942667 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:51.946817 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:51.951447 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:51.954184 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Start _get_guest_xml network_info=[{"id": "6aa6ae79-94a7-4711-b0eb-c55753c3cae7", "address": "fa:16:3e:c1:3f:10", "network": {"id": "0d87381a-1454-4b59-b8c7-3a13e0fcd476", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1915607964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e4b1d73ecb40dfa464da2993358b3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa6ae79-94", "ovs_interfaceid": "6aa6ae79-94a7-4711-b0eb-c55753c3cae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048', 'iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '652bf495-9b59-45b1-aacb-fc5f9d75e048', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '227baa5d-04b6-44bc-bf06-412f2874f947', 'attached_at': '', 'detached_at': '', 'volume_id': '652bf495-9b59-45b1-aacb-fc5f9d75e048', 'serial': '652bf495-9b59-45b1-aacb-fc5f9d75e048'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '05e6d388-662c-4c82-a9be-b6de246a87bb', 'boot_index': -1, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:09:51.959954 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:09:51.962008 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-instance-1615945330', uuid='227baa5d-04b6-44bc-bf06-412f2874f947'), owner=OwnerMeta(userid='982435d9a6494fbd8f260955ada95c32', username='tempest-VolumesBackupsTest-876673241-project-member', projectid='11e4b1d73ecb40dfa464da2993358b3f', projectname='tempest-VolumesBackupsTest-876673241'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6aa6ae79-94a7-4711-b0eb-c55753c3cae7", "address": "fa:16:3e:c1:3f:10", "network": {"id": "0d87381a-1454-4b59-b8c7-3a13e0fcd476", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1915607964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e4b1d73ecb40dfa464da2993358b3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa6ae79-94", "ovs_interfaceid": "6aa6ae79-94a7-4711-b0eb-c55753c3cae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930591.9614851) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:09:51.962764 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:51.968951 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:09:51.969629 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:09:51.971656 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:09:51.971726 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:09:51.973337 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:09:51.973823 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:09:51.974061 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:09:51.974121 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:09:51.974618 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:09:51.974618 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:09:51.974618 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:09:51.974618 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:09:51.975904 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:09:51.976689 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:09:51.976689 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:09:51.976689 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:09:51.989952 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:09:51.989952 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048', 'iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '652bf495-9b59-45b1-aacb-fc5f9d75e048', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:09:51.990156 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:09:51.990425 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:09:51.990738 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048', 'iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '652bf495-9b59-45b1-aacb-fc5f9d75e048', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:09:52.006266 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:09:52.006266 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:09:52.006266 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:09:52.008682 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:09:52.009245 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:09:52.009481 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:09:52.019210 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:09:52.019210 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:52.025660 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:09:52.025660 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:52.032059 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048] added
May 28 01:09:52.032059 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:09:52.032059 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:09:52.032059 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:09:52.032059 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:09:52.032059 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:09:52.032059 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:52.032205 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:09:52.032412 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0268(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:09:52.032675 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:09:52.043798 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048] added
May 28 01:09:52.043798 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:09:52.043798 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:09:52.043798 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:09:52.043798 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:09:52.043798 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:09:52.043798 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:52.043798 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:09:52.043798 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0309(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:09:52.043798 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:09:52.116620 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-fcd03ca5-e153-4b47-a323-b3f80956f6fa req-1e7a5739-f992-4262-a4c8-fb58e5964a56 service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Received event network-vif-plugged-4e4e8646-56c4-4135-b704-3eda00177287 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:09:52.116804 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fcd03ca5-e153-4b47-a323-b3f80956f6fa req-1e7a5739-f992-4262-a4c8-fb58e5964a56 service nova] Acquiring lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:52.117043 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fcd03ca5-e153-4b47-a323-b3f80956f6fa req-1e7a5739-f992-4262-a4c8-fb58e5964a56 service nova] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:52.117114 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fcd03ca5-e153-4b47-a323-b3f80956f6fa req-1e7a5739-f992-4262-a4c8-fb58e5964a56 service nova] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:52.117239 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-fcd03ca5-e153-4b47-a323-b3f80956f6fa req-1e7a5739-f992-4262-a4c8-fb58e5964a56 service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] No waiting events found dispatching network-vif-plugged-4e4e8646-56c4-4135-b704-3eda00177287 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:09:52.117369 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-fcd03ca5-e153-4b47-a323-b3f80956f6fa req-1e7a5739-f992-4262-a4c8-fb58e5964a56 service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Received unexpected event network-vif-plugged-4e4e8646-56c4-4135-b704-3eda00177287 for instance with vm_state active and task_state resize_finish.
May 28 01:09:52.164841 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:52.221565 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:52.248218 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:53.033182 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:09:53.040939 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:09:53.045578 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:09:53.045578 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:09:53.052406 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:09:53.052406 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:53.058825 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:53.067211 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:53.072522 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:53.072522 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:53.072522 np0000001577 nova-compute[98319]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:53.072522 np0000001577 nova-compute[98319]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:53.072522 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:09:53.072709 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:53.072709 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:53.072709 np0000001577 nova-compute[98319]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:53.072709 np0000001577 nova-compute[98319]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:53.072709 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:09:53.084568 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:53.084568 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:53.084568 np0000001577 nova-compute[98319]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:53.084568 np0000001577 nova-compute[98319]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:53.084568 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:09:53.084568 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:53.084568 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:53.084568 np0000001577 nova-compute[98319]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:53.084568 np0000001577 nova-compute[98319]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:53.084568 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:09:53.114798 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048, portal: 192.168.40.100,3260]
May 28 01:09:53.114798 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048, portal: 192.168.40.100,3260] successful.
May 28 01:09:53.114798 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:53.123832 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048, portal: 192.168.50.100,3260]
May 28 01:09:53.123832 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048, portal: 192.168.50.100,3260] successful.
May 28 01:09:53.123832 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:53.133275 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:53.142518 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:53.151543 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:53.151543 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:53.151543 np0000001577 nova-compute[98319]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:53.151543 np0000001577 nova-compute[98319]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:53.151543 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:09:53.151543 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:09:53.151543 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:09:53.151543 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:53.151543 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:53.151543 np0000001577 nova-compute[98319]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:53.151543 np0000001577 nova-compute[98319]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:53.151543 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:09:53.151543 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:09:53.151543 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:09:53.152156 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.146s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:09:53.152156 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:09:53.153023 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] HCTL ('11', '-', '-', 0) found on session 153 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:09:53.153225 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:09:53.158659 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:53.158659 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:53.158659 np0000001577 nova-compute[98319]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:53.158659 np0000001577 nova-compute[98319]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:53.158659 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:09:53.158659 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:09:53.158659 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:09:53.158936 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:53.158936 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:53.158936 np0000001577 nova-compute[98319]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:53.158936 np0000001577 nova-compute[98319]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:53.158936 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:09:53.158936 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:09:53.158936 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:09:53.159150 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:09:53.159150 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:09:53.159758 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] HCTL ('12', '-', '-', 0) found on session 154 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:09:53.159869 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:09:53.176620 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Searching for a device in session 153 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:09:53.176620 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '652bf495-9b59-45b1-aacb-fc5f9d75e048', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:09:53.179294 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Searching for a device in session 154 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:09:53.179294 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '652bf495-9b59-45b1-aacb-fc5f9d75e048', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:09:53.223017 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00047774099994057906 future=<Future at 0x7c987047c260 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:09:53.223838 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Emitting event <LifecycleEvent: 1779930578.2223942, 412ac56c-f524-46c2-91eb-fa4672db46a9 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:09:53.224059 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:09:53.224820 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] VM Stopped (Lifecycle Event)
May 28 01:09:53.226420 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=7.305429603999983 future=<Future at 0x7c988c025ee0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:09:53.226763 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=7.305081096000322 future=<Future at 0x7c988c025ee0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:09:53.573075 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Removed pending STOPPED event for 412ac56c-f524-46c2-91eb-fa4672db46a9 due to new event <LifecycleEvent: 1779930593.5727496, 412ac56c-f524-46c2-91eb-fa4672db46a9 => Resumed> {{(pid=98319) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 01:09:53.573197 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930593.5727496, 412ac56c-f524-46c2-91eb-fa4672db46a9 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:09:53.573312 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] VM Resumed (Lifecycle Event)
May 28 01:09:53.575870 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Instance event wait completed in 0 seconds for  {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:09:53.578592 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Instance running successfully.
May 28 01:09:53.582512 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Failed to set time: agent not configured {{(pid=98319) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 28 01:09:53.582512 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5b7bf698-fb17-4f48-894f-dafff366d26a tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] finish_migration finished successfully. {{(pid=98319) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 28 01:09:53.728329 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:09:54.009958 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:09:54.080569 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:09:54.080569 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:54.080569 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:09:54.173591 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "14f9e91b-230b-468d-940b-39ad40e0eca2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:54.173821 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "14f9e91b-230b-468d-940b-39ad40e0eca2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:54.195409 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ac147832-a387-4492-a205-315bcf7acda7 req-f09a6f1c-fc01-452f-a2ae-1a47a4a2d3a2 service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Received event network-vif-plugged-4e4e8646-56c4-4135-b704-3eda00177287 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:09:54.195409 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ac147832-a387-4492-a205-315bcf7acda7 req-f09a6f1c-fc01-452f-a2ae-1a47a4a2d3a2 service nova] Acquiring lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:54.195409 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ac147832-a387-4492-a205-315bcf7acda7 req-f09a6f1c-fc01-452f-a2ae-1a47a4a2d3a2 service nova] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:54.195409 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ac147832-a387-4492-a205-315bcf7acda7 req-f09a6f1c-fc01-452f-a2ae-1a47a4a2d3a2 service nova] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:54.195409 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ac147832-a387-4492-a205-315bcf7acda7 req-f09a6f1c-fc01-452f-a2ae-1a47a4a2d3a2 service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] No waiting events found dispatching network-vif-plugged-4e4e8646-56c4-4135-b704-3eda00177287 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:09:54.195409 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-ac147832-a387-4492-a205-315bcf7acda7 req-f09a6f1c-fc01-452f-a2ae-1a47a4a2d3a2 service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Received unexpected event network-vif-plugged-4e4e8646-56c4-4135-b704-3eda00177287 for instance with vm_state active and task_state resize_finish.
May 28 01:09:54.583009 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 28 01:09:54.583268 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930594.5831187, 412ac56c-f524-46c2-91eb-fa4672db46a9 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:09:54.583359 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] VM Started (Lifecycle Event)
May 28 01:09:54.675938 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:09:54.863585 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:55.023496 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Found WWN 330000000a81816c1 for multipath device dm-4 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:09:55.023759 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:09:55.023954 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '330000000a81816c1', 'path': '/dev/dm-4', 'multipath_id': '330000000a81816c1'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:09:55.024087 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a81816c1', 'path': '/dev/dm-4', 'multipath_id': '330000000a81816c1'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:09:55.086018 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:09:55.087586 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:09:55.305523 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:55.305713 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:55.308373 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:09:55.308590 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Claim successful on node np0000001577
May 28 01:09:55.528757 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:09:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-instance-1615945330',display_name='tempest-instance-1615945330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-instance-1615945330',id=62,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzZFz5iRPdcSxPwNZ9r7GJd/rDuFgrBfQhJmBZe50aBQCoO03VLW5b05BZptTp9XzHnmmerM/DWs3VbG7EO1eBlDSxYBf3oEmpMiGljUt12CsMj924QZWzMboKHkqRAlg==',key_name='tempest-keypair-1835143746',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11e4b1d73ecb40dfa464da2993358b3f',ramdisk_id='',reservation_id='r-rm0e0bza',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-876673241',owner_user_name='tempest-VolumesBackupsTest-876673241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:09:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='982435d9a6494fbd8f260955ada95c32',uuid=227baa5d-04b6-44bc-bf06-412f2874f947,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6aa6ae79-94a7-4711-b0eb-c55753c3cae7", "address": "fa:16:3e:c1:3f:10", "network": {"id": "0d87381a-1454-4b59-b8c7-3a13e0fcd476", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1915607964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e4b1d73ecb40dfa464da2993358b3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa6ae79-94", "ovs_interfaceid": "6aa6ae79-94a7-4711-b0eb-c55753c3cae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:09:55.528946 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Converting VIF {"id": "6aa6ae79-94a7-4711-b0eb-c55753c3cae7", "address": "fa:16:3e:c1:3f:10", "network": {"id": "0d87381a-1454-4b59-b8c7-3a13e0fcd476", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1915607964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e4b1d73ecb40dfa464da2993358b3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa6ae79-94", "ovs_interfaceid": "6aa6ae79-94a7-4711-b0eb-c55753c3cae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:09:55.529457 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:3f:10,bridge_name='br-int',has_traffic_filtering=True,id=6aa6ae79-94a7-4711-b0eb-c55753c3cae7,network=Network(0d87381a-1454-4b59-b8c7-3a13e0fcd476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aa6ae79-94') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:09:55.529973 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Lazy-loading 'pci_devices' on Instance uuid 227baa5d-04b6-44bc-bf06-412f2874f947 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:09:56.006932 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:56.035948 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] End _get_guest_xml xml=<domain type="qemu">
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:   <uuid>227baa5d-04b6-44bc-bf06-412f2874f947</uuid>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:   <name>instance-0000003e</name>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <nova:name>tempest-instance-1615945330</nova:name>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:09:51</nova:creationTime>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:         <nova:user uuid="982435d9a6494fbd8f260955ada95c32">tempest-VolumesBackupsTest-876673241-project-member</nova:user>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:         <nova:project uuid="11e4b1d73ecb40dfa464da2993358b3f">tempest-VolumesBackupsTest-876673241</nova:project>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:         <nova:port uuid="6aa6ae79-94a7-4711-b0eb-c55753c3cae7">
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:     <system>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <entry name="serial">227baa5d-04b6-44bc-bf06-412f2874f947</entry>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <entry name="uuid">227baa5d-04b6-44bc-bf06-412f2874f947</entry>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:     </system>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:   <os>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:   </os>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:   <features>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:   </features>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:   <devices>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/227baa5d-04b6-44bc-bf06-412f2874f947/disk"/>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:     </disk>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/227baa5d-04b6-44bc-bf06-412f2874f947/disk.config"/>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:     </disk>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <alias name="ua-652bf495-9b59-45b1-aacb-fc5f9d75e048"/>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-4"/>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <serial>652bf495-9b59-45b1-aacb-fc5f9d75e048</serial>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:     </disk>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:c1:3f:10"/>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <target dev="tap6aa6ae79-94"/>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:     </interface>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/227baa5d-04b6-44bc-bf06-412f2874f947/console.log" append="off"/>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:     </serial>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:     <video>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:     </video>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:     </rng>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:   </devices>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]: </domain>
May 28 01:09:56.035948 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:09:56.037818 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Preparing to wait for external event network-vif-plugged-6aa6ae79-94a7-4711-b0eb-c55753c3cae7 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:09:56.037818 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Acquiring lock "227baa5d-04b6-44bc-bf06-412f2874f947-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:56.037818 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Lock "227baa5d-04b6-44bc-bf06-412f2874f947-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:56.037818 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Lock "227baa5d-04b6-44bc-bf06-412f2874f947-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:56.037818 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:09:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-instance-1615945330',display_name='tempest-instance-1615945330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-instance-1615945330',id=62,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzZFz5iRPdcSxPwNZ9r7GJd/rDuFgrBfQhJmBZe50aBQCoO03VLW5b05BZptTp9XzHnmmerM/DWs3VbG7EO1eBlDSxYBf3oEmpMiGljUt12CsMj924QZWzMboKHkqRAlg==',key_name='tempest-keypair-1835143746',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11e4b1d73ecb40dfa464da2993358b3f',ramdisk_id='',reservation_id='r-rm0e0bza',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-876673241',owner_user_name='tempest-VolumesBackupsTest-876673241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:09:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='982435d9a6494fbd8f260955ada95c32',uuid=227baa5d-04b6-44bc-bf06-412f2874f947,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6aa6ae79-94a7-4711-b0eb-c55753c3cae7", "address": "fa:16:3e:c1:3f:10", "network": {"id": "0d87381a-1454-4b59-b8c7-3a13e0fcd476", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1915607964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e4b1d73ecb40dfa464da2993358b3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa6ae79-94", "ovs_interfaceid": "6aa6ae79-94a7-4711-b0eb-c55753c3cae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:09:56.037818 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Converting VIF {"id": "6aa6ae79-94a7-4711-b0eb-c55753c3cae7", "address": "fa:16:3e:c1:3f:10", "network": {"id": "0d87381a-1454-4b59-b8c7-3a13e0fcd476", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1915607964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e4b1d73ecb40dfa464da2993358b3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa6ae79-94", "ovs_interfaceid": "6aa6ae79-94a7-4711-b0eb-c55753c3cae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:09:56.039115 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:3f:10,bridge_name='br-int',has_traffic_filtering=True,id=6aa6ae79-94a7-4711-b0eb-c55753c3cae7,network=Network(0d87381a-1454-4b59-b8c7-3a13e0fcd476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aa6ae79-94') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:09:56.039389 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:3f:10,bridge_name='br-int',has_traffic_filtering=True,id=6aa6ae79-94a7-4711-b0eb-c55753c3cae7,network=Network(0d87381a-1454-4b59-b8c7-3a13e0fcd476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aa6ae79-94') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:09:56.039672 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:56.039865 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:56.040092 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:09:56.040695 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:56.040816 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35ff0d11-a852-5b2a-a897-ef22a683e5ac', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:56.041530 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:56.042181 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:09:56.043901 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:56.044064 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6aa6ae79-94, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:56.044344 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6aa6ae79-94, col_values=(('qos', UUID('c53d303a-8171-486b-821f-5c1b77487081')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:56.044485 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6aa6ae79-94, col_values=(('external_ids', {'iface-id': '6aa6ae79-94a7-4711-b0eb-c55753c3cae7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:3f:10', 'vm-uuid': '227baa5d-04b6-44bc-bf06-412f2874f947'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:56.045127 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:56.046141 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:09:56.050576 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:56.051411 np0000001577 nova-compute[98319]: INFO os_vif [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:3f:10,bridge_name='br-int',has_traffic_filtering=True,id=6aa6ae79-94a7-4711-b0eb-c55753c3cae7,network=Network(0d87381a-1454-4b59-b8c7-3a13e0fcd476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aa6ae79-94')
May 28 01:09:56.104363 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:56.104993 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:56.105227 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:56.166011 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Port 4e4e8646-56c4-4135-b704-3eda00177287 binding to destination host np0000001577 is already ACTIVE {{(pid=98319) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 01:09:56.166177 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "refresh_cache-412ac56c-f524-46c2-91eb-fa4672db46a9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:09:56.166270 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquired lock "refresh_cache-412ac56c-f524-46c2-91eb-fa4672db46a9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:09:56.166423 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:09:56.364185 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Refreshing inventories for resource provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 28 01:09:56.404238 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Updating ProviderTree inventory for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 28 01:09:56.404380 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Updating inventory in ProviderTree for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 01:09:56.448624 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Refreshing aggregate associations for resource provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2, aggregates: None {{(pid=98319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 28 01:09:56.492927 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Refreshing trait associations for resource provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ARCH_PPC64LE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,HW_ARCH_X86_64,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOUND_MODEL_AC97,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ARCH_X86_64,COMPUTE_ARCH_S390X,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_SOUND_MODEL_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ARCH_MIPSEL,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOUND_MODEL_SB16,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ARCH_RISCV64,HW_CPU_X86_SSE2,COMPUTE_ARCH_AARCH64,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_IGB {{(pid=98319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 28 01:09:56.510693 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:56.668809 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:56.862519 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:09:56.862723 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:09:57.023787 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:57.137939 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Updating instance_info_cache with network_info: [{"id": "4e4e8646-56c4-4135-b704-3eda00177287", "address": "fa:16:3e:d7:12:9f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e8646-56", "ovs_interfaceid": "4e4e8646-56c4-4135-b704-3eda00177287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:09:57.365106 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:09:57.483077 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "e8151422-37a0-4b7a-914f-34dc2979ead9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:57.483238 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:57.568908 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:09:57.569045 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:09:57.569114 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:09:57.569187 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] No VIF found with MAC fa:16:3e:c1:3f:10, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:09:57.569538 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Using config drive
May 28 01:09:57.639565 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Releasing lock "refresh_cache-412ac56c-f524-46c2-91eb-fa4672db46a9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:09:57.872563 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.565s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:57.872563 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:09:57.984800 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:09:58.074278 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:58.141932 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Creating tmpfile /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/tmpd19_bo31 to verify with other compute node that the instance is on the same shared storage. {{(pid=98319) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10552}}
May 28 01:09:58.142345 np0000001577 nova-compute[98319]: DEBUG nova.compute.rpcapi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98319) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 01:09:58.181129 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Creating config drive at /opt/stack/data/nova/instances/227baa5d-04b6-44bc-bf06-412f2874f947/disk.config
May 28 01:09:58.184784 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/227baa5d-04b6-44bc-bf06-412f2874f947/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5icnc8vv {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:09:58.234867 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/227baa5d-04b6-44bc-bf06-412f2874f947/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5icnc8vv" returned: 0 in 0.050s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:09:58.377597 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:09:58.377876 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:09:58.378314 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:58.378622 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:09:58.440282 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60d68bbf62c74dd2bfe638f00ef6aa3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23578125da1e4bf2bb3d59281a0e261e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:09:58.548083 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:58.548286 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:58.551516 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:09:58.551707 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Claim successful on node np0000001577
May 28 01:09:58.632816 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:58.658730 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:58.673081 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:58.675876 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:58.693260 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:58.748018 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:58.880930 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-94251593-8fbd-4a20-9570-10108b7c86a7 req-1675d4c4-2776-411a-b739-420f8b0d7f50 service nova] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Received event network-vif-plugged-6aa6ae79-94a7-4711-b0eb-c55753c3cae7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:09:58.881181 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-94251593-8fbd-4a20-9570-10108b7c86a7 req-1675d4c4-2776-411a-b739-420f8b0d7f50 service nova] Acquiring lock "227baa5d-04b6-44bc-bf06-412f2874f947-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:09:58.881377 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-94251593-8fbd-4a20-9570-10108b7c86a7 req-1675d4c4-2776-411a-b739-420f8b0d7f50 service nova] Lock "227baa5d-04b6-44bc-bf06-412f2874f947-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:09:58.881529 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-94251593-8fbd-4a20-9570-10108b7c86a7 req-1675d4c4-2776-411a-b739-420f8b0d7f50 service nova] Lock "227baa5d-04b6-44bc-bf06-412f2874f947-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:09:58.881688 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-94251593-8fbd-4a20-9570-10108b7c86a7 req-1675d4c4-2776-411a-b739-420f8b0d7f50 service nova] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Processing event network-vif-plugged-6aa6ae79-94a7-4711-b0eb-c55753c3cae7 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:09:58.882496 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:09:58.946216 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:58.953681 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:58.955459 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:58.976013 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:58.983960 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:58.995562 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999663573999896 future=<Future at 0x7c984c417d10 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:09:58.999739 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Instance destroyed successfully.
May 28 01:09:59.000377 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lazy-loading 'resources' on Instance uuid 412ac56c-f524-46c2-91eb-fa4672db46a9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:09:59.076474 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:59.080647 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Successfully created port: 2d2cecfd-dabf-4512-99c4-fc9703fef8c9 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:09:59.100771 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:59.386568 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:09:59.405110 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:09:59.405578 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930599.405205, 227baa5d-04b6-44bc-bf06-412f2874f947 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:09:59.405711 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] VM Started (Lifecycle Event)
May 28 01:09:59.408924 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:09:59.410782 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Instance spawned successfully.
May 28 01:09:59.411041 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:09:59.509137 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1464485741',display_name='tempest-TestEncryptedCinderVolumes-server-1464485741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(13),hidden=False,host='np0000001577',hostname='tempest-testencryptedcindervolumes-server-1464485741',id=59,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=13,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaxiVCL/oeyuc6Fn/LaDWPWiO7mXNOG+NJ+ojaTKJd77Zn7nrd05FgcX3093dXQNIvdpDxCbUKUzqvcTZNFcgRrrPUR46mHMo/POLXh0IP7v2hya+rwuFblpqAtbu1bbg==',key_name='tempest-keypair-1398822484',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:09:54Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=Flavor(13),node='np0000001577',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a430f0d6bcc84a29bc3e96514422896b',ramdisk_id='',reservation_id='r-nu20f4t0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-2086871542',owner_user_name='tempest-TestEncryptedCinderVolumes-2086871542-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:09:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbae7974478d45b3908aaaa5b4408e26',uuid=412ac56c-f524-46c2-91eb-fa4672db46a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "4e4e8646-56c4-4135-b704-3eda00177287", "address": "fa:16:3e:d7:12:9f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e8646-56", "ovs_interfaceid": "4e4e8646-56c4-4135-b704-3eda00177287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:09:59.509137 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converting VIF {"id": "4e4e8646-56c4-4135-b704-3eda00177287", "address": "fa:16:3e:d7:12:9f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e8646-56", "ovs_interfaceid": "4e4e8646-56c4-4135-b704-3eda00177287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:09:59.509137 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:12:9f,bridge_name='br-int',has_traffic_filtering=True,id=4e4e8646-56c4-4135-b704-3eda00177287,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e8646-56') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:09:59.509137 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:12:9f,bridge_name='br-int',has_traffic_filtering=True,id=4e4e8646-56c4-4135-b704-3eda00177287,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e8646-56') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:09:59.509137 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:59.509137 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e4e8646-56, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:59.510587 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:59.510860 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:09:59.513026 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:59.513760 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:59.514192 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9cc02641-c274-4414-a3ba-4c9978fbd111) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:09:59.516725 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:09:59.517336 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:09:59.519155 np0000001577 nova-compute[98319]: INFO os_vif [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:12:9f,bridge_name='br-int',has_traffic_filtering=True,id=4e4e8646-56c4-4135-b704-3eda00177287,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e8646-56')
May 28 01:09:59.522470 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:09:59.522647 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7725186-2460-4632-868e-1cb41674f3f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:09:59.523504 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:09:59.523504 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:09:59.524062 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7725186-2460-4632-868e-1cb41674f3f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:09:59.524426 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:09:59.551993 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:59.551993 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:59.551993 np0000001577 nova-compute[98319]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:59.551993 np0000001577 nova-compute[98319]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:59.551993 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:09:59.551993 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:09:59.551993 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:09:59.552363 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:59.552363 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:09:59.552363 np0000001577 nova-compute[98319]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:59.552363 np0000001577 nova-compute[98319]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:09:59.552363 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:09:59.552363 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:09:59.552363 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:09:59.552363 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', '146'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', '147'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', '151'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', '152'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048', '153'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048', '154')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:09:59.552680 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', '151')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:09:59.553348 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', '152')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:09:59.554096 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c987054c2c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0'): ({'sdc'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:09:59.554328 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:09:59.554581 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Flush multipath device 330000000dd6bd600 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:09:59.588610 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:09:59.638069 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:09:59.693706 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:09:59.693706 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:09:59.693706 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:09:59.703635 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:09:59.703836 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:09:59.713968 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:59.740927 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Successfully updated port: 2d2cecfd-dabf-4512-99c4-fc9703fef8c9 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:09:59.742694 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 151, target: iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0, portal: 192.168.40.100,3260]
May 28 01:09:59.742694 np0000001577 nova-compute[98319]: Logout of [sid: 151, target: iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0, portal: 192.168.40.100,3260] successful.
May 28 01:09:59.742694 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:59.760321 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:59.771052 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:59.805873 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 152, target: iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0, portal: 192.168.50.100,3260]
May 28 01:09:59.805873 np0000001577 nova-compute[98319]: Logout of [sid: 152, target: iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0, portal: 192.168.50.100,3260] successful.
May 28 01:09:59.805873 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:59.820514 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:09:59.821401 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:09:59.821560 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] <== disconnect_volume: return (298ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:09:59.821723 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:09:59.908398 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:09:59.912249 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:09:59.923155 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:09:59.923155 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:09:59.923155 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:09:59.923155 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:09:59.923155 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:09:59.923578 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:09:59.941905 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:09:59.941905 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:10:00.242600 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "refresh_cache-14f9e91b-230b-468d-940b-39ad40e0eca2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:10:00.242702 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquired lock "refresh_cache-14f9e91b-230b-468d-940b-39ad40e0eca2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:10:00.242822 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:10:00.394868 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:10:00.395761 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:10:00.395995 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Creating image(s)
May 28 01:10:00.396418 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "/opt/stack/data/nova/instances/14f9e91b-230b-468d-940b-39ad40e0eca2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:00.397841 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "/opt/stack/data/nova/instances/14f9e91b-230b-468d-940b-39ad40e0eca2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:00.398513 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "/opt/stack/data/nova/instances/14f9e91b-230b-468d-940b-39ad40e0eca2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:00.399111 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:10:00.404386 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:10:00.405476 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:10:00.422341 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:10:00.424062 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930600.4236872, 227baa5d-04b6-44bc-bf06-412f2874f947 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:10:00.424396 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] VM Paused (Lifecycle Event)
May 28 01:10:00.435690 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Took 8.98 seconds to spawn the instance on the hypervisor.
May 28 01:10:00.435690 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:10:00.444579 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:10:00.506251 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.101s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:10:00.508573 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:00.508573 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:00.508897 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:10:00.513317 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:10:00.513967 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:10:00.533105 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0011837309998554701 future=<Future at 0x7c988c025ee0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:10:00.533291 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:10:00.533443 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=13.461747424999885 future=<Future at 0x7c984c417d10 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:10:00.533576 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=13.46161800400023 future=<Future at 0x7c984c417d10 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:10:00.534351 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Emitting event <LifecycleEvent: 1779930585.5317156, 1e7c5308-80cc-4991-8626-2ba32fa09acf => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:10:00.534646 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] VM Stopped (Lifecycle Event)
May 28 01:10:00.602013 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.088s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:10:00.602353 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/14f9e91b-230b-468d-940b-39ad40e0eca2/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:10:00.656910 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/14f9e91b-230b-468d-940b-39ad40e0eca2/disk 1073741824" returned: 0 in 0.054s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:10:00.657591 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.150s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:00.657819 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:10:00.743774 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:10:00.744171 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Checking if we can resize image /opt/stack/data/nova/instances/14f9e91b-230b-468d-940b-39ad40e0eca2/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:10:00.744403 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f9e91b-230b-468d-940b-39ad40e0eca2/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:10:00.820084 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:10:00.825469 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f9e91b-230b-468d-940b-39ad40e0eca2/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:10:00.825878 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Cannot resize image /opt/stack/data/nova/instances/14f9e91b-230b-468d-940b-39ad40e0eca2/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:10:00.826245 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:10:00.826426 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Ensure instance console log exists: /opt/stack/data/nova/instances/14f9e91b-230b-468d-940b-39ad40e0eca2/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:10:00.826816 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:00.827065 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:00.827235 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:00.935228 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:10:00.940556 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930600.940268, 227baa5d-04b6-44bc-bf06-412f2874f947 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:10:00.940700 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] VM Resumed (Lifecycle Event)
May 28 01:10:00.952232 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-dfa39b3d-5215-4b39-ab23-f675129890d8 req-7fb6f26a-beb5-4339-9a8e-d1a5b87f58d8 service nova] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Received event network-vif-plugged-6aa6ae79-94a7-4711-b0eb-c55753c3cae7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:00.952748 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dfa39b3d-5215-4b39-ab23-f675129890d8 req-7fb6f26a-beb5-4339-9a8e-d1a5b87f58d8 service nova] Acquiring lock "227baa5d-04b6-44bc-bf06-412f2874f947-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:00.953424 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dfa39b3d-5215-4b39-ab23-f675129890d8 req-7fb6f26a-beb5-4339-9a8e-d1a5b87f58d8 service nova] Lock "227baa5d-04b6-44bc-bf06-412f2874f947-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:00.953621 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dfa39b3d-5215-4b39-ab23-f675129890d8 req-7fb6f26a-beb5-4339-9a8e-d1a5b87f58d8 service nova] Lock "227baa5d-04b6-44bc-bf06-412f2874f947-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:00.955033 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-dfa39b3d-5215-4b39-ab23-f675129890d8 req-7fb6f26a-beb5-4339-9a8e-d1a5b87f58d8 service nova] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] No waiting events found dispatching network-vif-plugged-6aa6ae79-94a7-4711-b0eb-c55753c3cae7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:10:00.955699 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:00.957966 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-dfa39b3d-5215-4b39-ab23-f675129890d8 req-7fb6f26a-beb5-4339-9a8e-d1a5b87f58d8 service nova] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Received unexpected event network-vif-plugged-6aa6ae79-94a7-4711-b0eb-c55753c3cae7 for instance with vm_state active and task_state None.
May 28 01:10:00.958670 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-dfa39b3d-5215-4b39-ab23-f675129890d8 req-7fb6f26a-beb5-4339-9a8e-d1a5b87f58d8 service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Received event network-vif-unplugged-4e4e8646-56c4-4135-b704-3eda00177287 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:00.958813 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dfa39b3d-5215-4b39-ab23-f675129890d8 req-7fb6f26a-beb5-4339-9a8e-d1a5b87f58d8 service nova] Acquiring lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:00.959107 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dfa39b3d-5215-4b39-ab23-f675129890d8 req-7fb6f26a-beb5-4339-9a8e-d1a5b87f58d8 service nova] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:00.959172 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dfa39b3d-5215-4b39-ab23-f675129890d8 req-7fb6f26a-beb5-4339-9a8e-d1a5b87f58d8 service nova] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:00.959431 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.409s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:00.959862 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:10:00.964281 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-dfa39b3d-5215-4b39-ab23-f675129890d8 req-7fb6f26a-beb5-4339-9a8e-d1a5b87f58d8 service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] No waiting events found dispatching network-vif-unplugged-4e4e8646-56c4-4135-b704-3eda00177287 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:10:00.965127 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Took 17.70 seconds to build instance.
May 28 01:10:00.969755 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-dfa39b3d-5215-4b39-ab23-f675129890d8 req-7fb6f26a-beb5-4339-9a8e-d1a5b87f58d8 service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Received unexpected event network-vif-unplugged-4e4e8646-56c4-4135-b704-3eda00177287 for instance with vm_state resized and task_state resize_reverting.
May 28 01:10:00.970724 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:00.970951 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-dfa39b3d-5215-4b39-ab23-f675129890d8 req-7fb6f26a-beb5-4339-9a8e-d1a5b87f58d8 service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Received event network-vif-unplugged-4e4e8646-56c4-4135-b704-3eda00177287 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:00.971157 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:00.973030 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dfa39b3d-5215-4b39-ab23-f675129890d8 req-7fb6f26a-beb5-4339-9a8e-d1a5b87f58d8 service nova] Acquiring lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:00.973684 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dfa39b3d-5215-4b39-ab23-f675129890d8 req-7fb6f26a-beb5-4339-9a8e-d1a5b87f58d8 service nova] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:00.973818 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dfa39b3d-5215-4b39-ab23-f675129890d8 req-7fb6f26a-beb5-4339-9a8e-d1a5b87f58d8 service nova] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:00.973942 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-dfa39b3d-5215-4b39-ab23-f675129890d8 req-7fb6f26a-beb5-4339-9a8e-d1a5b87f58d8 service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] No waiting events found dispatching network-vif-unplugged-4e4e8646-56c4-4135-b704-3eda00177287 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:10:00.974050 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-dfa39b3d-5215-4b39-ab23-f675129890d8 req-7fb6f26a-beb5-4339-9a8e-d1a5b87f58d8 service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Received unexpected event network-vif-unplugged-4e4e8646-56c4-4135-b704-3eda00177287 for instance with vm_state resized and task_state resize_reverting.
May 28 01:10:00.974357 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-dfa39b3d-5215-4b39-ab23-f675129890d8 req-7fb6f26a-beb5-4339-9a8e-d1a5b87f58d8 service nova] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Received event network-changed-2d2cecfd-dabf-4512-99c4-fc9703fef8c9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:00.974357 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-dfa39b3d-5215-4b39-ab23-f675129890d8 req-7fb6f26a-beb5-4339-9a8e-d1a5b87f58d8 service nova] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Refreshing instance network info cache due to event network-changed-2d2cecfd-dabf-4512-99c4-fc9703fef8c9. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:10:00.974357 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dfa39b3d-5215-4b39-ab23-f675129890d8 req-7fb6f26a-beb5-4339-9a8e-d1a5b87f58d8 service nova] Acquiring lock "refresh_cache-14f9e91b-230b-468d-940b-39ad40e0eca2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:10:01.042317 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 1e7c5308-80cc-4991-8626-2ba32fa09acf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:10:01.098138 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Updating instance_info_cache with network_info: [{"id": "2d2cecfd-dabf-4512-99c4-fc9703fef8c9", "address": "fa:16:3e:b9:2b:05", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2cecfd-da", "ovs_interfaceid": "2d2cecfd-dabf-4512-99c4-fc9703fef8c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:10:01.370240 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-87a6c9ba-6aeb-4329-9422-c727a5e84410 req-0d70f616-86ae-4ddb-a1f8-3476404ce796 service nova] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Received event network-vif-unplugged-2d2cecfd-dabf-4512-99c4-fc9703fef8c9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:01.370842 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-87a6c9ba-6aeb-4329-9422-c727a5e84410 req-0d70f616-86ae-4ddb-a1f8-3476404ce796 service nova] Acquiring lock "14f9e91b-230b-468d-940b-39ad40e0eca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:01.371041 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-87a6c9ba-6aeb-4329-9422-c727a5e84410 req-0d70f616-86ae-4ddb-a1f8-3476404ce796 service nova] Lock "14f9e91b-230b-468d-940b-39ad40e0eca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:01.371171 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-87a6c9ba-6aeb-4329-9422-c727a5e84410 req-0d70f616-86ae-4ddb-a1f8-3476404ce796 service nova] Lock "14f9e91b-230b-468d-940b-39ad40e0eca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:01.371304 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-87a6c9ba-6aeb-4329-9422-c727a5e84410 req-0d70f616-86ae-4ddb-a1f8-3476404ce796 service nova] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] No waiting events found dispatching network-vif-unplugged-2d2cecfd-dabf-4512-99c4-fc9703fef8c9 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:10:01.371412 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-87a6c9ba-6aeb-4329-9422-c727a5e84410 req-0d70f616-86ae-4ddb-a1f8-3476404ce796 service nova] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Received unexpected event network-vif-unplugged-2d2cecfd-dabf-4512-99c4-fc9703fef8c9 for instance with vm_state building and task_state spawning.
May 28 01:10:01.443640 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:10:01.445721 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:10:01.470509 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Lock "227baa5d-04b6-44bc-bf06-412f2874f947" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.209s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:01.474306 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lazy-loading 'migration_context' on Instance uuid 412ac56c-f524-46c2-91eb-fa4672db46a9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:10:01.477941 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:10:01.478227 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:10:01.478559 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:01.479905 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:01.515673 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:01.559714 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ae6af3cf5df464bbc9da74d825ddb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f3bdd3aef04045aac40e4b851915e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:10:01.602573 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Releasing lock "refresh_cache-14f9e91b-230b-468d-940b-39ad40e0eca2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:10:01.602573 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Instance network_info: |[{"id": "2d2cecfd-dabf-4512-99c4-fc9703fef8c9", "address": "fa:16:3e:b9:2b:05", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2cecfd-da", "ovs_interfaceid": "2d2cecfd-dabf-4512-99c4-fc9703fef8c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:10:01.602573 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Start _get_guest_xml network_info=[{"id": "2d2cecfd-dabf-4512-99c4-fc9703fef8c9", "address": "fa:16:3e:b9:2b:05", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2cecfd-da", "ovs_interfaceid": "2d2cecfd-dabf-4512-99c4-fc9703fef8c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:10:01.604572 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dfa39b3d-5215-4b39-ab23-f675129890d8 req-7fb6f26a-beb5-4339-9a8e-d1a5b87f58d8 service nova] Acquired lock "refresh_cache-14f9e91b-230b-468d-940b-39ad40e0eca2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:10:01.604572 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-dfa39b3d-5215-4b39-ab23-f675129890d8 req-7fb6f26a-beb5-4339-9a8e-d1a5b87f58d8 service nova] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Refreshing network info cache for port 2d2cecfd-dabf-4512-99c4-fc9703fef8c9 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:10:01.608205 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:10:01.609387 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-1850765549', uuid='14f9e91b-230b-468d-940b-39ad40e0eca2'), owner=OwnerMeta(userid='60d68bbf62c74dd2bfe638f00ef6aa3d', username='tempest-AttachVolumeTestJSON-1682604103-project-member', projectid='23578125da1e4bf2bb3d59281a0e261e', projectname='tempest-AttachVolumeTestJSON-1682604103'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2d2cecfd-dabf-4512-99c4-fc9703fef8c9", "address": "fa:16:3e:b9:2b:05", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2cecfd-da", "ovs_interfaceid": "2d2cecfd-dabf-4512-99c4-fc9703fef8c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930601.6090105) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:10:01.613340 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:10:01.613676 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:10:01.614705 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:10:01.614855 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:10:01.615772 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:10:01.616065 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:10:01.616223 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:10:01.616316 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:10:01.617188 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:10:01.617188 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:10:01.617275 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:10:01.618051 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:10:01.618051 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:10:01.618051 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:10:01.618051 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:10:01.618051 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:10:01.631912 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:09:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1850765549',display_name='tempest-AttachVolumeTestJSON-server-1850765549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumetestjson-server-1850765549',id=63,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEttzIubeiZHK2PdkGVJrORKil8eH52WCWdL7xrJ/dy/8TyvuPIDX/nZbR2qfM+BhdNBug1eHuhD1u2c23GvYUloli3nlrnIXYMIbmvsxMVpMAnzfJ4fiDeH5VuYL/Whsw==',key_name='tempest-keypair-475132385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23578125da1e4bf2bb3d59281a0e261e',ramdisk_id='',reservation_id='r-mztgwexd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1682604103',owner_user_name='tempest-AttachVolumeTestJSON-1682604103-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:09:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d68bbf62c74dd2bfe638f00ef6aa3d',uuid=14f9e91b-230b-468d-940b-39ad40e0eca2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d2cecfd-dabf-4512-99c4-fc9703fef8c9", "address": "fa:16:3e:b9:2b:05", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2cecfd-da", "ovs_interfaceid": "2d2cecfd-dabf-4512-99c4-fc9703fef8c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:10:01.632072 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Converting VIF {"id": "2d2cecfd-dabf-4512-99c4-fc9703fef8c9", "address": "fa:16:3e:b9:2b:05", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2cecfd-da", "ovs_interfaceid": "2d2cecfd-dabf-4512-99c4-fc9703fef8c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:10:01.632647 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2b:05,bridge_name='br-int',has_traffic_filtering=True,id=2d2cecfd-dabf-4512-99c4-fc9703fef8c9,network=Network(02f45984-182d-4648-ab01-d4773a271319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2cecfd-da') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:10:01.633104 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lazy-loading 'pci_devices' on Instance uuid 14f9e91b-230b-468d-940b-39ad40e0eca2 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:10:01.980154 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:10:01.982772 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Object Instance<412ac56c-f524-46c2-91eb-fa4672db46a9> lazy-loaded attributes: resources,migration_context {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:10:02.005928 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Successfully created port: f9933e16-d9fb-47e4-9e9a-3ba073b1a35f {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:10:02.111213 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-dfa39b3d-5215-4b39-ab23-f675129890d8 req-7fb6f26a-beb5-4339-9a8e-d1a5b87f58d8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:02.136304 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] End _get_guest_xml xml=<domain type="qemu">
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:   <uuid>14f9e91b-230b-468d-940b-39ad40e0eca2</uuid>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:   <name>instance-0000003f</name>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       <nova:name>tempest-AttachVolumeTestJSON-server-1850765549</nova:name>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:10:01</nova:creationTime>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:         <nova:user uuid="60d68bbf62c74dd2bfe638f00ef6aa3d">tempest-AttachVolumeTestJSON-1682604103-project-member</nova:user>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:         <nova:project uuid="23578125da1e4bf2bb3d59281a0e261e">tempest-AttachVolumeTestJSON-1682604103</nova:project>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:         <nova:port uuid="2d2cecfd-dabf-4512-99c4-fc9703fef8c9">
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:     <system>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       <entry name="serial">14f9e91b-230b-468d-940b-39ad40e0eca2</entry>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       <entry name="uuid">14f9e91b-230b-468d-940b-39ad40e0eca2</entry>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:     </system>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:   <os>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:   </os>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:   <features>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:   </features>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:   <devices>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/14f9e91b-230b-468d-940b-39ad40e0eca2/disk"/>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:     </disk>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/14f9e91b-230b-468d-940b-39ad40e0eca2/disk.config"/>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:     </disk>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:b9:2b:05"/>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       <target dev="tap2d2cecfd-da"/>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:     </interface>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/14f9e91b-230b-468d-940b-39ad40e0eca2/console.log" append="off"/>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:     </serial>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:     <video>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:     </video>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:     </rng>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:   </devices>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]: </domain>
May 28 01:10:02.136304 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:10:02.138229 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Preparing to wait for external event network-vif-plugged-2d2cecfd-dabf-4512-99c4-fc9703fef8c9 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:10:02.138229 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "14f9e91b-230b-468d-940b-39ad40e0eca2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:02.138229 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "14f9e91b-230b-468d-940b-39ad40e0eca2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:02.138229 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "14f9e91b-230b-468d-940b-39ad40e0eca2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:02.138229 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:09:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1850765549',display_name='tempest-AttachVolumeTestJSON-server-1850765549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumetestjson-server-1850765549',id=63,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEttzIubeiZHK2PdkGVJrORKil8eH52WCWdL7xrJ/dy/8TyvuPIDX/nZbR2qfM+BhdNBug1eHuhD1u2c23GvYUloli3nlrnIXYMIbmvsxMVpMAnzfJ4fiDeH5VuYL/Whsw==',key_name='tempest-keypair-475132385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23578125da1e4bf2bb3d59281a0e261e',ramdisk_id='',reservation_id='r-mztgwexd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1682604103',owner_user_name='tempest-AttachVolumeTestJSON-1682604103-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:09:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d68bbf62c74dd2bfe638f00ef6aa3d',uuid=14f9e91b-230b-468d-940b-39ad40e0eca2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d2cecfd-dabf-4512-99c4-fc9703fef8c9", "address": "fa:16:3e:b9:2b:05", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2cecfd-da", "ovs_interfaceid": "2d2cecfd-dabf-4512-99c4-fc9703fef8c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:10:02.138229 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Converting VIF {"id": "2d2cecfd-dabf-4512-99c4-fc9703fef8c9", "address": "fa:16:3e:b9:2b:05", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2cecfd-da", "ovs_interfaceid": "2d2cecfd-dabf-4512-99c4-fc9703fef8c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:10:02.138229 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2b:05,bridge_name='br-int',has_traffic_filtering=True,id=2d2cecfd-dabf-4512-99c4-fc9703fef8c9,network=Network(02f45984-182d-4648-ab01-d4773a271319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2cecfd-da') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:10:02.138624 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2b:05,bridge_name='br-int',has_traffic_filtering=True,id=2d2cecfd-dabf-4512-99c4-fc9703fef8c9,network=Network(02f45984-182d-4648-ab01-d4773a271319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2cecfd-da') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:10:02.138991 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:02.139352 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:10:02.139599 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:10:02.140932 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:02.141122 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '330207f2-a7b4-58e7-bf61-93e5e1c66144', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:10:02.143174 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:02.143907 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:10:02.147954 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:02.148179 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d2cecfd-da, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:10:02.148583 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d2cecfd-da, col_values=(('qos', UUID('538c5429-15d7-4ef8-980b-75692dcd9aa7')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:10:02.148760 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d2cecfd-da, col_values=(('external_ids', {'iface-id': '2d2cecfd-dabf-4512-99c4-fc9703fef8c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:2b:05', 'vm-uuid': '14f9e91b-230b-468d-940b-39ad40e0eca2'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:10:02.152612 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:10:02.156392 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:02.157399 np0000001577 nova-compute[98319]: INFO os_vif [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2b:05,bridge_name='br-int',has_traffic_filtering=True,id=2d2cecfd-dabf-4512-99c4-fc9703fef8c9,network=Network(02f45984-182d-4648-ab01-d4773a271319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2cecfd-da')
May 28 01:10:02.486636 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:10:02.489538 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:10:02.490585 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:10:02.510562 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-dfa39b3d-5215-4b39-ab23-f675129890d8 req-7fb6f26a-beb5-4339-9a8e-d1a5b87f58d8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:02.573570 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Successfully updated port: f9933e16-d9fb-47e4-9e9a-3ba073b1a35f {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:10:02.628482 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-de030b2e-aaa6-48ae-8189-27f5fa638652 req-7b8bbabb-73ac-4dfe-9808-a9da87adf669 service nova] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Received event network-changed-f9933e16-d9fb-47e4-9e9a-3ba073b1a35f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:02.628482 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-de030b2e-aaa6-48ae-8189-27f5fa638652 req-7b8bbabb-73ac-4dfe-9808-a9da87adf669 service nova] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Refreshing instance network info cache due to event network-changed-f9933e16-d9fb-47e4-9e9a-3ba073b1a35f. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:10:02.628482 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-de030b2e-aaa6-48ae-8189-27f5fa638652 req-7b8bbabb-73ac-4dfe-9808-a9da87adf669 service nova] Acquiring lock "refresh_cache-e8151422-37a0-4b7a-914f-34dc2979ead9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:10:02.628482 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-de030b2e-aaa6-48ae-8189-27f5fa638652 req-7b8bbabb-73ac-4dfe-9808-a9da87adf669 service nova] Acquired lock "refresh_cache-e8151422-37a0-4b7a-914f-34dc2979ead9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:10:02.628482 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-de030b2e-aaa6-48ae-8189-27f5fa638652 req-7b8bbabb-73ac-4dfe-9808-a9da87adf669 service nova] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Refreshing network info cache for port f9933e16-d9fb-47e4-9e9a-3ba073b1a35f {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:10:02.643317 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-dfa39b3d-5215-4b39-ab23-f675129890d8 req-7fb6f26a-beb5-4339-9a8e-d1a5b87f58d8 service nova] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Updated VIF entry in instance network info cache for port 2d2cecfd-dabf-4512-99c4-fc9703fef8c9. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:10:02.643531 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-dfa39b3d-5215-4b39-ab23-f675129890d8 req-7fb6f26a-beb5-4339-9a8e-d1a5b87f58d8 service nova] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Updating instance_info_cache with network_info: [{"id": "2d2cecfd-dabf-4512-99c4-fc9703fef8c9", "address": "fa:16:3e:b9:2b:05", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2cecfd-da", "ovs_interfaceid": "2d2cecfd-dabf-4512-99c4-fc9703fef8c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:10:02.994586 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:10:03.023833 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "38636bdc-bca3-469b-80d7-05d8fa9e1c78" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:03.024009 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "38636bdc-bca3-469b-80d7-05d8fa9e1c78" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:03.073634 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "refresh_cache-e8151422-37a0-4b7a-914f-34dc2979ead9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:10:03.130373 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-de030b2e-aaa6-48ae-8189-27f5fa638652 req-7b8bbabb-73ac-4dfe-9808-a9da87adf669 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:03.145644 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dfa39b3d-5215-4b39-ab23-f675129890d8 req-7fb6f26a-beb5-4339-9a8e-d1a5b87f58d8 service nova] Releasing lock "refresh_cache-14f9e91b-230b-468d-940b-39ad40e0eca2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:10:03.192476 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-de030b2e-aaa6-48ae-8189-27f5fa638652 req-7b8bbabb-73ac-4dfe-9808-a9da87adf669 service nova] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:10:03.329794 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-de030b2e-aaa6-48ae-8189-27f5fa638652 req-7b8bbabb-73ac-4dfe-9808-a9da87adf669 service nova] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:10:03.423188 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-53527cc7-c32c-4bf5-9317-b14eac623e8b req-a6e931bb-ee09-4ae0-8dae-5999a968cd9e service nova] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Received event network-changed-6aa6ae79-94a7-4711-b0eb-c55753c3cae7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:03.423491 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-53527cc7-c32c-4bf5-9317-b14eac623e8b req-a6e931bb-ee09-4ae0-8dae-5999a968cd9e service nova] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Refreshing instance network info cache due to event network-changed-6aa6ae79-94a7-4711-b0eb-c55753c3cae7. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:10:03.423653 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-53527cc7-c32c-4bf5-9317-b14eac623e8b req-a6e931bb-ee09-4ae0-8dae-5999a968cd9e service nova] Acquiring lock "refresh_cache-227baa5d-04b6-44bc-bf06-412f2874f947" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:10:03.426167 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-53527cc7-c32c-4bf5-9317-b14eac623e8b req-a6e931bb-ee09-4ae0-8dae-5999a968cd9e service nova] Acquired lock "refresh_cache-227baa5d-04b6-44bc-bf06-412f2874f947" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:10:03.426167 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-53527cc7-c32c-4bf5-9317-b14eac623e8b req-a6e931bb-ee09-4ae0-8dae-5999a968cd9e service nova] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Refreshing network info cache for port 6aa6ae79-94a7-4711-b0eb-c55753c3cae7 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:10:03.500115 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:10:03.505074 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:10:03.505348 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Creating image(s)
May 28 01:10:03.505845 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "/opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:03.506075 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "/opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:03.506567 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "/opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:03.507149 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:10:03.516702 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:10:03.517996 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:10:03.544701 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:10:03.612843 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.095s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:10:03.613370 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:03.613929 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:03.615429 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:10:03.619602 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:10:03.619896 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:10:03.686037 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:10:03.686213 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:10:03.686249 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] No VIF found with MAC fa:16:3e:b9:2b:05, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:10:03.686850 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Using config drive
May 28 01:10:03.711705 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:10:03.712068 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:10:03.763900 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9/disk 1073741824" returned: 0 in 0.051s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:10:03.764449 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.150s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:03.764776 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:10:03.832537 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-de030b2e-aaa6-48ae-8189-27f5fa638652 req-7b8bbabb-73ac-4dfe-9808-a9da87adf669 service nova] Releasing lock "refresh_cache-e8151422-37a0-4b7a-914f-34dc2979ead9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:10:03.833342 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquired lock "refresh_cache-e8151422-37a0-4b7a-914f-34dc2979ead9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:10:03.833569 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:10:03.852111 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.087s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:10:03.852407 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:10:03.852671 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:10:03.926621 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-53527cc7-c32c-4bf5-9317-b14eac623e8b req-a6e931bb-ee09-4ae0-8dae-5999a968cd9e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:03.952719 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:10:03.953081 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Cannot resize image /opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:10:03.953398 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:10:03.953539 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Ensure instance console log exists: /opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:10:03.953814 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:03.954021 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:03.954140 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:04.006048 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 3.035s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:04.006304 np0000001577 nova-compute[98319]: DEBUG nova.compute.rpcapi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98319) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 01:10:04.115006 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:04.115215 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:04.120561 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:10:04.120762 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Claim successful on node np0000001577
May 28 01:10:04.194786 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:04.253827 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-53527cc7-c32c-4bf5-9317-b14eac623e8b req-a6e931bb-ee09-4ae0-8dae-5999a968cd9e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:04.325570 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Creating config drive at /opt/stack/data/nova/instances/14f9e91b-230b-468d-940b-39ad40e0eca2/disk.config
May 28 01:10:04.330746 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/14f9e91b-230b-468d-940b-39ad40e0eca2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsfi9fb7m {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:10:04.384728 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/14f9e91b-230b-468d-940b-39ad40e0eca2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsfi9fb7m" returned: 0 in 0.054s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:10:04.400925 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-53527cc7-c32c-4bf5-9317-b14eac623e8b req-a6e931bb-ee09-4ae0-8dae-5999a968cd9e service nova] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Updated VIF entry in instance network info cache for port 6aa6ae79-94a7-4711-b0eb-c55753c3cae7. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:10:04.401416 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-53527cc7-c32c-4bf5-9317-b14eac623e8b req-a6e931bb-ee09-4ae0-8dae-5999a968cd9e service nova] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Updating instance_info_cache with network_info: [{"id": "6aa6ae79-94a7-4711-b0eb-c55753c3cae7", "address": "fa:16:3e:c1:3f:10", "network": {"id": "0d87381a-1454-4b59-b8c7-3a13e0fcd476", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1915607964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e4b1d73ecb40dfa464da2993358b3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa6ae79-94", "ovs_interfaceid": "6aa6ae79-94a7-4711-b0eb-c55753c3cae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:10:04.413627 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:10:04.550027 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:04.676361 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Updating instance_info_cache with network_info: [{"id": "f9933e16-d9fb-47e4-9e9a-3ba073b1a35f", "address": "fa:16:3e:65:fa:89", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9933e16-d9", "ovs_interfaceid": "f9933e16-d9fb-47e4-9e9a-3ba073b1a35f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:10:04.789453 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:04.819071 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:04.896589 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:04.906720 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-53527cc7-c32c-4bf5-9317-b14eac623e8b req-a6e931bb-ee09-4ae0-8dae-5999a968cd9e service nova] Releasing lock "refresh_cache-227baa5d-04b6-44bc-bf06-412f2874f947" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:10:05.158535 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:05.181202 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Releasing lock "refresh_cache-e8151422-37a0-4b7a-914f-34dc2979ead9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:10:05.181471 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Instance network_info: |[{"id": "f9933e16-d9fb-47e4-9e9a-3ba073b1a35f", "address": "fa:16:3e:65:fa:89", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9933e16-d9", "ovs_interfaceid": "f9933e16-d9fb-47e4-9e9a-3ba073b1a35f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:10:05.183087 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:05.184331 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Start _get_guest_xml network_info=[{"id": "f9933e16-d9fb-47e4-9e9a-3ba073b1a35f", "address": "fa:16:3e:65:fa:89", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9933e16-d9", "ovs_interfaceid": "f9933e16-d9fb-47e4-9e9a-3ba073b1a35f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:10:05.199890 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:10:05.202564 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-334526556', uuid='e8151422-37a0-4b7a-914f-34dc2979ead9'), owner=OwnerMeta(userid='0ae6af3cf5df464bbc9da74d825ddb4e', username='tempest-VolumeMultiattachTests-1632400240-project-member', projectid='07f3bdd3aef04045aac40e4b851915e1', projectname='tempest-VolumeMultiattachTests-1632400240'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f9933e16-d9fb-47e4-9e9a-3ba073b1a35f", "address": "fa:16:3e:65:fa:89", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9933e16-d9", "ovs_interfaceid": "f9933e16-d9fb-47e4-9e9a-3ba073b1a35f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930605.2011955) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:10:05.205049 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:10:05.205049 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:10:05.205745 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:10:05.205910 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:10:05.206779 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:10:05.207112 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:10:05.207601 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:10:05.207696 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:10:05.207814 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:10:05.207911 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:10:05.208046 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:10:05.208194 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:10:05.208315 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:10:05.208456 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:10:05.208628 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:10:05.208813 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:10:05.229732 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:09:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-334526556',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumemultiattachtests-server-334526556',id=64,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZPR0Gj39BZcWrRlU1NY4uwBiAIpfhz5q66W9RrzOpiQ/np/JXsGVyBJNTTO+6yHZcqzSOevY1HNVzn2A/GM7sX1gKgxLatKq6sG+HtO56znleQjhIEua31xTu77Jqhlg==',key_name='tempest-keypair-2138912526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07f3bdd3aef04045aac40e4b851915e1',ramdisk_id='',reservation_id='r-9yd6l23b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1632400240',owner_user_name='tempest-VolumeMultiattachTests-1632400240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:10:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ae6af3cf5df464bbc9da74d825ddb4e',uuid=e8151422-37a0-4b7a-914f-34dc2979ead9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9933e16-d9fb-47e4-9e9a-3ba073b1a35f", "address": "fa:16:3e:65:fa:89", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9933e16-d9", "ovs_interfaceid": "f9933e16-d9fb-47e4-9e9a-3ba073b1a35f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:10:05.230302 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Converting VIF {"id": "f9933e16-d9fb-47e4-9e9a-3ba073b1a35f", "address": "fa:16:3e:65:fa:89", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9933e16-d9", "ovs_interfaceid": "f9933e16-d9fb-47e4-9e9a-3ba073b1a35f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:10:05.232095 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:fa:89,bridge_name='br-int',has_traffic_filtering=True,id=f9933e16-d9fb-47e4-9e9a-3ba073b1a35f,network=Network(7357480b-2ba7-465c-88fe-aaf2e8f7a673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9933e16-d9') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:10:05.232989 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lazy-loading 'pci_devices' on Instance uuid e8151422-37a0-4b7a-914f-34dc2979ead9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:10:05.494560 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-bc1b2d35-1503-49e4-88f7-2b812be8a88b req-86ee5086-e15d-4f2b-85d4-6a669feb07f1 service nova] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Received event network-vif-plugged-2d2cecfd-dabf-4512-99c4-fc9703fef8c9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:05.494782 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bc1b2d35-1503-49e4-88f7-2b812be8a88b req-86ee5086-e15d-4f2b-85d4-6a669feb07f1 service nova] Acquiring lock "14f9e91b-230b-468d-940b-39ad40e0eca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:05.495008 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bc1b2d35-1503-49e4-88f7-2b812be8a88b req-86ee5086-e15d-4f2b-85d4-6a669feb07f1 service nova] Lock "14f9e91b-230b-468d-940b-39ad40e0eca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:05.495187 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bc1b2d35-1503-49e4-88f7-2b812be8a88b req-86ee5086-e15d-4f2b-85d4-6a669feb07f1 service nova] Lock "14f9e91b-230b-468d-940b-39ad40e0eca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:05.495348 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-bc1b2d35-1503-49e4-88f7-2b812be8a88b req-86ee5086-e15d-4f2b-85d4-6a669feb07f1 service nova] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Processing event network-vif-plugged-2d2cecfd-dabf-4512-99c4-fc9703fef8c9 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:10:05.495684 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-bc1b2d35-1503-49e4-88f7-2b812be8a88b req-86ee5086-e15d-4f2b-85d4-6a669feb07f1 service nova] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Received event network-vif-plugged-2d2cecfd-dabf-4512-99c4-fc9703fef8c9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:05.495879 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bc1b2d35-1503-49e4-88f7-2b812be8a88b req-86ee5086-e15d-4f2b-85d4-6a669feb07f1 service nova] Acquiring lock "14f9e91b-230b-468d-940b-39ad40e0eca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:05.496071 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bc1b2d35-1503-49e4-88f7-2b812be8a88b req-86ee5086-e15d-4f2b-85d4-6a669feb07f1 service nova] Lock "14f9e91b-230b-468d-940b-39ad40e0eca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:05.496321 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bc1b2d35-1503-49e4-88f7-2b812be8a88b req-86ee5086-e15d-4f2b-85d4-6a669feb07f1 service nova] Lock "14f9e91b-230b-468d-940b-39ad40e0eca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:05.496363 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-bc1b2d35-1503-49e4-88f7-2b812be8a88b req-86ee5086-e15d-4f2b-85d4-6a669feb07f1 service nova] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] No waiting events found dispatching network-vif-plugged-2d2cecfd-dabf-4512-99c4-fc9703fef8c9 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:10:05.496508 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-bc1b2d35-1503-49e4-88f7-2b812be8a88b req-86ee5086-e15d-4f2b-85d4-6a669feb07f1 service nova] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Received unexpected event network-vif-plugged-2d2cecfd-dabf-4512-99c4-fc9703fef8c9 for instance with vm_state building and task_state spawning.
May 28 01:10:05.550797 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930605.5503516, 14f9e91b-230b-468d-940b-39ad40e0eca2 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:10:05.552381 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:10:05.552648 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] VM Started (Lifecycle Event)
May 28 01:10:05.554319 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:10:05.560107 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Instance spawned successfully.
May 28 01:10:05.560470 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:10:05.573477 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Swapping old allocation on dict_keys(['78eed366-a2f0-4ead-b3a1-1ceb637e76c2']) held by migration 89c274ec-c439-4cb6-8e95-835338708472 for instance
May 28 01:10:05.612162 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:10:05.612360 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:10:05.669360 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Overwriting current allocation {'allocations': {'78eed366-a2f0-4ead-b3a1-1ceb637e76c2': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 83}}, 'project_id': 'a430f0d6bcc84a29bc3e96514422896b', 'user_id': 'fbae7974478d45b3908aaaa5b4408e26', 'consumer_generation': 1} on consumer 412ac56c-f524-46c2-91eb-fa4672db46a9 {{(pid=98319) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2036}}
May 28 01:10:05.740459 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] End _get_guest_xml xml=<domain type="qemu">
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:   <uuid>e8151422-37a0-4b7a-914f-34dc2979ead9</uuid>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:   <name>instance-00000040</name>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       <nova:name>tempest-VolumeMultiattachTests-server-334526556</nova:name>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:10:05</nova:creationTime>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:         <nova:user uuid="0ae6af3cf5df464bbc9da74d825ddb4e">tempest-VolumeMultiattachTests-1632400240-project-member</nova:user>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:         <nova:project uuid="07f3bdd3aef04045aac40e4b851915e1">tempest-VolumeMultiattachTests-1632400240</nova:project>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:         <nova:port uuid="f9933e16-d9fb-47e4-9e9a-3ba073b1a35f">
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:     <system>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       <entry name="serial">e8151422-37a0-4b7a-914f-34dc2979ead9</entry>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       <entry name="uuid">e8151422-37a0-4b7a-914f-34dc2979ead9</entry>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:     </system>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:   <os>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:   </os>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:   <features>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:   </features>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:   <devices>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9/disk"/>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:     </disk>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9/disk.config"/>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:     </disk>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:65:fa:89"/>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       <target dev="tapf9933e16-d9"/>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:     </interface>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9/console.log" append="off"/>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:     </serial>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:     <video>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:     </video>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:     </rng>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:   </devices>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]: </domain>
May 28 01:10:05.740459 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:10:05.742075 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Preparing to wait for external event network-vif-plugged-f9933e16-d9fb-47e4-9e9a-3ba073b1a35f {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:10:05.743223 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "e8151422-37a0-4b7a-914f-34dc2979ead9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:05.743884 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:05.744055 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:05.744888 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:09:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-334526556',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumemultiattachtests-server-334526556',id=64,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZPR0Gj39BZcWrRlU1NY4uwBiAIpfhz5q66W9RrzOpiQ/np/JXsGVyBJNTTO+6yHZcqzSOevY1HNVzn2A/GM7sX1gKgxLatKq6sG+HtO56znleQjhIEua31xTu77Jqhlg==',key_name='tempest-keypair-2138912526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07f3bdd3aef04045aac40e4b851915e1',ramdisk_id='',reservation_id='r-9yd6l23b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1632400240',owner_user_name='tempest-VolumeMultiattachTests-1632400240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:10:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ae6af3cf5df464bbc9da74d825ddb4e',uuid=e8151422-37a0-4b7a-914f-34dc2979ead9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9933e16-d9fb-47e4-9e9a-3ba073b1a35f", "address": "fa:16:3e:65:fa:89", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9933e16-d9", "ovs_interfaceid": "f9933e16-d9fb-47e4-9e9a-3ba073b1a35f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:10:05.746527 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:05.748158 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Converting VIF {"id": "f9933e16-d9fb-47e4-9e9a-3ba073b1a35f", "address": "fa:16:3e:65:fa:89", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9933e16-d9", "ovs_interfaceid": "f9933e16-d9fb-47e4-9e9a-3ba073b1a35f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:10:05.748727 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:fa:89,bridge_name='br-int',has_traffic_filtering=True,id=f9933e16-d9fb-47e4-9e9a-3ba073b1a35f,network=Network(7357480b-2ba7-465c-88fe-aaf2e8f7a673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9933e16-d9') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:10:05.748985 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:fa:89,bridge_name='br-int',has_traffic_filtering=True,id=f9933e16-d9fb-47e4-9e9a-3ba073b1a35f,network=Network(7357480b-2ba7-465c-88fe-aaf2e8f7a673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9933e16-d9') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:10:05.749401 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:05.749784 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:10:05.750033 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:10:05.751581 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:05.751955 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32c02d32-6fc2-5c92-ae35-3f401a621e34', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:10:05.761553 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:10:05.763080 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:05.763233 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9933e16-d9, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:10:05.763490 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf9933e16-d9, col_values=(('qos', UUID('ccd80b53-cb27-4286-be39-1f3516ea376a')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:10:05.763665 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf9933e16-d9, col_values=(('external_ids', {'iface-id': 'f9933e16-d9fb-47e4-9e9a-3ba073b1a35f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:fa:89', 'vm-uuid': 'e8151422-37a0-4b7a-914f-34dc2979ead9'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:10:05.765748 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:10:05.770658 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:05.771387 np0000001577 nova-compute[98319]: INFO os_vif [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:fa:89,bridge_name='br-int',has_traffic_filtering=True,id=f9933e16-d9fb-47e4-9e9a-3ba073b1a35f,network=Network(7357480b-2ba7-465c-88fe-aaf2e8f7a673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9933e16-d9')
May 28 01:10:05.809283 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "refresh_cache-412ac56c-f524-46c2-91eb-fa4672db46a9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:10:05.809380 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquired lock "refresh_cache-412ac56c-f524-46c2-91eb-fa4672db46a9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:10:05.809489 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:10:06.061467 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:10:06.064973 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:10:06.067222 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:10:06.067341 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:10:06.067606 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:10:06.067826 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:10:06.068056 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:10:06.068276 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:10:06.114743 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:10:06.311165 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:06.515074 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:06.570970 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:10:06.571311 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930606.5710125, 14f9e91b-230b-468d-940b-39ad40e0eca2 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:10:06.571311 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] VM Paused (Lifecycle Event)
May 28 01:10:06.573412 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Took 6.18 seconds to spawn the instance on the hypervisor.
May 28 01:10:06.573617 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:10:06.602683 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:06.620776 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.505s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:06.621059 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:10:06.724055 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Updating instance_info_cache with network_info: [{"id": "4e4e8646-56c4-4135-b704-3eda00177287", "address": "fa:16:3e:d7:12:9f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e8646-56", "ovs_interfaceid": "4e4e8646-56c4-4135-b704-3eda00177287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:10:07.074997 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:10:07.076806 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930607.0765374, 14f9e91b-230b-468d-940b-39ad40e0eca2 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:10:07.076902 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] VM Resumed (Lifecycle Event)
May 28 01:10:07.080408 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Took 11.90 seconds to build instance.
May 28 01:10:07.125894 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:10:07.126053 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:10:07.126245 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:07.126428 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:07.184364 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c803ddeaf4f4b3db07587419087b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050f928f1ce449d6a447cd343dc4ff80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:10:07.225676 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Releasing lock "refresh_cache-412ac56c-f524-46c2-91eb-fa4672db46a9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:10:07.226507 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:10:07.238834 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:10:07.258076 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:10:07.296086 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:10:07.296248 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:10:07.296311 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No VIF found with MAC fa:16:3e:65:fa:89, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:10:07.297471 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Using config drive
May 28 01:10:07.302593 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:10:07.302876 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:10:07.311840 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:10:07.314906 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe46:94e9', 'fe80::e873:f8ff:fed0:1522', 'fe80::fc16:3eff:fe94:f622', 'fe80::fc16:3eff:fec1:3f10', 'fe80::4c74:35ff:fe9d:cf4a', 'fe80::fc16:3eff:feb9:2b05', 'fe80::84b7:d3ff:feed:4f01', 'fe80::fc16:3eff:feab:f427', 'fe80::9c16:39ff:fe2e:9aef'] 
May 28 01:10:07.315119 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:10:07.315277 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:10:07.315569 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:10:07.581283 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:10:07.584142 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fd90050-4a37-4651-89cb-9850a3bc84cb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "14f9e91b-230b-468d-940b-39ad40e0eca2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.410s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:07.585838 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:10:07.628571 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:10:07.733801 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Successfully created port: 939d5f23-c81b-44c1-a5b5-3facfb23bd08 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:10:07.806690 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:07.940685 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Creating config drive at /opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9/disk.config
May 28 01:10:07.945465 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmysx7nmr {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:10:07.999612 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmysx7nmr" returned: 0 in 0.054s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:10:08.132247 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:10:08.201531 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Successfully updated port: 939d5f23-c81b-44c1-a5b5-3facfb23bd08 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:10:08.257988 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d72ab64d-1217-4950-ba44-204a80c3736c req-0b64d1e0-8a54-471c-b2d4-194024e90414 service nova] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Received event network-changed-939d5f23-c81b-44c1-a5b5-3facfb23bd08 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:08.258185 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d72ab64d-1217-4950-ba44-204a80c3736c req-0b64d1e0-8a54-471c-b2d4-194024e90414 service nova] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Refreshing instance network info cache due to event network-changed-939d5f23-c81b-44c1-a5b5-3facfb23bd08. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:10:08.258454 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d72ab64d-1217-4950-ba44-204a80c3736c req-0b64d1e0-8a54-471c-b2d4-194024e90414 service nova] Acquiring lock "refresh_cache-38636bdc-bca3-469b-80d7-05d8fa9e1c78" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:10:08.259018 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d72ab64d-1217-4950-ba44-204a80c3736c req-0b64d1e0-8a54-471c-b2d4-194024e90414 service nova] Acquired lock "refresh_cache-38636bdc-bca3-469b-80d7-05d8fa9e1c78" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:10:08.259178 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-d72ab64d-1217-4950-ba44-204a80c3736c req-0b64d1e0-8a54-471c-b2d4-194024e90414 service nova] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Refreshing network info cache for port 939d5f23-c81b-44c1-a5b5-3facfb23bd08 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:10:08.402228 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Starting finish_revert_migration {{(pid=98319) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12932}}
May 28 01:10:08.423602 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Start _get_guest_xml network_info=[{"id": "4e4e8646-56c4-4135-b704-3eda00177287", "address": "fa:16:3e:d7:12:9f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e8646-56", "ovs_interfaceid": "4e4e8646-56c4-4135-b704-3eda00177287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7725186-2460-4632-868e-1cb41674f3f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '412ac56c-f524-46c2-91eb-fa4672db46a9', 'attached_at': '2026-05-28T01:10:07.000000', 'detached_at': '', 'volume_id': 'f7725186-2460-4632-868e-1cb41674f3f0', 'serial': 'f7725186-2460-4632-868e-1cb41674f3f0'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '573adda1-26fd-4d6b-ae8e-4fb6d35ac5ca', 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:10:08.427282 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:10:08.432583 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1464485741', uuid='412ac56c-f524-46c2-91eb-fa4672db46a9'), owner=OwnerMeta(userid='fbae7974478d45b3908aaaa5b4408e26', username='tempest-TestEncryptedCinderVolumes-2086871542-project-member', projectid='a430f0d6bcc84a29bc3e96514422896b', projectname='tempest-TestEncryptedCinderVolumes-2086871542'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4e4e8646-56c4-4135-b704-3eda00177287", "address": "fa:16:3e:d7:12:9f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e8646-56", "ovs_interfaceid": "4e4e8646-56c4-4135-b704-3eda00177287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930608.4300644) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:10:08.433008 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:08.444759 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:10:08.445315 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:10:08.447219 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:10:08.447503 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:10:08.448836 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:10:08.449245 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:10:08.449492 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:10:08.449614 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:10:08.449793 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:10:08.449928 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:10:08.450086 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:10:08.450317 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:10:08.453000 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:10:08.453000 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:10:08.453000 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:10:08.453000 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:10:08.453000 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lazy-loading 'vcpu_model' on Instance uuid 412ac56c-f524-46c2-91eb-fa4672db46a9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:10:08.454383 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:08.534136 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:08.605988 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-87ac871b-7aba-4812-9e51-afb21b9acfb8 req-5c678837-89ab-44ce-b9d8-48c197109e75 service nova] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Received event network-vif-plugged-f9933e16-d9fb-47e4-9e9a-3ba073b1a35f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:08.606325 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-87ac871b-7aba-4812-9e51-afb21b9acfb8 req-5c678837-89ab-44ce-b9d8-48c197109e75 service nova] Acquiring lock "e8151422-37a0-4b7a-914f-34dc2979ead9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:08.606325 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-87ac871b-7aba-4812-9e51-afb21b9acfb8 req-5c678837-89ab-44ce-b9d8-48c197109e75 service nova] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:08.606446 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-87ac871b-7aba-4812-9e51-afb21b9acfb8 req-5c678837-89ab-44ce-b9d8-48c197109e75 service nova] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:08.607324 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-87ac871b-7aba-4812-9e51-afb21b9acfb8 req-5c678837-89ab-44ce-b9d8-48c197109e75 service nova] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Processing event network-vif-plugged-f9933e16-d9fb-47e4-9e9a-3ba073b1a35f {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:10:08.640587 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Booting with volume 8d4682bb-7f09-4e32-8669-e6904066213e at /dev/vda
May 28 01:10:08.690082 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:10:08.703936 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "refresh_cache-38636bdc-bca3-469b-80d7-05d8fa9e1c78" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:10:08.708622 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:10:08.741024 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:10:08.763777 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-d72ab64d-1217-4950-ba44-204a80c3736c req-0b64d1e0-8a54-471c-b2d4-194024e90414 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:08.789790 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:10:08.790105 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:10:08.794111 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:08.802001 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:10:08.805090 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe46:94e9', 'fe80::e873:f8ff:fed0:1522', 'fe80::fc16:3eff:fe94:f622', 'fe80::fc16:3eff:fec1:3f10', 'fe80::4c74:35ff:fe9d:cf4a', 'fe80::fc16:3eff:feb9:2b05', 'fe80::84b7:d3ff:feed:4f01', 'fe80::fc16:3eff:fe65:fa89', 'fe80::583c:47ff:fea3:281d', 'fe80::fc16:3eff:feab:f427', 'fe80::9c16:39ff:fe2e:9aef'] 
May 28 01:10:08.805090 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:10:08.805090 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:10:08.805090 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:10:08.805090 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Updating existing volume attachment record: 89e605d2-3da9-4fe1-9d83-bb90d3941d68 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:10:08.807112 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:08.822581 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:08.857622 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-d72ab64d-1217-4950-ba44-204a80c3736c req-0b64d1e0-8a54-471c-b2d4-194024e90414 service nova] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:10:08.976094 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk.config --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:10:09.007486 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-d72ab64d-1217-4950-ba44-204a80c3736c req-0b64d1e0-8a54-471c-b2d4-194024e90414 service nova] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:10:09.013486 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-86c6b24f-6c76-45e7-9762-1ccb224dbdfc req-3237185e-c4ee-4552-9790-64a49426244d service nova] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Received event network-changed-2d2cecfd-dabf-4512-99c4-fc9703fef8c9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:09.013642 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-86c6b24f-6c76-45e7-9762-1ccb224dbdfc req-3237185e-c4ee-4552-9790-64a49426244d service nova] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Refreshing instance network info cache due to event network-changed-2d2cecfd-dabf-4512-99c4-fc9703fef8c9. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:10:09.014218 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-86c6b24f-6c76-45e7-9762-1ccb224dbdfc req-3237185e-c4ee-4552-9790-64a49426244d service nova] Acquiring lock "refresh_cache-14f9e91b-230b-468d-940b-39ad40e0eca2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:10:09.014340 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-86c6b24f-6c76-45e7-9762-1ccb224dbdfc req-3237185e-c4ee-4552-9790-64a49426244d service nova] Acquired lock "refresh_cache-14f9e91b-230b-468d-940b-39ad40e0eca2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:10:09.014485 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-86c6b24f-6c76-45e7-9762-1ccb224dbdfc req-3237185e-c4ee-4552-9790-64a49426244d service nova] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Refreshing network info cache for port 2d2cecfd-dabf-4512-99c4-fc9703fef8c9 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:10:09.067833 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk.config --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:10:09.068239 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "/opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:09.068429 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "/opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:09.068910 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "/opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:09.069280 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:10:09.069665 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7725186-2460-4632-868e-1cb41674f3f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:10:09.069807 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:10:09.070100 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:10:09.070379 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7725186-2460-4632-868e-1cb41674f3f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:10:09.081156 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:10:09.081918 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:10:09.082343 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:10:09.082685 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:10:09.083041 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:10:09.083690 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:10:09.093941 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:10:09.093941 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:09.098920 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:10:09.098920 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:09.109214 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0] added
May 28 01:10:09.109214 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:10:09.109214 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:10:09.109214 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:10:09.109214 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:10:09.109214 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:10:09.109214 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:09.109479 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:10:09.109655 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0263(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:10:09.110254 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0] added
May 28 01:10:09.110254 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:10:09.110254 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:10:09.110254 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:10:09.110254 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:10:09.110254 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:10:09.110254 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:09.110752 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:10:09.110966 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:10:09.111175 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0285(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:10:09.111304 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:10:09.209954 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930609.2096238, e8151422-37a0-4b7a-914f-34dc2979ead9 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:10:09.210125 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] VM Started (Lifecycle Event)
May 28 01:10:09.211995 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:10:09.214433 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:10:09.217470 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Instance spawned successfully.
May 28 01:10:09.217900 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:10:09.511571 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d72ab64d-1217-4950-ba44-204a80c3736c req-0b64d1e0-8a54-471c-b2d4-194024e90414 service nova] Releasing lock "refresh_cache-38636bdc-bca3-469b-80d7-05d8fa9e1c78" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:10:09.512373 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquired lock "refresh_cache-38636bdc-bca3-469b-80d7-05d8fa9e1c78" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:10:09.512520 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:10:09.516907 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-86c6b24f-6c76-45e7-9762-1ccb224dbdfc req-3237185e-c4ee-4552-9790-64a49426244d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:09.716724 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:10:09.718642 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:10:09.735816 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:10:09.736054 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:10:09.736710 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:10:09.737150 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:10:09.737630 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:10:09.738019 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:10:09.825347 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-86c6b24f-6c76-45e7-9762-1ccb224dbdfc req-3237185e-c4ee-4552-9790-64a49426244d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:09.957808 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-86c6b24f-6c76-45e7-9762-1ccb224dbdfc req-3237185e-c4ee-4552-9790-64a49426244d service nova] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Updated VIF entry in instance network info cache for port 2d2cecfd-dabf-4512-99c4-fc9703fef8c9. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:10:09.958074 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-86c6b24f-6c76-45e7-9762-1ccb224dbdfc req-3237185e-c4ee-4552-9790-64a49426244d service nova] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Updating instance_info_cache with network_info: [{"id": "2d2cecfd-dabf-4512-99c4-fc9703fef8c9", "address": "fa:16:3e:b9:2b:05", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2cecfd-da", "ovs_interfaceid": "2d2cecfd-dabf-4512-99c4-fc9703fef8c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:10:10.086564 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:10:10.111193 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:10:10.111624 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:10:10.124428 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:10:10.124428 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:10:10.127635 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:10:10.127635 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:10.138489 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:10.142730 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:10.151760 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:10.151760 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:10.151760 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:10.151760 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:10.151760 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:10:10.151933 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:10.151933 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:10.151933 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:10.151933 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:10.151933 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:10:10.156114 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:10.156114 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:10.156114 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:10.156114 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:10.156114 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:10:10.156319 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:10.156319 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:10.156319 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:10.156319 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:10.156319 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:10:10.198287 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0, portal: 192.168.50.100,3260]
May 28 01:10:10.198287 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0, portal: 192.168.50.100,3260] successful.
May 28 01:10:10.198287 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:10.212774 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:10.220659 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:10:10.221097 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930610.2209163, e8151422-37a0-4b7a-914f-34dc2979ead9 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:10:10.221232 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] VM Paused (Lifecycle Event)
May 28 01:10:10.223896 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0, portal: 192.168.40.100,3260]
May 28 01:10:10.223896 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0, portal: 192.168.40.100,3260] successful.
May 28 01:10:10.223896 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:10.231992 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:10.231992 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:10.231992 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:10.231992 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:10.231992 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:10.231992 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:10.231992 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:10:10.232204 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:10.232204 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:10.232204 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:10.232204 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:10.232204 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:10.232204 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:10.232204 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:10:10.232347 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:10:10.232447 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:10:10.233198 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] HCTL ('7', '-', '-', 0) found on session 155 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:10:10.233824 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:10:10.238751 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:10.244643 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Took 6.74 seconds to spawn the instance on the hypervisor.
May 28 01:10:10.244835 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:10:10.260224 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:10.267192 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:10.267192 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:10.267192 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:10.267192 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:10.267192 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:10.267192 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:10.267192 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:10:10.267766 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:10.267766 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:10.267766 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:10.267766 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:10.267766 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:10.267766 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:10.267766 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:10:10.268074 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.186s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:10:10.268211 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:10:10.268653 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Searching for a device in session 155 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:10:10.268856 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f7725186-2460-4632-868e-1cb41674f3f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:10:10.269909 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] HCTL ('8', '-', '-', 0) found on session 156 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:10:10.270064 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:10:10.289417 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Searching for a device in session 156 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:10:10.289417 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7725186-2460-4632-868e-1cb41674f3f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:10:10.421959 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Updating instance_info_cache with network_info: [{"id": "939d5f23-c81b-44c1-a5b5-3facfb23bd08", "address": "fa:16:3e:58:6b:6d", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap939d5f23-c8", "ovs_interfaceid": "939d5f23-c81b-44c1-a5b5-3facfb23bd08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:10:10.460012 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-86c6b24f-6c76-45e7-9762-1ccb224dbdfc req-3237185e-c4ee-4552-9790-64a49426244d service nova] Releasing lock "refresh_cache-14f9e91b-230b-468d-940b-39ad40e0eca2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:10:10.670463 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-727cb7ba-913c-49ff-b661-c3bcfb86fcb6 req-4d7fad1e-653f-457c-80e3-58cc1bb9715f service nova] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Received event network-vif-plugged-f9933e16-d9fb-47e4-9e9a-3ba073b1a35f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:10.670691 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-727cb7ba-913c-49ff-b661-c3bcfb86fcb6 req-4d7fad1e-653f-457c-80e3-58cc1bb9715f service nova] Acquiring lock "e8151422-37a0-4b7a-914f-34dc2979ead9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:10.670879 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-727cb7ba-913c-49ff-b661-c3bcfb86fcb6 req-4d7fad1e-653f-457c-80e3-58cc1bb9715f service nova] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:10.671042 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-727cb7ba-913c-49ff-b661-c3bcfb86fcb6 req-4d7fad1e-653f-457c-80e3-58cc1bb9715f service nova] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:10.671473 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-727cb7ba-913c-49ff-b661-c3bcfb86fcb6 req-4d7fad1e-653f-457c-80e3-58cc1bb9715f service nova] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] No waiting events found dispatching network-vif-plugged-f9933e16-d9fb-47e4-9e9a-3ba073b1a35f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:10:10.671757 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-727cb7ba-913c-49ff-b661-c3bcfb86fcb6 req-4d7fad1e-653f-457c-80e3-58cc1bb9715f service nova] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Received unexpected event network-vif-plugged-f9933e16-d9fb-47e4-9e9a-3ba073b1a35f for instance with vm_state active and task_state None.
May 28 01:10:10.723245 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:10:10.725087 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930610.7248905, e8151422-37a0-4b7a-914f-34dc2979ead9 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:10:10.725213 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] VM Resumed (Lifecycle Event)
May 28 01:10:10.754024 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Took 12.27 seconds to build instance.
May 28 01:10:10.779771 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:10.914188 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:10:10.915005 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:10:10.915230 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Creating image(s)
May 28 01:10:10.915509 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:10:10.915680 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Ensure instance console log exists: /opt/stack/data/nova/instances/38636bdc-bca3-469b-80d7-05d8fa9e1c78/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:10:10.915958 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:10.916139 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:10.916254 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:10.925427 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Releasing lock "refresh_cache-38636bdc-bca3-469b-80d7-05d8fa9e1c78" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:10:10.925671 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Instance network_info: |[{"id": "939d5f23-c81b-44c1-a5b5-3facfb23bd08", "address": "fa:16:3e:58:6b:6d", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap939d5f23-c8", "ovs_interfaceid": "939d5f23-c81b-44c1-a5b5-3facfb23bd08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:10:10.926159 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Start _get_guest_xml network_info=[{"id": "939d5f23-c81b-44c1-a5b5-3facfb23bd08", "address": "fa:16:3e:58:6b:6d", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap939d5f23-c8", "ovs_interfaceid": "939d5f23-c81b-44c1-a5b5-3facfb23bd08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e', 'iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d4682bb-7f09-4e32-8669-e6904066213e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '38636bdc-bca3-469b-80d7-05d8fa9e1c78', 'attached_at': '', 'detached_at': '', 'volume_id': '8d4682bb-7f09-4e32-8669-e6904066213e', 'serial': '8d4682bb-7f09-4e32-8669-e6904066213e'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '89e605d2-3da9-4fe1-9d83-bb90d3941d68', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:10:10.928181 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:10:10.929098 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-607844118', uuid='38636bdc-bca3-469b-80d7-05d8fa9e1c78'), owner=OwnerMeta(userid='0c803ddeaf4f4b3db07587419087b3b2', username='tempest-TestVolumeBootPattern-1449742411-project-member', projectid='050f928f1ce449d6a447cd343dc4ff80', projectname='tempest-TestVolumeBootPattern-1449742411'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "939d5f23-c81b-44c1-a5b5-3facfb23bd08", "address": "fa:16:3e:58:6b:6d", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap939d5f23-c8", "ovs_interfaceid": "939d5f23-c81b-44c1-a5b5-3facfb23bd08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930610.9288104) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:10:10.930182 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:10:10.930518 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:10:10.931425 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:10:10.931627 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:10:10.932476 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:10:10.932764 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:10:10.932955 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:10:10.933085 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:10:10.933250 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:10:10.933370 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:10:10.933506 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:10:10.933708 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:10:10.933843 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:10:10.934001 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:10:10.934144 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:10:10.934299 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:10:10.942917 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:10:10.943187 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e', 'iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d4682bb-7f09-4e32-8669-e6904066213e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:10:10.943341 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:10:11.086989 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:10:11.227501 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:10:11.235437 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:10:11.255409 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9b700b26-a6d4-403d-8ea4-afdecd788b01 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.772s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:11.515428 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:11.958734 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "e5a3d695-94e9-4ad7-aa07-b6cc865b30a1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:11.958734 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "e5a3d695-94e9-4ad7-aa07-b6cc865b30a1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:12.103087 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Found WWN 330000000dd6bd600 for multipath device dm-2 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:10:12.103454 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:10:12.104140 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.161s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:10:12.104372 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e', 'iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d4682bb-7f09-4e32-8669-e6904066213e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:10:12.104853 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000dd6bd600', 'path': '/dev/disk/by-id/os-brick+dev+dm-2', 'multipath_id': '330000000dd6bd600'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:10:12.105617 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000dd6bd600', 'path': '/dev/disk/by-id/os-brick+dev+dm-2', 'multipath_id': '330000000dd6bd600'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:10:12.117891 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:10:12.118800 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:10:12.119225 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:10:12.119390 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:10:12.120001 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:10:12.120247 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:10:12.131778 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:10:12.131778 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:12.139343 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:10:12.139343 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:12.144564 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7725186-2460-4632-868e-1cb41674f3f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-2'}, 'status': 'attaching', 'instance': '412ac56c-f524-46c2-91eb-fa4672db46a9', 'attached_at': '2026-05-28T01:10:07.000000', 'detached_at': '', 'volume_id': 'f7725186-2460-4632-868e-1cb41674f3f0', 'serial': 'f7725186-2460-4632-868e-1cb41674f3f0'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 01:10:12.144564 np0000001577 nova-compute[98319]: WARNING stevedore.named [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 01:10:12.144564 np0000001577 nova-compute[98319]: WARNING castellan.key_manager [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:10:12.144564 np0000001577 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:10:12.150067 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e] added
May 28 01:10:12.150067 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:10:12.150067 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:10:12.150067 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:10:12.150067 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:10:12.150067 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:10:12.150067 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:12.150263 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:10:12.150372 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0309(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:10:12.150526 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:10:12.152316 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e] added
May 28 01:10:12.152316 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:10:12.152316 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:10:12.152316 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:10:12.152316 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:10:12.152316 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:10:12.152316 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:12.152492 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:10:12.152752 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0325(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:10:12.152953 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:10:12.158306 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 01:10:12.158306 np0000001577 nova-compute[98319]:   <usage type="volume">
May 28 01:10:12.158306 np0000001577 nova-compute[98319]:     <volume>f7725186-2460-4632-868e-1cb41674f3f0</volume>
May 28 01:10:12.158306 np0000001577 nova-compute[98319]:   </usage>
May 28 01:10:12.158306 np0000001577 nova-compute[98319]: </secret>
May 28 01:10:12.158306 np0000001577 nova-compute[98319]:  {{(pid=98319) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 01:10:12.461538 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lazy-loading 'flavor' on Instance uuid e5a3d695-94e9-4ad7-aa07-b6cc865b30a1 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:10:12.666142 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1464485741',display_name='tempest-TestEncryptedCinderVolumes-server-1464485741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testencryptedcindervolumes-server-1464485741',id=59,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaxiVCL/oeyuc6Fn/LaDWPWiO7mXNOG+NJ+ojaTKJd77Zn7nrd05FgcX3093dXQNIvdpDxCbUKUzqvcTZNFcgRrrPUR46mHMo/POLXh0IP7v2hya+rwuFblpqAtbu1bbg==',key_name='tempest-keypair-1398822484',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:09:54Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000001577',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a430f0d6bcc84a29bc3e96514422896b',ramdisk_id='',reservation_id='r-nu20f4t0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-2086871542',owner_user_name='tempest-TestEncryptedCinderVolumes-2086871542-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:09:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbae7974478d45b3908aaaa5b4408e26',uuid=412ac56c-f524-46c2-91eb-fa4672db46a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "4e4e8646-56c4-4135-b704-3eda00177287", "address": "fa:16:3e:d7:12:9f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e8646-56", "ovs_interfaceid": "4e4e8646-56c4-4135-b704-3eda00177287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:10:12.666689 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converting VIF {"id": "4e4e8646-56c4-4135-b704-3eda00177287", "address": "fa:16:3e:d7:12:9f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e8646-56", "ovs_interfaceid": "4e4e8646-56c4-4135-b704-3eda00177287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:10:12.667412 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:12:9f,bridge_name='br-int',has_traffic_filtering=True,id=4e4e8646-56c4-4135-b704-3eda00177287,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e8646-56') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:10:12.671361 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] End _get_guest_xml xml=<domain type="qemu">
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:   <uuid>412ac56c-f524-46c2-91eb-fa4672db46a9</uuid>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:   <name>instance-0000003b</name>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1464485741</nova:name>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:10:08</nova:creationTime>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:         <nova:user uuid="fbae7974478d45b3908aaaa5b4408e26">tempest-TestEncryptedCinderVolumes-2086871542-project-member</nova:user>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:         <nova:project uuid="a430f0d6bcc84a29bc3e96514422896b">tempest-TestEncryptedCinderVolumes-2086871542</nova:project>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:         <nova:port uuid="4e4e8646-56c4-4135-b704-3eda00177287">
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:     <system>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <entry name="serial">412ac56c-f524-46c2-91eb-fa4672db46a9</entry>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <entry name="uuid">412ac56c-f524-46c2-91eb-fa4672db46a9</entry>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:     </system>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:   <os>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:   </os>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:   <features>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:   </features>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:   <devices>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk"/>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:     </disk>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk.config"/>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:     </disk>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <alias name="ua-f7725186-2460-4632-868e-1cb41674f3f0"/>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-2"/>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <serial>f7725186-2460-4632-868e-1cb41674f3f0</serial>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <encryption format="luks">
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:         <secret type="passphrase" uuid="7210f4aa-7cba-46e3-ae37-603ee1977b92"/>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       </encryption>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:     </disk>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:d7:12:9f"/>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <target dev="tap4e4e8646-56"/>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:     </interface>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/console.log" append="off"/>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:     </serial>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:     <video>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:     </video>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:     </rng>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:   </devices>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]: </domain>
May 28 01:10:12.671361 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:10:12.677452 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Preparing to wait for external event network-vif-plugged-4e4e8646-56c4-4135-b704-3eda00177287 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:10:12.677452 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:12.677452 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:12.677452 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:12.677452 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1464485741',display_name='tempest-TestEncryptedCinderVolumes-server-1464485741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testencryptedcindervolumes-server-1464485741',id=59,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaxiVCL/oeyuc6Fn/LaDWPWiO7mXNOG+NJ+ojaTKJd77Zn7nrd05FgcX3093dXQNIvdpDxCbUKUzqvcTZNFcgRrrPUR46mHMo/POLXh0IP7v2hya+rwuFblpqAtbu1bbg==',key_name='tempest-keypair-1398822484',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:09:54Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000001577',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a430f0d6bcc84a29bc3e96514422896b',ramdisk_id='',reservation_id='r-nu20f4t0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-2086871542',owner_user_name='tempest-TestEncryptedCinderVolumes-2086871542-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:09:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbae7974478d45b3908aaaa5b4408e26',uuid=412ac56c-f524-46c2-91eb-fa4672db46a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "4e4e8646-56c4-4135-b704-3eda00177287", "address": "fa:16:3e:d7:12:9f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e8646-56", "ovs_interfaceid": "4e4e8646-56c4-4135-b704-3eda00177287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:10:12.677452 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converting VIF {"id": "4e4e8646-56c4-4135-b704-3eda00177287", "address": "fa:16:3e:d7:12:9f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e8646-56", "ovs_interfaceid": "4e4e8646-56c4-4135-b704-3eda00177287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:10:12.677452 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:12:9f,bridge_name='br-int',has_traffic_filtering=True,id=4e4e8646-56c4-4135-b704-3eda00177287,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e8646-56') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:10:12.677452 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:12:9f,bridge_name='br-int',has_traffic_filtering=True,id=4e4e8646-56c4-4135-b704-3eda00177287,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e8646-56') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:10:12.677452 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:12.678244 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:10:12.678244 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:10:12.678976 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:12.679097 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3655c88f-41d6-5a9e-b4ef-7de38bc60c61', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:10:12.679736 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:12.680286 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:10:12.681198 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:12.683002 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:12.683125 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e4e8646-56, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:10:12.683462 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e4e8646-56, col_values=(('qos', UUID('71810972-d685-43f3-b14c-e59396389e80')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:10:12.683609 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e4e8646-56, col_values=(('external_ids', {'iface-id': '4e4e8646-56c4-4135-b704-3eda00177287', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:12:9f', 'vm-uuid': '412ac56c-f524-46c2-91eb-fa4672db46a9'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:10:12.684744 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:12.685743 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:10:12.693660 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:12.694765 np0000001577 nova-compute[98319]: INFO os_vif [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:12:9f,bridge_name='br-int',has_traffic_filtering=True,id=4e4e8646-56c4-4135-b704-3eda00177287,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e8646-56')
May 28 01:10:12.729537 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-65dba6ca-a970-4db8-8c86-801402437693 req-3995c6d6-93e9-441f-a1b3-297a2b48e975 service nova] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Received event network-changed-f9933e16-d9fb-47e4-9e9a-3ba073b1a35f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:12.730024 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-65dba6ca-a970-4db8-8c86-801402437693 req-3995c6d6-93e9-441f-a1b3-297a2b48e975 service nova] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Refreshing instance network info cache due to event network-changed-f9933e16-d9fb-47e4-9e9a-3ba073b1a35f. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:10:12.730238 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-65dba6ca-a970-4db8-8c86-801402437693 req-3995c6d6-93e9-441f-a1b3-297a2b48e975 service nova] Acquiring lock "refresh_cache-e8151422-37a0-4b7a-914f-34dc2979ead9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:10:12.730375 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-65dba6ca-a970-4db8-8c86-801402437693 req-3995c6d6-93e9-441f-a1b3-297a2b48e975 service nova] Acquired lock "refresh_cache-e8151422-37a0-4b7a-914f-34dc2979ead9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:10:12.730528 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-65dba6ca-a970-4db8-8c86-801402437693 req-3995c6d6-93e9-441f-a1b3-297a2b48e975 service nova] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Refreshing network info cache for port f9933e16-d9fb-47e4-9e9a-3ba073b1a35f {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:10:13.110790 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:13.137442 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:13.141569 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:13.151095 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:10:13.153877 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:10:13.166845 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:10:13.166845 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:10:13.172311 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:10:13.172311 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:13.182104 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:13.186108 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:13.196888 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:13.196888 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:13.196888 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:13.196888 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:13.196888 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:13.196888 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:13.196888 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:10:13.197097 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:13.197097 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:13.197097 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:13.197097 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:13.197097 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:13.197097 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:13.197097 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:10:13.206148 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:13.206148 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:13.206148 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:13.206148 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:13.206148 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:13.206148 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:13.206148 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:10:13.206310 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:13.206310 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:13.206310 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:13.206310 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:13.206310 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:13.206310 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:13.206310 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:10:13.233163 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-65dba6ca-a970-4db8-8c86-801402437693 req-3995c6d6-93e9-441f-a1b3-297a2b48e975 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:13.241919 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:13.261507 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e, portal: 192.168.40.100,3260]
May 28 01:10:13.261507 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e, portal: 192.168.40.100,3260] successful.
May 28 01:10:13.261507 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:13.267041 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e, portal: 192.168.50.100,3260]
May 28 01:10:13.267041 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e, portal: 192.168.50.100,3260] successful.
May 28 01:10:13.267041 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:13.276184 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:13.285125 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:13.300661 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:13.300661 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:13.300661 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:13.300661 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:13.300661 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:13.300661 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:13.300661 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:13.300661 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:13.300661 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:10:13.301012 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:13.301012 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:13.301012 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:13.301012 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:13.301012 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:13.301012 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:13.301012 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:13.301012 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:13.301012 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:10:13.301279 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:10:13.301279 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:10:13.302276 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] HCTL ('13', '-', '-', 0) found on session 157 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:10:13.302448 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:10:13.306173 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:13.306173 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:13.306173 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:13.306173 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:13.306173 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:13.306173 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:13.306173 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:13.306173 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:13.306173 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:10:13.306372 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:13.306372 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:13.306372 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:13.306372 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:13.306372 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:13.306372 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:13.306372 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:13.306372 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:13.306372 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:10:13.306752 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.187s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:10:13.306900 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:10:13.308358 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] HCTL ('14', '-', '-', 0) found on session 158 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:10:13.308358 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:10:13.320092 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching for a device in session 157 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:10:13.320404 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d4682bb-7f09-4e32-8669-e6904066213e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:10:13.338004 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e2f2745d-2ba4-4634-956f-91a13a6008a3 req-5519b02d-6f9a-4306-88bd-529d7e52a28d service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Received event network-vif-plugged-4e4e8646-56c4-4135-b704-3eda00177287 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:13.338004 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e2f2745d-2ba4-4634-956f-91a13a6008a3 req-5519b02d-6f9a-4306-88bd-529d7e52a28d service nova] Acquiring lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:13.338004 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e2f2745d-2ba4-4634-956f-91a13a6008a3 req-5519b02d-6f9a-4306-88bd-529d7e52a28d service nova] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:13.338004 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e2f2745d-2ba4-4634-956f-91a13a6008a3 req-5519b02d-6f9a-4306-88bd-529d7e52a28d service nova] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:13.338004 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e2f2745d-2ba4-4634-956f-91a13a6008a3 req-5519b02d-6f9a-4306-88bd-529d7e52a28d service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Processing event network-vif-plugged-4e4e8646-56c4-4135-b704-3eda00177287 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:10:13.338004 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Searching for a device in session 158 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:10:13.338004 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8d4682bb-7f09-4e32-8669-e6904066213e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:10:13.469216 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "e5a3d695-94e9-4ad7-aa07-b6cc865b30a1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:13.543312 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:13.545851 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:13.548478 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:13.572837 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:13.574633 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:13.641817 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-65dba6ca-a970-4db8-8c86-801402437693 req-3995c6d6-93e9-441f-a1b3-297a2b48e975 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:13.761882 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-65dba6ca-a970-4db8-8c86-801402437693 req-3995c6d6-93e9-441f-a1b3-297a2b48e975 service nova] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Updated VIF entry in instance network info cache for port f9933e16-d9fb-47e4-9e9a-3ba073b1a35f. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:10:13.762337 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-65dba6ca-a970-4db8-8c86-801402437693 req-3995c6d6-93e9-441f-a1b3-297a2b48e975 service nova] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Updating instance_info_cache with network_info: [{"id": "f9933e16-d9fb-47e4-9e9a-3ba073b1a35f", "address": "fa:16:3e:65:fa:89", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9933e16-d9", "ovs_interfaceid": "f9933e16-d9fb-47e4-9e9a-3ba073b1a35f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:10:13.995670 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00043543299989323714 future=<Future at 0x7c984c417d10 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:10:13.995754 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:10:13.996320 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Emitting event <LifecycleEvent: 1779930598.9950771, 412ac56c-f524-46c2-91eb-fa4672db46a9 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:10:13.996605 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] VM Stopped (Lifecycle Event)
May 28 01:10:14.121807 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:10:14.264020 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-65dba6ca-a970-4db8-8c86-801402437693 req-3995c6d6-93e9-441f-a1b3-297a2b48e975 service nova] Releasing lock "refresh_cache-e8151422-37a0-4b7a-914f-34dc2979ead9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:10:14.499172 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:10:14.541783 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "e5a3d695-94e9-4ad7-aa07-b6cc865b30a1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:14.541972 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "e5a3d695-94e9-4ad7-aa07-b6cc865b30a1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:14.542113 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Attaching volume 1e907dc0-271d-498d-a92b-3de8b69f2149 to /dev/vdb
May 28 01:10:14.578182 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:10:14.591099 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:10:14.615843 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:10:14.666720 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:10:14.667061 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:10:14.675440 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:10:14.677916 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe46:94e9', 'fe80::e873:f8ff:fed0:1522', 'fe80::fc16:3eff:fe94:f622', 'fe80::fc16:3eff:fec1:3f10', 'fe80::4c74:35ff:fe9d:cf4a', 'fe80::fc16:3eff:feb9:2b05', 'fe80::84b7:d3ff:feed:4f01', 'fe80::fc16:3eff:fe65:fa89', 'fe80::583c:47ff:fea3:281d', 'fe80::fc16:3eff:fed7:129f', 'fe80::49a:a7ff:fef7:c9e8', 'fe80::fc16:3eff:feab:f427', 'fe80::9c16:39ff:fe2e:9aef'] 
May 28 01:10:14.678048 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:10:14.678148 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:10:14.678349 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] <== get_connector_properties: return (99ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:10:14.678557 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Updating existing volume attachment record: 53dd318a-b401-444d-a89c-45e2a41d569a {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:10:14.801611 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930614.801222, 412ac56c-f524-46c2-91eb-fa4672db46a9 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:10:14.802258 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:10:14.802420 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] VM Started (Lifecycle Event)
May 28 01:10:14.809500 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Instance running successfully.
May 28 01:10:14.809829 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] finish_revert_migration finished successfully. {{(pid=98319) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12978}}
May 28 01:10:15.144660 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Found WWN 330000000d04168f1 for multipath device dm-7 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:10:15.144660 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:10:15.144660 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] <== connect_volume: return (4200ms) {'type': 'block', 'scsi_wwn': '330000000d04168f1', 'path': '/dev/dm-7', 'multipath_id': '330000000d04168f1'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:10:15.144660 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d04168f1', 'path': '/dev/dm-7', 'multipath_id': '330000000d04168f1'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:10:15.228689 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:10:15.229294 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149', 'iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1e907dc0-271d-498d-a92b-3de8b69f2149', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:10:15.229606 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:10:15.230185 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:10:15.230473 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149', 'iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1e907dc0-271d-498d-a92b-3de8b69f2149', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:10:15.242988 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:10:15.243641 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:10:15.245419 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:10:15.245419 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:10:15.245419 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:10:15.245419 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:10:15.255418 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:10:15.255418 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:15.263500 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:10:15.263500 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:15.275672 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149] added
May 28 01:10:15.275672 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:10:15.275672 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:10:15.275672 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:10:15.275672 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:10:15.275672 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:10:15.275672 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:15.275984 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:10:15.276587 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149] added
May 28 01:10:15.276587 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:10:15.276587 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:10:15.276587 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:10:15.276587 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:10:15.276587 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:10:15.276587 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:15.276800 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0319(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:10:15.277061 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:10:15.277492 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:10:15.277662 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0322(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:10:15.277814 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:10:15.305248 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:10:15.307066 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:10:15.387248 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-06bee9db-379d-417d-b062-6053243fb1a7 req-235843e4-748c-44c3-a3f2-731e21062451 service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Received event network-vif-plugged-4e4e8646-56c4-4135-b704-3eda00177287 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:15.387702 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-06bee9db-379d-417d-b062-6053243fb1a7 req-235843e4-748c-44c3-a3f2-731e21062451 service nova] Acquiring lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:15.387854 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-06bee9db-379d-417d-b062-6053243fb1a7 req-235843e4-748c-44c3-a3f2-731e21062451 service nova] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:15.387981 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-06bee9db-379d-417d-b062-6053243fb1a7 req-235843e4-748c-44c3-a3f2-731e21062451 service nova] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:15.388085 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-06bee9db-379d-417d-b062-6053243fb1a7 req-235843e4-748c-44c3-a3f2-731e21062451 service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] No waiting events found dispatching network-vif-plugged-4e4e8646-56c4-4135-b704-3eda00177287 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:10:15.388201 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-06bee9db-379d-417d-b062-6053243fb1a7 req-235843e4-748c-44c3-a3f2-731e21062451 service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Received unexpected event network-vif-plugged-4e4e8646-56c4-4135-b704-3eda00177287 for instance with vm_state resized and task_state resize_reverting.
May 28 01:10:15.649973 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:10:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-607844118',display_name='tempest-TestVolumeBootPattern-server-607844118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpattern-server-607844118',id=65,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLDywRMt1gYjzqU0nLt38yv/dkf6iz5rhLwqujx5EHrUiUYa0LEwAEl6oAEMxfnED+yXkyyB7J9zFdusIexML2cYEzV2m5bo9N6+7QjUI/1FFtVJ+XDyI2kpbVbncy1iQ==',key_name='tempest-TestVolumeBootPattern-1635525277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='050f928f1ce449d6a447cd343dc4ff80',ramdisk_id='',reservation_id='r-bnobdv7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1449742411',owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:10:08Z,user_data=None,user_id='0c803ddeaf4f4b3db07587419087b3b2',uuid=38636bdc-bca3-469b-80d7-05d8fa9e1c78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "939d5f23-c81b-44c1-a5b5-3facfb23bd08", "address": "fa:16:3e:58:6b:6d", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap939d5f23-c8", "ovs_interfaceid": "939d5f23-c81b-44c1-a5b5-3facfb23bd08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:10:15.650213 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converting VIF {"id": "939d5f23-c81b-44c1-a5b5-3facfb23bd08", "address": "fa:16:3e:58:6b:6d", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap939d5f23-c8", "ovs_interfaceid": "939d5f23-c81b-44c1-a5b5-3facfb23bd08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:10:15.650737 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:6b:6d,bridge_name='br-int',has_traffic_filtering=True,id=939d5f23-c81b-44c1-a5b5-3facfb23bd08,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap939d5f23-c8') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:10:15.651563 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lazy-loading 'pci_devices' on Instance uuid 38636bdc-bca3-469b-80d7-05d8fa9e1c78 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:10:15.809070 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] During sync_power_state the instance has a pending task (resize_reverting). Skip.
May 28 01:10:15.809328 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930615.809153, 412ac56c-f524-46c2-91eb-fa4672db46a9 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:10:15.809479 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] VM Paused (Lifecycle Event)
May 28 01:10:15.852182 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-ca6a68bf-d103-476b-b98f-d1696e5711ef tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Updating instance to original state: 'active'
May 28 01:10:16.154079 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] End _get_guest_xml xml=<domain type="qemu">
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:   <uuid>38636bdc-bca3-469b-80d7-05d8fa9e1c78</uuid>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:   <name>instance-00000041</name>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestVolumeBootPattern-server-607844118</nova:name>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:10:10</nova:creationTime>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       <nova:image uuid="">
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:         <nova:user uuid="0c803ddeaf4f4b3db07587419087b3b2">tempest-TestVolumeBootPattern-1449742411-project-member</nova:user>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:         <nova:project uuid="050f928f1ce449d6a447cd343dc4ff80">tempest-TestVolumeBootPattern-1449742411</nova:project>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:         <nova:port uuid="939d5f23-c81b-44c1-a5b5-3facfb23bd08">
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:     <system>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       <entry name="serial">38636bdc-bca3-469b-80d7-05d8fa9e1c78</entry>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       <entry name="uuid">38636bdc-bca3-469b-80d7-05d8fa9e1c78</entry>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:     </system>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:   <os>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:   </os>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:   <features>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:   </features>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:   <devices>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/38636bdc-bca3-469b-80d7-05d8fa9e1c78/disk.config"/>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:     </disk>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       <alias name="ua-8d4682bb-7f09-4e32-8669-e6904066213e"/>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-7"/>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       <serial>8d4682bb-7f09-4e32-8669-e6904066213e</serial>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:     </disk>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:58:6b:6d"/>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       <target dev="tap939d5f23-c8"/>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:     </interface>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/38636bdc-bca3-469b-80d7-05d8fa9e1c78/console.log" append="off"/>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:     </serial>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:     <video>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:     </video>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:     </rng>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:   </devices>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]: </domain>
May 28 01:10:16.154079 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:10:16.160641 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Preparing to wait for external event network-vif-plugged-939d5f23-c81b-44c1-a5b5-3facfb23bd08 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:10:16.160641 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "38636bdc-bca3-469b-80d7-05d8fa9e1c78-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:16.160641 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "38636bdc-bca3-469b-80d7-05d8fa9e1c78-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:16.160641 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "38636bdc-bca3-469b-80d7-05d8fa9e1c78-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:16.160641 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:10:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-607844118',display_name='tempest-TestVolumeBootPattern-server-607844118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpattern-server-607844118',id=65,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLDywRMt1gYjzqU0nLt38yv/dkf6iz5rhLwqujx5EHrUiUYa0LEwAEl6oAEMxfnED+yXkyyB7J9zFdusIexML2cYEzV2m5bo9N6+7QjUI/1FFtVJ+XDyI2kpbVbncy1iQ==',key_name='tempest-TestVolumeBootPattern-1635525277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='050f928f1ce449d6a447cd343dc4ff80',ramdisk_id='',reservation_id='r-bnobdv7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1449742411',owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:10:08Z,user_data=None,user_id='0c803ddeaf4f4b3db07587419087b3b2',uuid=38636bdc-bca3-469b-80d7-05d8fa9e1c78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "939d5f23-c81b-44c1-a5b5-3facfb23bd08", "address": "fa:16:3e:58:6b:6d", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap939d5f23-c8", "ovs_interfaceid": "939d5f23-c81b-44c1-a5b5-3facfb23bd08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:10:16.160641 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converting VIF {"id": "939d5f23-c81b-44c1-a5b5-3facfb23bd08", "address": "fa:16:3e:58:6b:6d", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap939d5f23-c8", "ovs_interfaceid": "939d5f23-c81b-44c1-a5b5-3facfb23bd08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:10:16.160641 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:6b:6d,bridge_name='br-int',has_traffic_filtering=True,id=939d5f23-c81b-44c1-a5b5-3facfb23bd08,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap939d5f23-c8') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:10:16.160641 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:6b:6d,bridge_name='br-int',has_traffic_filtering=True,id=939d5f23-c81b-44c1-a5b5-3facfb23bd08,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap939d5f23-c8') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:10:16.160641 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:16.160641 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:10:16.160641 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:10:16.160641 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:16.160641 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf8c06de-c9e3-5034-a167-30c4cc6815f9', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:10:16.160641 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:10:16.161605 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:16.164667 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:16.164874 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap939d5f23-c8, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:10:16.165342 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap939d5f23-c8, col_values=(('qos', UUID('0ce96ce5-92d4-4861-bfd5-b897a838a13b')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:10:16.165645 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap939d5f23-c8, col_values=(('external_ids', {'iface-id': '939d5f23-c81b-44c1-a5b5-3facfb23bd08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:6b:6d', 'vm-uuid': '38636bdc-bca3-469b-80d7-05d8fa9e1c78'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:10:16.169469 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:10:16.172484 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:16.172862 np0000001577 nova-compute[98319]: INFO os_vif [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:6b:6d,bridge_name='br-int',has_traffic_filtering=True,id=939d5f23-c81b-44c1-a5b5-3facfb23bd08,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap939d5f23-c8')
May 28 01:10:16.277874 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:10:16.278193 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:10:16.289968 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:10:16.289968 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:10:16.300164 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:10:16.300164 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:16.301915 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:16.312837 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:10:16.313266 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:16.317192 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930616.3168247, 412ac56c-f524-46c2-91eb-fa4672db46a9 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:10:16.317322 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] VM Resumed (Lifecycle Event)
May 28 01:10:16.325195 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:16.325195 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:16.325195 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:16.325195 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:16.325195 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:16.325195 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:16.325195 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:16.325195 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:16.325195 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:10:16.325616 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:16.325616 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:16.325616 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:16.325616 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:16.325616 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:16.325616 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:16.325616 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:16.325616 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:16.325616 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:10:16.330948 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:16.330948 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:16.330948 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:16.330948 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:16.330948 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:16.330948 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:16.330948 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:16.330948 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:16.330948 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:10:16.331302 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:16.331302 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:16.331302 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:16.331302 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:16.331302 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:16.331302 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:16.331302 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:16.331302 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:16.331302 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:10:16.366932 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149, portal: 192.168.40.100,3260]
May 28 01:10:16.366932 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149, portal: 192.168.40.100,3260] successful.
May 28 01:10:16.366932 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:16.372634 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149, portal: 192.168.50.100,3260]
May 28 01:10:16.372634 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149, portal: 192.168.50.100,3260] successful.
May 28 01:10:16.372634 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:16.381167 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:16.390850 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:16.402570 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:16.402570 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:16.402570 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:16.402570 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:16.402570 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:16.402570 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:16.402570 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:16.402570 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:16.402570 np0000001577 nova-compute[98319]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149 (non-flash)
May 28 01:10:16.402570 np0000001577 nova-compute[98319]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149 (non-flash)
May 28 01:10:16.402570 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:10:16.402570 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:16.402570 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:16.402570 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:16.402570 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:16.402570 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:16.402570 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:16.402570 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:16.402570 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:16.402570 np0000001577 nova-compute[98319]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149 (non-flash)
May 28 01:10:16.402570 np0000001577 nova-compute[98319]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149 (non-flash)
May 28 01:10:16.402570 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:10:16.402570 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:10:16.402570 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:10:16.404042 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] HCTL ('15', '-', '-', 0) found on session 159 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:10:16.404157 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:10:16.414346 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:16.414346 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:16.414346 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:16.414346 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:16.414346 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:16.414346 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:16.414346 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:16.414346 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:16.414346 np0000001577 nova-compute[98319]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149 (non-flash)
May 28 01:10:16.414346 np0000001577 nova-compute[98319]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149 (non-flash)
May 28 01:10:16.414346 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:10:16.414790 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:16.414790 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:16.414790 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:16.414790 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:16.414790 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:16.414790 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:16.414790 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:16.414790 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:16.414790 np0000001577 nova-compute[98319]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149 (non-flash)
May 28 01:10:16.414790 np0000001577 nova-compute[98319]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149 (non-flash)
May 28 01:10:16.414790 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:10:16.414790 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:10:16.414790 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:10:16.415695 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] HCTL ('16', '-', '-', 0) found on session 160 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:10:16.415812 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:10:16.425947 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Searching for a device in session 159 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:10:16.428010 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1e907dc0-271d-498d-a92b-3de8b69f2149', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:10:16.436535 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Searching for a device in session 160 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:10:16.436535 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1e907dc0-271d-498d-a92b-3de8b69f2149', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:10:16.517310 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:16.757655 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "412ac56c-f524-46c2-91eb-fa4672db46a9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:16.757803 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:16.821410 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:10:16.823634 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:10:17.245159 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:10:17.260230 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Detaching volume f7725186-2460-4632-868e-1cb41674f3f0
May 28 01:10:17.295658 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Attempting to driver detach volume f7725186-2460-4632-868e-1cb41674f3f0 from mountpoint /dev/vdb
May 28 01:10:17.326002 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7725186-2460-4632-868e-1cb41674f3f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-2'}, 'status': 'attaching', 'instance': '412ac56c-f524-46c2-91eb-fa4672db46a9', 'attached_at': '2026-05-28T01:10:07.000000', 'detached_at': '', 'volume_id': 'f7725186-2460-4632-868e-1cb41674f3f0', 'serial': 'f7725186-2460-4632-868e-1cb41674f3f0'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 01:10:17.330450 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Found disk vdb by alias ua-f7725186-2460-4632-868e-1cb41674f3f0 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:10:17.331779 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Found disk vdb by alias ua-f7725186-2460-4632-868e-1cb41674f3f0 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:10:17.331948 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Attempting to detach device vdb from instance 412ac56c-f524-46c2-91eb-fa4672db46a9 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:10:17.332247 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:10:17.332247 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:10:17.332247 np0000001577 nova-compute[98319]:   <alias name="ua-f7725186-2460-4632-868e-1cb41674f3f0"/>
May 28 01:10:17.332247 np0000001577 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-2"/>
May 28 01:10:17.332247 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:10:17.332247 np0000001577 nova-compute[98319]:   <serial>f7725186-2460-4632-868e-1cb41674f3f0</serial>
May 28 01:10:17.332247 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 01:10:17.332247 np0000001577 nova-compute[98319]:   <encryption format="luks">
May 28 01:10:17.332247 np0000001577 nova-compute[98319]:     <secret type="passphrase" uuid="7210f4aa-7cba-46e3-ae37-603ee1977b92"/>
May 28 01:10:17.332247 np0000001577 nova-compute[98319]:   </encryption>
May 28 01:10:17.332247 np0000001577 nova-compute[98319]: </disk>
May 28 01:10:17.332247 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:10:17.337149 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Successfully detached device vdb from instance 412ac56c-f524-46c2-91eb-fa4672db46a9 from the persistent domain config.
May 28 01:10:17.337449 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] (1/8): Attempting to detach device vdb with device alias ua-f7725186-2460-4632-868e-1cb41674f3f0 from instance 412ac56c-f524-46c2-91eb-fa4672db46a9 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:10:17.337780 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:10:17.337780 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:10:17.337780 np0000001577 nova-compute[98319]:   <alias name="ua-f7725186-2460-4632-868e-1cb41674f3f0"/>
May 28 01:10:17.337780 np0000001577 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-2"/>
May 28 01:10:17.337780 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:10:17.337780 np0000001577 nova-compute[98319]:   <serial>f7725186-2460-4632-868e-1cb41674f3f0</serial>
May 28 01:10:17.337780 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 01:10:17.337780 np0000001577 nova-compute[98319]:   <encryption format="luks">
May 28 01:10:17.337780 np0000001577 nova-compute[98319]:     <secret type="passphrase" uuid="7210f4aa-7cba-46e3-ae37-603ee1977b92"/>
May 28 01:10:17.337780 np0000001577 nova-compute[98319]:   </encryption>
May 28 01:10:17.337780 np0000001577 nova-compute[98319]: </disk>
May 28 01:10:17.337780 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:10:17.688560 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:10:17.688690 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:10:17.688784 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] No VIF found with MAC fa:16:3e:58:6b:6d, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:10:17.689211 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Using config drive
May 28 01:10:18.195381 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:18.265754 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Found WWN 33000000042cdab36 for multipath device dm-10 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:10:18.266155 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:10:18.266155 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '33000000042cdab36', 'path': '/dev/dm-10', 'multipath_id': '33000000042cdab36'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:10:18.266246 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000042cdab36', 'path': '/dev/dm-10', 'multipath_id': '33000000042cdab36'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:10:18.277667 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lazy-loading 'flavor' on Instance uuid e5a3d695-94e9-4ad7-aa07-b6cc865b30a1 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:10:18.325486 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Creating config drive at /opt/stack/data/nova/instances/38636bdc-bca3-469b-80d7-05d8fa9e1c78/disk.config
May 28 01:10:18.328217 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/38636bdc-bca3-469b-80d7-05d8fa9e1c78/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgxpygv53 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:10:18.382500 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/38636bdc-bca3-469b-80d7-05d8fa9e1c78/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgxpygv53" returned: 0 in 0.054s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:10:18.748485 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:18.771504 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:18.774450 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:18.781488 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Attempting to attach volume 1e907dc0-271d-498d-a92b-3de8b69f2149 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:10:18.789875 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:10:18.789875 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:10:18.789875 np0000001577 nova-compute[98319]:   <alias name="ua-1e907dc0-271d-498d-a92b-3de8b69f2149"/>
May 28 01:10:18.789875 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-10"/>
May 28 01:10:18.789875 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:10:18.789875 np0000001577 nova-compute[98319]:   <serial>1e907dc0-271d-498d-a92b-3de8b69f2149</serial>
May 28 01:10:18.789875 np0000001577 nova-compute[98319]: </disk>
May 28 01:10:18.789875 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:10:18.871699 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:18.908834 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:18.909645 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:19.001898 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2b47e65d-3b76-46b6-893d-300d6d28026a req-5076e923-aa3b-4c59-85c7-25217adf1cdd service nova] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Received event network-vif-plugged-939d5f23-c81b-44c1-a5b5-3facfb23bd08 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:19.002120 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2b47e65d-3b76-46b6-893d-300d6d28026a req-5076e923-aa3b-4c59-85c7-25217adf1cdd service nova] Acquiring lock "38636bdc-bca3-469b-80d7-05d8fa9e1c78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:19.003892 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2b47e65d-3b76-46b6-893d-300d6d28026a req-5076e923-aa3b-4c59-85c7-25217adf1cdd service nova] Lock "38636bdc-bca3-469b-80d7-05d8fa9e1c78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:19.003892 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2b47e65d-3b76-46b6-893d-300d6d28026a req-5076e923-aa3b-4c59-85c7-25217adf1cdd service nova] Lock "38636bdc-bca3-469b-80d7-05d8fa9e1c78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:19.003892 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2b47e65d-3b76-46b6-893d-300d6d28026a req-5076e923-aa3b-4c59-85c7-25217adf1cdd service nova] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Processing event network-vif-plugged-939d5f23-c81b-44c1-a5b5-3facfb23bd08 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:10:19.577050 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:10:19.577460 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930619.577085, 38636bdc-bca3-469b-80d7-05d8fa9e1c78 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:10:19.577602 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] VM Started (Lifecycle Event)
May 28 01:10:19.579431 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:10:19.584617 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Instance spawned successfully.
May 28 01:10:19.584826 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:10:20.079727 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:10:20.084418 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:10:20.093083 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:10:20.093208 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:10:20.093449 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:10:20.093644 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:10:20.093847 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:10:20.094060 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:10:20.532882 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:10:20.533043 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:10:20.533138 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:10:20.533320 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] No VIF found with MAC fa:16:3e:94:f6:22, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:10:20.586568 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:10:20.587002 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930620.586734, 38636bdc-bca3-469b-80d7-05d8fa9e1c78 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:10:20.587002 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] VM Paused (Lifecycle Event)
May 28 01:10:20.600816 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Took 9.69 seconds to spawn the instance on the hypervisor.
May 28 01:10:20.601887 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:10:21.089057 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:10:21.093015 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930621.0928109, 38636bdc-bca3-469b-80d7-05d8fa9e1c78 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:10:21.093130 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] VM Resumed (Lifecycle Event)
May 28 01:10:21.112131 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Took 17.06 seconds to build instance.
May 28 01:10:21.167380 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:21.281091 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d6b4f03e-ef70-420c-8959-1b96f6059f26 req-7c6fab2e-66dc-4932-9da5-057b0bb3529b service nova] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Received event network-vif-plugged-939d5f23-c81b-44c1-a5b5-3facfb23bd08 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:21.282997 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d6b4f03e-ef70-420c-8959-1b96f6059f26 req-7c6fab2e-66dc-4932-9da5-057b0bb3529b service nova] Acquiring lock "38636bdc-bca3-469b-80d7-05d8fa9e1c78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:21.283215 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d6b4f03e-ef70-420c-8959-1b96f6059f26 req-7c6fab2e-66dc-4932-9da5-057b0bb3529b service nova] Lock "38636bdc-bca3-469b-80d7-05d8fa9e1c78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:21.283365 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d6b4f03e-ef70-420c-8959-1b96f6059f26 req-7c6fab2e-66dc-4932-9da5-057b0bb3529b service nova] Lock "38636bdc-bca3-469b-80d7-05d8fa9e1c78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:21.284457 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d6b4f03e-ef70-420c-8959-1b96f6059f26 req-7c6fab2e-66dc-4932-9da5-057b0bb3529b service nova] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] No waiting events found dispatching network-vif-plugged-939d5f23-c81b-44c1-a5b5-3facfb23bd08 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:10:21.284457 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-d6b4f03e-ef70-420c-8959-1b96f6059f26 req-7c6fab2e-66dc-4932-9da5-057b0bb3529b service nova] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Received unexpected event network-vif-plugged-939d5f23-c81b-44c1-a5b5-3facfb23bd08 for instance with vm_state active and task_state None.
May 28 01:10:21.519810 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:21.595692 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:10:21.600848 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:10:21.613620 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "38636bdc-bca3-469b-80d7-05d8fa9e1c78" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.589s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:22.081113 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a2b16ebe-cced-4a60-9477-54b7b4db1299 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "e5a3d695-94e9-4ad7-aa07-b6cc865b30a1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.539s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:22.341823 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-f7725186-2460-4632-868e-1cb41674f3f0 for instance 412ac56c-f524-46c2-91eb-fa4672db46a9 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:10:22.672629 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9570ff8a-3bb5-4220-91a9-48b43840ed4b req-8e83d432-c3d7-49fc-b9da-cfd0c0d049a0 service nova] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Received event network-changed-939d5f23-c81b-44c1-a5b5-3facfb23bd08 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:22.673040 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9570ff8a-3bb5-4220-91a9-48b43840ed4b req-8e83d432-c3d7-49fc-b9da-cfd0c0d049a0 service nova] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Refreshing instance network info cache due to event network-changed-939d5f23-c81b-44c1-a5b5-3facfb23bd08. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:10:22.673040 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9570ff8a-3bb5-4220-91a9-48b43840ed4b req-8e83d432-c3d7-49fc-b9da-cfd0c0d049a0 service nova] Acquiring lock "refresh_cache-38636bdc-bca3-469b-80d7-05d8fa9e1c78" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:10:22.673040 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9570ff8a-3bb5-4220-91a9-48b43840ed4b req-8e83d432-c3d7-49fc-b9da-cfd0c0d049a0 service nova] Acquired lock "refresh_cache-38636bdc-bca3-469b-80d7-05d8fa9e1c78" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:10:22.673295 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-9570ff8a-3bb5-4220-91a9-48b43840ed4b req-8e83d432-c3d7-49fc-b9da-cfd0c0d049a0 service nova] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Refreshing network info cache for port 939d5f23-c81b-44c1-a5b5-3facfb23bd08 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:10:23.179699 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-9570ff8a-3bb5-4220-91a9-48b43840ed4b req-8e83d432-c3d7-49fc-b9da-cfd0c0d049a0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:23.473677 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-9570ff8a-3bb5-4220-91a9-48b43840ed4b req-8e83d432-c3d7-49fc-b9da-cfd0c0d049a0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:23.595434 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-9570ff8a-3bb5-4220-91a9-48b43840ed4b req-8e83d432-c3d7-49fc-b9da-cfd0c0d049a0 service nova] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Updated VIF entry in instance network info cache for port 939d5f23-c81b-44c1-a5b5-3facfb23bd08. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:10:23.595681 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-9570ff8a-3bb5-4220-91a9-48b43840ed4b req-8e83d432-c3d7-49fc-b9da-cfd0c0d049a0 service nova] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Updating instance_info_cache with network_info: [{"id": "939d5f23-c81b-44c1-a5b5-3facfb23bd08", "address": "fa:16:3e:58:6b:6d", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap939d5f23-c8", "ovs_interfaceid": "939d5f23-c81b-44c1-a5b5-3facfb23bd08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:10:24.097470 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9570ff8a-3bb5-4220-91a9-48b43840ed4b req-8e83d432-c3d7-49fc-b9da-cfd0c0d049a0 service nova] Releasing lock "refresh_cache-38636bdc-bca3-469b-80d7-05d8fa9e1c78" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:10:24.663630 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "e5a3d695-94e9-4ad7-aa07-b6cc865b30a1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:24.663806 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "e5a3d695-94e9-4ad7-aa07-b6cc865b30a1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:25.166110 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Detaching volume 1e907dc0-271d-498d-a92b-3de8b69f2149
May 28 01:10:25.197393 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Attempting to driver detach volume 1e907dc0-271d-498d-a92b-3de8b69f2149 from mountpoint /dev/vdb
May 28 01:10:25.201696 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Found disk vdb by alias ua-1e907dc0-271d-498d-a92b-3de8b69f2149 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:10:25.202668 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Found disk vdb by alias ua-1e907dc0-271d-498d-a92b-3de8b69f2149 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:10:25.202766 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Attempting to detach device vdb from instance e5a3d695-94e9-4ad7-aa07-b6cc865b30a1 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:10:25.202989 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:10:25.202989 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:10:25.202989 np0000001577 nova-compute[98319]:   <alias name="ua-1e907dc0-271d-498d-a92b-3de8b69f2149"/>
May 28 01:10:25.202989 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-10"/>
May 28 01:10:25.202989 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:10:25.202989 np0000001577 nova-compute[98319]:   <serial>1e907dc0-271d-498d-a92b-3de8b69f2149</serial>
May 28 01:10:25.202989 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:10:25.202989 np0000001577 nova-compute[98319]: </disk>
May 28 01:10:25.202989 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:10:25.211316 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Successfully detached device vdb from instance e5a3d695-94e9-4ad7-aa07-b6cc865b30a1 from the persistent domain config.
May 28 01:10:25.211414 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] (1/8): Attempting to detach device vdb with device alias ua-1e907dc0-271d-498d-a92b-3de8b69f2149 from instance e5a3d695-94e9-4ad7-aa07-b6cc865b30a1 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:10:25.211629 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:10:25.211629 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:10:25.211629 np0000001577 nova-compute[98319]:   <alias name="ua-1e907dc0-271d-498d-a92b-3de8b69f2149"/>
May 28 01:10:25.211629 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-10"/>
May 28 01:10:25.211629 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:10:25.211629 np0000001577 nova-compute[98319]:   <serial>1e907dc0-271d-498d-a92b-3de8b69f2149</serial>
May 28 01:10:25.211629 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:10:25.211629 np0000001577 nova-compute[98319]: </disk>
May 28 01:10:25.211629 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:10:25.666619 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930625.6662123, e5a3d695-94e9-4ad7-aa07-b6cc865b30a1 => ua-1e907dc0-271d-498d-a92b-3de8b69f2149> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:10:25.667398 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-1e907dc0-271d-498d-a92b-3de8b69f2149 for instance e5a3d695-94e9-4ad7-aa07-b6cc865b30a1 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:10:25.669687 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Successfully detached device vdb from instance e5a3d695-94e9-4ad7-aa07-b6cc865b30a1 from the live domain config.
May 28 01:10:25.670704 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:10:25.671109 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149', 'iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1e907dc0-271d-498d-a92b-3de8b69f2149', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:10:25.671287 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:10:25.671723 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:10:25.672106 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149', 'iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1e907dc0-271d-498d-a92b-3de8b69f2149', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:10:25.672291 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:10:25.702392 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:25.702392 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:25.702392 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:25.702392 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:25.702392 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:25.702392 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:25.702392 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:25.702392 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:25.702392 np0000001577 nova-compute[98319]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149 (non-flash)
May 28 01:10:25.702392 np0000001577 nova-compute[98319]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149 (non-flash)
May 28 01:10:25.702392 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:10:25.702744 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:25.702744 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:25.702744 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:25.702744 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:25.702744 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:25.702744 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:25.702744 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:25.702744 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:25.702744 np0000001577 nova-compute[98319]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149 (non-flash)
May 28 01:10:25.702744 np0000001577 nova-compute[98319]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149 (non-flash)
May 28 01:10:25.702744 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:10:25.702965 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', '146'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', '147'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048', '153'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048', '154'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', '155'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', '156'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e', '157'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e', '158'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149', '159'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149', '160')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:10:25.703042 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149', '159')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:10:25.704390 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149', '160')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:10:25.705493 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c98704b5f80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149'): ({'sdk'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:10:25.705921 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Removing multipathed devices sdj, sdk {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:10:25.706202 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Flush multipath device 33000000042cdab36 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:10:25.746097 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:10:25.789191 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:10:25.849616 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:10:25.849616 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:10:25.849616 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:10:25.860743 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:10:25.860743 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:10:25.871102 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:25.899611 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 159, target: iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149, portal: 192.168.40.100,3260]
May 28 01:10:25.899611 np0000001577 nova-compute[98319]: Logout of [sid: 159, target: iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149, portal: 192.168.40.100,3260] successful.
May 28 01:10:25.899611 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:25.917663 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:25.928245 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:25.955708 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 160, target: iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149, portal: 192.168.50.100,3260]
May 28 01:10:25.955708 np0000001577 nova-compute[98319]: Logout of [sid: 160, target: iqn.2023-03.storpool.com:os--volume-1e907dc0-271d-498d-a92b-3de8b69f2149, portal: 192.168.50.100,3260] successful.
May 28 01:10:25.955708 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:25.976095 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:25.976095 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:10:25.976095 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] <== disconnect_volume: return (301ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:10:25.976095 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:10:26.169188 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:26.515640 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lazy-loading 'flavor' on Instance uuid e5a3d695-94e9-4ad7-aa07-b6cc865b30a1 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:10:26.520689 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:27.513955 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:27.519882 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-95259e3f-52e4-469f-bc53-2755d1a2e0f5 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "e5a3d695-94e9-4ad7-aa07-b6cc865b30a1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.856s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:27.673751 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1dd643a8-f100-4cb3-bc65-d18f65e267ac req-12342640-0a1d-4847-b335-f418eab45485 service nova] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Received event network-changed-78589b79-8f25-4f7e-a6c8-96e5a5c076b8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:27.674911 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1dd643a8-f100-4cb3-bc65-d18f65e267ac req-12342640-0a1d-4847-b335-f418eab45485 service nova] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Refreshing instance network info cache due to event network-changed-78589b79-8f25-4f7e-a6c8-96e5a5c076b8. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:10:27.675074 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1dd643a8-f100-4cb3-bc65-d18f65e267ac req-12342640-0a1d-4847-b335-f418eab45485 service nova] Acquiring lock "refresh_cache-e5a3d695-94e9-4ad7-aa07-b6cc865b30a1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:10:27.675151 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1dd643a8-f100-4cb3-bc65-d18f65e267ac req-12342640-0a1d-4847-b335-f418eab45485 service nova] Acquired lock "refresh_cache-e5a3d695-94e9-4ad7-aa07-b6cc865b30a1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:10:27.675296 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-1dd643a8-f100-4cb3-bc65-d18f65e267ac req-12342640-0a1d-4847-b335-f418eab45485 service nova] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Refreshing network info cache for port 78589b79-8f25-4f7e-a6c8-96e5a5c076b8 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:10:28.181627 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-1dd643a8-f100-4cb3-bc65-d18f65e267ac req-12342640-0a1d-4847-b335-f418eab45485 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:28.189816 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-66f19c70-1f1f-49a1-8598-9b7293d0da46 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "e5a3d695-94e9-4ad7-aa07-b6cc865b30a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:28.189995 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-66f19c70-1f1f-49a1-8598-9b7293d0da46 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "e5a3d695-94e9-4ad7-aa07-b6cc865b30a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:28.190174 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-66f19c70-1f1f-49a1-8598-9b7293d0da46 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "e5a3d695-94e9-4ad7-aa07-b6cc865b30a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:28.190298 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-66f19c70-1f1f-49a1-8598-9b7293d0da46 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "e5a3d695-94e9-4ad7-aa07-b6cc865b30a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:28.190399 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-66f19c70-1f1f-49a1-8598-9b7293d0da46 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "e5a3d695-94e9-4ad7-aa07-b6cc865b30a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:28.192223 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-66f19c70-1f1f-49a1-8598-9b7293d0da46 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Terminating instance
May 28 01:10:28.461146 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-1dd643a8-f100-4cb3-bc65-d18f65e267ac req-12342640-0a1d-4847-b335-f418eab45485 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:28.581363 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-1dd643a8-f100-4cb3-bc65-d18f65e267ac req-12342640-0a1d-4847-b335-f418eab45485 service nova] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Updated VIF entry in instance network info cache for port 78589b79-8f25-4f7e-a6c8-96e5a5c076b8. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:10:28.581835 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-1dd643a8-f100-4cb3-bc65-d18f65e267ac req-12342640-0a1d-4847-b335-f418eab45485 service nova] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Updating instance_info_cache with network_info: [{"id": "78589b79-8f25-4f7e-a6c8-96e5a5c076b8", "address": "fa:16:3e:94:f6:22", "network": {"id": "8bf5903d-3155-48fb-98dd-859e96b349d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1733749547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92f49e31415146d281ba6b462016d5d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78589b79-8f", "ovs_interfaceid": "78589b79-8f25-4f7e-a6c8-96e5a5c076b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:10:28.694691 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-66f19c70-1f1f-49a1-8598-9b7293d0da46 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:10:28.717746 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:28.740929 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:28.868429 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ddbc9973-9adf-41e5-87b8-e7cc7ef63e6a req-39dea4c1-694a-46bd-a242-0ce991c2e430 service nova] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Received event network-vif-unplugged-78589b79-8f25-4f7e-a6c8-96e5a5c076b8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:28.868429 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ddbc9973-9adf-41e5-87b8-e7cc7ef63e6a req-39dea4c1-694a-46bd-a242-0ce991c2e430 service nova] Acquiring lock "e5a3d695-94e9-4ad7-aa07-b6cc865b30a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:28.868429 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ddbc9973-9adf-41e5-87b8-e7cc7ef63e6a req-39dea4c1-694a-46bd-a242-0ce991c2e430 service nova] Lock "e5a3d695-94e9-4ad7-aa07-b6cc865b30a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:28.868429 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ddbc9973-9adf-41e5-87b8-e7cc7ef63e6a req-39dea4c1-694a-46bd-a242-0ce991c2e430 service nova] Lock "e5a3d695-94e9-4ad7-aa07-b6cc865b30a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:28.868429 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ddbc9973-9adf-41e5-87b8-e7cc7ef63e6a req-39dea4c1-694a-46bd-a242-0ce991c2e430 service nova] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] No waiting events found dispatching network-vif-unplugged-78589b79-8f25-4f7e-a6c8-96e5a5c076b8 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:10:28.868429 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ddbc9973-9adf-41e5-87b8-e7cc7ef63e6a req-39dea4c1-694a-46bd-a242-0ce991c2e430 service nova] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Received event network-vif-unplugged-78589b79-8f25-4f7e-a6c8-96e5a5c076b8 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:10:28.882878 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:28.888880 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:28.939930 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Acquiring lock "227baa5d-04b6-44bc-bf06-412f2874f947" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:28.940244 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Lock "227baa5d-04b6-44bc-bf06-412f2874f947" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:28.940244 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Acquiring lock "227baa5d-04b6-44bc-bf06-412f2874f947-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:28.941638 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Lock "227baa5d-04b6-44bc-bf06-412f2874f947-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:28.941638 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Lock "227baa5d-04b6-44bc-bf06-412f2874f947-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:28.943120 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Terminating instance
May 28 01:10:29.039570 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999710862000029 future=<Future at 0x7c984c5b5c70 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:10:29.039570 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.99909532699985 future=<Future at 0x7c984c5b5c70 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:10:29.039570 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999003466999966 future=<Future at 0x7c984c5b5c70 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:10:29.039570 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Instance destroyed successfully.
May 28 01:10:29.040977 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-66f19c70-1f1f-49a1-8598-9b7293d0da46 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lazy-loading 'resources' on Instance uuid e5a3d695-94e9-4ad7-aa07-b6cc865b30a1 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:10:29.083723 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1dd643a8-f100-4cb3-bc65-d18f65e267ac req-12342640-0a1d-4847-b335-f418eab45485 service nova] Releasing lock "refresh_cache-e5a3d695-94e9-4ad7-aa07-b6cc865b30a1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:10:29.445433 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:10:29.484561 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:29.500115 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:29.509763 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:29.535845 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:29.538985 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:29.543640 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-66f19c70-1f1f-49a1-8598-9b7293d0da46 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:09:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1244396529',display_name='tempest-TestStampPattern-server-1244396529',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-teststamppattern-server-1244396529',id=61,image_ref='0109a854-afbc-41f9-bf88-afd37822f089',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY7LZ57I2hyMdKVO08J6JSzhqiI0ZTtKrP9nyz1z53fPuESHxKL03vnaQuF8H5q84b516fImHzGWaVzsCTjOGesM9ULlqWAaR2gPi+wEj2GKOu9g0fSmRD2xOlCcqeMHw==',key_name='tempest-TestStampPattern-1233377666',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:09:34Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92f49e31415146d281ba6b462016d5d4',ramdisk_id='',reservation_id='r-54mtg7ux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='4d7b37c7-b091-44f7-a330-4e55e2b1e348',image_min_disk='1',image_min_ram='0',image_owner_id='92f49e31415146d281ba6b462016d5d4',image_owner_project_name='tempest-TestStampPattern-1316789919',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1316789919-project-member',image_user_id='9258145be7414d88accbdb4802619956',owner_project_name='tempest-TestStampPattern-1316789919',owner_user_name='tempest-TestStampPattern-1316789919-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:09:34Z,user_data=None,user_id='9258145be7414d88accbdb4802619956',uuid=e5a3d695-94e9-4ad7-aa07-b6cc865b30a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78589b79-8f25-4f7e-a6c8-96e5a5c076b8", "address": "fa:16:3e:94:f6:22", "network": {"id": "8bf5903d-3155-48fb-98dd-859e96b349d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1733749547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92f49e31415146d281ba6b462016d5d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78589b79-8f", "ovs_interfaceid": "78589b79-8f25-4f7e-a6c8-96e5a5c076b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:10:29.543640 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-66f19c70-1f1f-49a1-8598-9b7293d0da46 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Converting VIF {"id": "78589b79-8f25-4f7e-a6c8-96e5a5c076b8", "address": "fa:16:3e:94:f6:22", "network": {"id": "8bf5903d-3155-48fb-98dd-859e96b349d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1733749547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92f49e31415146d281ba6b462016d5d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap78589b79-8f", "ovs_interfaceid": "78589b79-8f25-4f7e-a6c8-96e5a5c076b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:10:29.544210 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-66f19c70-1f1f-49a1-8598-9b7293d0da46 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:f6:22,bridge_name='br-int',has_traffic_filtering=True,id=78589b79-8f25-4f7e-a6c8-96e5a5c076b8,network=Network(8bf5903d-3155-48fb-98dd-859e96b349d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78589b79-8f') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:10:29.544690 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-66f19c70-1f1f-49a1-8598-9b7293d0da46 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:f6:22,bridge_name='br-int',has_traffic_filtering=True,id=78589b79-8f25-4f7e-a6c8-96e5a5c076b8,network=Network(8bf5903d-3155-48fb-98dd-859e96b349d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78589b79-8f') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:10:29.547605 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:29.547825 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78589b79-8f, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:10:29.552668 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:10:29.554255 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:29.555103 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:29.555243 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bf340229-7439-4e89-896c-b4ed1c4ac1dd) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:10:29.555662 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:29.556083 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:10:29.562184 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:29.567045 np0000001577 nova-compute[98319]: INFO os_vif [None req-66f19c70-1f1f-49a1-8598-9b7293d0da46 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:f6:22,bridge_name='br-int',has_traffic_filtering=True,id=78589b79-8f25-4f7e-a6c8-96e5a5c076b8,network=Network(8bf5903d-3155-48fb-98dd-859e96b349d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78589b79-8f')
May 28 01:10:29.567045 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-66f19c70-1f1f-49a1-8598-9b7293d0da46 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Deleting instance files /opt/stack/data/nova/instances/e5a3d695-94e9-4ad7-aa07-b6cc865b30a1_del
May 28 01:10:29.567045 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-66f19c70-1f1f-49a1-8598-9b7293d0da46 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Deletion of /opt/stack/data/nova/instances/e5a3d695-94e9-4ad7-aa07-b6cc865b30a1_del complete
May 28 01:10:29.646775 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-66a4f7d0-556a-4657-bad6-ed70becaa597 req-7239aa8b-7b22-4688-8a84-020da108e8de service nova] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Received event network-vif-unplugged-6aa6ae79-94a7-4711-b0eb-c55753c3cae7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:29.647192 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-66a4f7d0-556a-4657-bad6-ed70becaa597 req-7239aa8b-7b22-4688-8a84-020da108e8de service nova] Acquiring lock "227baa5d-04b6-44bc-bf06-412f2874f947-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:29.648969 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-66a4f7d0-556a-4657-bad6-ed70becaa597 req-7239aa8b-7b22-4688-8a84-020da108e8de service nova] Lock "227baa5d-04b6-44bc-bf06-412f2874f947-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:29.649104 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-66a4f7d0-556a-4657-bad6-ed70becaa597 req-7239aa8b-7b22-4688-8a84-020da108e8de service nova] Lock "227baa5d-04b6-44bc-bf06-412f2874f947-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:29.649224 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-66a4f7d0-556a-4657-bad6-ed70becaa597 req-7239aa8b-7b22-4688-8a84-020da108e8de service nova] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] No waiting events found dispatching network-vif-unplugged-6aa6ae79-94a7-4711-b0eb-c55753c3cae7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:10:29.649335 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-66a4f7d0-556a-4657-bad6-ed70becaa597 req-7239aa8b-7b22-4688-8a84-020da108e8de service nova] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Received event network-vif-unplugged-6aa6ae79-94a7-4711-b0eb-c55753c3cae7 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:10:29.770840 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.99971821500003 future=<Future at 0x7c984c5db830 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:10:29.774524 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Instance destroyed successfully.
May 28 01:10:29.775651 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Lazy-loading 'resources' on Instance uuid 227baa5d-04b6-44bc-bf06-412f2874f947 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:10:30.071501 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-66f19c70-1f1f-49a1-8598-9b7293d0da46 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Took 1.38 seconds to destroy the instance on the hypervisor.
May 28 01:10:30.071843 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-66f19c70-1f1f-49a1-8598-9b7293d0da46 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:10:30.072192 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:10:30.072276 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:10:30.072474 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:30.164702 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:30.278902 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:09:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-instance-1615945330',display_name='tempest-instance-1615945330',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-instance-1615945330',id=62,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzZFz5iRPdcSxPwNZ9r7GJd/rDuFgrBfQhJmBZe50aBQCoO03VLW5b05BZptTp9XzHnmmerM/DWs3VbG7EO1eBlDSxYBf3oEmpMiGljUt12CsMj924QZWzMboKHkqRAlg==',key_name='tempest-keypair-1835143746',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:10:00Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11e4b1d73ecb40dfa464da2993358b3f',ramdisk_id='',reservation_id='r-rm0e0bza',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-876673241',owner_user_name='tempest-VolumesBackupsTest-876673241-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:10:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='982435d9a6494fbd8f260955ada95c32',uuid=227baa5d-04b6-44bc-bf06-412f2874f947,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6aa6ae79-94a7-4711-b0eb-c55753c3cae7", "address": "fa:16:3e:c1:3f:10", "network": {"id": "0d87381a-1454-4b59-b8c7-3a13e0fcd476", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1915607964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e4b1d73ecb40dfa464da2993358b3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa6ae79-94", "ovs_interfaceid": "6aa6ae79-94a7-4711-b0eb-c55753c3cae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:10:30.279056 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Converting VIF {"id": "6aa6ae79-94a7-4711-b0eb-c55753c3cae7", "address": "fa:16:3e:c1:3f:10", "network": {"id": "0d87381a-1454-4b59-b8c7-3a13e0fcd476", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1915607964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "11e4b1d73ecb40dfa464da2993358b3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa6ae79-94", "ovs_interfaceid": "6aa6ae79-94a7-4711-b0eb-c55753c3cae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:10:30.279519 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:3f:10,bridge_name='br-int',has_traffic_filtering=True,id=6aa6ae79-94a7-4711-b0eb-c55753c3cae7,network=Network(0d87381a-1454-4b59-b8c7-3a13e0fcd476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aa6ae79-94') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:10:30.279721 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:3f:10,bridge_name='br-int',has_traffic_filtering=True,id=6aa6ae79-94a7-4711-b0eb-c55753c3cae7,network=Network(0d87381a-1454-4b59-b8c7-3a13e0fcd476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aa6ae79-94') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:10:30.280627 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:30.280880 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6aa6ae79-94, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:10:30.281791 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:30.282520 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:10:30.282763 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:30.283441 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:30.283592 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c53d303a-8171-486b-821f-5c1b77487081) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:10:30.285189 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:10:30.286646 np0000001577 nova-compute[98319]: INFO os_vif [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:3f:10,bridge_name='br-int',has_traffic_filtering=True,id=6aa6ae79-94a7-4711-b0eb-c55753c3cae7,network=Network(0d87381a-1454-4b59-b8c7-3a13e0fcd476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aa6ae79-94')
May 28 01:10:30.287935 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:10:30.288192 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048', 'iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '652bf495-9b59-45b1-aacb-fc5f9d75e048', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:10:30.288329 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:10:30.288591 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:10:30.288822 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048', 'iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '652bf495-9b59-45b1-aacb-fc5f9d75e048', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:10:30.288947 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:10:30.313123 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:30.313123 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:30.313123 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:30.313123 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:30.313123 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:30.313123 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:30.313123 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:30.313123 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:30.313123 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:10:30.313470 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:30.313470 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:30.313470 np0000001577 nova-compute[98319]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:30.313470 np0000001577 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:30.313470 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:30.313470 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:30.313470 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:30.313470 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:30.313470 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:10:30.313470 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', '146'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', '147'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048', '153'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048', '154'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', '155'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', '156'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e', '157'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e', '158')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:10:30.313470 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048', '153')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:10:30.314249 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048', '154')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:10:30.314929 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c9870529ee0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048'): ({'sdg'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:10:30.315080 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Removing multipathed devices sdf, sdg {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:10:30.315252 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Flush multipath device 330000000a81816c1 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:10:30.376695 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:10:30.419768 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:10:30.455733 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:10:30.455876 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:10:30.456853 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:10:30.467239 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:10:30.467411 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:10:30.478572 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:30.507301 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 153, target: iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048, portal: 192.168.40.100,3260]
May 28 01:10:30.507301 np0000001577 nova-compute[98319]: Logout of [sid: 153, target: iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048, portal: 192.168.40.100,3260] successful.
May 28 01:10:30.507301 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:30.523149 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:30.534852 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:30.573747 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 154, target: iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048, portal: 192.168.50.100,3260]
May 28 01:10:30.573747 np0000001577 nova-compute[98319]: Logout of [sid: 154, target: iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048, portal: 192.168.50.100,3260] successful.
May 28 01:10:30.573747 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:30.590180 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:30.590329 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:10:30.590440 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] <== disconnect_volume: return (301ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:10:30.590554 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:10:30.590875 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Deleting instance files /opt/stack/data/nova/instances/227baa5d-04b6-44bc-bf06-412f2874f947_del
May 28 01:10:30.591439 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Deletion of /opt/stack/data/nova/instances/227baa5d-04b6-44bc-bf06-412f2874f947_del complete
May 28 01:10:30.902880 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:10:30.939395 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b418a1c3-dd70-4853-9150-636fd2a2184f req-b00d949c-0aa5-471e-8948-1a2e99b2569a service nova] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Received event network-vif-unplugged-78589b79-8f25-4f7e-a6c8-96e5a5c076b8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:30.939395 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b418a1c3-dd70-4853-9150-636fd2a2184f req-b00d949c-0aa5-471e-8948-1a2e99b2569a service nova] Acquiring lock "e5a3d695-94e9-4ad7-aa07-b6cc865b30a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:30.939492 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b418a1c3-dd70-4853-9150-636fd2a2184f req-b00d949c-0aa5-471e-8948-1a2e99b2569a service nova] Lock "e5a3d695-94e9-4ad7-aa07-b6cc865b30a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:30.939642 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b418a1c3-dd70-4853-9150-636fd2a2184f req-b00d949c-0aa5-471e-8948-1a2e99b2569a service nova] Lock "e5a3d695-94e9-4ad7-aa07-b6cc865b30a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:30.939759 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b418a1c3-dd70-4853-9150-636fd2a2184f req-b00d949c-0aa5-471e-8948-1a2e99b2569a service nova] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] No waiting events found dispatching network-vif-unplugged-78589b79-8f25-4f7e-a6c8-96e5a5c076b8 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:10:30.939950 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b418a1c3-dd70-4853-9150-636fd2a2184f req-b00d949c-0aa5-471e-8948-1a2e99b2569a service nova] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Received event network-vif-unplugged-78589b79-8f25-4f7e-a6c8-96e5a5c076b8 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:10:30.940012 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b418a1c3-dd70-4853-9150-636fd2a2184f req-b00d949c-0aa5-471e-8948-1a2e99b2569a service nova] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Received event network-vif-deleted-78589b79-8f25-4f7e-a6c8-96e5a5c076b8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:30.940489 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-b418a1c3-dd70-4853-9150-636fd2a2184f req-b00d949c-0aa5-471e-8948-1a2e99b2569a service nova] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Neutron deleted interface 78589b79-8f25-4f7e-a6c8-96e5a5c076b8; detaching it from the instance and deleting it from the info cache
May 28 01:10:30.941846 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b418a1c3-dd70-4853-9150-636fd2a2184f req-b00d949c-0aa5-471e-8948-1a2e99b2569a service nova] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Detach interface failed, port_id=78589b79-8f25-4f7e-a6c8-96e5a5c076b8, reason: Instance e5a3d695-94e9-4ad7-aa07-b6cc865b30a1 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:10:31.096525 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Took 1.65 seconds to destroy the instance on the hypervisor.
May 28 01:10:31.097052 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:10:31.097334 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:10:31.097441 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:10:31.097696 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:31.201771 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:31.407684 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Took 1.34 seconds to deallocate network for instance.
May 28 01:10:31.523381 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:31.665032 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-289b8399-cd1c-47fd-8e38-62ef17afc82b req-b8c1922b-2927-476f-82e7-e810ea935539 service nova] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Received event network-vif-deleted-6aa6ae79-94a7-4711-b0eb-c55753c3cae7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:31.665213 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-289b8399-cd1c-47fd-8e38-62ef17afc82b req-b8c1922b-2927-476f-82e7-e810ea935539 service nova] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Neutron deleted interface 6aa6ae79-94a7-4711-b0eb-c55753c3cae7; detaching it from the instance and deleting it from the info cache
May 28 01:10:31.670703 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-289b8399-cd1c-47fd-8e38-62ef17afc82b req-b8c1922b-2927-476f-82e7-e810ea935539 service nova] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Detach interface failed, port_id=6aa6ae79-94a7-4711-b0eb-c55753c3cae7, reason: Instance 227baa5d-04b6-44bc-bf06-412f2874f947 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:10:31.718437 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c4f73896-a852-474e-ae4b-e49fc140788b req-423a0d22-7d46-481d-a544-685b429d693e service nova] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Received event network-vif-unplugged-6aa6ae79-94a7-4711-b0eb-c55753c3cae7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:31.718933 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c4f73896-a852-474e-ae4b-e49fc140788b req-423a0d22-7d46-481d-a544-685b429d693e service nova] Acquiring lock "227baa5d-04b6-44bc-bf06-412f2874f947-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:31.719134 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c4f73896-a852-474e-ae4b-e49fc140788b req-423a0d22-7d46-481d-a544-685b429d693e service nova] Lock "227baa5d-04b6-44bc-bf06-412f2874f947-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:31.719288 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c4f73896-a852-474e-ae4b-e49fc140788b req-423a0d22-7d46-481d-a544-685b429d693e service nova] Lock "227baa5d-04b6-44bc-bf06-412f2874f947-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:31.719441 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c4f73896-a852-474e-ae4b-e49fc140788b req-423a0d22-7d46-481d-a544-685b429d693e service nova] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] No waiting events found dispatching network-vif-unplugged-6aa6ae79-94a7-4711-b0eb-c55753c3cae7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:10:31.719609 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c4f73896-a852-474e-ae4b-e49fc140788b req-423a0d22-7d46-481d-a544-685b429d693e service nova] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Received event network-vif-unplugged-6aa6ae79-94a7-4711-b0eb-c55753c3cae7 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:10:31.914210 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-66f19c70-1f1f-49a1-8598-9b7293d0da46 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:31.914747 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-66f19c70-1f1f-49a1-8598-9b7293d0da46 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:32.127949 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:10:32.293844 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "14f9e91b-230b-468d-940b-39ad40e0eca2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:32.294072 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "14f9e91b-230b-468d-940b-39ad40e0eca2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:32.304374 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-66f19c70-1f1f-49a1-8598-9b7293d0da46 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:10:32.304523 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-66f19c70-1f1f-49a1-8598-9b7293d0da46 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:10:32.630284 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Took 1.53 seconds to deallocate network for instance.
May 28 01:10:32.797401 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lazy-loading 'flavor' on Instance uuid 14f9e91b-230b-468d-940b-39ad40e0eca2 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:10:32.807060 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-66f19c70-1f1f-49a1-8598-9b7293d0da46 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:10:33.170589 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Took 0.54 seconds to detach 1 volumes for instance.
May 28 01:10:33.313109 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-66f19c70-1f1f-49a1-8598-9b7293d0da46 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.399s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:33.366648 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-66f19c70-1f1f-49a1-8598-9b7293d0da46 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Deleted allocations for instance e5a3d695-94e9-4ad7-aa07-b6cc865b30a1
May 28 01:10:33.674947 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:33.675084 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:33.802714 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "14f9e91b-230b-468d-940b-39ad40e0eca2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:33.995791 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:10:33.996036 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:10:34.375165 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-66f19c70-1f1f-49a1-8598-9b7293d0da46 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "e5a3d695-94e9-4ad7-aa07-b6cc865b30a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.185s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:34.499626 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:10:34.928250 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "14f9e91b-230b-468d-940b-39ad40e0eca2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:34.928409 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "14f9e91b-230b-468d-940b-39ad40e0eca2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:34.928455 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Attaching volume e18c498d-23b8-44dc-a0c5-434983238967 to /dev/vdb
May 28 01:10:34.971236 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:10:34.980839 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:10:34.998359 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:10:35.012061 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.336s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:35.038086 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:10:35.038310 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:10:35.046113 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:10:35.047225 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe46:94e9', 'fe80::e873:f8ff:fed0:1522', 'fe80::fc16:3eff:feb9:2b05', 'fe80::84b7:d3ff:feed:4f01', 'fe80::fc16:3eff:fe65:fa89', 'fe80::583c:47ff:fea3:281d', 'fe80::fc16:3eff:fed7:129f', 'fe80::49a:a7ff:fef7:c9e8', 'fe80::fc16:3eff:fe58:6b6d', 'fe80::fc16:3eff:feab:f427', 'fe80::9c16:39ff:fe2e:9aef'] 
May 28 01:10:35.047362 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:10:35.047441 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:10:35.047667 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] <== get_connector_properties: return (75ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:10:35.047860 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Updating existing volume attachment record: 278a3b60-4319-48cd-8cf5-1826043b697f {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:10:35.059451 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Deleted allocations for instance 227baa5d-04b6-44bc-bf06-412f2874f947
May 28 01:10:35.285686 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:35.592870 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:10:35.593223 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967', 'iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e18c498d-23b8-44dc-a0c5-434983238967', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:10:35.593329 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:10:36.067628 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9f950cb-22c4-4e16-bf50-ab6d9ade167c tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Lock "227baa5d-04b6-44bc-bf06-412f2874f947" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.127s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:36.524561 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:36.547438 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.953s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:10:36.547438 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967', 'iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e18c498d-23b8-44dc-a0c5-434983238967', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:10:36.561588 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:10:36.562064 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:10:36.562634 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:10:36.562838 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:10:36.563122 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:10:36.563248 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:10:36.574854 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:10:36.574854 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:36.579646 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:10:36.579646 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:36.587880 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967] added
May 28 01:10:36.587880 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:10:36.587880 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:10:36.587880 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:10:36.587880 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:10:36.587880 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:10:36.587880 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:36.588111 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:10:36.588433 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.025(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:10:36.588700 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:10:36.593230 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967] added
May 28 01:10:36.593230 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:10:36.593230 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:10:36.593230 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:10:36.593230 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:10:36.593230 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:10:36.593230 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:36.593742 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:10:36.593742 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0307(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:10:36.593742 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:10:37.483770 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-87b7de67-0fad-499d-93fb-83191cce1c25 req-e756a852-6fe1-41e3-9625-2f438afb318f service nova] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Received event network-changed-bb9312b6-5458-47c9-aac1-0cccedf5d70b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:37.484013 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-87b7de67-0fad-499d-93fb-83191cce1c25 req-e756a852-6fe1-41e3-9625-2f438afb318f service nova] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Refreshing instance network info cache due to event network-changed-bb9312b6-5458-47c9-aac1-0cccedf5d70b. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:10:37.484225 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-87b7de67-0fad-499d-93fb-83191cce1c25 req-e756a852-6fe1-41e3-9625-2f438afb318f service nova] Acquiring lock "refresh_cache-4d7b37c7-b091-44f7-a330-4e55e2b1e348" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:10:37.484358 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-87b7de67-0fad-499d-93fb-83191cce1c25 req-e756a852-6fe1-41e3-9625-2f438afb318f service nova] Acquired lock "refresh_cache-4d7b37c7-b091-44f7-a330-4e55e2b1e348" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:10:37.484529 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-87b7de67-0fad-499d-93fb-83191cce1c25 req-e756a852-6fe1-41e3-9625-2f438afb318f service nova] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Refreshing network info cache for port bb9312b6-5458-47c9-aac1-0cccedf5d70b {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:10:37.589152 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:10:37.594673 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:10:37.607352 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:10:37.607352 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:10:37.614923 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:10:37.614923 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:37.625136 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:37.630868 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:37.643267 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:37.643267 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:37.643267 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:37.643267 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:37.643267 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:37.643267 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:37.643267 np0000001577 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:37.643267 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:10:37.643541 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:37.643541 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:37.643541 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:37.643541 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:37.643541 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:37.643541 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:37.643541 np0000001577 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:37.643541 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:10:37.648683 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:37.648683 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:37.648683 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:37.648683 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:37.648683 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:37.648683 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:37.648683 np0000001577 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:37.648683 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:10:37.649030 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:37.649030 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:37.649030 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:37.649030 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:37.649030 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:37.649030 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:37.649030 np0000001577 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:37.649030 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:10:37.688630 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967, portal: 192.168.50.100,3260]
May 28 01:10:37.688630 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967, portal: 192.168.50.100,3260] successful.
May 28 01:10:37.688630 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:37.697381 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967, portal: 192.168.40.100,3260]
May 28 01:10:37.697381 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967, portal: 192.168.40.100,3260] successful.
May 28 01:10:37.697381 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:37.703003 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:37.712860 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:37.721013 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:37.721013 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:37.721013 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:37.721013 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:37.721013 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:37.721013 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:37.721013 np0000001577 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:37.721013 np0000001577 nova-compute[98319]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:37.721013 np0000001577 nova-compute[98319]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:37.721013 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:10:37.721329 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:37.721329 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:37.721329 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:37.721329 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:37.721329 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:37.721329 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:37.721329 np0000001577 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:37.721329 np0000001577 nova-compute[98319]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:37.721329 np0000001577 nova-compute[98319]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:37.721329 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:10:37.721627 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.158s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:10:37.721627 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:10:37.722753 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] HCTL ('12', '-', '-', 0) found on session 162 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:10:37.722922 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:10:37.739286 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:37.739286 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:37.739286 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:37.739286 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:37.739286 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:37.739286 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:37.739286 np0000001577 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:37.739286 np0000001577 nova-compute[98319]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:37.739286 np0000001577 nova-compute[98319]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:37.739286 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:10:37.739286 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:37.739286 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:37.739286 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:37.739286 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:37.739286 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:37.739286 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:37.739286 np0000001577 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:37.739286 np0000001577 nova-compute[98319]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:37.739286 np0000001577 nova-compute[98319]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:37.739286 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:10:37.739286 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:10:37.739286 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:10:37.739286 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Searching for a device in session 162 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:10:37.739286 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e18c498d-23b8-44dc-a0c5-434983238967', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:10:37.739286 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] HCTL ('15', '-', '-', 0) found on session 163 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:10:37.739286 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:10:37.754864 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Searching for a device in session 163 and hctl ['15', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:10:37.979005 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:10:37.979524 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:10:37.986864 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-87b7de67-0fad-499d-93fb-83191cce1c25 req-e756a852-6fe1-41e3-9625-2f438afb318f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:38.000988 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cee383ed-1082-48f6-9c28-148fd3326d7f tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "4d7b37c7-b091-44f7-a330-4e55e2b1e348" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:38.000988 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cee383ed-1082-48f6-9c28-148fd3326d7f tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "4d7b37c7-b091-44f7-a330-4e55e2b1e348" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:38.001179 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cee383ed-1082-48f6-9c28-148fd3326d7f tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "4d7b37c7-b091-44f7-a330-4e55e2b1e348-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:38.001275 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cee383ed-1082-48f6-9c28-148fd3326d7f tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "4d7b37c7-b091-44f7-a330-4e55e2b1e348-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:38.001416 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cee383ed-1082-48f6-9c28-148fd3326d7f tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "4d7b37c7-b091-44f7-a330-4e55e2b1e348-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:38.003139 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-cee383ed-1082-48f6-9c28-148fd3326d7f tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Terminating instance
May 28 01:10:38.371443 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-87b7de67-0fad-499d-93fb-83191cce1c25 req-e756a852-6fe1-41e3-9625-2f438afb318f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:38.510524 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-cee383ed-1082-48f6-9c28-148fd3326d7f tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:10:38.512652 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-87b7de67-0fad-499d-93fb-83191cce1c25 req-e756a852-6fe1-41e3-9625-2f438afb318f service nova] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Updated VIF entry in instance network info cache for port bb9312b6-5458-47c9-aac1-0cccedf5d70b. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:10:38.512970 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-87b7de67-0fad-499d-93fb-83191cce1c25 req-e756a852-6fe1-41e3-9625-2f438afb318f service nova] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Updating instance_info_cache with network_info: [{"id": "bb9312b6-5458-47c9-aac1-0cccedf5d70b", "address": "fa:16:3e:ab:f4:27", "network": {"id": "8bf5903d-3155-48fb-98dd-859e96b349d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1733749547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92f49e31415146d281ba6b462016d5d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb9312b6-54", "ovs_interfaceid": "bb9312b6-5458-47c9-aac1-0cccedf5d70b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:10:38.533186 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:38.551681 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:38.556997 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:38.579656 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:38.581409 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:38.684284 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c9a67cd0-9025-4088-ac0a-2fe1c0a28020 req-732ed5d6-eddd-4be7-9eba-908b5a539367 service nova] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Received event network-vif-unplugged-bb9312b6-5458-47c9-aac1-0cccedf5d70b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:38.684671 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c9a67cd0-9025-4088-ac0a-2fe1c0a28020 req-732ed5d6-eddd-4be7-9eba-908b5a539367 service nova] Acquiring lock "4d7b37c7-b091-44f7-a330-4e55e2b1e348-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:38.684671 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c9a67cd0-9025-4088-ac0a-2fe1c0a28020 req-732ed5d6-eddd-4be7-9eba-908b5a539367 service nova] Lock "4d7b37c7-b091-44f7-a330-4e55e2b1e348-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:38.684760 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c9a67cd0-9025-4088-ac0a-2fe1c0a28020 req-732ed5d6-eddd-4be7-9eba-908b5a539367 service nova] Lock "4d7b37c7-b091-44f7-a330-4e55e2b1e348-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:38.684969 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c9a67cd0-9025-4088-ac0a-2fe1c0a28020 req-732ed5d6-eddd-4be7-9eba-908b5a539367 service nova] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] No waiting events found dispatching network-vif-unplugged-bb9312b6-5458-47c9-aac1-0cccedf5d70b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:10:38.685155 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c9a67cd0-9025-4088-ac0a-2fe1c0a28020 req-732ed5d6-eddd-4be7-9eba-908b5a539367 service nova] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Received event network-vif-unplugged-bb9312b6-5458-47c9-aac1-0cccedf5d70b for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:10:38.752918 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Searching for a device in session 163 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:10:38.753114 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e18c498d-23b8-44dc-a0c5-434983238967', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:10:38.838485 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999044452999897 future=<Future at 0x7c984c4c5e20 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:10:38.840528 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Instance destroyed successfully.
May 28 01:10:38.841096 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-cee383ed-1082-48f6-9c28-148fd3326d7f tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lazy-loading 'resources' on Instance uuid 4d7b37c7-b091-44f7-a330-4e55e2b1e348 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:10:39.016700 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-87b7de67-0fad-499d-93fb-83191cce1c25 req-e756a852-6fe1-41e3-9625-2f438afb318f service nova] Releasing lock "refresh_cache-4d7b37c7-b091-44f7-a330-4e55e2b1e348" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:10:39.343477 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-cee383ed-1082-48f6-9c28-148fd3326d7f tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:08:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-810281881',display_name='tempest-TestStampPattern-server-810281881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-teststamppattern-server-810281881',id=58,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY7LZ57I2hyMdKVO08J6JSzhqiI0ZTtKrP9nyz1z53fPuESHxKL03vnaQuF8H5q84b516fImHzGWaVzsCTjOGesM9ULlqWAaR2gPi+wEj2GKOu9g0fSmRD2xOlCcqeMHw==',key_name='tempest-TestStampPattern-1233377666',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:08:29Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92f49e31415146d281ba6b462016d5d4',ramdisk_id='',reservation_id='r-i8r70j4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1316789919',owner_user_name='tempest-TestStampPattern-1316789919-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:09:20Z,user_data=None,user_id='9258145be7414d88accbdb4802619956',uuid=4d7b37c7-b091-44f7-a330-4e55e2b1e348,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb9312b6-5458-47c9-aac1-0cccedf5d70b", "address": "fa:16:3e:ab:f4:27", "network": {"id": "8bf5903d-3155-48fb-98dd-859e96b349d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1733749547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92f49e31415146d281ba6b462016d5d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb9312b6-54", "ovs_interfaceid": "bb9312b6-5458-47c9-aac1-0cccedf5d70b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:10:39.343648 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-cee383ed-1082-48f6-9c28-148fd3326d7f tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Converting VIF {"id": "bb9312b6-5458-47c9-aac1-0cccedf5d70b", "address": "fa:16:3e:ab:f4:27", "network": {"id": "8bf5903d-3155-48fb-98dd-859e96b349d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1733749547-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92f49e31415146d281ba6b462016d5d4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb9312b6-54", "ovs_interfaceid": "bb9312b6-5458-47c9-aac1-0cccedf5d70b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:10:39.344187 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-cee383ed-1082-48f6-9c28-148fd3326d7f tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:f4:27,bridge_name='br-int',has_traffic_filtering=True,id=bb9312b6-5458-47c9-aac1-0cccedf5d70b,network=Network(8bf5903d-3155-48fb-98dd-859e96b349d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb9312b6-54') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:10:39.344390 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-cee383ed-1082-48f6-9c28-148fd3326d7f tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:f4:27,bridge_name='br-int',has_traffic_filtering=True,id=bb9312b6-5458-47c9-aac1-0cccedf5d70b,network=Network(8bf5903d-3155-48fb-98dd-859e96b349d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb9312b6-54') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:10:39.346301 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:39.346301 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb9312b6-54, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:10:39.347640 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:39.348038 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:10:39.348479 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:39.349261 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:39.349418 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=188382e0-6aeb-4a3e-8908-f1387b88631a) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:10:39.349873 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:39.350303 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:10:39.350622 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:39.352275 np0000001577 nova-compute[98319]: INFO os_vif [None req-cee383ed-1082-48f6-9c28-148fd3326d7f tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:f4:27,bridge_name='br-int',has_traffic_filtering=True,id=bb9312b6-5458-47c9-aac1-0cccedf5d70b,network=Network(8bf5903d-3155-48fb-98dd-859e96b349d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb9312b6-54')
May 28 01:10:39.352578 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-cee383ed-1082-48f6-9c28-148fd3326d7f tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Deleting instance files /opt/stack/data/nova/instances/4d7b37c7-b091-44f7-a330-4e55e2b1e348_del
May 28 01:10:39.353283 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-cee383ed-1082-48f6-9c28-148fd3326d7f tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Deletion of /opt/stack/data/nova/instances/4d7b37c7-b091-44f7-a330-4e55e2b1e348_del complete
May 28 01:10:39.581239 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Found WWN 330000000e9ecb9f5 for multipath device dm-10 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:10:39.581239 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:10:39.581239 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] <== connect_volume: return (3986ms) {'type': 'block', 'scsi_wwn': '330000000e9ecb9f5', 'path': '/dev/dm-10', 'multipath_id': '330000000e9ecb9f5'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:10:39.581239 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e9ecb9f5', 'path': '/dev/dm-10', 'multipath_id': '330000000e9ecb9f5'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:10:39.583745 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lazy-loading 'flavor' on Instance uuid 14f9e91b-230b-468d-940b-39ad40e0eca2 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:10:39.860212 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-cee383ed-1082-48f6-9c28-148fd3326d7f tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Took 1.35 seconds to destroy the instance on the hypervisor.
May 28 01:10:39.861354 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-cee383ed-1082-48f6-9c28-148fd3326d7f tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:10:39.861560 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:10:39.861664 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:10:39.861829 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:39.951423 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:40.088307 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Attempting to attach volume e18c498d-23b8-44dc-a0c5-434983238967 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:10:40.090456 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:10:40.090456 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:10:40.090456 np0000001577 nova-compute[98319]:   <alias name="ua-e18c498d-23b8-44dc-a0c5-434983238967"/>
May 28 01:10:40.090456 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-10"/>
May 28 01:10:40.090456 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:10:40.090456 np0000001577 nova-compute[98319]:   <serial>e18c498d-23b8-44dc-a0c5-434983238967</serial>
May 28 01:10:40.090456 np0000001577 nova-compute[98319]: </disk>
May 28 01:10:40.090456 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:10:40.213283 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-62d60e07-93b5-4536-9497-4dbc37b06525 req-1168fd3a-ea3b-42f0-8340-5c2dbb2a8f87 service nova] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Received event network-vif-deleted-bb9312b6-5458-47c9-aac1-0cccedf5d70b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:40.215897 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-62d60e07-93b5-4536-9497-4dbc37b06525 req-1168fd3a-ea3b-42f0-8340-5c2dbb2a8f87 service nova] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Neutron deleted interface bb9312b6-5458-47c9-aac1-0cccedf5d70b; detaching it from the instance and deleting it from the info cache
May 28 01:10:40.218443 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-62d60e07-93b5-4536-9497-4dbc37b06525 req-1168fd3a-ea3b-42f0-8340-5c2dbb2a8f87 service nova] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Detach interface failed, port_id=bb9312b6-5458-47c9-aac1-0cccedf5d70b, reason: Instance 4d7b37c7-b091-44f7-a330-4e55e2b1e348 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:10:40.666298 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:10:40.736582 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f3f2e35d-d553-4974-b478-090bb2bf65b3 req-8ffc6aa1-45e1-4216-92b8-a59eb7536d49 service nova] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Received event network-vif-unplugged-bb9312b6-5458-47c9-aac1-0cccedf5d70b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:40.736777 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f3f2e35d-d553-4974-b478-090bb2bf65b3 req-8ffc6aa1-45e1-4216-92b8-a59eb7536d49 service nova] Acquiring lock "4d7b37c7-b091-44f7-a330-4e55e2b1e348-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:40.736994 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f3f2e35d-d553-4974-b478-090bb2bf65b3 req-8ffc6aa1-45e1-4216-92b8-a59eb7536d49 service nova] Lock "4d7b37c7-b091-44f7-a330-4e55e2b1e348-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:40.737161 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f3f2e35d-d553-4974-b478-090bb2bf65b3 req-8ffc6aa1-45e1-4216-92b8-a59eb7536d49 service nova] Lock "4d7b37c7-b091-44f7-a330-4e55e2b1e348-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:40.737328 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f3f2e35d-d553-4974-b478-090bb2bf65b3 req-8ffc6aa1-45e1-4216-92b8-a59eb7536d49 service nova] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] No waiting events found dispatching network-vif-unplugged-bb9312b6-5458-47c9-aac1-0cccedf5d70b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:10:40.737473 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f3f2e35d-d553-4974-b478-090bb2bf65b3 req-8ffc6aa1-45e1-4216-92b8-a59eb7536d49 service nova] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Received event network-vif-unplugged-bb9312b6-5458-47c9-aac1-0cccedf5d70b for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:10:40.977993 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:10:41.168735 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Took 1.31 seconds to deallocate network for instance.
May 28 01:10:41.487531 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:41.489470 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:41.489669 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:41.490280 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Auditing locally available compute resources for np0000001577 (node: np0000001577) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 01:10:41.526972 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:41.673672 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cee383ed-1082-48f6-9c28-148fd3326d7f tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:41.673812 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cee383ed-1082-48f6-9c28-148fd3326d7f tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:41.767221 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:10:41.767388 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:10:41.767388 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:10:41.767712 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] No VIF found with MAC fa:16:3e:b9:2b:05, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:10:41.950387 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cee383ed-1082-48f6-9c28-148fd3326d7f tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:10:41.950639 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-cee383ed-1082-48f6-9c28-148fd3326d7f tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:10:41.971934 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "e8151422-37a0-4b7a-914f-34dc2979ead9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:41.973122 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:42.342367 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Waiting for libvirt event about the detach of device vdb with device alias ua-f7725186-2460-4632-868e-1cb41674f3f0 from instance 412ac56c-f524-46c2-91eb-fa4672db46a9 is timed out.
May 28 01:10:42.344419 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Found disk vdb by alias ua-f7725186-2460-4632-868e-1cb41674f3f0 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:10:42.344599 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Failed to detach device vdb with device alias ua-f7725186-2460-4632-868e-1cb41674f3f0 from instance 412ac56c-f524-46c2-91eb-fa4672db46a9 from the live domain config. Libvirt did not report any error but the device is still in the config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2694}}
May 28 01:10:42.344725 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] (2/8): Attempting to detach device vdb with device alias ua-f7725186-2460-4632-868e-1cb41674f3f0 from instance 412ac56c-f524-46c2-91eb-fa4672db46a9 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:10:42.345012 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:10:42.345012 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:10:42.345012 np0000001577 nova-compute[98319]:   <alias name="ua-f7725186-2460-4632-868e-1cb41674f3f0"/>
May 28 01:10:42.345012 np0000001577 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-2"/>
May 28 01:10:42.345012 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:10:42.345012 np0000001577 nova-compute[98319]:   <serial>f7725186-2460-4632-868e-1cb41674f3f0</serial>
May 28 01:10:42.345012 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 01:10:42.345012 np0000001577 nova-compute[98319]:   <encryption format="luks">
May 28 01:10:42.345012 np0000001577 nova-compute[98319]:     <secret type="passphrase" uuid="7210f4aa-7cba-46e3-ae37-603ee1977b92"/>
May 28 01:10:42.345012 np0000001577 nova-compute[98319]:   </encryption>
May 28 01:10:42.345012 np0000001577 nova-compute[98319]: </disk>
May 28 01:10:42.345012 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:10:42.453372 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-cee383ed-1082-48f6-9c28-148fd3326d7f tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:10:42.477612 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lazy-loading 'flavor' on Instance uuid e8151422-37a0-4b7a-914f-34dc2979ead9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:10:42.549910 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f9e91b-230b-468d-940b-39ad40e0eca2/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:10:42.634042 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f9e91b-230b-468d-940b-39ad40e0eca2/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:10:42.634562 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f9e91b-230b-468d-940b-39ad40e0eca2/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:10:42.718025 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14f9e91b-230b-468d-940b-39ad40e0eca2/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:10:42.718467 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-10 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:10:42.722825 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:10:42.814775 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:10:42.817802 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:10:42.864604 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930642.8638182, 412ac56c-f524-46c2-91eb-fa4672db46a9 => ua-f7725186-2460-4632-868e-1cb41674f3f0> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:10:42.865071 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-f7725186-2460-4632-868e-1cb41674f3f0 for instance 412ac56c-f524-46c2-91eb-fa4672db46a9 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:10:42.867701 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Successfully detached device vdb from instance 412ac56c-f524-46c2-91eb-fa4672db46a9 from the live domain config.
May 28 01:10:42.870266 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:10:42.870725 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7725186-2460-4632-868e-1cb41674f3f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:10:42.871109 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:10:42.871361 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:10:42.871727 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7725186-2460-4632-868e-1cb41674f3f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:10:42.871929 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:10:42.896524 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:42.896524 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:42.896524 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:42.896524 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:42.896524 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:42.896524 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:42.896524 np0000001577 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:42.896524 np0000001577 nova-compute[98319]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:42.896524 np0000001577 nova-compute[98319]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:42.896524 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:10:42.896920 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:42.896920 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:42.896920 np0000001577 nova-compute[98319]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:42.896920 np0000001577 nova-compute[98319]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0 (non-flash)
May 28 01:10:42.896920 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:42.896920 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:42.896920 np0000001577 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048 (non-flash)
May 28 01:10:42.896920 np0000001577 nova-compute[98319]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:42.896920 np0000001577 nova-compute[98319]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:42.896920 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:10:42.896920 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', '146'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', '147'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', '155'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', '156'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e', '157'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e', '158'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-652bf495-9b59-45b1-aacb-fc5f9d75e048', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967', '162'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967', '163')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:10:42.897211 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', '156')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:10:42.897968 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0', '155')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:10:42.898681 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c984c50a160>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0'): ({'sdb'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:10:42.898890 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:10:42.899434 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Flush multipath device 330000000dd6bd600 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:10:42.913192 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:10:42.913499 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-2 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:10:42.915959 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:10:42.940871 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:10:42.960618 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cee383ed-1082-48f6-9c28-148fd3326d7f tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.287s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:42.991361 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:10:43.005817 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:10:43.006700 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:10:43.021657 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-cee383ed-1082-48f6-9c28-148fd3326d7f tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Deleted allocations for instance 4d7b37c7-b091-44f7-a330-4e55e2b1e348
May 28 01:10:43.040277 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:10:43.040495 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:10:43.043039 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:10:43.053476 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:10:43.053853 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:10:43.064973 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:43.094817 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 156, target: iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0, portal: 192.168.40.100,3260]
May 28 01:10:43.094817 np0000001577 nova-compute[98319]: Logout of [sid: 156, target: iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0, portal: 192.168.40.100,3260] successful.
May 28 01:10:43.094817 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:43.102215 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:10:43.106591 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:10:43.108032 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:10:43.109865 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:10:43.110848 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:10:43.123068 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:43.136298 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:43.156534 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "env LANG=C uptime" returned: 0 in 0.046s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:10:43.156872 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Hypervisor/Node resource view: name=np0000001577 free_ram=12118MB free_disk=72.80506134033203GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 01:10:43.157090 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:43.157341 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:43.173648 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 155, target: iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0, portal: 192.168.50.100,3260]
May 28 01:10:43.173648 np0000001577 nova-compute[98319]: Logout of [sid: 155, target: iqn.2023-03.storpool.com:os--volume-f7725186-2460-4632-868e-1cb41674f3f0, portal: 192.168.50.100,3260] successful.
May 28 01:10:43.173648 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:43.190004 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:43.191301 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:10:43.191481 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] <== disconnect_volume: return (320ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:10:43.191704 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:10:43.322532 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eca96254-3b3f-4504-a46f-4a2accd0f3c0 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "14f9e91b-230b-468d-940b-39ad40e0eca2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.394s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:43.486340 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:43.739260 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lazy-loading 'flavor' on Instance uuid 412ac56c-f524-46c2-91eb-fa4672db46a9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:10:44.034088 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cee383ed-1082-48f6-9c28-148fd3326d7f tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Lock "4d7b37c7-b091-44f7-a330-4e55e2b1e348" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.033s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:44.037162 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00032329299983757664 future=<Future at 0x7c984c5b5c70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:10:44.037300 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:10:44.037384 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=0.7331392080000114 future=<Future at 0x7c984c5db830 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:10:44.037494 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=0.7330435909998414 future=<Future at 0x7c984c5db830 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:10:44.038030 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] Emitting event <LifecycleEvent: 1779930629.0367491, e5a3d695-94e9-4ad7-aa07-b6cc865b30a1 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:10:44.038206 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] VM Stopped (Lifecycle Event)
May 28 01:10:44.210003 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 1e644f60-1f1f-4679-aec6-d1bbb3b69efe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:10:44.210115 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 412ac56c-f524-46c2-91eb-fa4672db46a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:10:44.210217 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 14f9e91b-230b-468d-940b-39ad40e0eca2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:10:44.210306 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance e8151422-37a0-4b7a-914f-34dc2979ead9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:10:44.210390 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 38636bdc-bca3-469b-80d7-05d8fa9e1c78 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:10:44.210565 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 01:10:44.210763 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Final resource view: name=np0000001577 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:10:43 up 42 min,  2 users,  load average: 4.28, 5.41, 4.26\n', 'num_instances': '5', 'num_vm_active': '5', 'num_task_None': '5', 'num_os_type_None': '5', 'num_proj_a430f0d6bcc84a29bc3e96514422896b': '1', 'io_workload': '0', 'num_proj_050f928f1ce449d6a447cd343dc4ff80': '2', 'num_proj_23578125da1e4bf2bb3d59281a0e261e': '1', 'num_proj_07f3bdd3aef04045aac40e4b851915e1': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 01:10:44.352395 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:44.476645 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:10:44.476953 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:10:44.505504 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "14f9e91b-230b-468d-940b-39ad40e0eca2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:44.505888 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "14f9e91b-230b-468d-940b-39ad40e0eca2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:44.541423 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-297a4fd0-9d07-4846-aa2a-acbbaa5f09b6 tempest-TestStampPattern-1316789919 tempest-TestStampPattern-1316789919-project-member] [instance: e5a3d695-94e9-4ad7-aa07-b6cc865b30a1] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:10:44.554144 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "e8151422-37a0-4b7a-914f-34dc2979ead9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:44.554353 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:44.554566 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Attaching volume dcba93e1-027e-4d13-816c-65749a70f47b to /dev/vdb
May 28 01:10:44.610520 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:10:44.623207 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:10:44.648764 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:10:44.692851 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:10:44.693474 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:10:44.701532 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:10:44.703048 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe46:94e9', 'fe80::e873:f8ff:fed0:1522', 'fe80::fc16:3eff:feb9:2b05', 'fe80::84b7:d3ff:feed:4f01', 'fe80::fc16:3eff:fe65:fa89', 'fe80::583c:47ff:fea3:281d', 'fe80::fc16:3eff:fed7:129f', 'fe80::49a:a7ff:fef7:c9e8', 'fe80::fc16:3eff:fe58:6b6d'] 
May 28 01:10:44.703167 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:10:44.703300 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:10:44.703592 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:10:44.703888 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Updating existing volume attachment record: 78191d5f-c286-493b-9925-1688e3851366 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:10:44.747164 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3bf8a020-9f70-4ee9-80bc-392ffd8627d9 tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 27.989s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:44.771040 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00044758800004274235 future=<Future at 0x7c984c5db830 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:10:44.771124 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:10:44.771206 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=9.066309358000126 future=<Future at 0x7c984c4c5e20 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:10:44.771341 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=9.066226234000169 future=<Future at 0x7c984c4c5e20 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:10:44.771685 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Emitting event <LifecycleEvent: 1779930629.7704682, 227baa5d-04b6-44bc-bf06-412f2874f947 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:10:44.771813 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] VM Stopped (Lifecycle Event)
May 28 01:10:44.943804 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c697bdfa-a615-490f-a563-c132aa31417e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "412ac56c-f524-46c2-91eb-fa4672db46a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:44.944159 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c697bdfa-a615-490f-a563-c132aa31417e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:44.944395 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c697bdfa-a615-490f-a563-c132aa31417e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:44.944560 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c697bdfa-a615-490f-a563-c132aa31417e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:44.944686 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c697bdfa-a615-490f-a563-c132aa31417e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:44.947641 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-c697bdfa-a615-490f-a563-c132aa31417e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Terminating instance
May 28 01:10:44.980325 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:10:45.010717 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lazy-loading 'flavor' on Instance uuid 14f9e91b-230b-468d-940b-39ad40e0eca2 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:10:45.249473 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:10:45.249835 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcba93e1-027e-4d13-816c-65749a70f47b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:10:45.249964 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:10:45.274077 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 227baa5d-04b6-44bc-bf06-412f2874f947] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:10:45.401102 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.151s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:10:45.401319 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcba93e1-027e-4d13-816c-65749a70f47b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:10:45.412563 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:10:45.412973 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:10:45.413585 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:10:45.413820 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:10:45.414249 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:10:45.414553 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:10:45.423016 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:10:45.423016 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:45.427360 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:10:45.427360 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:45.433406 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b] added
May 28 01:10:45.433406 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:10:45.433406 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:10:45.433406 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:10:45.433406 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:10:45.433406 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:10:45.433406 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:45.433580 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:10:45.433743 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0199(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:10:45.433879 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:10:45.436905 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b] added
May 28 01:10:45.436905 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:10:45.436905 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:10:45.436905 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:10:45.436905 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:10:45.436905 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:10:45.436905 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:45.437079 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:10:45.437140 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0227(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:10:45.437245 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:10:45.450269 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-c697bdfa-a615-490f-a563-c132aa31417e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:10:45.465141 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:45.467165 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:45.484117 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:45.486140 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Compute_service record updated for np0000001577:np0000001577 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 01:10:45.486276 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.329s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:45.486659 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:10:45.486867 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:45.508352 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:45.508860 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:45.589302 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0624041e-2626-4a2e-b557-44c0cf4c7340 req-be40e1b6-5e3d-4ad9-acdd-f66de2ec2cb2 service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Received event network-vif-unplugged-4e4e8646-56c4-4135-b704-3eda00177287 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:45.589654 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0624041e-2626-4a2e-b557-44c0cf4c7340 req-be40e1b6-5e3d-4ad9-acdd-f66de2ec2cb2 service nova] Acquiring lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:45.589905 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0624041e-2626-4a2e-b557-44c0cf4c7340 req-be40e1b6-5e3d-4ad9-acdd-f66de2ec2cb2 service nova] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:45.590081 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0624041e-2626-4a2e-b557-44c0cf4c7340 req-be40e1b6-5e3d-4ad9-acdd-f66de2ec2cb2 service nova] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:45.590212 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0624041e-2626-4a2e-b557-44c0cf4c7340 req-be40e1b6-5e3d-4ad9-acdd-f66de2ec2cb2 service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] No waiting events found dispatching network-vif-unplugged-4e4e8646-56c4-4135-b704-3eda00177287 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:10:45.590367 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0624041e-2626-4a2e-b557-44c0cf4c7340 req-be40e1b6-5e3d-4ad9-acdd-f66de2ec2cb2 service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Received event network-vif-unplugged-4e4e8646-56c4-4135-b704-3eda00177287 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:10:45.736835 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:45.742802 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:45.760639 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999672071000077 future=<Future at 0x7c984c6cb350 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:10:45.762633 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Instance destroyed successfully.
May 28 01:10:45.763325 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-c697bdfa-a615-490f-a563-c132aa31417e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lazy-loading 'resources' on Instance uuid 412ac56c-f524-46c2-91eb-fa4672db46a9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:10:46.016470 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "14f9e91b-230b-468d-940b-39ad40e0eca2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:46.265315 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-c697bdfa-a615-490f-a563-c132aa31417e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:08:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1464485741',display_name='tempest-TestEncryptedCinderVolumes-server-1464485741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testencryptedcindervolumes-server-1464485741',id=59,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaxiVCL/oeyuc6Fn/LaDWPWiO7mXNOG+NJ+ojaTKJd77Zn7nrd05FgcX3093dXQNIvdpDxCbUKUzqvcTZNFcgRrrPUR46mHMo/POLXh0IP7v2hya+rwuFblpqAtbu1bbg==',key_name='tempest-keypair-1398822484',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:10:15Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a430f0d6bcc84a29bc3e96514422896b',ramdisk_id='',reservation_id='r-nu20f4t0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-2086871542',owner_user_name='tempest-TestEncryptedCinderVolumes-2086871542-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:10:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbae7974478d45b3908aaaa5b4408e26',uuid=412ac56c-f524-46c2-91eb-fa4672db46a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e4e8646-56c4-4135-b704-3eda00177287", "address": "fa:16:3e:d7:12:9f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e8646-56", "ovs_interfaceid": "4e4e8646-56c4-4135-b704-3eda00177287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:10:46.265529 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c697bdfa-a615-490f-a563-c132aa31417e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converting VIF {"id": "4e4e8646-56c4-4135-b704-3eda00177287", "address": "fa:16:3e:d7:12:9f", "network": {"id": "7fdf5d94-cd33-4896-a6d5-cdc57ef2d023", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1626834362-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a430f0d6bcc84a29bc3e96514422896b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e4e8646-56", "ovs_interfaceid": "4e4e8646-56c4-4135-b704-3eda00177287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:10:46.266112 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c697bdfa-a615-490f-a563-c132aa31417e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:12:9f,bridge_name='br-int',has_traffic_filtering=True,id=4e4e8646-56c4-4135-b704-3eda00177287,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e8646-56') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:10:46.266347 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-c697bdfa-a615-490f-a563-c132aa31417e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:12:9f,bridge_name='br-int',has_traffic_filtering=True,id=4e4e8646-56c4-4135-b704-3eda00177287,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e8646-56') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:10:46.267656 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:46.267908 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e4e8646-56, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:10:46.268858 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:46.269592 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:10:46.270169 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:46.271210 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:46.271517 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=71810972-d685-43f3-b14c-e59396389e80) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:10:46.271996 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:46.272651 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:10:46.272856 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:46.274838 np0000001577 nova-compute[98319]: INFO os_vif [None req-c697bdfa-a615-490f-a563-c132aa31417e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:12:9f,bridge_name='br-int',has_traffic_filtering=True,id=4e4e8646-56c4-4135-b704-3eda00177287,network=Network(7fdf5d94-cd33-4896-a6d5-cdc57ef2d023),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e4e8646-56')
May 28 01:10:46.275159 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c697bdfa-a615-490f-a563-c132aa31417e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Deleting instance files /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9_del
May 28 01:10:46.279596 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c697bdfa-a615-490f-a563-c132aa31417e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Deletion of /opt/stack/data/nova/instances/412ac56c-f524-46c2-91eb-fa4672db46a9_del complete
May 28 01:10:46.434221 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:10:46.437542 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:10:46.445578 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:10:46.445578 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:10:46.450087 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:10:46.450087 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:46.456328 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:46.461253 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:46.470391 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:46.470391 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:46.470391 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:46.470391 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:46.470391 np0000001577 nova-compute[98319]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:46.470391 np0000001577 nova-compute[98319]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:46.470391 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:10:46.470589 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:46.470589 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:46.470589 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:46.470589 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:46.470589 np0000001577 nova-compute[98319]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:46.470589 np0000001577 nova-compute[98319]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:46.470589 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:10:46.476102 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:46.476102 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:46.476102 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:46.476102 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:46.476102 np0000001577 nova-compute[98319]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:46.476102 np0000001577 nova-compute[98319]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:46.476102 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:10:46.476332 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:46.476332 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:46.476332 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:46.476332 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:46.476332 np0000001577 nova-compute[98319]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:46.476332 np0000001577 nova-compute[98319]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:46.476332 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:10:46.486461 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:10:46.486587 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 01:10:46.486731 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:10:46.509235 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b, portal: 192.168.50.100,3260]
May 28 01:10:46.509235 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b, portal: 192.168.50.100,3260] successful.
May 28 01:10:46.509235 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:46.509694 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b, portal: 192.168.40.100,3260]
May 28 01:10:46.509694 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b, portal: 192.168.40.100,3260] successful.
May 28 01:10:46.509694 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:46.524290 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:46.525141 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:46.532043 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:46.540348 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:46.540348 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:46.540348 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:46.540348 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:46.540348 np0000001577 nova-compute[98319]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:46.540348 np0000001577 nova-compute[98319]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:46.540348 np0000001577 nova-compute[98319]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:46.540348 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:46.540348 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:10:46.540692 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:46.540692 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:46.540692 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:46.540692 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:46.540692 np0000001577 nova-compute[98319]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:46.540692 np0000001577 nova-compute[98319]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:46.540692 np0000001577 nova-compute[98319]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:46.540692 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:46.540692 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:10:46.540941 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.127s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:10:46.541019 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:10:46.542367 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] HCTL ('8', '-', '-', 0) found on session 165 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:10:46.542522 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:10:46.549271 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:46.549271 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:46.549271 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:46.549271 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:46.549271 np0000001577 nova-compute[98319]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:46.549271 np0000001577 nova-compute[98319]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:46.549271 np0000001577 nova-compute[98319]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:46.549271 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:46.549271 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:10:46.549271 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:46.549271 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:46.549271 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:46.549271 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:46.549271 np0000001577 nova-compute[98319]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:46.549271 np0000001577 nova-compute[98319]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:46.549271 np0000001577 nova-compute[98319]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:46.549271 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:46.549271 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:10:46.549271 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.134s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:10:46.549271 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:10:46.549271 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] HCTL ('7', '-', '-', 0) found on session 164 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:10:46.549271 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:10:46.560472 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Searching for a device in session 165 and hctl ['8', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:10:46.561691 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcba93e1-027e-4d13-816c-65749a70f47b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:10:46.579917 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Searching for a device in session 164 and hctl ['7', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:10:46.579917 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'dcba93e1-027e-4d13-816c-65749a70f47b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:10:46.785302 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-c697bdfa-a615-490f-a563-c132aa31417e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Took 1.33 seconds to destroy the instance on the hypervisor.
May 28 01:10:46.786352 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-c697bdfa-a615-490f-a563-c132aa31417e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:10:46.786535 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:10:46.786683 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:10:46.787064 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:46.871667 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:46.974737 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:10:46.975289 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:10:46.977748 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:10:46.980281 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:10:46.980281 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:10:47.057269 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:47.149444 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "14f9e91b-230b-468d-940b-39ad40e0eca2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:47.149444 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "14f9e91b-230b-468d-940b-39ad40e0eca2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:47.149444 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Attaching volume e4bef18a-e690-428c-87a0-441811b1d661 to /dev/vdc
May 28 01:10:47.192904 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:10:47.209834 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:10:47.243590 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:10:47.291016 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:10:47.291789 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:10:47.299953 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a81e3212-71ad-4820-a451-81623c66f014 req-5623da98-cefc-4176-b75a-25da82d604d1 service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Received event network-vif-deleted-4e4e8646-56c4-4135-b704-3eda00177287 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:47.300200 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-a81e3212-71ad-4820-a451-81623c66f014 req-5623da98-cefc-4176-b75a-25da82d604d1 service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Neutron deleted interface 4e4e8646-56c4-4135-b704-3eda00177287; detaching it from the instance and deleting it from the info cache
May 28 01:10:47.310944 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:10:47.310944 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe46:94e9', 'fe80::e873:f8ff:fed0:1522', 'fe80::fc16:3eff:feb9:2b05', 'fe80::84b7:d3ff:feed:4f01', 'fe80::fc16:3eff:fe65:fa89', 'fe80::583c:47ff:fea3:281d', 'fe80::fc16:3eff:fe58:6b6d'] 
May 28 01:10:47.310944 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:10:47.310944 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:10:47.310944 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:10:47.310944 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Updating existing volume attachment record: 8a700349-9ef3-41e8-a933-f82e108152d3 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:10:47.312903 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a81e3212-71ad-4820-a451-81623c66f014 req-5623da98-cefc-4176-b75a-25da82d604d1 service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Detach interface failed, port_id=4e4e8646-56c4-4135-b704-3eda00177287, reason: Instance 412ac56c-f524-46c2-91eb-fa4672db46a9 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:10:47.414606 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:10:47.667968 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-023840b7-4259-40de-a4ca-77beb0d6e705 req-7be18d7b-3b62-41f9-98df-584352335a35 service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Received event network-vif-unplugged-4e4e8646-56c4-4135-b704-3eda00177287 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:47.668495 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-023840b7-4259-40de-a4ca-77beb0d6e705 req-7be18d7b-3b62-41f9-98df-584352335a35 service nova] Acquiring lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:47.668798 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-023840b7-4259-40de-a4ca-77beb0d6e705 req-7be18d7b-3b62-41f9-98df-584352335a35 service nova] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:47.668992 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-023840b7-4259-40de-a4ca-77beb0d6e705 req-7be18d7b-3b62-41f9-98df-584352335a35 service nova] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:47.669193 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-023840b7-4259-40de-a4ca-77beb0d6e705 req-7be18d7b-3b62-41f9-98df-584352335a35 service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] No waiting events found dispatching network-vif-unplugged-4e4e8646-56c4-4135-b704-3eda00177287 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:10:47.669944 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-023840b7-4259-40de-a4ca-77beb0d6e705 req-7be18d7b-3b62-41f9-98df-584352335a35 service nova] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Received event network-vif-unplugged-4e4e8646-56c4-4135-b704-3eda00177287 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:10:47.770922 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:10:47.872532 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:10:47.872532 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661', 'iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e4bef18a-e690-428c-87a0-441811b1d661', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:10:47.872532 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:10:47.979344 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:10:47.979738 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:10:48.273640 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Took 1.49 seconds to deallocate network for instance.
May 28 01:10:48.433905 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Found WWN 33000000094011810 for multipath device dm-2 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:10:48.434347 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:10:48.434384 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] <== connect_volume: return (3184ms) {'type': 'block', 'scsi_wwn': '33000000094011810', 'path': '/dev/dm-2', 'multipath_id': '33000000094011810'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:10:48.434518 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000094011810', 'path': '/dev/dm-2', 'multipath_id': '33000000094011810'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:10:48.435050 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.563s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:10:48.435380 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661', 'iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e4bef18a-e690-428c-87a0-441811b1d661', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:10:48.439645 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lazy-loading 'flavor' on Instance uuid e8151422-37a0-4b7a-914f-34dc2979ead9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:10:48.449143 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:10:48.450139 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:10:48.450709 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:10:48.451213 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:10:48.451441 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:10:48.451785 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:10:48.473390 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:10:48.473390 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:48.479999 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:10:48.479999 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:48.486967 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661] added
May 28 01:10:48.486967 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:10:48.486967 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:10:48.486967 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:10:48.486967 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:10:48.486967 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:10:48.486967 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:48.487279 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:10:48.487408 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0362(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:10:48.487622 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:10:48.490144 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661] added
May 28 01:10:48.490144 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:10:48.490144 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:10:48.490144 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:10:48.490144 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:10:48.490144 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:10:48.490144 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:48.490358 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:10:48.490578 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0391(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:10:48.490711 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:10:48.754618 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:48.781013 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c697bdfa-a615-490f-a563-c132aa31417e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:48.781255 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c697bdfa-a615-490f-a563-c132aa31417e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:48.942591 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Attempting to attach volume dcba93e1-027e-4d13-816c-65749a70f47b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:10:48.944122 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:10:48.944122 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:10:48.944122 np0000001577 nova-compute[98319]:   <alias name="ua-dcba93e1-027e-4d13-816c-65749a70f47b"/>
May 28 01:10:48.944122 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-2"/>
May 28 01:10:48.944122 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:10:48.944122 np0000001577 nova-compute[98319]:   <serial>dcba93e1-027e-4d13-816c-65749a70f47b</serial>
May 28 01:10:48.944122 np0000001577 nova-compute[98319]: </disk>
May 28 01:10:48.944122 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:10:48.976059 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:10:48.976286 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:10:49.105938 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c697bdfa-a615-490f-a563-c132aa31417e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:10:49.110367 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-c697bdfa-a615-490f-a563-c132aa31417e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:10:49.488035 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:10:49.493146 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:10:49.506357 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:10:49.506357 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:10:49.511975 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:10:49.511975 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:49.519775 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:49.524938 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:49.534760 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:49.534760 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:49.534760 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:49.534760 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:49.534760 np0000001577 nova-compute[98319]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:49.534760 np0000001577 nova-compute[98319]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:49.534760 np0000001577 nova-compute[98319]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:49.534760 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:49.534760 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:10:49.535018 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:49.535018 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:49.535018 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:49.535018 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:49.535018 np0000001577 nova-compute[98319]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:49.535018 np0000001577 nova-compute[98319]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:49.535018 np0000001577 nova-compute[98319]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:49.535018 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:49.535018 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:10:49.542912 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:49.542912 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:49.542912 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:49.542912 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:49.542912 np0000001577 nova-compute[98319]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:49.542912 np0000001577 nova-compute[98319]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:49.542912 np0000001577 nova-compute[98319]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:49.542912 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:49.542912 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:10:49.543153 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:49.543153 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:49.543153 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:49.543153 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:49.543153 np0000001577 nova-compute[98319]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:49.543153 np0000001577 nova-compute[98319]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:49.543153 np0000001577 nova-compute[98319]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:49.543153 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:49.543153 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:10:49.575618 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661, portal: 192.168.40.100,3260]
May 28 01:10:49.575618 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661, portal: 192.168.40.100,3260] successful.
May 28 01:10:49.575618 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:49.581246 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661, portal: 192.168.50.100,3260]
May 28 01:10:49.581246 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661, portal: 192.168.50.100,3260] successful.
May 28 01:10:49.581246 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:49.587741 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:49.594884 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:49.606826 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:49.606826 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:49.606826 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:49.606826 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:49.606826 np0000001577 nova-compute[98319]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:49.606826 np0000001577 nova-compute[98319]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:49.606826 np0000001577 nova-compute[98319]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:49.606826 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:49.606826 np0000001577 nova-compute[98319]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:10:49.606826 np0000001577 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:10:49.606826 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:10:49.607087 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:49.607087 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:49.607087 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:49.607087 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:49.607087 np0000001577 nova-compute[98319]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:49.607087 np0000001577 nova-compute[98319]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:49.607087 np0000001577 nova-compute[98319]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:49.607087 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:49.607087 np0000001577 nova-compute[98319]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:10:49.607087 np0000001577 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:10:49.607087 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:10:49.607562 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:10:49.607688 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:10:49.608991 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] HCTL ('11', '-', '-', 0) found on session 166 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:10:49.609182 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:10:49.609505 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:49.609505 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:49.609505 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:49.609505 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:49.609505 np0000001577 nova-compute[98319]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:49.609505 np0000001577 nova-compute[98319]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:49.609505 np0000001577 nova-compute[98319]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:49.609505 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:49.609505 np0000001577 nova-compute[98319]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:10:49.609505 np0000001577 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:10:49.609505 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:10:49.609755 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:49.609755 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:49.609755 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:49.609755 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:49.609755 np0000001577 nova-compute[98319]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:49.609755 np0000001577 nova-compute[98319]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:49.609755 np0000001577 nova-compute[98319]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:49.609755 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:49.609755 np0000001577 nova-compute[98319]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:10:49.609755 np0000001577 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:10:49.609755 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:10:49.609956 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:10:49.609956 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:10:49.610874 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] HCTL ('16', '-', '-', 0) found on session 167 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:10:49.610976 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:10:49.614530 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-c697bdfa-a615-490f-a563-c132aa31417e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:10:49.624738 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Searching for a device in session 166 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:10:49.624851 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e4bef18a-e690-428c-87a0-441811b1d661', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:10:49.636625 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Searching for a device in session 167 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:10:49.636951 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e4bef18a-e690-428c-87a0-441811b1d661', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:10:49.977904 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:10:49.978241 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:10:50.120967 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c697bdfa-a615-490f-a563-c132aa31417e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.340s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:50.168073 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-c697bdfa-a615-490f-a563-c132aa31417e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Deleted allocations for instance 412ac56c-f524-46c2-91eb-fa4672db46a9
May 28 01:10:50.451267 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:10:50.605626 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:10:50.605735 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:10:50.605832 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:10:50.605928 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No VIF found with MAC fa:16:3e:65:fa:89, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:10:51.174895 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c697bdfa-a615-490f-a563-c132aa31417e tempest-TestEncryptedCinderVolumes-2086871542 tempest-TestEncryptedCinderVolumes-2086871542-project-member] Lock "412ac56c-f524-46c2-91eb-fa4672db46a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.231s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:51.273202 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:51.467486 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Found WWN 33000000050dde13c for multipath device dm-4 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:10:51.467728 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:10:51.469088 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] <== connect_volume: return (3595ms) {'type': 'block', 'scsi_wwn': '33000000050dde13c', 'path': '/dev/dm-4', 'multipath_id': '33000000050dde13c'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:10:51.469088 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000050dde13c', 'path': '/dev/dm-4', 'multipath_id': '33000000050dde13c'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:10:51.471603 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lazy-loading 'flavor' on Instance uuid 14f9e91b-230b-468d-940b-39ad40e0eca2 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:10:51.531070 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:51.863226 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "e8151422-37a0-4b7a-914f-34dc2979ead9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:51.972891 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Attempting to attach volume e4bef18a-e690-428c-87a0-441811b1d661 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:10:51.974561 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:10:51.974561 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:10:51.974561 np0000001577 nova-compute[98319]:   <alias name="ua-e4bef18a-e690-428c-87a0-441811b1d661"/>
May 28 01:10:51.974561 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-4"/>
May 28 01:10:51.974561 np0000001577 nova-compute[98319]:   <target dev="vdc" bus="virtio"/>
May 28 01:10:51.974561 np0000001577 nova-compute[98319]:   <serial>e4bef18a-e690-428c-87a0-441811b1d661</serial>
May 28 01:10:51.974561 np0000001577 nova-compute[98319]: </disk>
May 28 01:10:51.974561 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:10:52.156862 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0dc12a32-d768-412b-a489-c7c3808d6036 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.602s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:52.157692 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.294s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:52.317286 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:52.664207 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lazy-loading 'flavor' on Instance uuid e8151422-37a0-4b7a-914f-34dc2979ead9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:10:53.623653 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:10:53.623653 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:10:53.623653 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:10:53.623653 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:10:53.623653 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] No VIF found with MAC fa:16:3e:b9:2b:05, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:10:53.669080 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:53.750030 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:53.837977 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0003816869998445327 future=<Future at 0x7c984c4c5e20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:10:53.838025 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:10:53.838101 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=6.9221780460002265 future=<Future at 0x7c984c6cb350 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:10:53.838188 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=6.9220950409999205 future=<Future at 0x7c984c6cb350 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:10:53.838645 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Emitting event <LifecycleEvent: 1779930638.8374481, 4d7b37c7-b091-44f7-a330-4e55e2b1e348 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:10:53.838997 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] VM Stopped (Lifecycle Event)
May 28 01:10:54.317471 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:54.341385 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ee5174e0-20f6-469c-b659-fb249b060d29 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 4d7b37c7-b091-44f7-a330-4e55e2b1e348] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:10:54.432566 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "e8151422-37a0-4b7a-914f-34dc2979ead9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:54.432735 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:54.432923 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Attaching volume e92af439-ed11-4ca7-994a-5580fa2498cc to /dev/vdc
May 28 01:10:54.465650 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:10:54.475736 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:10:54.497966 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:10:54.547669 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:10:54.547950 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:10:54.556139 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:10:54.558624 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe46:94e9', 'fe80::e873:f8ff:fed0:1522', 'fe80::fc16:3eff:feb9:2b05', 'fe80::84b7:d3ff:feed:4f01', 'fe80::fc16:3eff:fe65:fa89', 'fe80::583c:47ff:fea3:281d', 'fe80::fc16:3eff:fe58:6b6d'] 
May 28 01:10:54.558732 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:10:54.558900 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:10:54.559055 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] <== get_connector_properties: return (93ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:10:54.559941 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Updating existing volume attachment record: afe026a2-0430-4a75-b86f-c236a79acb7b {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:10:55.126675 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e92af439-ed11-4ca7-994a-5580fa2498cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'e8151422-37a0-4b7a-914f-34dc2979ead9', 'attached_at': '', 'detached_at': '', 'volume_id': 'e92af439-ed11-4ca7-994a-5580fa2498cc', 'serial': 'e92af439-ed11-4ca7-994a-5580fa2498cc'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 01:10:55.130475 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:10:55.130853 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e92af439-ed11-4ca7-994a-5580fa2498cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:10:55.130996 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:10:55.173169 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c2bfc1e1-a70f-468e-a4d2-52b8e4a1e608 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "14f9e91b-230b-468d-940b-39ad40e0eca2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.025s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:56.065273 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:56.179195 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:10:56.217517 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:56.273874 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:56.298392 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "14f9e91b-230b-468d-940b-39ad40e0eca2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:56.298620 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "14f9e91b-230b-468d-940b-39ad40e0eca2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:56.532205 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:56.801336 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Detaching volume e18c498d-23b8-44dc-a0c5-434983238967
May 28 01:10:56.846789 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Attempting to driver detach volume e18c498d-23b8-44dc-a0c5-434983238967 from mountpoint /dev/vdb
May 28 01:10:56.859031 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Found disk vdb by alias ua-e18c498d-23b8-44dc-a0c5-434983238967 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:10:56.860034 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Found disk vdb by alias ua-e18c498d-23b8-44dc-a0c5-434983238967 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:10:56.860781 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Attempting to detach device vdb from instance 14f9e91b-230b-468d-940b-39ad40e0eca2 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:10:56.860781 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:10:56.860781 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:10:56.860781 np0000001577 nova-compute[98319]:   <alias name="ua-e18c498d-23b8-44dc-a0c5-434983238967"/>
May 28 01:10:56.860781 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-10"/>
May 28 01:10:56.860781 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:10:56.860781 np0000001577 nova-compute[98319]:   <serial>e18c498d-23b8-44dc-a0c5-434983238967</serial>
May 28 01:10:56.860781 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:10:56.860781 np0000001577 nova-compute[98319]: </disk>
May 28 01:10:56.860781 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:10:56.868829 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Successfully detached device vdb from instance 14f9e91b-230b-468d-940b-39ad40e0eca2 from the persistent domain config.
May 28 01:10:56.868829 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] (1/8): Attempting to detach device vdb with device alias ua-e18c498d-23b8-44dc-a0c5-434983238967 from instance 14f9e91b-230b-468d-940b-39ad40e0eca2 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:10:56.868829 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:10:56.868829 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:10:56.868829 np0000001577 nova-compute[98319]:   <alias name="ua-e18c498d-23b8-44dc-a0c5-434983238967"/>
May 28 01:10:56.868829 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-10"/>
May 28 01:10:56.868829 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:10:56.868829 np0000001577 nova-compute[98319]:   <serial>e18c498d-23b8-44dc-a0c5-434983238967</serial>
May 28 01:10:56.868829 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:10:56.868829 np0000001577 nova-compute[98319]: </disk>
May 28 01:10:56.868829 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:10:56.887083 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.756s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:10:56.887268 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e92af439-ed11-4ca7-994a-5580fa2498cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:10:56.902843 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:10:56.902843 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:10:56.903114 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:10:56.910579 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:10:56.910579 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:10:56.910579 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:10:56.915780 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:10:56.915780 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:56.926033 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:10:56.926033 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:56.934666 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc] added
May 28 01:10:56.934666 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:10:56.934666 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:10:56.934666 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:10:56.934666 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:10:56.934666 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:10:56.934666 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:56.935149 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:10:56.935149 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0319(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:10:56.935250 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:10:56.938941 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc] added
May 28 01:10:56.938941 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:10:56.938941 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:10:56.938941 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:10:56.938941 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:10:56.938941 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:10:56.938941 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:56.939202 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:10:56.939202 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0306(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:10:56.939299 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:10:57.462211 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930657.4617848, 14f9e91b-230b-468d-940b-39ad40e0eca2 => ua-e18c498d-23b8-44dc-a0c5-434983238967> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:10:57.466655 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e18c498d-23b8-44dc-a0c5-434983238967 for instance 14f9e91b-230b-468d-940b-39ad40e0eca2 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:10:57.468701 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Successfully detached device vdb from instance 14f9e91b-230b-468d-940b-39ad40e0eca2 from the live domain config.
May 28 01:10:57.469940 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:10:57.470026 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967', 'iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e18c498d-23b8-44dc-a0c5-434983238967', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:10:57.470132 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:10:57.656379 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:10:57.936896 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:10:57.939741 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:10:57.949729 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:10:57.949729 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:10:57.960717 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:10:57.960717 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:57.964641 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:57.976450 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:57.989845 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:57.989845 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:57.989845 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:57.989845 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:57.989845 np0000001577 nova-compute[98319]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:57.989845 np0000001577 nova-compute[98319]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:57.989845 np0000001577 nova-compute[98319]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:57.989845 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:57.989845 np0000001577 nova-compute[98319]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:10:57.989845 np0000001577 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:10:57.989845 np0000001577 nova-compute[98319]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd3414e6-fa0f-4d28-965a-251213673d35 (non-flash)
May 28 01:10:57.989845 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:10:57.990337 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:57.990337 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:57.990337 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:57.990337 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:57.990337 np0000001577 nova-compute[98319]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:57.990337 np0000001577 nova-compute[98319]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:57.990337 np0000001577 nova-compute[98319]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:57.990337 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:57.990337 np0000001577 nova-compute[98319]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:10:57.990337 np0000001577 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:10:57.990337 np0000001577 nova-compute[98319]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd3414e6-fa0f-4d28-965a-251213673d35 (non-flash)
May 28 01:10:57.990337 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:10:57.993721 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:57.993721 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:57.993721 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:57.993721 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:57.993721 np0000001577 nova-compute[98319]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:57.993721 np0000001577 nova-compute[98319]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:57.993721 np0000001577 nova-compute[98319]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:57.993721 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:57.993721 np0000001577 nova-compute[98319]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:10:57.993721 np0000001577 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:10:57.993721 np0000001577 nova-compute[98319]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd3414e6-fa0f-4d28-965a-251213673d35 (non-flash)
May 28 01:10:57.993721 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:10:57.994068 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:57.994068 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:57.994068 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:57.994068 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:57.994068 np0000001577 nova-compute[98319]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:57.994068 np0000001577 nova-compute[98319]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:57.994068 np0000001577 nova-compute[98319]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:57.994068 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:57.994068 np0000001577 nova-compute[98319]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:10:57.994068 np0000001577 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:10:57.994068 np0000001577 nova-compute[98319]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd3414e6-fa0f-4d28-965a-251213673d35 (non-flash)
May 28 01:10:57.994068 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:10:58.044410 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc, portal: 192.168.40.100,3260]
May 28 01:10:58.044410 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc, portal: 192.168.40.100,3260] successful.
May 28 01:10:58.044410 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:58.058697 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:58.065741 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc, portal: 192.168.50.100,3260]
May 28 01:10:58.065741 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc, portal: 192.168.50.100,3260] successful.
May 28 01:10:58.065741 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:58.078384 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:58.078384 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:58.078384 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:58.078384 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:58.078384 np0000001577 nova-compute[98319]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:58.078384 np0000001577 nova-compute[98319]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:58.078384 np0000001577 nova-compute[98319]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:58.078384 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:58.078384 np0000001577 nova-compute[98319]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:10:58.078384 np0000001577 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:10:58.078384 np0000001577 nova-compute[98319]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd3414e6-fa0f-4d28-965a-251213673d35 (non-flash)
May 28 01:10:58.078384 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:10:58.078384 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:10:58.078384 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:10:58.078681 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:58.078681 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:58.078681 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:58.078681 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:58.078681 np0000001577 nova-compute[98319]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:58.078681 np0000001577 nova-compute[98319]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:58.078681 np0000001577 nova-compute[98319]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:58.078681 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:58.078681 np0000001577 nova-compute[98319]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:10:58.078681 np0000001577 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:10:58.078681 np0000001577 nova-compute[98319]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd3414e6-fa0f-4d28-965a-251213673d35 (non-flash)
May 28 01:10:58.078681 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:10:58.078681 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:10:58.078681 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:10:58.078956 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.176s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:10:58.078956 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:10:58.079510 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:10:58.080861 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] HCTL ('18', '-', '-', 0) found on session 169 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:10:58.080972 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:10:58.096532 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Searching for a device in session 169 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:10:58.096746 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e92af439-ed11-4ca7-994a-5580fa2498cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:10:58.097999 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:58.097999 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:58.097999 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:58.097999 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:58.097999 np0000001577 nova-compute[98319]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:58.097999 np0000001577 nova-compute[98319]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:58.097999 np0000001577 nova-compute[98319]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:58.097999 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:58.097999 np0000001577 nova-compute[98319]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:10:58.097999 np0000001577 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:10:58.097999 np0000001577 nova-compute[98319]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd3414e6-fa0f-4d28-965a-251213673d35 (non-flash)
May 28 01:10:58.097999 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:10:58.097999 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:10:58.097999 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:10:58.099760 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:58.099760 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:58.099760 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:58.099760 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:58.099760 np0000001577 nova-compute[98319]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:58.099760 np0000001577 nova-compute[98319]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:58.099760 np0000001577 nova-compute[98319]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:58.099760 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:58.099760 np0000001577 nova-compute[98319]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:10:58.099760 np0000001577 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:10:58.099760 np0000001577 nova-compute[98319]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd3414e6-fa0f-4d28-965a-251213673d35 (non-flash)
May 28 01:10:58.099760 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:10:58.099760 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:10:58.099760 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:10:58.100207 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.191s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:10:58.100437 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:10:58.102036 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] HCTL ('19', '-', '-', 0) found on session 170 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:10:58.102445 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:10:58.120113 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Searching for a device in session 170 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:10:58.120255 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e92af439-ed11-4ca7-994a-5580fa2498cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:10:58.908850 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:10:59.384911 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-33046243-72b1-4f23-bf50-9a56ee330206 req-00353726-91d5-400f-a418-c3ac38a002cf service nova] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Received event network-changed-939d5f23-c81b-44c1-a5b5-3facfb23bd08 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:10:59.385126 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-33046243-72b1-4f23-bf50-9a56ee330206 req-00353726-91d5-400f-a418-c3ac38a002cf service nova] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Refreshing instance network info cache due to event network-changed-939d5f23-c81b-44c1-a5b5-3facfb23bd08. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:10:59.385307 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-33046243-72b1-4f23-bf50-9a56ee330206 req-00353726-91d5-400f-a418-c3ac38a002cf service nova] Acquiring lock "refresh_cache-38636bdc-bca3-469b-80d7-05d8fa9e1c78" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:10:59.385396 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-33046243-72b1-4f23-bf50-9a56ee330206 req-00353726-91d5-400f-a418-c3ac38a002cf service nova] Acquired lock "refresh_cache-38636bdc-bca3-469b-80d7-05d8fa9e1c78" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:10:59.385523 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-33046243-72b1-4f23-bf50-9a56ee330206 req-00353726-91d5-400f-a418-c3ac38a002cf service nova] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Refreshing network info cache for port 939d5f23-c81b-44c1-a5b5-3facfb23bd08 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:10:59.887325 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-33046243-72b1-4f23-bf50-9a56ee330206 req-00353726-91d5-400f-a418-c3ac38a002cf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:10:59.903418 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "38636bdc-bca3-469b-80d7-05d8fa9e1c78" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:59.903589 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "38636bdc-bca3-469b-80d7-05d8fa9e1c78" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:59.903755 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "38636bdc-bca3-469b-80d7-05d8fa9e1c78-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:10:59.903901 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "38636bdc-bca3-469b-80d7-05d8fa9e1c78-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:10:59.903994 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "38636bdc-bca3-469b-80d7-05d8fa9e1c78-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:10:59.905647 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Terminating instance
May 28 01:10:59.926372 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Found WWN 330000000842784d6 for multipath device dm-5 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:10:59.926861 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:10:59.927157 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.457s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:10:59.927434 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967', 'iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e18c498d-23b8-44dc-a0c5-434983238967', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:10:59.927596 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:10:59.930607 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] <== connect_volume: return (4797ms) {'type': 'block', 'scsi_wwn': '330000000842784d6', 'path': '/dev/disk/by-id/os-brick+dev+dm-5', 'multipath_id': '330000000842784d6'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:10:59.930827 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000842784d6', 'path': '/dev/disk/by-id/os-brick+dev+dm-5', 'multipath_id': '330000000842784d6'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:10:59.932693 np0000001577 nova-compute[98319]: WARNING stevedore.named [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 01:10:59.932959 np0000001577 nova-compute[98319]: WARNING castellan.key_manager [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:10:59.933147 np0000001577 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:10:59.957291 np0000001577 nova-compute[98319]: WARNING os_brick.encryptors.luks [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 28 01:10:59.957661 np0000001577 nova-compute[98319]: WARNING stevedore.named [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 01:10:59.959199 np0000001577 nova-compute[98319]: WARNING castellan.key_manager [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:10:59.959199 np0000001577 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:10:59.959199 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x7c984c3642c0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e92af439-ed11-4ca7-994a-5580fa2498cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-5'}, 'status': 'reserved', 'instance': 'e8151422-37a0-4b7a-914f-34dc2979ead9', 'attached_at': '', 'detached_at': '', 'volume_id': 'e92af439-ed11-4ca7-994a-5580fa2498cc', 'serial': 'e92af439-ed11-4ca7-994a-5580fa2498cc'} {{(pid=98319) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 01:10:59.959199 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors.luks [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] formatting encrypted volume /dev/dm-5 {{(pid=98319) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 28 01:10:59.966172 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:59.966172 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:59.966172 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:59.966172 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:59.966172 np0000001577 nova-compute[98319]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:59.966172 np0000001577 nova-compute[98319]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:59.966172 np0000001577 nova-compute[98319]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:59.966172 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:59.966172 np0000001577 nova-compute[98319]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:10:59.966172 np0000001577 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:10:59.966172 np0000001577 nova-compute[98319]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd3414e6-fa0f-4d28-965a-251213673d35 (non-flash)
May 28 01:10:59.966172 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:10:59.966172 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:10:59.966172 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:10:59.966615 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:59.966615 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:10:59.966615 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:59.966615 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:10:59.966615 np0000001577 nova-compute[98319]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:59.966615 np0000001577 nova-compute[98319]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967 (non-flash)
May 28 01:10:59.966615 np0000001577 nova-compute[98319]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:59.966615 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:10:59.966615 np0000001577 nova-compute[98319]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:10:59.966615 np0000001577 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:10:59.966615 np0000001577 nova-compute[98319]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd3414e6-fa0f-4d28-965a-251213673d35 (non-flash)
May 28 01:10:59.966615 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:10:59.966615 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:10:59.966615 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:10:59.966615 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', '146'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', '147'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e', '157'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e', '158'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967', '162'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967', '163'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', '164'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', '165'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661', '166'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661', '167'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd3414e6-fa0f-4d28-965a-251213673d35', '168'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', '169'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', '170')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:10:59.966615 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967', '163')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:10:59.968101 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967', '162')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:10:59.969095 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c984c52d800>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967'): ({'sdg'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:10:59.969279 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Removing multipathed devices sdj, sdg {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:10:59.969788 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Flush multipath device 330000000e9ecb9f5 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:10:59.997725 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:11:00.046919 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:11:00.089735 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Checking to see if SCSI volumes sdj, sdg have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:11:00.089934 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] SCSI volumes sdj, sdg have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:11:00.091229 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Checking to see if device paths {'sdj', 'sdg'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:11:00.104972 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Device paths {'sdj', 'sdg'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:11:00.105195 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:11:00.117469 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:00.169385 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 163, target: iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967, portal: 192.168.40.100,3260]
May 28 01:11:00.169385 np0000001577 nova-compute[98319]: Logout of [sid: 163, target: iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967, portal: 192.168.40.100,3260] successful.
May 28 01:11:00.169385 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:00.205191 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:00.218949 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:00.243621 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-33046243-72b1-4f23-bf50-9a56ee330206 req-00353726-91d5-400f-a418-c3ac38a002cf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:00.256474 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:00.262390 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 162, target: iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967, portal: 192.168.50.100,3260]
May 28 01:11:00.262390 np0000001577 nova-compute[98319]: Logout of [sid: 162, target: iqn.2023-03.storpool.com:os--volume-e18c498d-23b8-44dc-a0c5-434983238967, portal: 192.168.50.100,3260] successful.
May 28 01:11:00.262390 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:00.296476 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:00.296713 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:11:00.296862 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] <== disconnect_volume: return (2827ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:11:00.297099 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:11:00.370481 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-33046243-72b1-4f23-bf50-9a56ee330206 req-00353726-91d5-400f-a418-c3ac38a002cf service nova] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Updated VIF entry in instance network info cache for port 939d5f23-c81b-44c1-a5b5-3facfb23bd08. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:11:00.371105 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-33046243-72b1-4f23-bf50-9a56ee330206 req-00353726-91d5-400f-a418-c3ac38a002cf service nova] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Updating instance_info_cache with network_info: [{"id": "939d5f23-c81b-44c1-a5b5-3facfb23bd08", "address": "fa:16:3e:58:6b:6d", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap939d5f23-c8", "ovs_interfaceid": "939d5f23-c81b-44c1-a5b5-3facfb23bd08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:11:00.408211 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:11:00.429873 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:00.450264 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:00.591662 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:00.597042 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:00.707774 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:00.720247 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:00.739247 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999715599999945 future=<Future at 0x7c984c5ef9b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:11:00.742250 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Instance destroyed successfully.
May 28 01:11:00.742873 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lazy-loading 'resources' on Instance uuid 38636bdc-bca3-469b-80d7-05d8fa9e1c78 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:11:00.760712 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0004081229999428615 future=<Future at 0x7c984c6cb350 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:11:00.761614 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:11:00.762108 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] Emitting event <LifecycleEvent: 1779930645.7602146, 412ac56c-f524-46c2-91eb-fa4672db46a9 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:11:00.762373 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.976488512999822 future=<Future at 0x7c984c5ef9b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:11:00.762679 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] VM Stopped (Lifecycle Event)
May 28 01:11:00.763949 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.97486863999984 future=<Future at 0x7c984c5ef9b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:11:00.862863 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lazy-loading 'flavor' on Instance uuid 14f9e91b-230b-468d-940b-39ad40e0eca2 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:11:00.877732 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-33046243-72b1-4f23-bf50-9a56ee330206 req-00353726-91d5-400f-a418-c3ac38a002cf service nova] Releasing lock "refresh_cache-38636bdc-bca3-469b-80d7-05d8fa9e1c78" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:11:01.247632 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:10:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-607844118',display_name='tempest-TestVolumeBootPattern-server-607844118',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpattern-server-607844118',id=65,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLDywRMt1gYjzqU0nLt38yv/dkf6iz5rhLwqujx5EHrUiUYa0LEwAEl6oAEMxfnED+yXkyyB7J9zFdusIexML2cYEzV2m5bo9N6+7QjUI/1FFtVJ+XDyI2kpbVbncy1iQ==',key_name='tempest-TestVolumeBootPattern-1635525277',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:10:20Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='050f928f1ce449d6a447cd343dc4ff80',ramdisk_id='',reservation_id='r-bnobdv7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1449742411',owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:10:21Z,user_data=None,user_id='0c803ddeaf4f4b3db07587419087b3b2',uuid=38636bdc-bca3-469b-80d7-05d8fa9e1c78,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "939d5f23-c81b-44c1-a5b5-3facfb23bd08", "address": "fa:16:3e:58:6b:6d", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap939d5f23-c8", "ovs_interfaceid": "939d5f23-c81b-44c1-a5b5-3facfb23bd08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:11:01.248186 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converting VIF {"id": "939d5f23-c81b-44c1-a5b5-3facfb23bd08", "address": "fa:16:3e:58:6b:6d", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap939d5f23-c8", "ovs_interfaceid": "939d5f23-c81b-44c1-a5b5-3facfb23bd08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:11:01.248327 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:6b:6d,bridge_name='br-int',has_traffic_filtering=True,id=939d5f23-c81b-44c1-a5b5-3facfb23bd08,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap939d5f23-c8') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:11:01.248630 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:6b:6d,bridge_name='br-int',has_traffic_filtering=True,id=939d5f23-c81b-44c1-a5b5-3facfb23bd08,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap939d5f23-c8') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:11:01.249768 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:01.249968 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap939d5f23-c8, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:11:01.250865 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:01.251504 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:11:01.253045 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:01.253788 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:01.254001 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ce96ce5-92d4-4861-bfd5-b897a838a13b) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:11:01.254705 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:01.255215 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:11:01.256462 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:01.258126 np0000001577 nova-compute[98319]: INFO os_vif [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:6b:6d,bridge_name='br-int',has_traffic_filtering=True,id=939d5f23-c81b-44c1-a5b5-3facfb23bd08,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap939d5f23-c8')
May 28 01:11:01.259752 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:11:01.260053 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e', 'iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d4682bb-7f09-4e32-8669-e6904066213e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:11:01.260251 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:11:01.266152 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-bea8f178-3855-49d0-b0c9-0e444876c51e tempest-VolumesBackupsTest-876673241 tempest-VolumesBackupsTest-876673241-project-member] [instance: 412ac56c-f524-46c2-91eb-fa4672db46a9] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:11:01.533496 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:01.691329 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "14f9e91b-230b-468d-940b-39ad40e0eca2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:01.872707 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3f7ce4aa-af41-4217-b6a7-1fb6a9edc936 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "14f9e91b-230b-468d-940b-39ad40e0eca2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.573s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:01.873416 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "14f9e91b-230b-468d-940b-39ad40e0eca2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.181s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:02.356600 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:02.379150 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Detaching volume e4bef18a-e690-428c-87a0-441811b1d661
May 28 01:11:02.433701 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Attempting to driver detach volume e4bef18a-e690-428c-87a0-441811b1d661 from mountpoint /dev/vdc
May 28 01:11:02.440483 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Found disk vdc by alias ua-e4bef18a-e690-428c-87a0-441811b1d661 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:11:02.442120 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Found disk vdc by alias ua-e4bef18a-e690-428c-87a0-441811b1d661 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:11:02.442259 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Attempting to detach device vdc from instance 14f9e91b-230b-468d-940b-39ad40e0eca2 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:11:02.442450 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:11:02.442450 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:11:02.442450 np0000001577 nova-compute[98319]:   <alias name="ua-e4bef18a-e690-428c-87a0-441811b1d661"/>
May 28 01:11:02.442450 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-4"/>
May 28 01:11:02.442450 np0000001577 nova-compute[98319]:   <target dev="vdc" bus="virtio"/>
May 28 01:11:02.442450 np0000001577 nova-compute[98319]:   <serial>e4bef18a-e690-428c-87a0-441811b1d661</serial>
May 28 01:11:02.442450 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 01:11:02.442450 np0000001577 nova-compute[98319]: </disk>
May 28 01:11:02.442450 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:11:02.459794 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Successfully detached device vdc from instance 14f9e91b-230b-468d-940b-39ad40e0eca2 from the persistent domain config.
May 28 01:11:02.460066 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] (1/8): Attempting to detach device vdc with device alias ua-e4bef18a-e690-428c-87a0-441811b1d661 from instance 14f9e91b-230b-468d-940b-39ad40e0eca2 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:11:02.460339 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:11:02.460339 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:11:02.460339 np0000001577 nova-compute[98319]:   <alias name="ua-e4bef18a-e690-428c-87a0-441811b1d661"/>
May 28 01:11:02.460339 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-4"/>
May 28 01:11:02.460339 np0000001577 nova-compute[98319]:   <target dev="vdc" bus="virtio"/>
May 28 01:11:02.460339 np0000001577 nova-compute[98319]:   <serial>e4bef18a-e690-428c-87a0-441811b1d661</serial>
May 28 01:11:02.460339 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 01:11:02.460339 np0000001577 nova-compute[98319]: </disk>
May 28 01:11:02.460339 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:11:02.613483 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.353s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:11:02.613803 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e', 'iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d4682bb-7f09-4e32-8669-e6904066213e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:11:02.614414 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:11:02.647071 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:11:02.647071 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:11:02.647071 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:11:02.647071 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:11:02.647071 np0000001577 nova-compute[98319]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:02.647071 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:02.647071 np0000001577 nova-compute[98319]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:11:02.647071 np0000001577 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:11:02.647071 np0000001577 nova-compute[98319]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd3414e6-fa0f-4d28-965a-251213673d35 (non-flash)
May 28 01:11:02.647071 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:02.647071 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:02.647071 np0000001577 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9722a93-f02e-49d6-9358-c68dd8574b4e (non-flash)
May 28 01:11:02.647071 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:11:02.647526 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:11:02.647526 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:11:02.647526 np0000001577 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:11:02.647526 np0000001577 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e (non-flash)
May 28 01:11:02.647526 np0000001577 nova-compute[98319]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:02.647526 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:02.647526 np0000001577 nova-compute[98319]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:11:02.647526 np0000001577 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:11:02.647526 np0000001577 nova-compute[98319]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd3414e6-fa0f-4d28-965a-251213673d35 (non-flash)
May 28 01:11:02.647526 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:02.647526 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:02.647526 np0000001577 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9722a93-f02e-49d6-9358-c68dd8574b4e (non-flash)
May 28 01:11:02.647526 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:11:02.647526 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', '146'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', '147'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e', '157'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e', '158'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', '164'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', '165'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661', '166'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661', '167'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd3414e6-fa0f-4d28-965a-251213673d35', '168'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', '169'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', '170'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9722a93-f02e-49d6-9358-c68dd8574b4e', '171')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:11:02.647526 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e', '157')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:11:02.648423 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e', '158')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:11:02.649295 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c984c775d00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e'): ({'sdi'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:11:02.649459 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Removing multipathed devices sdh, sdi {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:11:02.649664 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Flush multipath device 330000000d04168f1 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:11:02.701400 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:11:02.751323 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:11:02.811007 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:11:02.811194 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:11:02.813210 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:11:02.824203 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:11:02.824497 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:11:02.835481 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:02.884703 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 157, target: iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e, portal: 192.168.40.100,3260]
May 28 01:11:02.884703 np0000001577 nova-compute[98319]: Logout of [sid: 157, target: iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e, portal: 192.168.40.100,3260] successful.
May 28 01:11:02.884703 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:02.909037 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:02.924508 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:02.957473 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930662.9571772, 14f9e91b-230b-468d-940b-39ad40e0eca2 => ua-e4bef18a-e690-428c-87a0-441811b1d661> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:11:02.959296 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-e4bef18a-e690-428c-87a0-441811b1d661 for instance 14f9e91b-230b-468d-940b-39ad40e0eca2 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:11:02.960802 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 158, target: iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e, portal: 192.168.50.100,3260]
May 28 01:11:02.960802 np0000001577 nova-compute[98319]: Logout of [sid: 158, target: iqn.2023-03.storpool.com:os--volume-8d4682bb-7f09-4e32-8669-e6904066213e, portal: 192.168.50.100,3260] successful.
May 28 01:11:02.960802 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:02.962731 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Successfully detached device vdc from instance 14f9e91b-230b-468d-940b-39ad40e0eca2 from the live domain config.
May 28 01:11:02.963783 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:11:02.964247 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661', 'iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e4bef18a-e690-428c-87a0-441811b1d661', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:11:02.964367 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:11:02.983949 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:02.983949 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:11:02.983949 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] <== disconnect_volume: return (1722ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:11:02.983949 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:11:02.983949 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Deleting instance files /opt/stack/data/nova/instances/38636bdc-bca3-469b-80d7-05d8fa9e1c78_del
May 28 01:11:02.984169 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.020s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:11:02.984499 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661', 'iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e4bef18a-e690-428c-87a0-441811b1d661', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:11:02.986623 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:11:02.986623 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Deletion of /opt/stack/data/nova/instances/38636bdc-bca3-469b-80d7-05d8fa9e1c78_del complete
May 28 01:11:03.020470 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:11:03.020470 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:11:03.020470 np0000001577 nova-compute[98319]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:03.020470 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:03.020470 np0000001577 nova-compute[98319]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:11:03.020470 np0000001577 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:11:03.020470 np0000001577 nova-compute[98319]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd3414e6-fa0f-4d28-965a-251213673d35 (non-flash)
May 28 01:11:03.020470 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:03.020470 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:03.020470 np0000001577 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9722a93-f02e-49d6-9358-c68dd8574b4e (non-flash)
May 28 01:11:03.020470 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:11:03.020921 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:11:03.020921 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:11:03.020921 np0000001577 nova-compute[98319]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:03.020921 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:03.020921 np0000001577 nova-compute[98319]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:11:03.020921 np0000001577 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661 (non-flash)
May 28 01:11:03.020921 np0000001577 nova-compute[98319]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd3414e6-fa0f-4d28-965a-251213673d35 (non-flash)
May 28 01:11:03.020921 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:03.020921 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:03.020921 np0000001577 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9722a93-f02e-49d6-9358-c68dd8574b4e (non-flash)
May 28 01:11:03.020921 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:11:03.020921 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', '146'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', '147'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', '164'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', '165'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661', '166'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661', '167'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd3414e6-fa0f-4d28-965a-251213673d35', '168'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', '169'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', '170'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9722a93-f02e-49d6-9358-c68dd8574b4e', '171')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:11:03.020921 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661', '166')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:11:03.022578 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661', '167')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:11:03.023661 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c984c777240>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661'): ({'sdk'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:11:03.024003 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Removing multipathed devices sdf, sdk {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:11:03.024406 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Flush multipath device 33000000050dde13c {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:11:03.073571 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:11:03.144830 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:11:03.216818 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Checking to see if SCSI volumes sdf, sdk have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:11:03.217188 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] SCSI volumes sdf, sdk have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:11:03.219020 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Checking to see if device paths {'sdf', 'sdk'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:11:03.234390 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Device paths {'sdf', 'sdk'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:11:03.234554 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:11:03.247967 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:03.281692 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 166, target: iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661, portal: 192.168.40.100,3260]
May 28 01:11:03.281692 np0000001577 nova-compute[98319]: Logout of [sid: 166, target: iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661, portal: 192.168.40.100,3260] successful.
May 28 01:11:03.281692 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:03.307860 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:03.319974 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:03.354008 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 167, target: iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661, portal: 192.168.50.100,3260]
May 28 01:11:03.354008 np0000001577 nova-compute[98319]: Logout of [sid: 167, target: iqn.2023-03.storpool.com:os--volume-e4bef18a-e690-428c-87a0-441811b1d661, portal: 192.168.50.100,3260] successful.
May 28 01:11:03.354008 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:03.370434 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:03.370882 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:11:03.370882 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] <== disconnect_volume: return (406ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:11:03.370958 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:11:03.499591 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Took 3.09 seconds to destroy the instance on the hypervisor.
May 28 01:11:03.500886 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:11:03.501064 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:11:03.501159 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:11:03.501381 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:03.570940 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:03.792364 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 01:11:03.792364 np0000001577 nova-compute[98319]:   <usage type="volume">
May 28 01:11:03.792364 np0000001577 nova-compute[98319]:     <volume>e92af439-ed11-4ca7-994a-5580fa2498cc</volume>
May 28 01:11:03.792364 np0000001577 nova-compute[98319]:   </usage>
May 28 01:11:03.792364 np0000001577 nova-compute[98319]: </secret>
May 28 01:11:03.792364 np0000001577 nova-compute[98319]:  {{(pid=98319) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 01:11:03.794695 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lazy-loading 'flavor' on Instance uuid e8151422-37a0-4b7a-914f-34dc2979ead9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:11:03.870773 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-60323465-f8a9-41ac-90ec-7927c216d9ad req-e6ec0d5a-c1da-4079-aa11-29bad88408f4 service nova] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Received event network-vif-deleted-939d5f23-c81b-44c1-a5b5-3facfb23bd08 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:03.870918 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-60323465-f8a9-41ac-90ec-7927c216d9ad req-e6ec0d5a-c1da-4079-aa11-29bad88408f4 service nova] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Neutron deleted interface 939d5f23-c81b-44c1-a5b5-3facfb23bd08; detaching it from the instance and deleting it from the info cache
May 28 01:11:03.872357 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-60323465-f8a9-41ac-90ec-7927c216d9ad req-e6ec0d5a-c1da-4079-aa11-29bad88408f4 service nova] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Detach interface failed, port_id=939d5f23-c81b-44c1-a5b5-3facfb23bd08, reason: Instance 38636bdc-bca3-469b-80d7-05d8fa9e1c78 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:11:03.921838 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lazy-loading 'flavor' on Instance uuid 14f9e91b-230b-468d-940b-39ad40e0eca2 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:11:04.298165 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Attempting to attach volume e92af439-ed11-4ca7-994a-5580fa2498cc with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:11:04.299677 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:11:04.299677 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:11:04.299677 np0000001577 nova-compute[98319]:   <alias name="ua-e92af439-ed11-4ca7-994a-5580fa2498cc"/>
May 28 01:11:04.299677 np0000001577 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-5"/>
May 28 01:11:04.299677 np0000001577 nova-compute[98319]:   <target dev="vdc" bus="virtio"/>
May 28 01:11:04.299677 np0000001577 nova-compute[98319]:   <serial>e92af439-ed11-4ca7-994a-5580fa2498cc</serial>
May 28 01:11:04.299677 np0000001577 nova-compute[98319]:   <encryption format="luks">
May 28 01:11:04.299677 np0000001577 nova-compute[98319]:     <secret type="passphrase" uuid="749153a9-c5bf-448d-aa49-d547c0857e73"/>
May 28 01:11:04.299677 np0000001577 nova-compute[98319]:   </encryption>
May 28 01:11:04.299677 np0000001577 nova-compute[98319]: </disk>
May 28 01:11:04.299677 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:11:04.327468 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:11:04.831323 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Took 1.33 seconds to deallocate network for instance.
May 28 01:11:04.932464 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-11408435-134b-46c1-b2d0-5d7c0987e2fb tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "14f9e91b-230b-468d-940b-39ad40e0eca2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.058s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:05.312772 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:05.386299 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Took 0.55 seconds to detach 1 volumes for instance.
May 28 01:11:05.892290 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:05.892290 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:06.144568 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:11:06.144793 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:11:06.255464 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:06.279894 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-495dd315-e1a9-403d-b0d3-ef34579132f3 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "14f9e91b-230b-468d-940b-39ad40e0eca2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:06.280058 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-495dd315-e1a9-403d-b0d3-ef34579132f3 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "14f9e91b-230b-468d-940b-39ad40e0eca2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:06.280214 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-495dd315-e1a9-403d-b0d3-ef34579132f3 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "14f9e91b-230b-468d-940b-39ad40e0eca2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:06.280341 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-495dd315-e1a9-403d-b0d3-ef34579132f3 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "14f9e91b-230b-468d-940b-39ad40e0eca2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:06.280539 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-495dd315-e1a9-403d-b0d3-ef34579132f3 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "14f9e91b-230b-468d-940b-39ad40e0eca2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:06.284959 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-495dd315-e1a9-403d-b0d3-ef34579132f3 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Terminating instance
May 28 01:11:06.535626 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:06.647287 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:11:06.792487 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-495dd315-e1a9-403d-b0d3-ef34579132f3 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:11:06.841641 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:06.846494 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:06.859382 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:06.867274 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:06.888146 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:06.892269 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:06.976100 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-21c91f17-24f8-4a97-a803-e67bf37168b3 req-1d91ee25-fd2b-462e-9849-f98888412c01 service nova] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Received event network-vif-unplugged-2d2cecfd-dabf-4512-99c4-fc9703fef8c9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:06.976493 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-21c91f17-24f8-4a97-a803-e67bf37168b3 req-1d91ee25-fd2b-462e-9849-f98888412c01 service nova] Acquiring lock "14f9e91b-230b-468d-940b-39ad40e0eca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:06.976683 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-21c91f17-24f8-4a97-a803-e67bf37168b3 req-1d91ee25-fd2b-462e-9849-f98888412c01 service nova] Lock "14f9e91b-230b-468d-940b-39ad40e0eca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:06.976800 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-21c91f17-24f8-4a97-a803-e67bf37168b3 req-1d91ee25-fd2b-462e-9849-f98888412c01 service nova] Lock "14f9e91b-230b-468d-940b-39ad40e0eca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:06.977235 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-21c91f17-24f8-4a97-a803-e67bf37168b3 req-1d91ee25-fd2b-462e-9849-f98888412c01 service nova] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] No waiting events found dispatching network-vif-unplugged-2d2cecfd-dabf-4512-99c4-fc9703fef8c9 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:11:06.977235 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-21c91f17-24f8-4a97-a803-e67bf37168b3 req-1d91ee25-fd2b-462e-9849-f98888412c01 service nova] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Received event network-vif-unplugged-2d2cecfd-dabf-4512-99c4-fc9703fef8c9 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:11:06.995368 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:11:06.995597 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:11:06.995711 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:11:06.995766 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:11:06.995939 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No VIF found with MAC fa:16:3e:65:fa:89, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:11:07.086988 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:07.092719 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:07.117647 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999668595000003 future=<Future at 0x7c984c37ad50 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:11:07.119039 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Instance destroyed successfully.
May 28 01:11:07.120257 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-495dd315-e1a9-403d-b0d3-ef34579132f3 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lazy-loading 'resources' on Instance uuid 14f9e91b-230b-468d-940b-39ad40e0eca2 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:11:07.154575 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.261s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:07.201650 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Deleted allocations for instance 38636bdc-bca3-469b-80d7-05d8fa9e1c78
May 28 01:11:07.623032 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-495dd315-e1a9-403d-b0d3-ef34579132f3 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:09:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1850765549',display_name='tempest-AttachVolumeTestJSON-server-1850765549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumetestjson-server-1850765549',id=63,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEttzIubeiZHK2PdkGVJrORKil8eH52WCWdL7xrJ/dy/8TyvuPIDX/nZbR2qfM+BhdNBug1eHuhD1u2c23GvYUloli3nlrnIXYMIbmvsxMVpMAnzfJ4fiDeH5VuYL/Whsw==',key_name='tempest-keypair-475132385',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:10:06Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23578125da1e4bf2bb3d59281a0e261e',ramdisk_id='',reservation_id='r-mztgwexd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1682604103',owner_user_name='tempest-AttachVolumeTestJSON-1682604103-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:10:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d68bbf62c74dd2bfe638f00ef6aa3d',uuid=14f9e91b-230b-468d-940b-39ad40e0eca2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d2cecfd-dabf-4512-99c4-fc9703fef8c9", "address": "fa:16:3e:b9:2b:05", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2cecfd-da", "ovs_interfaceid": "2d2cecfd-dabf-4512-99c4-fc9703fef8c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:11:07.623287 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-495dd315-e1a9-403d-b0d3-ef34579132f3 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Converting VIF {"id": "2d2cecfd-dabf-4512-99c4-fc9703fef8c9", "address": "fa:16:3e:b9:2b:05", "network": {"id": "02f45984-182d-4648-ab01-d4773a271319", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1905764214-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23578125da1e4bf2bb3d59281a0e261e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2cecfd-da", "ovs_interfaceid": "2d2cecfd-dabf-4512-99c4-fc9703fef8c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:11:07.623839 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-495dd315-e1a9-403d-b0d3-ef34579132f3 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:2b:05,bridge_name='br-int',has_traffic_filtering=True,id=2d2cecfd-dabf-4512-99c4-fc9703fef8c9,network=Network(02f45984-182d-4648-ab01-d4773a271319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2cecfd-da') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:11:07.623956 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-495dd315-e1a9-403d-b0d3-ef34579132f3 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:2b:05,bridge_name='br-int',has_traffic_filtering=True,id=2d2cecfd-dabf-4512-99c4-fc9703fef8c9,network=Network(02f45984-182d-4648-ab01-d4773a271319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2cecfd-da') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:11:07.625011 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:07.625272 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d2cecfd-da, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:11:07.626567 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:07.628410 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:11:07.628410 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:07.629036 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:07.629190 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=538c5429-15d7-4ef8-980b-75692dcd9aa7) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:11:07.629619 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:07.630097 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:11:07.630323 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:07.633342 np0000001577 nova-compute[98319]: INFO os_vif [None req-495dd315-e1a9-403d-b0d3-ef34579132f3 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:2b:05,bridge_name='br-int',has_traffic_filtering=True,id=2d2cecfd-dabf-4512-99c4-fc9703fef8c9,network=Network(02f45984-182d-4648-ab01-d4773a271319),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2cecfd-da')
May 28 01:11:07.633674 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-495dd315-e1a9-403d-b0d3-ef34579132f3 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Deleting instance files /opt/stack/data/nova/instances/14f9e91b-230b-468d-940b-39ad40e0eca2_del
May 28 01:11:07.634556 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-495dd315-e1a9-403d-b0d3-ef34579132f3 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Deletion of /opt/stack/data/nova/instances/14f9e91b-230b-468d-940b-39ad40e0eca2_del complete
May 28 01:11:08.142923 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-495dd315-e1a9-403d-b0d3-ef34579132f3 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Took 1.35 seconds to destroy the instance on the hypervisor.
May 28 01:11:08.143438 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-495dd315-e1a9-403d-b0d3-ef34579132f3 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:11:08.143694 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:11:08.143761 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:11:08.143988 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:08.216799 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8347e764-2af5-4622-86d9-a7b1d518e2a6 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "38636bdc-bca3-469b-80d7-05d8fa9e1c78" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.313s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:08.249126 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:08.547749 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f80bb94e-d1ff-4ba4-8fd2-87556b4193e1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.114s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:08.729564 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-386ab8de-2579-45d0-adda-afd2b2a6fc84 req-4bb40b97-f854-40b7-a0a3-7be7430923da service nova] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Received event network-vif-deleted-2d2cecfd-dabf-4512-99c4-fc9703fef8c9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:08.729707 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-386ab8de-2579-45d0-adda-afd2b2a6fc84 req-4bb40b97-f854-40b7-a0a3-7be7430923da service nova] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Neutron deleted interface 2d2cecfd-dabf-4512-99c4-fc9703fef8c9; detaching it from the instance and deleting it from the info cache
May 28 01:11:08.730959 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-386ab8de-2579-45d0-adda-afd2b2a6fc84 req-4bb40b97-f854-40b7-a0a3-7be7430923da service nova] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Detach interface failed, port_id=2d2cecfd-dabf-4512-99c4-fc9703fef8c9, reason: Instance 14f9e91b-230b-468d-940b-39ad40e0eca2 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:11:09.035824 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-dc9ae3a6-4455-495a-8bf2-a1101ebe7b1c req-eef290aa-e55b-45d3-862c-bf247a37e71d service nova] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Received event network-vif-unplugged-2d2cecfd-dabf-4512-99c4-fc9703fef8c9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:09.036045 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dc9ae3a6-4455-495a-8bf2-a1101ebe7b1c req-eef290aa-e55b-45d3-862c-bf247a37e71d service nova] Acquiring lock "14f9e91b-230b-468d-940b-39ad40e0eca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:09.036584 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dc9ae3a6-4455-495a-8bf2-a1101ebe7b1c req-eef290aa-e55b-45d3-862c-bf247a37e71d service nova] Lock "14f9e91b-230b-468d-940b-39ad40e0eca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:09.036754 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dc9ae3a6-4455-495a-8bf2-a1101ebe7b1c req-eef290aa-e55b-45d3-862c-bf247a37e71d service nova] Lock "14f9e91b-230b-468d-940b-39ad40e0eca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:09.036988 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-dc9ae3a6-4455-495a-8bf2-a1101ebe7b1c req-eef290aa-e55b-45d3-862c-bf247a37e71d service nova] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] No waiting events found dispatching network-vif-unplugged-2d2cecfd-dabf-4512-99c4-fc9703fef8c9 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:11:09.037104 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-dc9ae3a6-4455-495a-8bf2-a1101ebe7b1c req-eef290aa-e55b-45d3-862c-bf247a37e71d service nova] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Received event network-vif-unplugged-2d2cecfd-dabf-4512-99c4-fc9703fef8c9 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:11:09.189995 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:11:09.579709 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "e8151422-37a0-4b7a-914f-34dc2979ead9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:09.580911 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:09.692055 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Took 1.55 seconds to deallocate network for instance.
May 28 01:11:09.904374 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "4edb886b-df1e-42fd-9881-91fc07339c3f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:09.904573 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "4edb886b-df1e-42fd-9881-91fc07339c3f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:10.083468 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lazy-loading 'flavor' on Instance uuid e8151422-37a0-4b7a-914f-34dc2979ead9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:11:10.199826 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-495dd315-e1a9-403d-b0d3-ef34579132f3 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:10.199826 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-495dd315-e1a9-403d-b0d3-ef34579132f3 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:10.407479 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:11:10.456125 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-495dd315-e1a9-403d-b0d3-ef34579132f3 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:11:10.456607 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-495dd315-e1a9-403d-b0d3-ef34579132f3 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:11:10.776030 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d46acf7f-5903-4834-83fe-310665d216a3 req-bc7e6649-419e-4ca7-96c9-28d68941aa1e service nova] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Received event network-changed-53200c91-a0b8-4a29-a8f7-acc2ba51c3fe {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:10.776339 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d46acf7f-5903-4834-83fe-310665d216a3 req-bc7e6649-419e-4ca7-96c9-28d68941aa1e service nova] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Refreshing instance network info cache due to event network-changed-53200c91-a0b8-4a29-a8f7-acc2ba51c3fe. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:11:10.776488 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d46acf7f-5903-4834-83fe-310665d216a3 req-bc7e6649-419e-4ca7-96c9-28d68941aa1e service nova] Acquiring lock "refresh_cache-1e644f60-1f1f-4679-aec6-d1bbb3b69efe" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:11:10.776604 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d46acf7f-5903-4834-83fe-310665d216a3 req-bc7e6649-419e-4ca7-96c9-28d68941aa1e service nova] Acquired lock "refresh_cache-1e644f60-1f1f-4679-aec6-d1bbb3b69efe" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:11:10.776725 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-d46acf7f-5903-4834-83fe-310665d216a3 req-bc7e6649-419e-4ca7-96c9-28d68941aa1e service nova] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Refreshing network info cache for port 53200c91-a0b8-4a29-a8f7-acc2ba51c3fe {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:11:10.813386 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "1e644f60-1f1f-4679-aec6-d1bbb3b69efe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:10.813541 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "1e644f60-1f1f-4679-aec6-d1bbb3b69efe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:10.813717 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "1e644f60-1f1f-4679-aec6-d1bbb3b69efe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:10.813853 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "1e644f60-1f1f-4679-aec6-d1bbb3b69efe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:10.813953 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "1e644f60-1f1f-4679-aec6-d1bbb3b69efe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:10.815679 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Terminating instance
May 28 01:11:10.947969 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:10.958805 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-495dd315-e1a9-403d-b0d3-ef34579132f3 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:11:11.089338 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:11.278499 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-d46acf7f-5903-4834-83fe-310665d216a3 req-bc7e6649-419e-4ca7-96c9-28d68941aa1e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:11.318927 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:11:11.335366 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:11.351867 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:11.358534 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:11.381806 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:11.386690 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:11.464792 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-495dd315-e1a9-403d-b0d3-ef34579132f3 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.267s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:11.465970 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.517s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:11.472708 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:11:11.472820 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Claim successful on node np0000001577
May 28 01:11:11.537515 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:11.544453 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-d46acf7f-5903-4834-83fe-310665d216a3 req-bc7e6649-419e-4ca7-96c9-28d68941aa1e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:11.546169 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-495dd315-e1a9-403d-b0d3-ef34579132f3 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Deleted allocations for instance 14f9e91b-230b-468d-940b-39ad40e0eca2
May 28 01:11:11.651706 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999611727000229 future=<Future at 0x7c9884121c70 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:11:11.653804 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Instance destroyed successfully.
May 28 01:11:11.654368 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lazy-loading 'resources' on Instance uuid 1e644f60-1f1f-4679-aec6-d1bbb3b69efe {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:11:11.686928 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-d46acf7f-5903-4834-83fe-310665d216a3 req-bc7e6649-419e-4ca7-96c9-28d68941aa1e service nova] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Updated VIF entry in instance network info cache for port 53200c91-a0b8-4a29-a8f7-acc2ba51c3fe. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:11:11.686928 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-d46acf7f-5903-4834-83fe-310665d216a3 req-bc7e6649-419e-4ca7-96c9-28d68941aa1e service nova] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Updating instance_info_cache with network_info: [{"id": "53200c91-a0b8-4a29-a8f7-acc2ba51c3fe", "address": "fa:16:3e:46:94:e9", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53200c91-a0", "ovs_interfaceid": "53200c91-a0b8-4a29-a8f7-acc2ba51c3fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:11:12.099334 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0617de94-7f71-4196-a69f-63ffa8421b4a req-8b8a4470-98f9-4a2b-a66f-9d5aad062b51 service nova] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Received event network-vif-unplugged-53200c91-a0b8-4a29-a8f7-acc2ba51c3fe {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:12.100376 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0617de94-7f71-4196-a69f-63ffa8421b4a req-8b8a4470-98f9-4a2b-a66f-9d5aad062b51 service nova] Acquiring lock "1e644f60-1f1f-4679-aec6-d1bbb3b69efe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:12.100376 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0617de94-7f71-4196-a69f-63ffa8421b4a req-8b8a4470-98f9-4a2b-a66f-9d5aad062b51 service nova] Lock "1e644f60-1f1f-4679-aec6-d1bbb3b69efe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:12.100376 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0617de94-7f71-4196-a69f-63ffa8421b4a req-8b8a4470-98f9-4a2b-a66f-9d5aad062b51 service nova] Lock "1e644f60-1f1f-4679-aec6-d1bbb3b69efe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:12.100376 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0617de94-7f71-4196-a69f-63ffa8421b4a req-8b8a4470-98f9-4a2b-a66f-9d5aad062b51 service nova] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] No waiting events found dispatching network-vif-unplugged-53200c91-a0b8-4a29-a8f7-acc2ba51c3fe {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:11:12.100376 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0617de94-7f71-4196-a69f-63ffa8421b4a req-8b8a4470-98f9-4a2b-a66f-9d5aad062b51 service nova] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Received event network-vif-unplugged-53200c91-a0b8-4a29-a8f7-acc2ba51c3fe for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:11:12.159280 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:09:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1171060503',display_name='tempest-TestVolumeBootPattern-server-1171060503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpattern-server-1171060503',id=60,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLDywRMt1gYjzqU0nLt38yv/dkf6iz5rhLwqujx5EHrUiUYa0LEwAEl6oAEMxfnED+yXkyyB7J9zFdusIexML2cYEzV2m5bo9N6+7QjUI/1FFtVJ+XDyI2kpbVbncy1iQ==',key_name='tempest-TestVolumeBootPattern-1635525277',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:09:20Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='050f928f1ce449d6a447cd343dc4ff80',ramdisk_id='',reservation_id='r-u2u145oc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1449742411',owner_user_name='tempest-TestVolumeBootPattern-1449742411-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:09:20Z,user_data=None,user_id='0c803ddeaf4f4b3db07587419087b3b2',uuid=1e644f60-1f1f-4679-aec6-d1bbb3b69efe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53200c91-a0b8-4a29-a8f7-acc2ba51c3fe", "address": "fa:16:3e:46:94:e9", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53200c91-a0", "ovs_interfaceid": "53200c91-a0b8-4a29-a8f7-acc2ba51c3fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:11:12.159741 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converting VIF {"id": "53200c91-a0b8-4a29-a8f7-acc2ba51c3fe", "address": "fa:16:3e:46:94:e9", "network": {"id": "c00293ea-3d86-4ab1-85b7-79294d0904fe", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1111437784-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "050f928f1ce449d6a447cd343dc4ff80", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53200c91-a0", "ovs_interfaceid": "53200c91-a0b8-4a29-a8f7-acc2ba51c3fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:11:12.160301 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:94:e9,bridge_name='br-int',has_traffic_filtering=True,id=53200c91-a0b8-4a29-a8f7-acc2ba51c3fe,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53200c91-a0') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:11:12.160512 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:94:e9,bridge_name='br-int',has_traffic_filtering=True,id=53200c91-a0b8-4a29-a8f7-acc2ba51c3fe,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53200c91-a0') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:11:12.161469 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:12.161675 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53200c91-a0, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:11:12.162624 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:12.164003 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:11:12.164137 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:12.164934 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:12.165066 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f5048fce-6c73-4660-924a-63ad9376f074) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:11:12.165457 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:12.165982 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:11:12.167811 np0000001577 nova-compute[98319]: INFO os_vif [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:94:e9,bridge_name='br-int',has_traffic_filtering=True,id=53200c91-a0b8-4a29-a8f7-acc2ba51c3fe,network=Network(c00293ea-3d86-4ab1-85b7-79294d0904fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53200c91-a0')
May 28 01:11:12.169224 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:11:12.169473 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '408b306f-e263-4cfa-a888-735b63628858', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:11:12.169612 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:11:12.169885 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:11:12.170116 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '408b306f-e263-4cfa-a888-735b63628858', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:11:12.170226 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:11:12.180539 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "e8151422-37a0-4b7a-914f-34dc2979ead9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:12.181584 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:12.182042 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Attaching volume 335404a4-ae14-42d9-aeb3-f6f69436ff1b to /dev/vdd
May 28 01:11:12.189927 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d46acf7f-5903-4834-83fe-310665d216a3 req-bc7e6649-419e-4ca7-96c9-28d68941aa1e service nova] Releasing lock "refresh_cache-1e644f60-1f1f-4679-aec6-d1bbb3b69efe" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:11:12.200863 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:11:12.200863 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:11:12.200863 np0000001577 nova-compute[98319]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:12.200863 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:12.200863 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:12.200863 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:12.200863 np0000001577 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9722a93-f02e-49d6-9358-c68dd8574b4e (non-flash)
May 28 01:11:12.200863 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:11:12.201074 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsi session list stdout=tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:11:12.201074 np0000001577 nova-compute[98319]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858 (non-flash)
May 28 01:11:12.201074 np0000001577 nova-compute[98319]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:12.201074 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:12.201074 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:12.201074 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:12.201074 np0000001577 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9722a93-f02e-49d6-9358-c68dd8574b4e (non-flash)
May 28 01:11:12.201074 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:11:12.201248 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', '146'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', '147'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', '164'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', '165'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', '169'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', '170'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9722a93-f02e-49d6-9358-c68dd8574b4e', '171')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:11:12.201541 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', '146')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:11:12.202470 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858', '147')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:11:12.203425 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c987058fa60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858'): ({'sde'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:11:12.203647 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Removing multipathed devices sde, sdd {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:11:12.203893 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Flush multipath device 3300000005024929f {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:11:12.223174 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:11:12.236045 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:11:12.256938 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:12.275597 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:11:12.302803 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:11:12.303206 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:11:12.312154 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:11:12.313461 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe65:fa89', 'fe80::583c:47ff:fea3:281d'] 
May 28 01:11:12.313461 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:11:12.313461 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:11:12.313753 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:11:12.314034 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Updating existing volume attachment record: 861adf50-3708-4330-9503-a5bab5c61c82 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:11:12.322520 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:11:12.362971 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:11:12.363184 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:11:12.364295 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:11:12.374724 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:11:12.375017 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:11:12.387301 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:12.422476 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 146, target: iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858, portal: 192.168.40.100,3260]
May 28 01:11:12.422476 np0000001577 nova-compute[98319]: Logout of [sid: 146, target: iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858, portal: 192.168.40.100,3260] successful.
May 28 01:11:12.422476 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:12.436817 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:12.450930 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:12.481571 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 147, target: iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858, portal: 192.168.50.100,3260]
May 28 01:11:12.481571 np0000001577 nova-compute[98319]: Logout of [sid: 147, target: iqn.2023-03.storpool.com:os--volume-408b306f-e263-4cfa-a888-735b63628858, portal: 192.168.50.100,3260] successful.
May 28 01:11:12.481571 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:12.501569 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:12.501569 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:11:12.501569 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] <== disconnect_volume: return (329ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:11:12.501569 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:11:12.501569 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Deleting instance files /opt/stack/data/nova/instances/1e644f60-1f1f-4679-aec6-d1bbb3b69efe_del
May 28 01:11:12.501569 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Deletion of /opt/stack/data/nova/instances/1e644f60-1f1f-4679-aec6-d1bbb3b69efe_del complete
May 28 01:11:12.554026 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-495dd315-e1a9-403d-b0d3-ef34579132f3 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Lock "14f9e91b-230b-468d-940b-39ad40e0eca2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.274s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:12.665581 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:11:12.665816 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:11:12.868089 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:11:12.868557 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b', 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '335404a4-ae14-42d9-aeb3-f6f69436ff1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:11:12.868781 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:11:12.869244 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:11:12.869531 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b', 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '335404a4-ae14-42d9-aeb3-f6f69436ff1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:11:12.882903 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:11:12.883654 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:11:12.884070 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:11:12.884259 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:11:12.884678 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:11:12.884899 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:11:12.896162 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:11:12.896162 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:12.902122 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:11:12.902122 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:12.909362 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b] added
May 28 01:11:12.909362 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:11:12.909362 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:11:12.909362 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:11:12.909362 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:11:12.909362 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:11:12.909362 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:12.909362 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:11:12.909362 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0248(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:11:12.909362 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:11:12.915242 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b] added
May 28 01:11:12.915242 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:11:12.915242 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:11:12.915242 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:11:12.915242 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:11:12.915242 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:11:12.915242 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:12.915456 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:11:12.915559 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0307(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:11:12.915714 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:11:13.009231 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Took 1.69 seconds to destroy the instance on the hypervisor.
May 28 01:11:13.010020 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:11:13.010320 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:11:13.010458 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:11:13.010714 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:13.072079 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:13.168148 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:11:13.675981 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.211s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:13.676461 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:11:13.794285 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:11:13.909775 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:11:13.915998 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:11:13.922783 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:11:13.922783 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:11:13.928431 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:11:13.928431 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:13.934770 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:13.939954 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:13.949185 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:13.949185 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:13.949185 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:13.949185 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:13.949185 np0000001577 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9722a93-f02e-49d6-9358-c68dd8574b4e (non-flash)
May 28 01:11:13.949185 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:11:13.949185 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:13.949185 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:13.949185 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:13.949185 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:13.949185 np0000001577 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9722a93-f02e-49d6-9358-c68dd8574b4e (non-flash)
May 28 01:11:13.949185 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:11:13.954565 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:13.954565 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:13.954565 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:13.954565 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:13.954565 np0000001577 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9722a93-f02e-49d6-9358-c68dd8574b4e (non-flash)
May 28 01:11:13.954565 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:11:13.954702 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:13.954702 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:13.954702 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:13.954702 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:13.954702 np0000001577 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9722a93-f02e-49d6-9358-c68dd8574b4e (non-flash)
May 28 01:11:13.954702 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:11:13.980723 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b, portal: 192.168.40.100,3260]
May 28 01:11:13.980723 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b, portal: 192.168.40.100,3260] successful.
May 28 01:11:13.980723 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:13.992370 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:13.997739 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b, portal: 192.168.50.100,3260]
May 28 01:11:13.997739 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b, portal: 192.168.50.100,3260] successful.
May 28 01:11:13.997739 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:14.009232 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:14.009863 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:14.009863 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:14.009863 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:14.009863 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:14.009863 np0000001577 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9722a93-f02e-49d6-9358-c68dd8574b4e (non-flash)
May 28 01:11:14.009863 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:14.009863 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:14.009863 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:11:14.009863 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:14.009863 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:14.009863 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:14.009863 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:14.009863 np0000001577 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9722a93-f02e-49d6-9358-c68dd8574b4e (non-flash)
May 28 01:11:14.009863 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:14.009863 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:14.009863 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:11:14.010171 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.126s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:11:14.012542 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:11:14.012542 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] HCTL ('9', '-', '-', 0) found on session 172 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:11:14.012542 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:11:14.027274 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Searching for a device in session 172 and hctl ['9', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:11:14.027274 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:14.027274 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:14.027274 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:14.027274 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:14.027274 np0000001577 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9722a93-f02e-49d6-9358-c68dd8574b4e (non-flash)
May 28 01:11:14.027274 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:14.027274 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:14.027274 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:11:14.027274 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:14.027274 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:14.027274 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:14.027274 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:14.027274 np0000001577 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9722a93-f02e-49d6-9358-c68dd8574b4e (non-flash)
May 28 01:11:14.027274 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:14.027274 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:14.027274 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:11:14.027274 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.142s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:11:14.027274 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:11:14.029954 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] HCTL ('10', '-', '-', 0) found on session 173 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:11:14.029954 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:11:14.041536 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Searching for a device in session 173 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:11:14.041536 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '335404a4-ae14-42d9-aeb3-f6f69436ff1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:11:14.158622 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-93c5aaaa-72df-40cf-90ae-58dcb40d6d7f req-28eda871-68ad-498e-b951-177a32383fb9 service nova] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Received event network-vif-unplugged-53200c91-a0b8-4a29-a8f7-acc2ba51c3fe {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:14.158870 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-93c5aaaa-72df-40cf-90ae-58dcb40d6d7f req-28eda871-68ad-498e-b951-177a32383fb9 service nova] Acquiring lock "1e644f60-1f1f-4679-aec6-d1bbb3b69efe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:14.159018 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-93c5aaaa-72df-40cf-90ae-58dcb40d6d7f req-28eda871-68ad-498e-b951-177a32383fb9 service nova] Lock "1e644f60-1f1f-4679-aec6-d1bbb3b69efe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:14.159148 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-93c5aaaa-72df-40cf-90ae-58dcb40d6d7f req-28eda871-68ad-498e-b951-177a32383fb9 service nova] Lock "1e644f60-1f1f-4679-aec6-d1bbb3b69efe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:14.159302 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-93c5aaaa-72df-40cf-90ae-58dcb40d6d7f req-28eda871-68ad-498e-b951-177a32383fb9 service nova] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] No waiting events found dispatching network-vif-unplugged-53200c91-a0b8-4a29-a8f7-acc2ba51c3fe {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:11:14.159445 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-93c5aaaa-72df-40cf-90ae-58dcb40d6d7f req-28eda871-68ad-498e-b951-177a32383fb9 service nova] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Received event network-vif-unplugged-53200c91-a0b8-4a29-a8f7-acc2ba51c3fe for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:11:14.159664 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-93c5aaaa-72df-40cf-90ae-58dcb40d6d7f req-28eda871-68ad-498e-b951-177a32383fb9 service nova] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Received event network-vif-deleted-53200c91-a0b8-4a29-a8f7-acc2ba51c3fe {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:14.185017 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:11:14.185259 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:11:14.185543 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:14.185955 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:14.248259 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0505bf2e15ba44ad881b94106ae054a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f65d208f44146903c7dcf0b143a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:11:14.295948 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Took 1.29 seconds to deallocate network for instance.
May 28 01:11:14.631642 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Successfully created port: 89446e5b-c447-4a2c-b547-03a71d82747b {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:11:14.687041 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:11:14.845097 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Took 0.55 seconds to detach 1 volumes for instance.
May 28 01:11:15.026622 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Searching for a device in session 172 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:11:15.026839 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '335404a4-ae14-42d9-aeb3-f6f69436ff1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:11:15.072280 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Successfully updated port: 89446e5b-c447-4a2c-b547-03a71d82747b {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:11:15.127410 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-42a10541-1d1d-4644-a0e5-15734cca561a req-fd114270-90fb-4b38-a698-ec1227f944ad service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Received event network-changed-89446e5b-c447-4a2c-b547-03a71d82747b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:15.127410 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-42a10541-1d1d-4644-a0e5-15734cca561a req-fd114270-90fb-4b38-a698-ec1227f944ad service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Refreshing instance network info cache due to event network-changed-89446e5b-c447-4a2c-b547-03a71d82747b. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:11:15.127410 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-42a10541-1d1d-4644-a0e5-15734cca561a req-fd114270-90fb-4b38-a698-ec1227f944ad service nova] Acquiring lock "refresh_cache-4edb886b-df1e-42fd-9881-91fc07339c3f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:11:15.127410 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-42a10541-1d1d-4644-a0e5-15734cca561a req-fd114270-90fb-4b38-a698-ec1227f944ad service nova] Acquired lock "refresh_cache-4edb886b-df1e-42fd-9881-91fc07339c3f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:11:15.127410 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-42a10541-1d1d-4644-a0e5-15734cca561a req-fd114270-90fb-4b38-a698-ec1227f944ad service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Refreshing network info cache for port 89446e5b-c447-4a2c-b547-03a71d82747b {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:11:15.188915 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:11:15.353035 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:15.353219 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:15.506710 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:11:15.506921 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:11:15.573906 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "refresh_cache-4edb886b-df1e-42fd-9881-91fc07339c3f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:11:15.628636 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-42a10541-1d1d-4644-a0e5-15734cca561a req-fd114270-90fb-4b38-a698-ec1227f944ad service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:15.682085 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-42a10541-1d1d-4644-a0e5-15734cca561a req-fd114270-90fb-4b38-a698-ec1227f944ad service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:11:15.739187 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0003528940001160663 future=<Future at 0x7c984c5ef9b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:11:15.739590 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Emitting event <LifecycleEvent: 1779930660.7387364, 38636bdc-bca3-469b-80d7-05d8fa9e1c78 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:11:15.739692 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:11:15.739847 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] VM Stopped (Lifecycle Event)
May 28 01:11:15.745091 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=6.372163220000402 future=<Future at 0x7c984c37ad50 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:11:15.745195 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=6.372034860999975 future=<Future at 0x7c984c37ad50 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:11:15.814482 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-42a10541-1d1d-4644-a0e5-15734cca561a req-fd114270-90fb-4b38-a698-ec1227f944ad service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:11:15.898486 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Found WWN 330000000cd1c3072 for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:11:15.898750 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:11:15.898918 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '330000000cd1c3072', 'path': '/dev/dm-0', 'multipath_id': '330000000cd1c3072'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:11:15.899057 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cd1c3072', 'path': '/dev/dm-0', 'multipath_id': '330000000cd1c3072'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:11:15.901258 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lazy-loading 'flavor' on Instance uuid e8151422-37a0-4b7a-914f-34dc2979ead9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:11:16.009159 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:11:16.196394 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:11:16.197188 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:11:16.197391 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Creating image(s)
May 28 01:11:16.197895 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "/opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:16.198030 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "/opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:16.198427 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "/opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:16.198725 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "40f6c6816480345643cb423b1fa0dc3e733a8eee" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:16.199071 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "40f6c6816480345643cb423b1fa0dc3e733a8eee" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:16.246226 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 38636bdc-bca3-469b-80d7-05d8fa9e1c78] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:11:16.316574 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-42a10541-1d1d-4644-a0e5-15734cca561a req-fd114270-90fb-4b38-a698-ec1227f944ad service nova] Releasing lock "refresh_cache-4edb886b-df1e-42fd-9881-91fc07339c3f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:11:16.317431 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquired lock "refresh_cache-4edb886b-df1e-42fd-9881-91fc07339c3f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:11:16.317431 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:11:16.404928 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Attempting to attach volume 335404a4-ae14-42d9-aeb3-f6f69436ff1b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:11:16.406677 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:11:16.406677 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:11:16.406677 np0000001577 nova-compute[98319]:   <alias name="ua-335404a4-ae14-42d9-aeb3-f6f69436ff1b"/>
May 28 01:11:16.406677 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 28 01:11:16.406677 np0000001577 nova-compute[98319]:   <target dev="vdd" bus="virtio"/>
May 28 01:11:16.406677 np0000001577 nova-compute[98319]:   <serial>335404a4-ae14-42d9-aeb3-f6f69436ff1b</serial>
May 28 01:11:16.406677 np0000001577 nova-compute[98319]:   <shareable/>
May 28 01:11:16.406677 np0000001577 nova-compute[98319]: </disk>
May 28 01:11:16.406677 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:11:16.515220 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.162s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:16.539040 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:16.591731 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Deleted allocations for instance 1e644f60-1f1f-4679-aec6-d1bbb3b69efe
May 28 01:11:16.621563 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:11:16.624254 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:11:16.624557 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40f6c6816480345643cb423b1fa0dc3e733a8eee.part --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:16.708640 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40f6c6816480345643cb423b1fa0dc3e733a8eee.part --force-share --output=json" returned: 0 in 0.084s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:11:16.709128 np0000001577 nova-compute[98319]: DEBUG nova.virt.images [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] b6771936-97f2-4073-bf9b-ccb3dc960886 was qcow2, converting to raw {{(pid=98319) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 01:11:16.709737 np0000001577 nova-compute[98319]: DEBUG nova.privsep.utils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 01:11:16.709996 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/40f6c6816480345643cb423b1fa0dc3e733a8eee.part /opt/stack/data/nova/instances/_base/40f6c6816480345643cb423b1fa0dc3e733a8eee.converted {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:16.866855 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/40f6c6816480345643cb423b1fa0dc3e733a8eee.part /opt/stack/data/nova/instances/_base/40f6c6816480345643cb423b1fa0dc3e733a8eee.converted" returned: 0 in 0.156s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:11:16.872010 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40f6c6816480345643cb423b1fa0dc3e733a8eee.converted --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:16.893150 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:11:16.957121 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40f6c6816480345643cb423b1fa0dc3e733a8eee.converted --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:11:16.957676 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "40f6c6816480345643cb423b1fa0dc3e733a8eee" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.759s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:16.958210 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:11:16.960953 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:11:16.961953 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40f6c6816480345643cb423b1fa0dc3e733a8eee --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:17.043995 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:17.046310 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40f6c6816480345643cb423b1fa0dc3e733a8eee --force-share --output=json" returned: 0 in 0.084s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:11:17.046952 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "40f6c6816480345643cb423b1fa0dc3e733a8eee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:17.047463 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "40f6c6816480345643cb423b1fa0dc3e733a8eee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:17.047953 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:11:17.051066 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:11:17.051456 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40f6c6816480345643cb423b1fa0dc3e733a8eee --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:17.141903 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40f6c6816480345643cb423b1fa0dc3e733a8eee --force-share --output=json" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:11:17.142295 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/40f6c6816480345643cb423b1fa0dc3e733a8eee,backing_fmt=raw /opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:17.176973 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:17.197733 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/40f6c6816480345643cb423b1fa0dc3e733a8eee,backing_fmt=raw /opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk 1073741824" returned: 0 in 0.055s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:11:17.198144 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "40f6c6816480345643cb423b1fa0dc3e733a8eee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.151s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:17.198436 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40f6c6816480345643cb423b1fa0dc3e733a8eee --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:17.217278 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Updating instance_info_cache with network_info: [{"id": "89446e5b-c447-4a2c-b547-03a71d82747b", "address": "fa:16:3e:fa:00:1f", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89446e5b-c4", "ovs_interfaceid": "89446e5b-c447-4a2c-b547-03a71d82747b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:11:17.287465 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40f6c6816480345643cb423b1fa0dc3e733a8eee --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:11:17.287862 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:11:17.288123 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:17.374721 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:11:17.375083 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Cannot resize image /opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:11:17.375653 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:11:17.375817 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Ensure instance console log exists: /opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:11:17.376066 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:17.376268 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:17.376390 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:17.602162 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-582e0a2c-5b57-4f48-97cf-f8d16aeae777 tempest-TestVolumeBootPattern-1449742411 tempest-TestVolumeBootPattern-1449742411-project-member] Lock "1e644f60-1f1f-4679-aec6-d1bbb3b69efe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.789s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:17.722010 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Releasing lock "refresh_cache-4edb886b-df1e-42fd-9881-91fc07339c3f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:11:17.722323 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Instance network_info: |[{"id": "89446e5b-c447-4a2c-b547-03a71d82747b", "address": "fa:16:3e:fa:00:1f", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89446e5b-c4", "ovs_interfaceid": "89446e5b-c447-4a2c-b547-03a71d82747b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:11:17.723799 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Start _get_guest_xml network_info=[{"id": "89446e5b-c447-4a2c-b547-03a71d82747b", "address": "fa:16:3e:fa:00:1f", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89446e5b-c4", "ovs_interfaceid": "89446e5b-c447-4a2c-b547-03a71d82747b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:11:07Z,direct_url=<?>,disk_format='qcow2',id=b6771936-97f2-4073-bf9b-ccb3dc960886,min_disk=0,min_ram=0,name='tempest-scenario-img--1624444782',owner='fb2f65d208f44146903c7dcf0b143a8e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:11:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b6771936-97f2-4073-bf9b-ccb3dc960886'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:11:17.727792 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:11:17.728849 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b6771936-97f2-4073-bf9b-ccb3dc960886', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-2023787221', uuid='4edb886b-df1e-42fd-9881-91fc07339c3f'), owner=OwnerMeta(userid='0505bf2e15ba44ad881b94106ae054a5', username='tempest-TestMinimumBasicScenario-1681839017-project-member', projectid='fb2f65d208f44146903c7dcf0b143a8e', projectname='tempest-TestMinimumBasicScenario-1681839017'), image=ImageMeta(id='b6771936-97f2-4073-bf9b-ccb3dc960886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "89446e5b-c447-4a2c-b547-03a71d82747b", "address": "fa:16:3e:fa:00:1f", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89446e5b-c4", "ovs_interfaceid": "89446e5b-c447-4a2c-b547-03a71d82747b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930677.7285411) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:11:17.729893 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:11:17.730192 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:11:17.731106 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:11:17.731257 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:11:17.732191 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:11:17.732473 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:11:07Z,direct_url=<?>,disk_format='qcow2',id=b6771936-97f2-4073-bf9b-ccb3dc960886,min_disk=0,min_ram=0,name='tempest-scenario-img--1624444782',owner='fb2f65d208f44146903c7dcf0b143a8e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:11:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:11:17.732616 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:11:17.732694 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:11:17.732826 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:11:17.732895 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:11:17.732995 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:11:17.733137 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:11:17.733235 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:11:17.733340 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:11:17.733435 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:11:17.733554 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:11:17.743252 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:11:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2023787221',display_name='tempest-TestMinimumBasicScenario-server-2023787221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testminimumbasicscenario-server-2023787221',id=66,image_ref='b6771936-97f2-4073-bf9b-ccb3dc960886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeedL+sGgE99d8g4dPt6DoVfxM3FqutzbPgV98SfFKefq8Z1zEo+4lbRsyO452zYjWQAX6ig52TSFvOZYkOsNEfBbe8Eu2SMeWXnNbThabXFesSaOO5KPV8LcFHScA3OA==',key_name='tempest-TestMinimumBasicScenario-1787881822',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb2f65d208f44146903c7dcf0b143a8e',ramdisk_id='',reservation_id='r-yunb341z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6771936-97f2-4073-bf9b-ccb3dc960886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1681839017',owner_user_name='tempest-TestMinimumBasicScenario-1681839017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:11:15Z,user_data=None,user_id='0505bf2e15ba44ad881b94106ae054a5',uuid=4edb886b-df1e-42fd-9881-91fc07339c3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89446e5b-c447-4a2c-b547-03a71d82747b", "address": "fa:16:3e:fa:00:1f", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89446e5b-c4", "ovs_interfaceid": "89446e5b-c447-4a2c-b547-03a71d82747b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:11:17.743373 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Converting VIF {"id": "89446e5b-c447-4a2c-b547-03a71d82747b", "address": "fa:16:3e:fa:00:1f", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89446e5b-c4", "ovs_interfaceid": "89446e5b-c447-4a2c-b547-03a71d82747b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:11:17.743941 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:00:1f,bridge_name='br-int',has_traffic_filtering=True,id=89446e5b-c447-4a2c-b547-03a71d82747b,network=Network(d9534aa6-926a-458a-a1d0-8512d11fe6a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89446e5b-c4') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:11:17.744604 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lazy-loading 'pci_devices' on Instance uuid 4edb886b-df1e-42fd-9881-91fc07339c3f {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:11:17.913263 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:18.079689 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:11:18.080424 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:11:18.080534 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:11:18.080726 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No BDM found with device name vdd, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:11:18.080726 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:11:18.080831 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No VIF found with MAC fa:16:3e:65:fa:89, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:11:18.246862 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] End _get_guest_xml xml=<domain type="qemu">
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:   <uuid>4edb886b-df1e-42fd-9881-91fc07339c3f</uuid>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:   <name>instance-00000042</name>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestMinimumBasicScenario-server-2023787221</nova:name>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:11:17</nova:creationTime>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       <nova:image uuid="b6771936-97f2-4073-bf9b-ccb3dc960886">
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:         <nova:properties/>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:         <nova:user uuid="0505bf2e15ba44ad881b94106ae054a5">tempest-TestMinimumBasicScenario-1681839017-project-member</nova:user>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:         <nova:project uuid="fb2f65d208f44146903c7dcf0b143a8e">tempest-TestMinimumBasicScenario-1681839017</nova:project>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="b6771936-97f2-4073-bf9b-ccb3dc960886"/>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:         <nova:port uuid="89446e5b-c447-4a2c-b547-03a71d82747b">
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:     <system>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       <entry name="serial">4edb886b-df1e-42fd-9881-91fc07339c3f</entry>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       <entry name="uuid">4edb886b-df1e-42fd-9881-91fc07339c3f</entry>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:     </system>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:   <os>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:   </os>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:   <features>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:   </features>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:   <devices>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk"/>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:     </disk>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk.config"/>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:     </disk>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:fa:00:1f"/>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       <target dev="tap89446e5b-c4"/>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:     </interface>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/console.log" append="off"/>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:     </serial>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:     <video>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:     </video>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:     </rng>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:   </devices>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]: </domain>
May 28 01:11:18.246862 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:11:18.248764 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Preparing to wait for external event network-vif-plugged-89446e5b-c447-4a2c-b547-03a71d82747b {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:11:18.248764 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "4edb886b-df1e-42fd-9881-91fc07339c3f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:18.248764 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "4edb886b-df1e-42fd-9881-91fc07339c3f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:18.248764 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "4edb886b-df1e-42fd-9881-91fc07339c3f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:18.248764 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:11:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2023787221',display_name='tempest-TestMinimumBasicScenario-server-2023787221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testminimumbasicscenario-server-2023787221',id=66,image_ref='b6771936-97f2-4073-bf9b-ccb3dc960886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeedL+sGgE99d8g4dPt6DoVfxM3FqutzbPgV98SfFKefq8Z1zEo+4lbRsyO452zYjWQAX6ig52TSFvOZYkOsNEfBbe8Eu2SMeWXnNbThabXFesSaOO5KPV8LcFHScA3OA==',key_name='tempest-TestMinimumBasicScenario-1787881822',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb2f65d208f44146903c7dcf0b143a8e',ramdisk_id='',reservation_id='r-yunb341z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6771936-97f2-4073-bf9b-ccb3dc960886',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1681839017',owner_user_name='tempest-TestMinimumBasicScenario-1681839017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:11:15Z,user_data=None,user_id='0505bf2e15ba44ad881b94106ae054a5',uuid=4edb886b-df1e-42fd-9881-91fc07339c3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89446e5b-c447-4a2c-b547-03a71d82747b", "address": "fa:16:3e:fa:00:1f", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89446e5b-c4", "ovs_interfaceid": "89446e5b-c447-4a2c-b547-03a71d82747b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:11:18.248764 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Converting VIF {"id": "89446e5b-c447-4a2c-b547-03a71d82747b", "address": "fa:16:3e:fa:00:1f", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89446e5b-c4", "ovs_interfaceid": "89446e5b-c447-4a2c-b547-03a71d82747b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:11:18.249210 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:00:1f,bridge_name='br-int',has_traffic_filtering=True,id=89446e5b-c447-4a2c-b547-03a71d82747b,network=Network(d9534aa6-926a-458a-a1d0-8512d11fe6a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89446e5b-c4') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:11:18.249455 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:00:1f,bridge_name='br-int',has_traffic_filtering=True,id=89446e5b-c447-4a2c-b547-03a71d82747b,network=Network(d9534aa6-926a-458a-a1d0-8512d11fe6a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89446e5b-c4') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:11:18.249914 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:18.250164 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:11:18.250370 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:11:18.251049 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:18.251378 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3d8586ec-0d96-5355-a9d1-76fe97d5b62f', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:11:18.268309 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:18.269045 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:18.270887 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:18.271085 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89446e5b-c4, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:11:18.271522 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89446e5b-c4, col_values=(('qos', UUID('8e35016c-a8a5-41ca-abcd-6e708fb7b6a1')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:11:18.272270 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89446e5b-c4, col_values=(('external_ids', {'iface-id': '89446e5b-c447-4a2c-b547-03a71d82747b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:00:1f', 'vm-uuid': '4edb886b-df1e-42fd-9881-91fc07339c3f'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:11:18.272528 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:18.274135 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:11:18.278298 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:18.279398 np0000001577 nova-compute[98319]: INFO os_vif [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:00:1f,bridge_name='br-int',has_traffic_filtering=True,id=89446e5b-c447-4a2c-b547-03a71d82747b,network=Network(d9534aa6-926a-458a-a1d0-8512d11fe6a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89446e5b-c4')
May 28 01:11:19.627467 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-87a1bf59-2681-4c1e-9c0b-1576621ae7fc tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.447s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:19.799662 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:11:19.799662 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:11:19.799662 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] No VIF found with MAC fa:16:3e:fa:00:1f, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:11:19.799662 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Using config drive
May 28 01:11:20.304460 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:20.329622 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:20.462255 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:20.624892 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Creating config drive at /opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk.config
May 28 01:11:20.628385 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyfx87orp {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:20.699891 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyfx87orp" returned: 0 in 0.072s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:11:21.161495 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:21.181934 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:21.183530 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:21.273240 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:21.398510 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:21.557268 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:21.563460 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:21.585157 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:21.981785 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0c578fa2-89c2-4a94-987f-e77020690779 req-6072f73e-4ccc-4fb7-a709-884348be6454 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Received event network-vif-plugged-89446e5b-c447-4a2c-b547-03a71d82747b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:21.982611 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0c578fa2-89c2-4a94-987f-e77020690779 req-6072f73e-4ccc-4fb7-a709-884348be6454 service nova] Acquiring lock "4edb886b-df1e-42fd-9881-91fc07339c3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:21.982842 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0c578fa2-89c2-4a94-987f-e77020690779 req-6072f73e-4ccc-4fb7-a709-884348be6454 service nova] Lock "4edb886b-df1e-42fd-9881-91fc07339c3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:21.982998 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0c578fa2-89c2-4a94-987f-e77020690779 req-6072f73e-4ccc-4fb7-a709-884348be6454 service nova] Lock "4edb886b-df1e-42fd-9881-91fc07339c3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:21.983128 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0c578fa2-89c2-4a94-987f-e77020690779 req-6072f73e-4ccc-4fb7-a709-884348be6454 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Processing event network-vif-plugged-89446e5b-c447-4a2c-b547-03a71d82747b {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:11:22.007631 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:11:22.008585 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930682.00782, 4edb886b-df1e-42fd-9881-91fc07339c3f => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:11:22.008585 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] VM Started (Lifecycle Event)
May 28 01:11:22.011477 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:11:22.014935 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Instance spawned successfully.
May 28 01:11:22.015208 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:11:22.117822 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0005221879996497591 future=<Future at 0x7c984c37ad50 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:11:22.118338 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] Emitting event <LifecycleEvent: 1779930667.117178, 14f9e91b-230b-468d-940b-39ad40e0eca2 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:11:22.118495 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:11:22.118712 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] VM Stopped (Lifecycle Event)
May 28 01:11:22.119760 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=4.531535950000034 future=<Future at 0x7c9884121c70 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:11:22.119898 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=4.5313889469998685 future=<Future at 0x7c9884121c70 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:11:22.510107 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "e4dca6bf-1591-46fa-8ade-a99fddf923a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:22.510529 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e4dca6bf-1591-46fa-8ade-a99fddf923a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:22.512174 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:11:22.516164 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:11:22.527930 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:11:22.528063 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:11:22.528581 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:11:22.529222 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:11:22.529222 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:11:22.529456 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:11:22.623805 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7cf389a0-cdd2-4aba-a0b2-b4a998130058 tempest-AttachVolumeTestJSON-1682604103 tempest-AttachVolumeTestJSON-1682604103-project-member] [instance: 14f9e91b-230b-468d-940b-39ad40e0eca2] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:11:23.014682 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:11:23.023054 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:11:23.023313 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930683.0231311, 4edb886b-df1e-42fd-9881-91fc07339c3f => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:11:23.023477 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] VM Paused (Lifecycle Event)
May 28 01:11:23.039321 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Took 6.84 seconds to spawn the instance on the hypervisor.
May 28 01:11:23.039592 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:11:23.049066 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:23.272972 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:23.532282 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:11:23.535347 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930683.53512, 4edb886b-df1e-42fd-9881-91fc07339c3f => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:11:23.535462 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] VM Resumed (Lifecycle Event)
May 28 01:11:23.557712 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Took 12.65 seconds to build instance.
May 28 01:11:23.576835 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:23.576939 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:23.581091 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:11:23.581215 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Claim successful on node np0000001577
May 28 01:11:23.904232 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:24.037656 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:11:24.044282 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-50bfeaca-f640-4200-a36d-642a6967fe8c req-467627a0-e5d2-48fc-9ed7-3ba85060a317 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Received event network-vif-plugged-89446e5b-c447-4a2c-b547-03a71d82747b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:24.044576 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-50bfeaca-f640-4200-a36d-642a6967fe8c req-467627a0-e5d2-48fc-9ed7-3ba85060a317 service nova] Acquiring lock "4edb886b-df1e-42fd-9881-91fc07339c3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:24.044799 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-50bfeaca-f640-4200-a36d-642a6967fe8c req-467627a0-e5d2-48fc-9ed7-3ba85060a317 service nova] Lock "4edb886b-df1e-42fd-9881-91fc07339c3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:24.044862 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-50bfeaca-f640-4200-a36d-642a6967fe8c req-467627a0-e5d2-48fc-9ed7-3ba85060a317 service nova] Lock "4edb886b-df1e-42fd-9881-91fc07339c3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:24.045072 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-50bfeaca-f640-4200-a36d-642a6967fe8c req-467627a0-e5d2-48fc-9ed7-3ba85060a317 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] No waiting events found dispatching network-vif-plugged-89446e5b-c447-4a2c-b547-03a71d82747b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:11:24.045188 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-50bfeaca-f640-4200-a36d-642a6967fe8c req-467627a0-e5d2-48fc-9ed7-3ba85060a317 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Received unexpected event network-vif-plugged-89446e5b-c447-4a2c-b547-03a71d82747b for instance with vm_state active and task_state None.
May 28 01:11:24.051566 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:11:24.059344 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "4edb886b-df1e-42fd-9881-91fc07339c3f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.155s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:24.794138 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:11:24.794399 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:11:25.297380 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:11:25.803951 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.227s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:25.804350 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:11:25.892092 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "4edb886b-df1e-42fd-9881-91fc07339c3f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:25.893329 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "4edb886b-df1e-42fd-9881-91fc07339c3f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:26.309956 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:11:26.310403 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:11:26.310403 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:26.310724 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:26.392156 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ae6af3cf5df464bbc9da74d825ddb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f3bdd3aef04045aac40e4b851915e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:11:26.396835 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lazy-loading 'flavor' on Instance uuid 4edb886b-df1e-42fd-9881-91fc07339c3f {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:11:26.560814 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:26.652026 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00035647799995786045 future=<Future at 0x7c9884121c70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:11:26.652026 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:11:26.653860 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] Emitting event <LifecycleEvent: 1779930671.6512363, 1e644f60-1f1f-4679-aec6-d1bbb3b69efe => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:11:26.653860 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] VM Stopped (Lifecycle Event)
May 28 01:11:26.814913 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:26.815412 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:11:26.817458 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:26.850644 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Successfully created port: 7117ae99-9818-42a9-9110-9bf8e26c3a34 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:11:27.031257 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:27.155349 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7d95f1ce-b2d7-458f-a072-9f79e1e3ad58 tempest-VolumesNegativeTest-26292438 tempest-VolumesNegativeTest-26292438-project-member] [instance: 1e644f60-1f1f-4679-aec6-d1bbb3b69efe] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:11:27.319296 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:11:27.321446 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:11:27.401386 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "4edb886b-df1e-42fd-9881-91fc07339c3f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:27.449151 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Successfully updated port: 7117ae99-9818-42a9-9110-9bf8e26c3a34 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:11:27.500920 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-621fa7e1-fc5f-4ad5-9445-69111705ccc6 req-c0496198-beaa-45af-8fe5-4fea17b10fed service nova] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Received event network-changed-7117ae99-9818-42a9-9110-9bf8e26c3a34 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:27.501291 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-621fa7e1-fc5f-4ad5-9445-69111705ccc6 req-c0496198-beaa-45af-8fe5-4fea17b10fed service nova] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Refreshing instance network info cache due to event network-changed-7117ae99-9818-42a9-9110-9bf8e26c3a34. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:11:27.501491 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-621fa7e1-fc5f-4ad5-9445-69111705ccc6 req-c0496198-beaa-45af-8fe5-4fea17b10fed service nova] Acquiring lock "refresh_cache-e4dca6bf-1591-46fa-8ade-a99fddf923a7" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:11:27.501610 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-621fa7e1-fc5f-4ad5-9445-69111705ccc6 req-c0496198-beaa-45af-8fe5-4fea17b10fed service nova] Acquired lock "refresh_cache-e4dca6bf-1591-46fa-8ade-a99fddf923a7" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:11:27.501774 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-621fa7e1-fc5f-4ad5-9445-69111705ccc6 req-c0496198-beaa-45af-8fe5-4fea17b10fed service nova] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Refreshing network info cache for port 7117ae99-9818-42a9-9110-9bf8e26c3a34 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:11:27.727939 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:27.898984 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:27.899486 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:27.903672 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:11:27.903788 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Claim successful on node np0000001577
May 28 01:11:27.951649 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "refresh_cache-e4dca6bf-1591-46fa-8ade-a99fddf923a7" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:11:28.004610 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-621fa7e1-fc5f-4ad5-9445-69111705ccc6 req-c0496198-beaa-45af-8fe5-4fea17b10fed service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:28.091487 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-621fa7e1-fc5f-4ad5-9445-69111705ccc6 req-c0496198-beaa-45af-8fe5-4fea17b10fed service nova] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:11:28.261236 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-621fa7e1-fc5f-4ad5-9445-69111705ccc6 req-c0496198-beaa-45af-8fe5-4fea17b10fed service nova] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:11:28.274230 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:28.329435 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:11:28.330573 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:11:28.330884 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Creating image(s)
May 28 01:11:28.331408 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4dca6bf-1591-46fa-8ade-a99fddf923a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:28.331652 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "/opt/stack/data/nova/instances/e4dca6bf-1591-46fa-8ade-a99fddf923a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:28.332296 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "/opt/stack/data/nova/instances/e4dca6bf-1591-46fa-8ade-a99fddf923a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:28.332863 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:11:28.337404 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:11:28.338753 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:28.441987 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.103s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:11:28.442504 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:28.443093 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:28.443592 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:11:28.449658 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:11:28.450094 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:28.480274 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "4edb886b-df1e-42fd-9881-91fc07339c3f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:28.480823 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "4edb886b-df1e-42fd-9881-91fc07339c3f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:28.481373 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Attaching volume f4367fd6-1652-4af4-a6b7-b55a2f5e737b to /dev/vdb
May 28 01:11:28.537801 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:11:28.547639 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.097s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:11:28.548107 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/e4dca6bf-1591-46fa-8ade-a99fddf923a7/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:28.565893 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:11:28.590529 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:28.609568 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/e4dca6bf-1591-46fa-8ade-a99fddf923a7/disk 1073741824" returned: 0 in 0.059s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:11:28.609568 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.166s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:28.609773 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:28.637322 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:11:28.637742 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:11:28.648319 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:11:28.649998 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe65:fa89', 'fe80::583c:47ff:fea3:281d', 'fe80::fc16:3eff:fefa:1f', 'fe80::d820:d3ff:fe1f:ca6e'] 
May 28 01:11:28.649998 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:11:28.649998 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:11:28.650171 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:11:28.650432 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Updating existing volume attachment record: 13dd473f-3c84-4a30-8c03-a32eabd74e74 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:11:28.713571 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:28.728162 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.118s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:11:28.728250 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4dca6bf-1591-46fa-8ade-a99fddf923a7/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:11:28.728462 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4dca6bf-1591-46fa-8ade-a99fddf923a7/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:28.764679 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-621fa7e1-fc5f-4ad5-9445-69111705ccc6 req-c0496198-beaa-45af-8fe5-4fea17b10fed service nova] Releasing lock "refresh_cache-e4dca6bf-1591-46fa-8ade-a99fddf923a7" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:11:28.765639 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquired lock "refresh_cache-e4dca6bf-1591-46fa-8ade-a99fddf923a7" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:11:28.766776 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:11:28.817745 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4dca6bf-1591-46fa-8ade-a99fddf923a7/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:11:28.818291 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Cannot resize image /opt/stack/data/nova/instances/e4dca6bf-1591-46fa-8ade-a99fddf923a7/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:11:28.818847 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:11:28.819220 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Ensure instance console log exists: /opt/stack/data/nova/instances/e4dca6bf-1591-46fa-8ade-a99fddf923a7/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:11:28.819628 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:28.819945 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:28.820128 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:29.126243 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:11:29.126435 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:11:29.222948 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:11:29.223368 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:11:29.223610 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:11:29.223972 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:11:29.224180 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:11:29.234944 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:11:29.235583 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:11:29.235924 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:11:29.236143 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:11:29.236769 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:11:29.237002 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:11:29.247571 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:11:29.247571 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:29.251955 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:11:29.251955 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:29.257992 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b] added
May 28 01:11:29.257992 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:11:29.257992 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:11:29.257992 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:11:29.257992 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:11:29.257992 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:11:29.257992 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:29.258180 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:11:29.258281 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0222(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:11:29.258413 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:11:29.262486 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b] added
May 28 01:11:29.262486 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:11:29.262486 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:11:29.262486 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:11:29.262486 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:11:29.262486 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:11:29.262486 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:29.262665 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:11:29.262781 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0257(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:11:29.262954 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:11:29.350064 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:11:29.496122 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:29.623351 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Updating instance_info_cache with network_info: [{"id": "7117ae99-9818-42a9-9110-9bf8e26c3a34", "address": "fa:16:3e:42:89:5e", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7117ae99-98", "ovs_interfaceid": "7117ae99-9818-42a9-9110-9bf8e26c3a34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:11:29.629125 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:11:30.125132 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Releasing lock "refresh_cache-e4dca6bf-1591-46fa-8ade-a99fddf923a7" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:11:30.125378 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Instance network_info: |[{"id": "7117ae99-9818-42a9-9110-9bf8e26c3a34", "address": "fa:16:3e:42:89:5e", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7117ae99-98", "ovs_interfaceid": "7117ae99-9818-42a9-9110-9bf8e26c3a34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:11:30.127150 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Start _get_guest_xml network_info=[{"id": "7117ae99-9818-42a9-9110-9bf8e26c3a34", "address": "fa:16:3e:42:89:5e", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7117ae99-98", "ovs_interfaceid": "7117ae99-9818-42a9-9110-9bf8e26c3a34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:11:30.129477 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:11:30.131999 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-382052642', uuid='e4dca6bf-1591-46fa-8ade-a99fddf923a7'), owner=OwnerMeta(userid='0ae6af3cf5df464bbc9da74d825ddb4e', username='tempest-VolumeMultiattachTests-1632400240-project-member', projectid='07f3bdd3aef04045aac40e4b851915e1', projectname='tempest-VolumeMultiattachTests-1632400240'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7117ae99-9818-42a9-9110-9bf8e26c3a34", "address": "fa:16:3e:42:89:5e", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7117ae99-98", "ovs_interfaceid": "7117ae99-9818-42a9-9110-9bf8e26c3a34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930690.130383) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:11:30.131999 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:11:30.132303 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:11:30.133274 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:11:30.133486 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:11:30.134410 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:11:30.134768 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:11:30.135010 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:11:30.135193 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:11:30.135583 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:11:30.136817 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.237s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:30.137285 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:11:30.137477 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:11:30.139654 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:11:30.139861 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:11:30.139971 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:11:30.140084 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:11:30.140221 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:11:30.140527 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:11:30.151138 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:11:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-382052642',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumemultiattachtests-server-382052642',id=67,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZPR0Gj39BZcWrRlU1NY4uwBiAIpfhz5q66W9RrzOpiQ/np/JXsGVyBJNTTO+6yHZcqzSOevY1HNVzn2A/GM7sX1gKgxLatKq6sG+HtO56znleQjhIEua31xTu77Jqhlg==',key_name='tempest-keypair-2138912526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07f3bdd3aef04045aac40e4b851915e1',ramdisk_id='',reservation_id='r-0njxzlyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1632400240',owner_user_name='tempest-VolumeMultiattachTests-1632400240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:11:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ae6af3cf5df464bbc9da74d825ddb4e',uuid=e4dca6bf-1591-46fa-8ade-a99fddf923a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7117ae99-9818-42a9-9110-9bf8e26c3a34", "address": "fa:16:3e:42:89:5e", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7117ae99-98", "ovs_interfaceid": "7117ae99-9818-42a9-9110-9bf8e26c3a34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:11:30.151440 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Converting VIF {"id": "7117ae99-9818-42a9-9110-9bf8e26c3a34", "address": "fa:16:3e:42:89:5e", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7117ae99-98", "ovs_interfaceid": "7117ae99-9818-42a9-9110-9bf8e26c3a34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:11:30.153494 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:89:5e,bridge_name='br-int',has_traffic_filtering=True,id=7117ae99-9818-42a9-9110-9bf8e26c3a34,network=Network(7357480b-2ba7-465c-88fe-aaf2e8f7a673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7117ae99-98') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:11:30.153494 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lazy-loading 'pci_devices' on Instance uuid e4dca6bf-1591-46fa-8ade-a99fddf923a7 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:11:30.258953 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:11:30.263341 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:11:30.271044 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:11:30.271044 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:11:30.278219 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:11:30.278219 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:30.284257 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:30.290740 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:30.299805 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:30.299805 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:30.299805 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:30.299805 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:30.299805 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:30.299805 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:30.299805 np0000001577 nova-compute[98319]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:30.299805 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:11:30.299805 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:30.299805 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:30.299805 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:30.299805 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:30.299805 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:30.299805 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:30.299805 np0000001577 nova-compute[98319]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:30.299805 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:11:30.309756 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:30.309756 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:30.309756 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:30.309756 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:30.309756 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:30.309756 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:30.309756 np0000001577 nova-compute[98319]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:30.309756 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:11:30.309945 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:30.309945 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:30.309945 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:30.309945 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:30.309945 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:30.309945 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:30.309945 np0000001577 nova-compute[98319]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:30.309945 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:11:30.343457 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b, portal: 192.168.40.100,3260]
May 28 01:11:30.343457 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b, portal: 192.168.40.100,3260] successful.
May 28 01:11:30.343457 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:30.352166 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b, portal: 192.168.50.100,3260]
May 28 01:11:30.352166 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b, portal: 192.168.50.100,3260] successful.
May 28 01:11:30.352166 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:30.363432 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:30.375008 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:30.384454 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:30.384454 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:30.384454 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:30.384454 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:30.384454 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:30.384454 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:30.384454 np0000001577 nova-compute[98319]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:30.384454 np0000001577 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:30.384454 np0000001577 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:30.384454 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:11:30.384454 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:30.384454 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:30.384454 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:30.384454 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:30.384454 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:30.384454 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:30.384454 np0000001577 nova-compute[98319]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:30.384454 np0000001577 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:30.384454 np0000001577 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:30.384454 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:11:30.384454 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.148s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:11:30.384454 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:11:30.384454 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] HCTL ('12', '-', '-', 0) found on session 175 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:11:30.384454 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:11:30.397812 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:30.397812 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:30.397812 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:30.397812 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:30.397812 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:30.397812 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:30.397812 np0000001577 nova-compute[98319]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:30.397812 np0000001577 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:30.397812 np0000001577 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:30.397812 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:11:30.397812 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:30.397812 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:30.397812 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:30.397812 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:30.397812 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:30.397812 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:30.397812 np0000001577 nova-compute[98319]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:30.397812 np0000001577 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:30.397812 np0000001577 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:30.397812 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:11:30.397812 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:11:30.397812 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:11:30.399692 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] HCTL ('13', '-', '-', 0) found on session 176 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:11:30.399892 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:11:30.401397 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Searching for a device in session 175 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:11:30.401397 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:11:30.417389 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Searching for a device in session 176 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:11:30.417389 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:11:30.644180 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:11:30.644180 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:11:30.644180 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:30.644272 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:30.656553 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] End _get_guest_xml xml=<domain type="qemu">
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:   <uuid>e4dca6bf-1591-46fa-8ade-a99fddf923a7</uuid>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:   <name>instance-00000043</name>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       <nova:name>tempest-VolumeMultiattachTests-server-382052642</nova:name>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:11:30</nova:creationTime>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:         <nova:user uuid="0ae6af3cf5df464bbc9da74d825ddb4e">tempest-VolumeMultiattachTests-1632400240-project-member</nova:user>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:         <nova:project uuid="07f3bdd3aef04045aac40e4b851915e1">tempest-VolumeMultiattachTests-1632400240</nova:project>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:         <nova:port uuid="7117ae99-9818-42a9-9110-9bf8e26c3a34">
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:     <system>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       <entry name="serial">e4dca6bf-1591-46fa-8ade-a99fddf923a7</entry>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       <entry name="uuid">e4dca6bf-1591-46fa-8ade-a99fddf923a7</entry>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:     </system>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:   <os>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:   </os>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:   <features>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:   </features>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:   <devices>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/e4dca6bf-1591-46fa-8ade-a99fddf923a7/disk"/>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:     </disk>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/e4dca6bf-1591-46fa-8ade-a99fddf923a7/disk.config"/>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:     </disk>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:42:89:5e"/>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       <target dev="tap7117ae99-98"/>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:     </interface>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/e4dca6bf-1591-46fa-8ade-a99fddf923a7/console.log" append="off"/>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:     </serial>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:     <video>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:     </video>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:     </rng>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:   </devices>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]: </domain>
May 28 01:11:30.656553 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:11:30.658351 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Preparing to wait for external event network-vif-plugged-7117ae99-9818-42a9-9110-9bf8e26c3a34 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:11:30.658351 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "e4dca6bf-1591-46fa-8ade-a99fddf923a7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:30.658351 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e4dca6bf-1591-46fa-8ade-a99fddf923a7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:30.658351 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e4dca6bf-1591-46fa-8ade-a99fddf923a7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:30.658490 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:11:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-382052642',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumemultiattachtests-server-382052642',id=67,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZPR0Gj39BZcWrRlU1NY4uwBiAIpfhz5q66W9RrzOpiQ/np/JXsGVyBJNTTO+6yHZcqzSOevY1HNVzn2A/GM7sX1gKgxLatKq6sG+HtO56znleQjhIEua31xTu77Jqhlg==',key_name='tempest-keypair-2138912526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07f3bdd3aef04045aac40e4b851915e1',ramdisk_id='',reservation_id='r-0njxzlyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1632400240',owner_user_name='tempest-VolumeMultiattachTests-1632400240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:11:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ae6af3cf5df464bbc9da74d825ddb4e',uuid=e4dca6bf-1591-46fa-8ade-a99fddf923a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7117ae99-9818-42a9-9110-9bf8e26c3a34", "address": "fa:16:3e:42:89:5e", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7117ae99-98", "ovs_interfaceid": "7117ae99-9818-42a9-9110-9bf8e26c3a34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:11:30.658809 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Converting VIF {"id": "7117ae99-9818-42a9-9110-9bf8e26c3a34", "address": "fa:16:3e:42:89:5e", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7117ae99-98", "ovs_interfaceid": "7117ae99-9818-42a9-9110-9bf8e26c3a34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:11:30.659431 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:89:5e,bridge_name='br-int',has_traffic_filtering=True,id=7117ae99-9818-42a9-9110-9bf8e26c3a34,network=Network(7357480b-2ba7-465c-88fe-aaf2e8f7a673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7117ae99-98') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:11:30.659842 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:89:5e,bridge_name='br-int',has_traffic_filtering=True,id=7117ae99-9818-42a9-9110-9bf8e26c3a34,network=Network(7357480b-2ba7-465c-88fe-aaf2e8f7a673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7117ae99-98') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:11:30.662700 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:30.664478 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:11:30.665142 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:11:30.665883 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:30.666046 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '12ec3eb9-b368-5e92-b138-607c2dfd6305', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:11:30.672664 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:11:30.675770 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:30.675770 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7117ae99-98, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:11:30.675770 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7117ae99-98, col_values=(('qos', UUID('21ce1f61-e9d2-43bc-b1d8-3e470cacb97d')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:11:30.675913 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7117ae99-98, col_values=(('external_ids', {'iface-id': '7117ae99-9818-42a9-9110-9bf8e26c3a34', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:89:5e', 'vm-uuid': 'e4dca6bf-1591-46fa-8ade-a99fddf923a7'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:11:30.681771 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:11:30.682814 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:30.683854 np0000001577 nova-compute[98319]: INFO os_vif [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:89:5e,bridge_name='br-int',has_traffic_filtering=True,id=7117ae99-9818-42a9-9110-9bf8e26c3a34,network=Network(7357480b-2ba7-465c-88fe-aaf2e8f7a673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7117ae99-98')
May 28 01:11:30.714342 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96f4ee9375c440d6abf68f2aa230b0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6ee814419446dcb5025c68fb0f4ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:11:31.112293 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Successfully created port: aef634ef-906c-43a3-bea0-bb5e3c94930f {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:11:31.147823 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:11:31.237098 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:11:31.308656 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:31.561920 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:31.654206 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:11:31.993293 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Successfully updated port: aef634ef-906c-43a3-bea0-bb5e3c94930f {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:11:32.040206 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-de6dcca7-a6ca-484c-a2c2-5e11c7b735fa req-8f676a08-f643-41bf-883c-77153f3a58a6 service nova] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Received event network-changed-aef634ef-906c-43a3-bea0-bb5e3c94930f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:32.040370 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-de6dcca7-a6ca-484c-a2c2-5e11c7b735fa req-8f676a08-f643-41bf-883c-77153f3a58a6 service nova] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Refreshing instance network info cache due to event network-changed-aef634ef-906c-43a3-bea0-bb5e3c94930f. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:11:32.040538 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-de6dcca7-a6ca-484c-a2c2-5e11c7b735fa req-8f676a08-f643-41bf-883c-77153f3a58a6 service nova] Acquiring lock "refresh_cache-60b7855e-1385-4a4b-89c8-f3c0f71f3959" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:11:32.040909 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-de6dcca7-a6ca-484c-a2c2-5e11c7b735fa req-8f676a08-f643-41bf-883c-77153f3a58a6 service nova] Acquired lock "refresh_cache-60b7855e-1385-4a4b-89c8-f3c0f71f3959" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:11:32.040974 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-de6dcca7-a6ca-484c-a2c2-5e11c7b735fa req-8f676a08-f643-41bf-883c-77153f3a58a6 service nova] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Refreshing network info cache for port aef634ef-906c-43a3-bea0-bb5e3c94930f {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:11:32.200003 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:11:32.200151 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:11:32.200151 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No VIF found with MAC fa:16:3e:42:89:5e, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:11:32.200646 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Using config drive
May 28 01:11:32.254429 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Found WWN 33000000009502b69 for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:11:32.254735 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:11:32.254930 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '33000000009502b69', 'path': '/dev/dm-1', 'multipath_id': '33000000009502b69'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:11:32.255058 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000009502b69', 'path': '/dev/dm-1', 'multipath_id': '33000000009502b69'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:11:32.258003 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lazy-loading 'flavor' on Instance uuid 4edb886b-df1e-42fd-9881-91fc07339c3f {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:11:32.495031 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "refresh_cache-60b7855e-1385-4a4b-89c8-f3c0f71f3959" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:11:32.543083 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-de6dcca7-a6ca-484c-a2c2-5e11c7b735fa req-8f676a08-f643-41bf-883c-77153f3a58a6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:32.612141 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-de6dcca7-a6ca-484c-a2c2-5e11c7b735fa req-8f676a08-f643-41bf-883c-77153f3a58a6 service nova] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:11:32.662634 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:11:32.663731 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:11:32.664085 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Creating image(s)
May 28 01:11:32.664296 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "/opt/stack/data/nova/instances/60b7855e-1385-4a4b-89c8-f3c0f71f3959/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:32.664440 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "/opt/stack/data/nova/instances/60b7855e-1385-4a4b-89c8-f3c0f71f3959/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:32.664937 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "/opt/stack/data/nova/instances/60b7855e-1385-4a4b-89c8-f3c0f71f3959/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:32.665613 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:11:32.669248 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:11:32.670286 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:32.713095 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:32.755763 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:11:32.756222 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:32.757230 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:32.757798 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:11:32.764388 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Attempting to attach volume f4367fd6-1652-4af4-a6b7-b55a2f5e737b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:11:32.766105 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:11:32.766680 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:32.812941 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:11:32.812941 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:11:32.812941 np0000001577 nova-compute[98319]:   <alias name="ua-f4367fd6-1652-4af4-a6b7-b55a2f5e737b"/>
May 28 01:11:32.812941 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 28 01:11:32.812941 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:11:32.812941 np0000001577 nova-compute[98319]:   <serial>f4367fd6-1652-4af4-a6b7-b55a2f5e737b</serial>
May 28 01:11:32.812941 np0000001577 nova-compute[98319]: </disk>
May 28 01:11:32.812941 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:11:32.872966 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Creating config drive at /opt/stack/data/nova/instances/e4dca6bf-1591-46fa-8ade-a99fddf923a7/disk.config
May 28 01:11:32.878362 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-de6dcca7-a6ca-484c-a2c2-5e11c7b735fa req-8f676a08-f643-41bf-883c-77153f3a58a6 service nova] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:11:32.881582 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e4dca6bf-1591-46fa-8ade-a99fddf923a7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgesiu05u {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:32.894159 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.127s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:11:32.895461 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/60b7855e-1385-4a4b-89c8-f3c0f71f3959/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:32.948427 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e4dca6bf-1591-46fa-8ade-a99fddf923a7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgesiu05u" returned: 0 in 0.066s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:11:32.970988 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/60b7855e-1385-4a4b-89c8-f3c0f71f3959/disk 1073741824" returned: 0 in 0.076s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:11:32.971616 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:32.972015 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:33.077605 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.105s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:11:33.077983 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60b7855e-1385-4a4b-89c8-f3c0f71f3959/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:11:33.078207 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b7855e-1385-4a4b-89c8-f3c0f71f3959/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:33.095310 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:33.162098 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b7855e-1385-4a4b-89c8-f3c0f71f3959/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:11:33.162771 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Cannot resize image /opt/stack/data/nova/instances/60b7855e-1385-4a4b-89c8-f3c0f71f3959/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:11:33.163210 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:11:33.163384 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Ensure instance console log exists: /opt/stack/data/nova/instances/60b7855e-1385-4a4b-89c8-f3c0f71f3959/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:11:33.163824 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:33.164106 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:33.164250 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:33.381311 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-de6dcca7-a6ca-484c-a2c2-5e11c7b735fa req-8f676a08-f643-41bf-883c-77153f3a58a6 service nova] Releasing lock "refresh_cache-60b7855e-1385-4a4b-89c8-f3c0f71f3959" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:11:33.381996 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquired lock "refresh_cache-60b7855e-1385-4a4b-89c8-f3c0f71f3959" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:11:33.382256 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:11:33.408971 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:33.436982 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:33.458926 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-df000ffd-1fab-45d9-954a-9a6efc4d7d36 req-9801322e-40cf-4dce-acc2-0babd5448398 service nova] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Received event network-vif-unplugged-aef634ef-906c-43a3-bea0-bb5e3c94930f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:33.460162 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-df000ffd-1fab-45d9-954a-9a6efc4d7d36 req-9801322e-40cf-4dce-acc2-0babd5448398 service nova] Acquiring lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:33.460301 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-df000ffd-1fab-45d9-954a-9a6efc4d7d36 req-9801322e-40cf-4dce-acc2-0babd5448398 service nova] Lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:33.460417 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-df000ffd-1fab-45d9-954a-9a6efc4d7d36 req-9801322e-40cf-4dce-acc2-0babd5448398 service nova] Lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:33.460562 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-df000ffd-1fab-45d9-954a-9a6efc4d7d36 req-9801322e-40cf-4dce-acc2-0babd5448398 service nova] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] No waiting events found dispatching network-vif-unplugged-aef634ef-906c-43a3-bea0-bb5e3c94930f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:11:33.460714 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-df000ffd-1fab-45d9-954a-9a6efc4d7d36 req-9801322e-40cf-4dce-acc2-0babd5448398 service nova] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Received unexpected event network-vif-unplugged-aef634ef-906c-43a3-bea0-bb5e3c94930f for instance with vm_state building and task_state spawning.
May 28 01:11:33.533456 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:33.585410 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:33.949382 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:11:34.115568 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:34.239619 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930694.2391555, e4dca6bf-1591-46fa-8ade-a99fddf923a7 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:11:34.239719 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] VM Started (Lifecycle Event)
May 28 01:11:34.256507 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Updating instance_info_cache with network_info: [{"id": "aef634ef-906c-43a3-bea0-bb5e3c94930f", "address": "fa:16:3e:8e:81:34", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef634ef-90", "ovs_interfaceid": "aef634ef-906c-43a3-bea0-bb5e3c94930f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:11:34.473366 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:11:34.473366 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:11:34.473366 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:11:34.473366 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] No VIF found with MAC fa:16:3e:fa:00:1f, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:11:34.742463 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:11:34.746283 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930694.7460134, e4dca6bf-1591-46fa-8ade-a99fddf923a7 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:11:34.746383 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] VM Paused (Lifecycle Event)
May 28 01:11:34.758787 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Releasing lock "refresh_cache-60b7855e-1385-4a4b-89c8-f3c0f71f3959" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:11:34.759049 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Instance network_info: |[{"id": "aef634ef-906c-43a3-bea0-bb5e3c94930f", "address": "fa:16:3e:8e:81:34", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef634ef-90", "ovs_interfaceid": "aef634ef-906c-43a3-bea0-bb5e3c94930f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:11:34.761489 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Start _get_guest_xml network_info=[{"id": "aef634ef-906c-43a3-bea0-bb5e3c94930f", "address": "fa:16:3e:8e:81:34", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef634ef-90", "ovs_interfaceid": "aef634ef-906c-43a3-bea0-bb5e3c94930f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:11:34.767623 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:11:34.768912 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-2128136567', uuid='60b7855e-1385-4a4b-89c8-f3c0f71f3959'), owner=OwnerMeta(userid='96f4ee9375c440d6abf68f2aa230b0c5', username='tempest-AttachVolumeNegativeTest-1272396699-project-member', projectid='1d6ee814419446dcb5025c68fb0f4ce9', projectname='tempest-AttachVolumeNegativeTest-1272396699'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "aef634ef-906c-43a3-bea0-bb5e3c94930f", "address": "fa:16:3e:8e:81:34", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef634ef-90", "ovs_interfaceid": "aef634ef-906c-43a3-bea0-bb5e3c94930f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930694.768491) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:11:34.771485 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:11:34.771815 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:11:34.772959 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:11:34.773116 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:11:34.774716 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:11:34.775011 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:11:34.775158 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:11:34.775245 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:11:34.775359 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:11:34.775436 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:11:34.775526 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:11:34.775687 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:11:34.775795 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:11:34.775901 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:11:34.775998 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:11:34.776109 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:11:34.789727 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:11:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2128136567',display_name='tempest-AttachVolumeNegativeTest-server-2128136567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumenegativetest-server-2128136567',id=68,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYRZOi0t1E+A/XLsfiwOo3P1+BvmJexWcY7jagSwno7Tm3CSiuhdXMOYCFihWyhsojoeIDDGzYPwL25/nioA/fjoV6Dx0RNTEMVEpkWnRccRwe4J0Emm1ErCLWSxUs0Bw==',key_name='tempest-keypair-260657815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d6ee814419446dcb5025c68fb0f4ce9',ramdisk_id='',reservation_id='r-k60ql0b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1272396699',owner_user_name='tempest-AttachVolumeNegativeTest-1272396699-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:11:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f4ee9375c440d6abf68f2aa230b0c5',uuid=60b7855e-1385-4a4b-89c8-f3c0f71f3959,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aef634ef-906c-43a3-bea0-bb5e3c94930f", "address": "fa:16:3e:8e:81:34", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef634ef-90", "ovs_interfaceid": "aef634ef-906c-43a3-bea0-bb5e3c94930f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:11:34.789875 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Converting VIF {"id": "aef634ef-906c-43a3-bea0-bb5e3c94930f", "address": "fa:16:3e:8e:81:34", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef634ef-90", "ovs_interfaceid": "aef634ef-906c-43a3-bea0-bb5e3c94930f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:11:34.790465 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:81:34,bridge_name='br-int',has_traffic_filtering=True,id=aef634ef-906c-43a3-bea0-bb5e3c94930f,network=Network(f8ce4f22-7484-451c-b0df-2e7318e070f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaef634ef-90') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:11:34.790981 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lazy-loading 'pci_devices' on Instance uuid 60b7855e-1385-4a4b-89c8-f3c0f71f3959 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:11:35.248488 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:11:35.250504 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:11:35.295697 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] End _get_guest_xml xml=<domain type="qemu">
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:   <uuid>60b7855e-1385-4a4b-89c8-f3c0f71f3959</uuid>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:   <name>instance-00000044</name>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2128136567</nova:name>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:11:34</nova:creationTime>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:         <nova:user uuid="96f4ee9375c440d6abf68f2aa230b0c5">tempest-AttachVolumeNegativeTest-1272396699-project-member</nova:user>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:         <nova:project uuid="1d6ee814419446dcb5025c68fb0f4ce9">tempest-AttachVolumeNegativeTest-1272396699</nova:project>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:         <nova:port uuid="aef634ef-906c-43a3-bea0-bb5e3c94930f">
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:     <system>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       <entry name="serial">60b7855e-1385-4a4b-89c8-f3c0f71f3959</entry>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       <entry name="uuid">60b7855e-1385-4a4b-89c8-f3c0f71f3959</entry>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:     </system>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:   <os>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:   </os>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:   <features>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:   </features>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:   <devices>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/60b7855e-1385-4a4b-89c8-f3c0f71f3959/disk"/>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:     </disk>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/60b7855e-1385-4a4b-89c8-f3c0f71f3959/disk.config"/>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:     </disk>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:8e:81:34"/>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       <target dev="tapaef634ef-90"/>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:     </interface>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/60b7855e-1385-4a4b-89c8-f3c0f71f3959/console.log" append="off"/>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:     </serial>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:     <video>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:     </video>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:     </rng>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:   </devices>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]: </domain>
May 28 01:11:35.295697 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:11:35.297657 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Preparing to wait for external event network-vif-plugged-aef634ef-906c-43a3-bea0-bb5e3c94930f {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:11:35.297657 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:35.297657 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:35.297657 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:35.297657 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:11:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2128136567',display_name='tempest-AttachVolumeNegativeTest-server-2128136567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumenegativetest-server-2128136567',id=68,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYRZOi0t1E+A/XLsfiwOo3P1+BvmJexWcY7jagSwno7Tm3CSiuhdXMOYCFihWyhsojoeIDDGzYPwL25/nioA/fjoV6Dx0RNTEMVEpkWnRccRwe4J0Emm1ErCLWSxUs0Bw==',key_name='tempest-keypair-260657815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d6ee814419446dcb5025c68fb0f4ce9',ramdisk_id='',reservation_id='r-k60ql0b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1272396699',owner_user_name='tempest-AttachVolumeNegativeTest-1272396699-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:11:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f4ee9375c440d6abf68f2aa230b0c5',uuid=60b7855e-1385-4a4b-89c8-f3c0f71f3959,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aef634ef-906c-43a3-bea0-bb5e3c94930f", "address": "fa:16:3e:8e:81:34", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef634ef-90", "ovs_interfaceid": "aef634ef-906c-43a3-bea0-bb5e3c94930f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:11:35.297657 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Converting VIF {"id": "aef634ef-906c-43a3-bea0-bb5e3c94930f", "address": "fa:16:3e:8e:81:34", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef634ef-90", "ovs_interfaceid": "aef634ef-906c-43a3-bea0-bb5e3c94930f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:11:35.297657 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:81:34,bridge_name='br-int',has_traffic_filtering=True,id=aef634ef-906c-43a3-bea0-bb5e3c94930f,network=Network(f8ce4f22-7484-451c-b0df-2e7318e070f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaef634ef-90') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:11:35.297657 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:81:34,bridge_name='br-int',has_traffic_filtering=True,id=aef634ef-906c-43a3-bea0-bb5e3c94930f,network=Network(f8ce4f22-7484-451c-b0df-2e7318e070f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaef634ef-90') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:11:35.298033 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:35.298033 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:11:35.298216 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:11:35.299109 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:35.299240 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '18833e53-4310-5082-b184-a432e02ec59f', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:11:35.299938 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:35.300517 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:11:35.301180 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:35.303020 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:35.303150 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaef634ef-90, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:11:35.303883 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaef634ef-90, col_values=(('qos', UUID('48ebe492-ed89-4119-8d20-f81109d5c0d7')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:11:35.304041 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaef634ef-90, col_values=(('external_ids', {'iface-id': 'aef634ef-906c-43a3-bea0-bb5e3c94930f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:81:34', 'vm-uuid': '60b7855e-1385-4a4b-89c8-f3c0f71f3959'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:11:35.305088 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:35.306102 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:11:35.310599 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:35.311307 np0000001577 nova-compute[98319]: INFO os_vif [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:81:34,bridge_name='br-int',has_traffic_filtering=True,id=aef634ef-906c-43a3-bea0-bb5e3c94930f,network=Network(f8ce4f22-7484-451c-b0df-2e7318e070f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaef634ef-90')
May 28 01:11:35.537886 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ab15287f-a6f6-48ce-b169-bf3710fc83f7 req-ff0f0e23-f39a-4871-8289-0300e22e1363 service nova] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Received event network-vif-plugged-7117ae99-9818-42a9-9110-9bf8e26c3a34 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:35.538106 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ab15287f-a6f6-48ce-b169-bf3710fc83f7 req-ff0f0e23-f39a-4871-8289-0300e22e1363 service nova] Acquiring lock "e4dca6bf-1591-46fa-8ade-a99fddf923a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:35.538673 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ab15287f-a6f6-48ce-b169-bf3710fc83f7 req-ff0f0e23-f39a-4871-8289-0300e22e1363 service nova] Lock "e4dca6bf-1591-46fa-8ade-a99fddf923a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:35.538821 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ab15287f-a6f6-48ce-b169-bf3710fc83f7 req-ff0f0e23-f39a-4871-8289-0300e22e1363 service nova] Lock "e4dca6bf-1591-46fa-8ade-a99fddf923a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:35.539081 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ab15287f-a6f6-48ce-b169-bf3710fc83f7 req-ff0f0e23-f39a-4871-8289-0300e22e1363 service nova] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Processing event network-vif-plugged-7117ae99-9818-42a9-9110-9bf8e26c3a34 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:11:35.539182 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ab15287f-a6f6-48ce-b169-bf3710fc83f7 req-ff0f0e23-f39a-4871-8289-0300e22e1363 service nova] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Received event network-vif-plugged-7117ae99-9818-42a9-9110-9bf8e26c3a34 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:35.539556 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ab15287f-a6f6-48ce-b169-bf3710fc83f7 req-ff0f0e23-f39a-4871-8289-0300e22e1363 service nova] Acquiring lock "e4dca6bf-1591-46fa-8ade-a99fddf923a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:35.539759 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ab15287f-a6f6-48ce-b169-bf3710fc83f7 req-ff0f0e23-f39a-4871-8289-0300e22e1363 service nova] Lock "e4dca6bf-1591-46fa-8ade-a99fddf923a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:35.539924 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ab15287f-a6f6-48ce-b169-bf3710fc83f7 req-ff0f0e23-f39a-4871-8289-0300e22e1363 service nova] Lock "e4dca6bf-1591-46fa-8ade-a99fddf923a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:35.540127 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ab15287f-a6f6-48ce-b169-bf3710fc83f7 req-ff0f0e23-f39a-4871-8289-0300e22e1363 service nova] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] No waiting events found dispatching network-vif-plugged-7117ae99-9818-42a9-9110-9bf8e26c3a34 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:11:35.540271 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-ab15287f-a6f6-48ce-b169-bf3710fc83f7 req-ff0f0e23-f39a-4871-8289-0300e22e1363 service nova] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Received unexpected event network-vif-plugged-7117ae99-9818-42a9-9110-9bf8e26c3a34 for instance with vm_state building and task_state spawning.
May 28 01:11:35.540771 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:11:35.548283 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:11:35.558770 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Instance spawned successfully.
May 28 01:11:35.558770 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:11:35.753124 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:11:35.753371 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930695.7532122, e4dca6bf-1591-46fa-8ade-a99fddf923a7 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:11:35.753502 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] VM Resumed (Lifecycle Event)
May 28 01:11:36.035001 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e6892c76-8a1a-4faa-8dde-41773769a25f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "4edb886b-df1e-42fd-9881-91fc07339c3f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.554s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:36.064427 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:11:36.064584 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:11:36.064869 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:11:36.065438 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:11:36.065438 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:11:36.068672 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:11:36.105899 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Acquiring lock "3d97b775-d6eb-4c8f-b951-11bcb0444adf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:36.106112 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Lock "3d97b775-d6eb-4c8f-b951-11bcb0444adf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:36.256104 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:11:36.258065 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:11:36.570565 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:36.573424 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Took 8.24 seconds to spawn the instance on the hypervisor.
May 28 01:11:36.573610 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:11:36.611052 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:11:36.760292 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:11:36.825623 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:11:36.825778 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:11:36.825918 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] No VIF found with MAC fa:16:3e:8e:81:34, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:11:36.826304 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Using config drive
May 28 01:11:37.083379 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Took 13.55 seconds to build instance.
May 28 01:11:37.121741 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "87f7f5aa-3bd9-49d0-9f75-50f768acb6ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:37.121935 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "87f7f5aa-3bd9-49d0-9f75-50f768acb6ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:37.178192 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:37.178485 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:37.181623 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:11:37.182062 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Claim successful on node np0000001577
May 28 01:11:37.332129 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:37.478807 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Creating config drive at /opt/stack/data/nova/instances/60b7855e-1385-4a4b-89c8-f3c0f71f3959/disk.config
May 28 01:11:37.492405 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/60b7855e-1385-4a4b-89c8-f3c0f71f3959/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2fnmuyx1 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:37.551801 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/60b7855e-1385-4a4b-89c8-f3c0f71f3959/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2fnmuyx1" returned: 0 in 0.060s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:11:37.585023 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-714bc286-9605-41ca-b03c-f258af490197 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e4dca6bf-1591-46fa-8ade-a99fddf923a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.075s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:37.630102 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:11:37.990388 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:38.025900 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:38.107888 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:38.190968 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:38.341477 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f48c8fd3-165a-4780-8ce0-29a8daaf6261 req-d4ffecb7-17e9-48a4-ad0f-fbf63c67c730 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Received event network-changed-89446e5b-c447-4a2c-b547-03a71d82747b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:38.341931 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f48c8fd3-165a-4780-8ce0-29a8daaf6261 req-d4ffecb7-17e9-48a4-ad0f-fbf63c67c730 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Refreshing instance network info cache due to event network-changed-89446e5b-c447-4a2c-b547-03a71d82747b. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:11:38.342080 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f48c8fd3-165a-4780-8ce0-29a8daaf6261 req-d4ffecb7-17e9-48a4-ad0f-fbf63c67c730 service nova] Acquiring lock "refresh_cache-4edb886b-df1e-42fd-9881-91fc07339c3f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:11:38.342139 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f48c8fd3-165a-4780-8ce0-29a8daaf6261 req-d4ffecb7-17e9-48a4-ad0f-fbf63c67c730 service nova] Acquired lock "refresh_cache-4edb886b-df1e-42fd-9881-91fc07339c3f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:11:38.342412 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-f48c8fd3-165a-4780-8ce0-29a8daaf6261 req-d4ffecb7-17e9-48a4-ad0f-fbf63c67c730 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Refreshing network info cache for port 89446e5b-c447-4a2c-b547-03a71d82747b {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:11:38.421628 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-afd2c28c-9b09-4021-8e68-e713c9d09f5d req-3e7cc7b6-a321-466b-8eb4-142226e6c37b service nova] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Received event network-vif-plugged-aef634ef-906c-43a3-bea0-bb5e3c94930f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:38.423469 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-afd2c28c-9b09-4021-8e68-e713c9d09f5d req-3e7cc7b6-a321-466b-8eb4-142226e6c37b service nova] Acquiring lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:38.423469 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-afd2c28c-9b09-4021-8e68-e713c9d09f5d req-3e7cc7b6-a321-466b-8eb4-142226e6c37b service nova] Lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:38.423469 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-afd2c28c-9b09-4021-8e68-e713c9d09f5d req-3e7cc7b6-a321-466b-8eb4-142226e6c37b service nova] Lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:38.423469 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-afd2c28c-9b09-4021-8e68-e713c9d09f5d req-3e7cc7b6-a321-466b-8eb4-142226e6c37b service nova] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Processing event network-vif-plugged-aef634ef-906c-43a3-bea0-bb5e3c94930f {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:11:38.546910 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:38.549052 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:38.552190 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:38.575184 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:38.603887 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:11:38.604157 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:11:38.849097 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-f48c8fd3-165a-4780-8ce0-29a8daaf6261 req-d4ffecb7-17e9-48a4-ad0f-fbf63c67c730 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:38.870393 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930698.8700228, 60b7855e-1385-4a4b-89c8-f3c0f71f3959 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:11:38.870761 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:11:38.870915 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] VM Started (Lifecycle Event)
May 28 01:11:38.872773 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:11:38.879583 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Instance spawned successfully.
May 28 01:11:38.879583 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:11:39.107523 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:11:39.175645 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-f48c8fd3-165a-4780-8ce0-29a8daaf6261 req-d4ffecb7-17e9-48a4-ad0f-fbf63c67c730 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:39.324157 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-f48c8fd3-165a-4780-8ce0-29a8daaf6261 req-d4ffecb7-17e9-48a4-ad0f-fbf63c67c730 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Updated VIF entry in instance network info cache for port 89446e5b-c447-4a2c-b547-03a71d82747b. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:11:39.324405 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-f48c8fd3-165a-4780-8ce0-29a8daaf6261 req-d4ffecb7-17e9-48a4-ad0f-fbf63c67c730 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Updating instance_info_cache with network_info: [{"id": "89446e5b-c447-4a2c-b547-03a71d82747b", "address": "fa:16:3e:fa:00:1f", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89446e5b-c4", "ovs_interfaceid": "89446e5b-c447-4a2c-b547-03a71d82747b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:11:39.373343 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:11:39.378194 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:11:39.383521 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:11:39.383656 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:11:39.383993 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:11:39.384168 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:11:39.384413 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:11:39.384661 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:11:39.621517 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.443s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:39.622203 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.433s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:39.622940 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:11:39.632813 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:11:39.632813 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Claim successful on node np0000001577
May 28 01:11:39.827697 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f48c8fd3-165a-4780-8ce0-29a8daaf6261 req-d4ffecb7-17e9-48a4-ad0f-fbf63c67c730 service nova] Releasing lock "refresh_cache-4edb886b-df1e-42fd-9881-91fc07339c3f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:11:39.881830 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:11:39.882033 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930699.8818913, 60b7855e-1385-4a4b-89c8-f3c0f71f3959 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:11:39.882125 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] VM Paused (Lifecycle Event)
May 28 01:11:39.888885 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Took 7.23 seconds to spawn the instance on the hypervisor.
May 28 01:11:39.889029 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:11:39.978212 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:11:39.978624 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:11:40.127911 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:11:40.128060 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:11:40.128270 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:40.128450 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:40.217905 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd6b37e0fb18f44cebefbd955aef64927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77c8c2778bf47d79d3119ed128f6608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:11:40.306146 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:40.385046 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:11:40.387686 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930700.3865962, 60b7855e-1385-4a4b-89c8-f3c0f71f3959 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:11:40.387686 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] VM Resumed (Lifecycle Event)
May 28 01:11:40.400560 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Took 12.57 seconds to build instance.
May 28 01:11:40.515506 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Received event network-changed-f9933e16-d9fb-47e4-9e9a-3ba073b1a35f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:40.516564 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Refreshing instance network info cache due to event network-changed-f9933e16-d9fb-47e4-9e9a-3ba073b1a35f. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:11:40.516564 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] Acquiring lock "refresh_cache-e8151422-37a0-4b7a-914f-34dc2979ead9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:11:40.516564 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] Acquired lock "refresh_cache-e8151422-37a0-4b7a-914f-34dc2979ead9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:11:40.516564 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Refreshing network info cache for port f9933e16-d9fb-47e4-9e9a-3ba073b1a35f {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:11:40.631586 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:11:40.753442 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Successfully created port: 47188850-53a4-4d18-8810-5b06dc353030 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:11:40.890534 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:11:40.894593 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:11:40.903829 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-53fd3d53-c953-4612-9c93-aa1ba667ef50 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.088s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:41.020109 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:41.042682 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:11:41.042958 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:11:41.136812 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:11:41.282863 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Successfully updated port: 47188850-53a4-4d18-8810-5b06dc353030 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:11:41.345839 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-58adf343-95bf-4708-89b4-12f0b78a3024 req-5620e052-e14e-42b9-963b-e8f6a21be764 service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Received event network-changed-47188850-53a4-4d18-8810-5b06dc353030 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:41.346202 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-58adf343-95bf-4708-89b4-12f0b78a3024 req-5620e052-e14e-42b9-963b-e8f6a21be764 service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Refreshing instance network info cache due to event network-changed-47188850-53a4-4d18-8810-5b06dc353030. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:11:41.346378 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-58adf343-95bf-4708-89b4-12f0b78a3024 req-5620e052-e14e-42b9-963b-e8f6a21be764 service nova] Acquiring lock "refresh_cache-3d97b775-d6eb-4c8f-b951-11bcb0444adf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:11:41.349719 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-58adf343-95bf-4708-89b4-12f0b78a3024 req-5620e052-e14e-42b9-963b-e8f6a21be764 service nova] Acquired lock "refresh_cache-3d97b775-d6eb-4c8f-b951-11bcb0444adf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:11:41.350070 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-58adf343-95bf-4708-89b4-12f0b78a3024 req-5620e052-e14e-42b9-963b-e8f6a21be764 service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Refreshing network info cache for port 47188850-53a4-4d18-8810-5b06dc353030 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:11:41.444741 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:41.546172 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:11:41.562348 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Updated VIF entry in instance network info cache for port f9933e16-d9fb-47e4-9e9a-3ba073b1a35f. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:11:41.562604 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Updating instance_info_cache with network_info: [{"id": "f9933e16-d9fb-47e4-9e9a-3ba073b1a35f", "address": "fa:16:3e:65:fa:89", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9933e16-d9", "ovs_interfaceid": "f9933e16-d9fb-47e4-9e9a-3ba073b1a35f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:11:41.572179 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:41.642395 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Booting with volume 655d9253-2209-439f-a631-a3c5b1bf6ed2 at /dev/vda
May 28 01:11:41.675487 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:11:41.686412 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:11:41.706564 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:41.754286 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:11:41.754589 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:11:41.762131 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:11:41.763215 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe65:fa89', 'fe80::583c:47ff:fea3:281d', 'fe80::fc16:3eff:fefa:1f', 'fe80::d820:d3ff:fe1f:ca6e', 'fe80::fc16:3eff:fe42:895e', 'fe80::fc16:3eff:fe8e:8134', 'fe80::c813:dcff:fe9e:6381'] 
May 28 01:11:41.763386 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:11:41.763535 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:11:41.763849 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:11:41.764096 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Updating existing volume attachment record: c84cc3e0-9622-4e50-a4c1-764c65a26d48 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:11:41.784896 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Acquiring lock "refresh_cache-3d97b775-d6eb-4c8f-b951-11bcb0444adf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:11:41.851847 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-58adf343-95bf-4708-89b4-12f0b78a3024 req-5620e052-e14e-42b9-963b-e8f6a21be764 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:41.906721 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-58adf343-95bf-4708-89b4-12f0b78a3024 req-5620e052-e14e-42b9-963b-e8f6a21be764 service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:11:42.028380 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-58adf343-95bf-4708-89b4-12f0b78a3024 req-5620e052-e14e-42b9-963b-e8f6a21be764 service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:11:42.054747 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.433s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:42.055200 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:11:42.064588 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] Releasing lock "refresh_cache-e8151422-37a0-4b7a-914f-34dc2979ead9" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:11:42.064792 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Received event network-changed-7117ae99-9818-42a9-9110-9bf8e26c3a34 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:42.064898 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Refreshing instance network info cache due to event network-changed-7117ae99-9818-42a9-9110-9bf8e26c3a34. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:11:42.065060 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] Acquiring lock "refresh_cache-e4dca6bf-1591-46fa-8ade-a99fddf923a7" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:11:42.065157 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] Acquired lock "refresh_cache-e4dca6bf-1591-46fa-8ade-a99fddf923a7" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:11:42.065227 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Refreshing network info cache for port 7117ae99-9818-42a9-9110-9bf8e26c3a34 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:11:42.530361 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-58adf343-95bf-4708-89b4-12f0b78a3024 req-5620e052-e14e-42b9-963b-e8f6a21be764 service nova] Releasing lock "refresh_cache-3d97b775-d6eb-4c8f-b951-11bcb0444adf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:11:42.531101 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Acquired lock "refresh_cache-3d97b775-d6eb-4c8f-b951-11bcb0444adf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:11:42.531341 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:11:42.560637 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:11:42.560835 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:11:42.561089 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:42.561314 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:42.568529 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:42.572175 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-acad81f2-4537-40d8-8157-03b83c7229fb req-1a73f032-f4fa-413e-9837-3a4cc71804d8 service nova] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Received event network-changed-aef634ef-906c-43a3-bea0-bb5e3c94930f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:42.572335 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-acad81f2-4537-40d8-8157-03b83c7229fb req-1a73f032-f4fa-413e-9837-3a4cc71804d8 service nova] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Refreshing instance network info cache due to event network-changed-aef634ef-906c-43a3-bea0-bb5e3c94930f. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:11:42.572514 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-acad81f2-4537-40d8-8157-03b83c7229fb req-1a73f032-f4fa-413e-9837-3a4cc71804d8 service nova] Acquiring lock "refresh_cache-60b7855e-1385-4a4b-89c8-f3c0f71f3959" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:11:42.572653 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-acad81f2-4537-40d8-8157-03b83c7229fb req-1a73f032-f4fa-413e-9837-3a4cc71804d8 service nova] Acquired lock "refresh_cache-60b7855e-1385-4a4b-89c8-f3c0f71f3959" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:11:42.572816 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-acad81f2-4537-40d8-8157-03b83c7229fb req-1a73f032-f4fa-413e-9837-3a4cc71804d8 service nova] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Refreshing network info cache for port aef634ef-906c-43a3-bea0-bb5e3c94930f {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:11:42.648826 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae6c3c6a50b24a58af140f523fb73374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1880a27e1ad0432f914e086d7fffdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:11:42.896934 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:42.977977 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:11:42.978106 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 01:11:42.978640 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:11:43.036989 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Updated VIF entry in instance network info cache for port 7117ae99-9818-42a9-9110-9bf8e26c3a34. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:11:43.037406 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Updating instance_info_cache with network_info: [{"id": "7117ae99-9818-42a9-9110-9bf8e26c3a34", "address": "fa:16:3e:42:89:5e", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7117ae99-98", "ovs_interfaceid": "7117ae99-9818-42a9-9110-9bf8e26c3a34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:11:43.064237 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:11:43.077888 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-acad81f2-4537-40d8-8157-03b83c7229fb req-1a73f032-f4fa-413e-9837-3a4cc71804d8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:43.099767 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Successfully created port: 94194a84-a05a-4791-a8d6-6c15f99969b2 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:11:43.103787 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:11:43.298569 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:43.434855 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Updating instance_info_cache with network_info: [{"id": "47188850-53a4-4d18-8810-5b06dc353030", "address": "fa:16:3e:1c:df:ad", "network": {"id": "64f08667-4fa5-4522-98af-795ef337993e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-2036728215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a77c8c2778bf47d79d3119ed128f6608", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47188850-53", "ovs_interfaceid": "47188850-53a4-4d18-8810-5b06dc353030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:11:43.463940 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-acad81f2-4537-40d8-8157-03b83c7229fb req-1a73f032-f4fa-413e-9837-3a4cc71804d8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:43.486065 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:43.487016 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:43.488009 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:43.488009 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Auditing locally available compute resources for np0000001577 (node: np0000001577) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 01:11:43.539503 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] Releasing lock "refresh_cache-e4dca6bf-1591-46fa-8ade-a99fddf923a7" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:11:43.539936 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Received event network-vif-plugged-aef634ef-906c-43a3-bea0-bb5e3c94930f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:43.539936 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] Acquiring lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:43.540409 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] Lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:43.540409 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] Lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:43.540409 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] No waiting events found dispatching network-vif-plugged-aef634ef-906c-43a3-bea0-bb5e3c94930f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:11:43.542222 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Received unexpected event network-vif-plugged-aef634ef-906c-43a3-bea0-bb5e3c94930f for instance with vm_state active and task_state None.
May 28 01:11:43.542222 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Received event network-changed-89446e5b-c447-4a2c-b547-03a71d82747b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:43.542222 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Refreshing instance network info cache due to event network-changed-89446e5b-c447-4a2c-b547-03a71d82747b. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:11:43.542822 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] Acquiring lock "refresh_cache-4edb886b-df1e-42fd-9881-91fc07339c3f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:11:43.542822 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] Acquired lock "refresh_cache-4edb886b-df1e-42fd-9881-91fc07339c3f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:11:43.542822 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Refreshing network info cache for port 89446e5b-c447-4a2c-b547-03a71d82747b {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:11:43.568005 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:11:43.613951 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-acad81f2-4537-40d8-8157-03b83c7229fb req-1a73f032-f4fa-413e-9837-3a4cc71804d8 service nova] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Updated VIF entry in instance network info cache for port aef634ef-906c-43a3-bea0-bb5e3c94930f. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:11:43.614279 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-acad81f2-4537-40d8-8157-03b83c7229fb req-1a73f032-f4fa-413e-9837-3a4cc71804d8 service nova] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Updating instance_info_cache with network_info: [{"id": "aef634ef-906c-43a3-bea0-bb5e3c94930f", "address": "fa:16:3e:8e:81:34", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef634ef-90", "ovs_interfaceid": "aef634ef-906c-43a3-bea0-bb5e3c94930f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:11:43.619853 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Successfully updated port: 94194a84-a05a-4791-a8d6-6c15f99969b2 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:11:43.665508 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-24fb2974-9125-4e85-8f09-06ff0852dd27 req-1b2a8f0a-90e3-4b67-8c61-48987384482d service nova] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Received event network-changed-94194a84-a05a-4791-a8d6-6c15f99969b2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:43.665646 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-24fb2974-9125-4e85-8f09-06ff0852dd27 req-1b2a8f0a-90e3-4b67-8c61-48987384482d service nova] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Refreshing instance network info cache due to event network-changed-94194a84-a05a-4791-a8d6-6c15f99969b2. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:11:43.666071 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-24fb2974-9125-4e85-8f09-06ff0852dd27 req-1b2a8f0a-90e3-4b67-8c61-48987384482d service nova] Acquiring lock "refresh_cache-87f7f5aa-3bd9-49d0-9f75-50f768acb6ef" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:11:43.666167 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-24fb2974-9125-4e85-8f09-06ff0852dd27 req-1b2a8f0a-90e3-4b67-8c61-48987384482d service nova] Acquired lock "refresh_cache-87f7f5aa-3bd9-49d0-9f75-50f768acb6ef" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:11:43.666970 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-24fb2974-9125-4e85-8f09-06ff0852dd27 req-1b2a8f0a-90e3-4b67-8c61-48987384482d service nova] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Refreshing network info cache for port 94194a84-a05a-4791-a8d6-6c15f99969b2 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:11:43.858359 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:11:43.859217 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:11:43.859417 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Creating image(s)
May 28 01:11:43.859675 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:11:43.859802 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Ensure instance console log exists: /opt/stack/data/nova/instances/3d97b775-d6eb-4c8f-b951-11bcb0444adf/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:11:43.860019 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:43.860149 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:43.860279 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:43.936674 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Releasing lock "refresh_cache-3d97b775-d6eb-4c8f-b951-11bcb0444adf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:11:43.936836 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Instance network_info: |[{"id": "47188850-53a4-4d18-8810-5b06dc353030", "address": "fa:16:3e:1c:df:ad", "network": {"id": "64f08667-4fa5-4522-98af-795ef337993e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-2036728215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a77c8c2778bf47d79d3119ed128f6608", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47188850-53", "ovs_interfaceid": "47188850-53a4-4d18-8810-5b06dc353030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:11:43.937359 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Start _get_guest_xml network_info=[{"id": "47188850-53a4-4d18-8810-5b06dc353030", "address": "fa:16:3e:1c:df:ad", "network": {"id": "64f08667-4fa5-4522-98af-795ef337993e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-2036728215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a77c8c2778bf47d79d3119ed128f6608", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47188850-53", "ovs_interfaceid": "47188850-53a4-4d18-8810-5b06dc353030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2', 'iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '655d9253-2209-439f-a631-a3c5b1bf6ed2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '3d97b775-d6eb-4c8f-b951-11bcb0444adf', 'attached_at': '', 'detached_at': '', 'volume_id': '655d9253-2209-439f-a631-a3c5b1bf6ed2', 'serial': '655d9253-2209-439f-a631-a3c5b1bf6ed2'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'c84cc3e0-9622-4e50-a4c1-764c65a26d48', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:11:43.939785 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:11:43.940795 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBackupRestore-server-360252113', uuid='3d97b775-d6eb-4c8f-b951-11bcb0444adf'), owner=OwnerMeta(userid='d6b37e0fb18f44cebefbd955aef64927', username='tempest-TestVolumeBackupRestore-1871172420-project-member', projectid='a77c8c2778bf47d79d3119ed128f6608', projectname='tempest-TestVolumeBackupRestore-1871172420'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "47188850-53a4-4d18-8810-5b06dc353030", "address": "fa:16:3e:1c:df:ad", "network": {"id": "64f08667-4fa5-4522-98af-795ef337993e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-2036728215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a77c8c2778bf47d79d3119ed128f6608", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47188850-53", "ovs_interfaceid": "47188850-53a4-4d18-8810-5b06dc353030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930703.940479) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:11:43.941801 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:11:43.942155 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:11:43.943126 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:11:43.943341 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:11:43.944264 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:11:43.944598 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:11:43.944828 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:11:43.944997 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:11:43.945193 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:11:43.945360 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:11:43.945541 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:11:43.945798 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:11:43.945981 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:11:43.946170 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:11:43.946351 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:11:43.946562 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:11:43.955664 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:11:43.956019 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2', 'iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '655d9253-2209-439f-a631-a3c5b1bf6ed2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:11:43.956242 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:11:43.956639 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:11:43.956918 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2', 'iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '655d9253-2209-439f-a631-a3c5b1bf6ed2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:11:43.968338 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:11:43.968760 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:11:43.968935 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:11:43.969386 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:11:43.969692 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:11:43.969852 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:11:43.980596 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:11:43.980596 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:43.984864 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:11:43.984864 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:43.991535 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2] added
May 28 01:11:43.991535 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:11:43.991535 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:11:43.991535 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:11:43.991535 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:11:43.991535 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:11:43.991535 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:43.991756 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:11:43.991881 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0229(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:11:43.992015 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:11:43.996301 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2] added
May 28 01:11:43.996301 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:11:43.996301 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:11:43.996301 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:11:43.996301 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:11:43.996301 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:11:43.996301 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:43.996440 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:11:43.996524 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0267(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:11:43.996643 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:11:44.046491 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:44.073922 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Booting with volume 36812bff-3b2c-4990-89a5-c5ab22274fef at /dev/vda
May 28 01:11:44.109846 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:11:44.116588 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-acad81f2-4537-40d8-8157-03b83c7229fb req-1a73f032-f4fa-413e-9837-3a4cc71804d8 service nova] Releasing lock "refresh_cache-60b7855e-1385-4a4b-89c8-f3c0f71f3959" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:11:44.121630 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "refresh_cache-87f7f5aa-3bd9-49d0-9f75-50f768acb6ef" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:11:44.122904 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:11:44.145977 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:44.169409 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-24fb2974-9125-4e85-8f09-06ff0852dd27 req-1b2a8f0a-90e3-4b67-8c61-48987384482d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:44.194207 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:11:44.194514 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:11:44.206074 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:11:44.208168 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe65:fa89', 'fe80::583c:47ff:fea3:281d', 'fe80::fc16:3eff:fefa:1f', 'fe80::d820:d3ff:fe1f:ca6e', 'fe80::fc16:3eff:fe42:895e', 'fe80::fc16:3eff:fe8e:8134', 'fe80::c813:dcff:fe9e:6381'] 
May 28 01:11:44.208249 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:11:44.208384 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:11:44.208605 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:11:44.208790 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Updating existing volume attachment record: 3dc4c8a9-daeb-4bf9-954e-566a89099c23 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:11:44.269911 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-24fb2974-9125-4e85-8f09-06ff0852dd27 req-1b2a8f0a-90e3-4b67-8c61-48987384482d service nova] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:11:44.426193 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:44.437554 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-24fb2974-9125-4e85-8f09-06ff0852dd27 req-1b2a8f0a-90e3-4b67-8c61-48987384482d service nova] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:11:44.516338 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:44.569230 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Updated VIF entry in instance network info cache for port 89446e5b-c447-4a2c-b547-03a71d82747b. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:11:44.569770 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Updating instance_info_cache with network_info: [{"id": "89446e5b-c447-4a2c-b547-03a71d82747b", "address": "fa:16:3e:fa:00:1f", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89446e5b-c4", "ovs_interfaceid": "89446e5b-c447-4a2c-b547-03a71d82747b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:11:44.610992 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:11:44.612623 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:44.708531 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:11:44.709026 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-2 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:11:44.709254 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-5 (vdc) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:11:44.709344 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-0 (vdd) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:11:44.714579 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:44.805335 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:11:44.805834 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:44.890606 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:11:44.890986 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:11:44.894981 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4dca6bf-1591-46fa-8ade-a99fddf923a7/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:44.940662 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-24fb2974-9125-4e85-8f09-06ff0852dd27 req-1b2a8f0a-90e3-4b67-8c61-48987384482d service nova] Releasing lock "refresh_cache-87f7f5aa-3bd9-49d0-9f75-50f768acb6ef" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:11:44.941402 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquired lock "refresh_cache-87f7f5aa-3bd9-49d0-9f75-50f768acb6ef" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:11:44.941648 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:11:44.980173 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4dca6bf-1591-46fa-8ade-a99fddf923a7/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:11:44.980580 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4dca6bf-1591-46fa-8ade-a99fddf923a7/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:44.993169 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:11:44.997282 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:11:45.006322 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:11:45.006322 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:11:45.014676 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:11:45.014676 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:45.020952 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:45.031076 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:45.042111 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:45.042111 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:45.042111 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:45.042111 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:45.042111 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:45.042111 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:45.042111 np0000001577 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:45.042111 np0000001577 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:45.042111 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:11:45.042111 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:45.042111 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:45.042111 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:45.042111 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:45.042111 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:45.042111 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:45.042111 np0000001577 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:45.042111 np0000001577 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:45.042111 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:11:45.055534 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:45.055534 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:45.055534 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:45.055534 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:45.055534 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:45.055534 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:45.055534 np0000001577 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:45.055534 np0000001577 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:45.055534 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:11:45.055821 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:45.055821 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:45.055821 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:45.055821 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:45.055821 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:45.055821 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:45.055821 np0000001577 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:45.055821 np0000001577 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:45.055821 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:11:45.072608 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4dca6bf-1591-46fa-8ade-a99fddf923a7/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:11:45.075273 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b57eb7d9-2796-4d6d-918b-45cf264a6c59 req-b2d55a57-e9a1-4231-82cc-d5fee2a7d543 service nova] Releasing lock "refresh_cache-4edb886b-df1e-42fd-9881-91fc07339c3f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:11:45.076599 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b7855e-1385-4a4b-89c8-f3c0f71f3959/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:45.096229 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2, portal: 192.168.40.100,3260]
May 28 01:11:45.096229 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2, portal: 192.168.40.100,3260] successful.
May 28 01:11:45.096229 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:45.107415 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:45.113651 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2, portal: 192.168.50.100,3260]
May 28 01:11:45.113651 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2, portal: 192.168.50.100,3260] successful.
May 28 01:11:45.113651 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:45.124353 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:45.124353 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:45.124353 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:45.124353 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:45.124353 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:45.124353 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:45.124353 np0000001577 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:45.124353 np0000001577 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:45.124353 np0000001577 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:45.124353 np0000001577 nova-compute[98319]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:45.124353 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:11:45.124663 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:45.124663 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:45.124663 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:45.124663 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:45.124663 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:45.124663 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:45.124663 np0000001577 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:45.124663 np0000001577 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:45.124663 np0000001577 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:45.124663 np0000001577 nova-compute[98319]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:45.124663 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:11:45.125044 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.156s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:11:45.125210 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:11:45.126281 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] HCTL ('11', '-', '-', 0) found on session 177 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:11:45.126393 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:11:45.130990 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:45.145768 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Searching for a device in session 177 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:11:45.146000 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '655d9253-2209-439f-a631-a3c5b1bf6ed2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:11:45.155133 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:45.155133 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:45.155133 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:45.155133 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:45.155133 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:45.155133 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:45.155133 np0000001577 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:45.155133 np0000001577 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:45.155133 np0000001577 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:45.155133 np0000001577 nova-compute[98319]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:45.155133 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:11:45.155517 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:45.155517 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:45.155517 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:45.155517 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:45.155517 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:45.155517 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:45.155517 np0000001577 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:45.155517 np0000001577 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:45.155517 np0000001577 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:45.155517 np0000001577 nova-compute[98319]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:45.155517 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:11:45.155743 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.186s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:11:45.156030 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:11:45.157139 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] HCTL ('14', '-', '-', 0) found on session 178 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:11:45.157288 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:11:45.169794 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b7855e-1385-4a4b-89c8-f3c0f71f3959/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:11:45.170253 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b7855e-1385-4a4b-89c8-f3c0f71f3959/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:45.190997 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Searching for a device in session 178 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:11:45.190997 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '655d9253-2209-439f-a631-a3c5b1bf6ed2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:11:45.272466 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b7855e-1385-4a4b-89c8-f3c0f71f3959/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:11:45.278927 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:11:45.280572 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:45.309322 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:45.340286 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "env LANG=C uptime" returned: 0 in 0.060s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:11:45.341170 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Hypervisor/Node resource view: name=np0000001577 free_ram=12520MB free_disk=72.74301147460938GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 01:11:45.341170 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:45.341376 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:45.501263 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:11:45.644808 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:45.757900 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Updating instance_info_cache with network_info: [{"id": "94194a84-a05a-4791-a8d6-6c15f99969b2", "address": "fa:16:3e:b6:e6:62", "network": {"id": "0be6df83-bfa0-4c90-aed3-88212317cb4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-252451076-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1880a27e1ad0432f914e086d7fffdeb4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94194a84-a0", "ovs_interfaceid": "94194a84-a05a-4791-a8d6-6c15f99969b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:11:45.970978 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:11:46.259661 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Releasing lock "refresh_cache-87f7f5aa-3bd9-49d0-9f75-50f768acb6ef" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:11:46.260016 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Instance network_info: |[{"id": "94194a84-a05a-4791-a8d6-6c15f99969b2", "address": "fa:16:3e:b6:e6:62", "network": {"id": "0be6df83-bfa0-4c90-aed3-88212317cb4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-252451076-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1880a27e1ad0432f914e086d7fffdeb4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94194a84-a0", "ovs_interfaceid": "94194a84-a05a-4791-a8d6-6c15f99969b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:11:46.367419 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:11:46.368432 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:11:46.368671 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Creating image(s)
May 28 01:11:46.368920 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:11:46.369020 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Ensure instance console log exists: /opt/stack/data/nova/instances/87f7f5aa-3bd9-49d0-9f75-50f768acb6ef/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:11:46.369218 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:46.369351 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:46.369467 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:46.370328 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Start _get_guest_xml network_info=[{"id": "94194a84-a05a-4791-a8d6-6c15f99969b2", "address": "fa:16:3e:b6:e6:62", "network": {"id": "0be6df83-bfa0-4c90-aed3-88212317cb4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-252451076-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1880a27e1ad0432f914e086d7fffdeb4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94194a84-a0", "ovs_interfaceid": "94194a84-a05a-4791-a8d6-6c15f99969b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '36812bff-3b2c-4990-89a5-c5ab22274fef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '87f7f5aa-3bd9-49d0-9f75-50f768acb6ef', 'attached_at': '', 'detached_at': '', 'volume_id': '36812bff-3b2c-4990-89a5-c5ab22274fef', 'serial': '36812bff-3b2c-4990-89a5-c5ab22274fef'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '3dc4c8a9-daeb-4bf9-954e-566a89099c23', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:11:46.373114 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:11:46.374467 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-1852089973', uuid='87f7f5aa-3bd9-49d0-9f75-50f768acb6ef'), owner=OwnerMeta(userid='ae6c3c6a50b24a58af140f523fb73374', username='tempest-TestVolumeBootPatternV346-1741753090-project-member', projectid='1880a27e1ad0432f914e086d7fffdeb4', projectname='tempest-TestVolumeBootPatternV346-1741753090'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "94194a84-a05a-4791-a8d6-6c15f99969b2", "address": "fa:16:3e:b6:e6:62", "network": {"id": "0be6df83-bfa0-4c90-aed3-88212317cb4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-252451076-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1880a27e1ad0432f914e086d7fffdeb4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94194a84-a0", "ovs_interfaceid": "94194a84-a05a-4791-a8d6-6c15f99969b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930706.37415) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:11:46.375987 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:11:46.376708 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:11:46.377525 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:11:46.377838 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:11:46.378950 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:11:46.379191 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:11:46.379336 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:11:46.379426 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:11:46.379589 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:11:46.379675 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:11:46.379778 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:11:46.379913 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:11:46.380003 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:11:46.380106 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:11:46.380196 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:11:46.380363 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:11:46.391356 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:11:46.391661 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '36812bff-3b2c-4990-89a5-c5ab22274fef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:11:46.391828 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:11:46.417513 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance e8151422-37a0-4b7a-914f-34dc2979ead9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:11:46.417727 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 4edb886b-df1e-42fd-9881-91fc07339c3f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:11:46.417806 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance e4dca6bf-1591-46fa-8ade-a99fddf923a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:11:46.417914 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 60b7855e-1385-4a4b-89c8-f3c0f71f3959 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:11:46.418005 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 3d97b775-d6eb-4c8f-b951-11bcb0444adf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:11:46.418108 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:11:46.418267 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 01:11:46.418407 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Final resource view: name=np0000001577 phys_ram=24030MB used_ram=1664MB phys_disk=95GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:11:45 up 43 min,  2 users,  load average: 5.03, 5.35, 4.31\n', 'num_instances': '6', 'num_vm_active': '4', 'num_task_None': '4', 'num_os_type_None': '6', 'num_proj_07f3bdd3aef04045aac40e4b851915e1': '2', 'io_workload': '2', 'num_proj_fb2f65d208f44146903c7dcf0b143a8e': '1', 'num_proj_1d6ee814419446dcb5025c68fb0f4ce9': '1', 'num_vm_building': '2', 'num_task_spawning': '1', 'num_proj_a77c8c2778bf47d79d3119ed128f6608': '1', 'num_task_block_device_mapping': '1', 'num_proj_1880a27e1ad0432f914e086d7fffdeb4': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 01:11:46.576758 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:46.696252 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:11:46.696648 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:11:46.986069 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Found WWN 330000000d5abb217 for multipath device dm-3 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:11:46.986557 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:11:46.986804 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '330000000d5abb217', 'path': '/dev/dm-3', 'multipath_id': '330000000d5abb217'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:11:46.986992 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d5abb217', 'path': '/dev/dm-3', 'multipath_id': '330000000d5abb217'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:11:46.987501 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.596s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:11:46.987765 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '36812bff-3b2c-4990-89a5-c5ab22274fef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:11:46.999287 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:11:46.999865 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:11:47.000307 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:11:47.000521 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:11:47.000873 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:11:47.001060 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:11:47.011584 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:11:47.011584 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:47.016247 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:11:47.016247 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:47.021994 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef] added
May 28 01:11:47.021994 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:11:47.021994 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:11:47.021994 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:11:47.021994 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:11:47.021994 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:11:47.021994 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:47.022178 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:11:47.022296 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0218(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:11:47.022403 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:11:47.026617 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef] added
May 28 01:11:47.026617 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:11:47.026617 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:11:47.026617 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:11:47.026617 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:11:47.026617 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:11:47.026617 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:47.026909 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:11:47.026909 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0258(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:11:47.027033 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:11:47.201983 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:11:47.492257 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:11:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-360252113',display_name='tempest-TestVolumeBackupRestore-server-360252113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebackuprestore-server-360252113',id=69,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRC+jjHgNHXSNzrpZMrdee0djqvGr8I/hS9uam4yNO99qWRLtPFNi0B4hfd8xRMu8o90bDcNag4hltJerabiC38fg7dJIcRlTrBxsP1+p0XGySgscyGia8CISvY/KJWQw==',key_name='tempest-TestVolumeBackupRestore-541610086',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a77c8c2778bf47d79d3119ed128f6608',ramdisk_id='',reservation_id='r-sn60g2mu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBackupRestore-1871172420',owner_user_name='tempest-TestVolumeBackupRestore-1871172420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:11:41Z,user_data=None,user_id='d6b37e0fb18f44cebefbd955aef64927',uuid=3d97b775-d6eb-4c8f-b951-11bcb0444adf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47188850-53a4-4d18-8810-5b06dc353030", "address": "fa:16:3e:1c:df:ad", "network": {"id": "64f08667-4fa5-4522-98af-795ef337993e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-2036728215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a77c8c2778bf47d79d3119ed128f6608", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47188850-53", "ovs_interfaceid": "47188850-53a4-4d18-8810-5b06dc353030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:11:47.492532 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Converting VIF {"id": "47188850-53a4-4d18-8810-5b06dc353030", "address": "fa:16:3e:1c:df:ad", "network": {"id": "64f08667-4fa5-4522-98af-795ef337993e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-2036728215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a77c8c2778bf47d79d3119ed128f6608", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47188850-53", "ovs_interfaceid": "47188850-53a4-4d18-8810-5b06dc353030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:11:47.493289 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:df:ad,bridge_name='br-int',has_traffic_filtering=True,id=47188850-53a4-4d18-8810-5b06dc353030,network=Network(64f08667-4fa5-4522-98af-795ef337993e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47188850-53') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:11:47.493674 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d97b775-d6eb-4c8f-b951-11bcb0444adf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:11:47.708022 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Compute_service record updated for np0000001577:np0000001577 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 01:11:47.708430 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.367s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:47.708430 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:11:47.996112 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] End _get_guest_xml xml=<domain type="qemu">
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:   <uuid>3d97b775-d6eb-4c8f-b951-11bcb0444adf</uuid>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:   <name>instance-00000045</name>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestVolumeBackupRestore-server-360252113</nova:name>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:11:43</nova:creationTime>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       <nova:image uuid="">
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:         <nova:user uuid="d6b37e0fb18f44cebefbd955aef64927">tempest-TestVolumeBackupRestore-1871172420-project-member</nova:user>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:         <nova:project uuid="a77c8c2778bf47d79d3119ed128f6608">tempest-TestVolumeBackupRestore-1871172420</nova:project>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:         <nova:port uuid="47188850-53a4-4d18-8810-5b06dc353030">
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:     <system>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       <entry name="serial">3d97b775-d6eb-4c8f-b951-11bcb0444adf</entry>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       <entry name="uuid">3d97b775-d6eb-4c8f-b951-11bcb0444adf</entry>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:     </system>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:   <os>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:   </os>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:   <features>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:   </features>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:   <devices>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/3d97b775-d6eb-4c8f-b951-11bcb0444adf/disk.config"/>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:     </disk>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       <alias name="ua-655d9253-2209-439f-a631-a3c5b1bf6ed2"/>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-3"/>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       <serial>655d9253-2209-439f-a631-a3c5b1bf6ed2</serial>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:     </disk>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:1c:df:ad"/>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       <target dev="tap47188850-53"/>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:     </interface>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/3d97b775-d6eb-4c8f-b951-11bcb0444adf/console.log" append="off"/>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:     </serial>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:     <video>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:     </video>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:     </rng>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:   </devices>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]: </domain>
May 28 01:11:47.996112 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:11:47.997862 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Preparing to wait for external event network-vif-plugged-47188850-53a4-4d18-8810-5b06dc353030 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:11:47.997862 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Acquiring lock "3d97b775-d6eb-4c8f-b951-11bcb0444adf-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:47.997862 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Lock "3d97b775-d6eb-4c8f-b951-11bcb0444adf-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:47.997862 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Lock "3d97b775-d6eb-4c8f-b951-11bcb0444adf-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:47.997862 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:11:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-360252113',display_name='tempest-TestVolumeBackupRestore-server-360252113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebackuprestore-server-360252113',id=69,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRC+jjHgNHXSNzrpZMrdee0djqvGr8I/hS9uam4yNO99qWRLtPFNi0B4hfd8xRMu8o90bDcNag4hltJerabiC38fg7dJIcRlTrBxsP1+p0XGySgscyGia8CISvY/KJWQw==',key_name='tempest-TestVolumeBackupRestore-541610086',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a77c8c2778bf47d79d3119ed128f6608',ramdisk_id='',reservation_id='r-sn60g2mu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBackupRestore-1871172420',owner_user_name='tempest-TestVolumeBackupRestore-1871172420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:11:41Z,user_data=None,user_id='d6b37e0fb18f44cebefbd955aef64927',uuid=3d97b775-d6eb-4c8f-b951-11bcb0444adf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47188850-53a4-4d18-8810-5b06dc353030", "address": "fa:16:3e:1c:df:ad", "network": {"id": "64f08667-4fa5-4522-98af-795ef337993e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-2036728215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a77c8c2778bf47d79d3119ed128f6608", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47188850-53", "ovs_interfaceid": "47188850-53a4-4d18-8810-5b06dc353030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:11:47.997862 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Converting VIF {"id": "47188850-53a4-4d18-8810-5b06dc353030", "address": "fa:16:3e:1c:df:ad", "network": {"id": "64f08667-4fa5-4522-98af-795ef337993e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-2036728215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a77c8c2778bf47d79d3119ed128f6608", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47188850-53", "ovs_interfaceid": "47188850-53a4-4d18-8810-5b06dc353030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:11:47.998120 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:df:ad,bridge_name='br-int',has_traffic_filtering=True,id=47188850-53a4-4d18-8810-5b06dc353030,network=Network(64f08667-4fa5-4522-98af-795ef337993e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47188850-53') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:11:47.998784 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:df:ad,bridge_name='br-int',has_traffic_filtering=True,id=47188850-53a4-4d18-8810-5b06dc353030,network=Network(64f08667-4fa5-4522-98af-795ef337993e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47188850-53') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:11:47.998784 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:47.998784 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:11:47.999010 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:11:47.999477 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:47.999659 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6d0059ee-f569-5d4d-9b43-00dfe3b2bca9', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:11:48.000408 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:48.001039 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:11:48.001347 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:48.002894 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:48.003004 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47188850-53, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:11:48.003252 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap47188850-53, col_values=(('qos', UUID('c0e312ae-c04d-49f3-864d-de9cc1db8d80')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:11:48.003387 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap47188850-53, col_values=(('external_ids', {'iface-id': '47188850-53a4-4d18-8810-5b06dc353030', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:df:ad', 'vm-uuid': '3d97b775-d6eb-4c8f-b951-11bcb0444adf'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:11:48.004021 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:48.005360 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:11:48.009256 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:48.009797 np0000001577 nova-compute[98319]: INFO os_vif [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:df:ad,bridge_name='br-int',has_traffic_filtering=True,id=47188850-53a4-4d18-8810-5b06dc353030,network=Network(64f08667-4fa5-4522-98af-795ef337993e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47188850-53')
May 28 01:11:48.022904 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:11:48.027489 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:11:48.037735 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:11:48.037735 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:11:48.043560 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:11:48.043560 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:48.049124 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:48.055814 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:48.067634 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:48.067634 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:48.067634 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:48.067634 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:48.067634 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:48.067634 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:48.067634 np0000001577 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:48.067634 np0000001577 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:48.067634 np0000001577 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:48.067634 np0000001577 nova-compute[98319]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:48.067634 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:11:48.068100 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:48.068100 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:48.068100 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:48.068100 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:48.068100 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:48.068100 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:48.068100 np0000001577 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:48.068100 np0000001577 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:48.068100 np0000001577 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:48.068100 np0000001577 nova-compute[98319]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:48.068100 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:11:48.073798 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:48.073798 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:48.073798 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:48.073798 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:48.073798 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:48.073798 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:48.073798 np0000001577 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:48.073798 np0000001577 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:48.073798 np0000001577 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:48.073798 np0000001577 nova-compute[98319]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:48.073798 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:11:48.073997 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:48.073997 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:48.073997 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:48.073997 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:48.073997 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:48.073997 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:48.073997 np0000001577 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:48.073997 np0000001577 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:48.073997 np0000001577 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:48.073997 np0000001577 nova-compute[98319]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:48.073997 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:11:48.113993 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef, portal: 192.168.40.100,3260]
May 28 01:11:48.113993 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef, portal: 192.168.40.100,3260] successful.
May 28 01:11:48.113993 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:48.121270 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef, portal: 192.168.50.100,3260]
May 28 01:11:48.121270 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef, portal: 192.168.50.100,3260] successful.
May 28 01:11:48.121270 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:48.125701 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:48.133178 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:48.148608 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:48.148608 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:48.148608 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:48.148608 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:48.148608 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:48.148608 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:48.148608 np0000001577 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:48.148608 np0000001577 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:48.148608 np0000001577 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:48.148608 np0000001577 nova-compute[98319]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:48.148608 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:11:48.148608 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:11:48.148608 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:11:48.148928 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:48.148928 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:48.148928 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:48.148928 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:48.148928 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:48.148928 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:48.148928 np0000001577 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:48.148928 np0000001577 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:48.148928 np0000001577 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:48.148928 np0000001577 nova-compute[98319]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:48.148928 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:11:48.148928 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:11:48.148928 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:11:48.149127 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:11:48.149127 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:11:48.150031 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:48.150031 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:48.150031 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:48.150031 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:48.150031 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:48.150031 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:48.150031 np0000001577 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:48.150031 np0000001577 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:48.150031 np0000001577 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:48.150031 np0000001577 nova-compute[98319]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:48.150031 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:11:48.150031 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:11:48.150031 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:11:48.150330 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:48.150330 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:48.150330 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:48.150330 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:48.150330 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:48.150330 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:48.150330 np0000001577 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:48.150330 np0000001577 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:48.150330 np0000001577 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:48.150330 np0000001577 nova-compute[98319]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:48.150330 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:11:48.150330 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:11:48.150330 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:11:48.150517 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:11:48.150584 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:11:48.151330 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] HCTL ('15', '-', '-', 0) found on session 179 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:11:48.151437 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:11:48.152114 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] HCTL ('16', '-', '-', 0) found on session 180 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:11:48.152213 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:11:48.167863 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Searching for a device in session 179 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:11:48.167863 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '36812bff-3b2c-4990-89a5-c5ab22274fef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:11:48.171967 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Searching for a device in session 180 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:11:48.171967 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '36812bff-3b2c-4990-89a5-c5ab22274fef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:11:49.002529 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:11:49.526611 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:11:49.526611 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:11:49.526611 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] No VIF found with MAC fa:16:3e:1c:df:ad, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:11:49.526611 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Using config drive
May 28 01:11:50.016993 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Found WWN 33000000086cebf09 for multipath device dm-7 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:11:50.017479 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:11:50.017479 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] <== connect_volume: return (3625ms) {'type': 'block', 'scsi_wwn': '33000000086cebf09', 'path': '/dev/dm-7', 'multipath_id': '33000000086cebf09'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:11:50.017479 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000086cebf09', 'path': '/dev/dm-7', 'multipath_id': '33000000086cebf09'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:11:50.035196 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:50.157573 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Creating config drive at /opt/stack/data/nova/instances/3d97b775-d6eb-4c8f-b951-11bcb0444adf/disk.config
May 28 01:11:50.159627 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3d97b775-d6eb-4c8f-b951-11bcb0444adf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmeg948ch {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:50.221825 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3d97b775-d6eb-4c8f-b951-11bcb0444adf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmeg948ch" returned: 0 in 0.062s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:11:50.522759 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:11:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1852089973',display_name='tempest-TestVolumeBootPatternV346-server-1852089973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpatternv346-server-1852089973',id=70,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOHRqXr+Iun2+cmM/863hQ16YEYy7Cqc2hSgV8etGHo/2KUcUM8wgHvVDKOZNw0kdwDAi4VYwwaPgJtZ7awCi3nnRIcpQW7MhW5XLUpfzc/MQTuH9dKzPx8+AWXq5V8eA==',key_name='tempest-keypair-15751798',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1880a27e1ad0432f914e086d7fffdeb4',ramdisk_id='',reservation_id='r-qubh6hui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1741753090',owner_user_name='tempest-TestVolumeBootPatternV346-1741753090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:11:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae6c3c6a50b24a58af140f523fb73374',uuid=87f7f5aa-3bd9-49d0-9f75-50f768acb6ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94194a84-a05a-4791-a8d6-6c15f99969b2", "address": "fa:16:3e:b6:e6:62", "network": {"id": "0be6df83-bfa0-4c90-aed3-88212317cb4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-252451076-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1880a27e1ad0432f914e086d7fffdeb4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94194a84-a0", "ovs_interfaceid": "94194a84-a05a-4791-a8d6-6c15f99969b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:11:50.523022 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Converting VIF {"id": "94194a84-a05a-4791-a8d6-6c15f99969b2", "address": "fa:16:3e:b6:e6:62", "network": {"id": "0be6df83-bfa0-4c90-aed3-88212317cb4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-252451076-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1880a27e1ad0432f914e086d7fffdeb4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94194a84-a0", "ovs_interfaceid": "94194a84-a05a-4791-a8d6-6c15f99969b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:11:50.523573 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:e6:62,bridge_name='br-int',has_traffic_filtering=True,id=94194a84-a05a-4791-a8d6-6c15f99969b2,network=Network(0be6df83-bfa0-4c90-aed3-88212317cb4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94194a84-a0') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:11:50.524249 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lazy-loading 'pci_devices' on Instance uuid 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:11:50.602963 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:50.632073 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:50.751646 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:50.833610 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d2f6a329-5403-4055-9e2d-d2ac0819b622 req-64a46ac3-ca26-45dc-b37c-c97935c1e0fb service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Received event network-vif-plugged-47188850-53a4-4d18-8810-5b06dc353030 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:50.833610 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d2f6a329-5403-4055-9e2d-d2ac0819b622 req-64a46ac3-ca26-45dc-b37c-c97935c1e0fb service nova] Acquiring lock "3d97b775-d6eb-4c8f-b951-11bcb0444adf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:50.833610 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d2f6a329-5403-4055-9e2d-d2ac0819b622 req-64a46ac3-ca26-45dc-b37c-c97935c1e0fb service nova] Lock "3d97b775-d6eb-4c8f-b951-11bcb0444adf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:50.833610 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d2f6a329-5403-4055-9e2d-d2ac0819b622 req-64a46ac3-ca26-45dc-b37c-c97935c1e0fb service nova] Lock "3d97b775-d6eb-4c8f-b951-11bcb0444adf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:50.833610 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d2f6a329-5403-4055-9e2d-d2ac0819b622 req-64a46ac3-ca26-45dc-b37c-c97935c1e0fb service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Processing event network-vif-plugged-47188850-53a4-4d18-8810-5b06dc353030 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:11:50.969564 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:50.971432 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:50.973761 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:50.997809 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:51.027454 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] End _get_guest_xml xml=<domain type="qemu">
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:   <uuid>87f7f5aa-3bd9-49d0-9f75-50f768acb6ef</uuid>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:   <name>instance-00000046</name>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestVolumeBootPatternV346-server-1852089973</nova:name>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:11:46</nova:creationTime>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       <nova:image uuid="">
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:         <nova:user uuid="ae6c3c6a50b24a58af140f523fb73374">tempest-TestVolumeBootPatternV346-1741753090-project-member</nova:user>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:         <nova:project uuid="1880a27e1ad0432f914e086d7fffdeb4">tempest-TestVolumeBootPatternV346-1741753090</nova:project>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:         <nova:port uuid="94194a84-a05a-4791-a8d6-6c15f99969b2">
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:     <system>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       <entry name="serial">87f7f5aa-3bd9-49d0-9f75-50f768acb6ef</entry>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       <entry name="uuid">87f7f5aa-3bd9-49d0-9f75-50f768acb6ef</entry>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:     </system>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:   <os>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:   </os>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:   <features>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:   </features>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:   <devices>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/87f7f5aa-3bd9-49d0-9f75-50f768acb6ef/disk.config"/>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:     </disk>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       <alias name="ua-36812bff-3b2c-4990-89a5-c5ab22274fef"/>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-7"/>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       <serial>36812bff-3b2c-4990-89a5-c5ab22274fef</serial>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:     </disk>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:b6:e6:62"/>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       <target dev="tap94194a84-a0"/>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:     </interface>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/87f7f5aa-3bd9-49d0-9f75-50f768acb6ef/console.log" append="off"/>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:     </serial>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:     <video>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:     </video>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:     </rng>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:   </devices>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]: </domain>
May 28 01:11:51.027454 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:11:51.030285 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Preparing to wait for external event network-vif-plugged-94194a84-a05a-4791-a8d6-6c15f99969b2 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:11:51.030285 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "87f7f5aa-3bd9-49d0-9f75-50f768acb6ef-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:51.030285 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "87f7f5aa-3bd9-49d0-9f75-50f768acb6ef-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:51.030285 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "87f7f5aa-3bd9-49d0-9f75-50f768acb6ef-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:51.030285 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:11:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1852089973',display_name='tempest-TestVolumeBootPatternV346-server-1852089973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpatternv346-server-1852089973',id=70,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOHRqXr+Iun2+cmM/863hQ16YEYy7Cqc2hSgV8etGHo/2KUcUM8wgHvVDKOZNw0kdwDAi4VYwwaPgJtZ7awCi3nnRIcpQW7MhW5XLUpfzc/MQTuH9dKzPx8+AWXq5V8eA==',key_name='tempest-keypair-15751798',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1880a27e1ad0432f914e086d7fffdeb4',ramdisk_id='',reservation_id='r-qubh6hui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1741753090',owner_user_name='tempest-TestVolumeBootPatternV346-1741753090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:11:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae6c3c6a50b24a58af140f523fb73374',uuid=87f7f5aa-3bd9-49d0-9f75-50f768acb6ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94194a84-a05a-4791-a8d6-6c15f99969b2", "address": "fa:16:3e:b6:e6:62", "network": {"id": "0be6df83-bfa0-4c90-aed3-88212317cb4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-252451076-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1880a27e1ad0432f914e086d7fffdeb4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94194a84-a0", "ovs_interfaceid": "94194a84-a05a-4791-a8d6-6c15f99969b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:11:51.030285 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Converting VIF {"id": "94194a84-a05a-4791-a8d6-6c15f99969b2", "address": "fa:16:3e:b6:e6:62", "network": {"id": "0be6df83-bfa0-4c90-aed3-88212317cb4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-252451076-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1880a27e1ad0432f914e086d7fffdeb4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94194a84-a0", "ovs_interfaceid": "94194a84-a05a-4791-a8d6-6c15f99969b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:11:51.030285 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:e6:62,bridge_name='br-int',has_traffic_filtering=True,id=94194a84-a05a-4791-a8d6-6c15f99969b2,network=Network(0be6df83-bfa0-4c90-aed3-88212317cb4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94194a84-a0') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:11:51.030285 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:e6:62,bridge_name='br-int',has_traffic_filtering=True,id=94194a84-a05a-4791-a8d6-6c15f99969b2,network=Network(0be6df83-bfa0-4c90-aed3-88212317cb4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94194a84-a0') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:11:51.030656 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:51.030693 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:11:51.031647 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:11:51.032709 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:51.032709 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '253cc44d-fdb7-52fd-95bd-f34b0b4897a4', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:11:51.033383 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:51.034455 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:51.038226 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:51.038226 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94194a84-a0, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:11:51.038633 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap94194a84-a0, col_values=(('qos', UUID('4524e2e6-2651-43d9-8a0e-37c3316bf44f')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:11:51.038887 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap94194a84-a0, col_values=(('external_ids', {'iface-id': '94194a84-a05a-4791-a8d6-6c15f99969b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:e6:62', 'vm-uuid': '87f7f5aa-3bd9-49d0-9f75-50f768acb6ef'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:11:51.041741 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:51.043315 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:11:51.046923 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:51.048080 np0000001577 nova-compute[98319]: INFO os_vif [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:e6:62,bridge_name='br-int',has_traffic_filtering=True,id=94194a84-a05a-4791-a8d6-6c15f99969b2,network=Network(0be6df83-bfa0-4c90-aed3-88212317cb4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94194a84-a0')
May 28 01:11:51.372438 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:11:51.373349 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930711.372871, 3d97b775-d6eb-4c8f-b951-11bcb0444adf => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:11:51.373349 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] VM Started (Lifecycle Event)
May 28 01:11:51.375591 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:11:51.377936 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Instance spawned successfully.
May 28 01:11:51.379096 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:11:51.575662 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:51.704452 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:11:51.704793 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:11:51.705137 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:11:51.705388 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:11:51.705699 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.27 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:11:51.875746 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:11:51.877841 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:11:51.884986 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:11:51.885124 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:11:51.885319 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:11:51.885490 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:11:51.885714 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:11:51.886630 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:11:51.977954 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:11:51.978235 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:11:52.380065 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:11:52.380480 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930712.3800666, 3d97b775-d6eb-4c8f-b951-11bcb0444adf => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:11:52.380480 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] VM Paused (Lifecycle Event)
May 28 01:11:52.390069 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Took 8.53 seconds to spawn the instance on the hypervisor.
May 28 01:11:52.390222 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:11:52.567968 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:11:52.568083 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:11:52.568209 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] No VIF found with MAC fa:16:3e:b6:e6:62, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:11:52.568595 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Using config drive
May 28 01:11:52.882790 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:11:52.887213 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f1377cd0-2a78-4790-ae48-6eb152c83693 req-37c722eb-3d0b-4b2f-9260-12a52deb19d4 service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Received event network-vif-plugged-47188850-53a4-4d18-8810-5b06dc353030 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:52.887213 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f1377cd0-2a78-4790-ae48-6eb152c83693 req-37c722eb-3d0b-4b2f-9260-12a52deb19d4 service nova] Acquiring lock "3d97b775-d6eb-4c8f-b951-11bcb0444adf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:52.887213 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f1377cd0-2a78-4790-ae48-6eb152c83693 req-37c722eb-3d0b-4b2f-9260-12a52deb19d4 service nova] Lock "3d97b775-d6eb-4c8f-b951-11bcb0444adf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:52.887213 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f1377cd0-2a78-4790-ae48-6eb152c83693 req-37c722eb-3d0b-4b2f-9260-12a52deb19d4 service nova] Lock "3d97b775-d6eb-4c8f-b951-11bcb0444adf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:52.887213 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f1377cd0-2a78-4790-ae48-6eb152c83693 req-37c722eb-3d0b-4b2f-9260-12a52deb19d4 service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] No waiting events found dispatching network-vif-plugged-47188850-53a4-4d18-8810-5b06dc353030 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:11:52.887213 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-f1377cd0-2a78-4790-ae48-6eb152c83693 req-37c722eb-3d0b-4b2f-9260-12a52deb19d4 service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Received unexpected event network-vif-plugged-47188850-53a4-4d18-8810-5b06dc353030 for instance with vm_state active and task_state None.
May 28 01:11:52.887470 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930712.887177, 3d97b775-d6eb-4c8f-b951-11bcb0444adf => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:11:52.887578 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] VM Resumed (Lifecycle Event)
May 28 01:11:52.899628 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Took 15.78 seconds to build instance.
May 28 01:11:53.074809 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:53.191512 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Creating config drive at /opt/stack/data/nova/instances/87f7f5aa-3bd9-49d0-9f75-50f768acb6ef/disk.config
May 28 01:11:53.195900 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/87f7f5aa-3bd9-49d0-9f75-50f768acb6ef/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf9s9its7 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:11:53.266475 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/87f7f5aa-3bd9-49d0-9f75-50f768acb6ef/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf9s9its7" returned: 0 in 0.070s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:11:53.392264 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:11:53.396101 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:11:53.401334 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Lock "3d97b775-d6eb-4c8f-b951-11bcb0444adf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.295s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:53.714230 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:53.740914 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:53.742449 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:53.839480 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:54.075995 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:54.077499 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:54.079396 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:54.104884 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:54.471097 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930714.4700785, 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:11:54.472617 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] VM Started (Lifecycle Event)
May 28 01:11:54.975642 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:11:54.977154 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930714.976984, 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:11:54.977388 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] VM Paused (Lifecycle Event)
May 28 01:11:54.980915 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e5decd02-070e-4435-9f96-d2f9a0d05f6e req-bb757c67-ee24-4e92-a218-96843ef7036a service nova] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Received event network-vif-plugged-94194a84-a05a-4791-a8d6-6c15f99969b2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:54.981244 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e5decd02-070e-4435-9f96-d2f9a0d05f6e req-bb757c67-ee24-4e92-a218-96843ef7036a service nova] Acquiring lock "87f7f5aa-3bd9-49d0-9f75-50f768acb6ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:54.983417 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e5decd02-070e-4435-9f96-d2f9a0d05f6e req-bb757c67-ee24-4e92-a218-96843ef7036a service nova] Lock "87f7f5aa-3bd9-49d0-9f75-50f768acb6ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:54.983417 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e5decd02-070e-4435-9f96-d2f9a0d05f6e req-bb757c67-ee24-4e92-a218-96843ef7036a service nova] Lock "87f7f5aa-3bd9-49d0-9f75-50f768acb6ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:54.983417 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e5decd02-070e-4435-9f96-d2f9a0d05f6e req-bb757c67-ee24-4e92-a218-96843ef7036a service nova] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Processing event network-vif-plugged-94194a84-a05a-4791-a8d6-6c15f99969b2 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:11:54.983417 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e5decd02-070e-4435-9f96-d2f9a0d05f6e req-bb757c67-ee24-4e92-a218-96843ef7036a service nova] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Received event network-vif-plugged-94194a84-a05a-4791-a8d6-6c15f99969b2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:54.983417 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e5decd02-070e-4435-9f96-d2f9a0d05f6e req-bb757c67-ee24-4e92-a218-96843ef7036a service nova] Acquiring lock "87f7f5aa-3bd9-49d0-9f75-50f768acb6ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:54.983417 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e5decd02-070e-4435-9f96-d2f9a0d05f6e req-bb757c67-ee24-4e92-a218-96843ef7036a service nova] Lock "87f7f5aa-3bd9-49d0-9f75-50f768acb6ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:54.983417 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e5decd02-070e-4435-9f96-d2f9a0d05f6e req-bb757c67-ee24-4e92-a218-96843ef7036a service nova] Lock "87f7f5aa-3bd9-49d0-9f75-50f768acb6ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:54.983417 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e5decd02-070e-4435-9f96-d2f9a0d05f6e req-bb757c67-ee24-4e92-a218-96843ef7036a service nova] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] No waiting events found dispatching network-vif-plugged-94194a84-a05a-4791-a8d6-6c15f99969b2 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:11:54.983417 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-e5decd02-070e-4435-9f96-d2f9a0d05f6e req-bb757c67-ee24-4e92-a218-96843ef7036a service nova] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Received unexpected event network-vif-plugged-94194a84-a05a-4791-a8d6-6c15f99969b2 for instance with vm_state building and task_state spawning.
May 28 01:11:54.983417 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e5decd02-070e-4435-9f96-d2f9a0d05f6e req-bb757c67-ee24-4e92-a218-96843ef7036a service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Received event network-changed-47188850-53a4-4d18-8810-5b06dc353030 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:54.983417 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e5decd02-070e-4435-9f96-d2f9a0d05f6e req-bb757c67-ee24-4e92-a218-96843ef7036a service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Refreshing instance network info cache due to event network-changed-47188850-53a4-4d18-8810-5b06dc353030. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:11:54.983417 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e5decd02-070e-4435-9f96-d2f9a0d05f6e req-bb757c67-ee24-4e92-a218-96843ef7036a service nova] Acquiring lock "refresh_cache-3d97b775-d6eb-4c8f-b951-11bcb0444adf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:11:54.983417 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e5decd02-070e-4435-9f96-d2f9a0d05f6e req-bb757c67-ee24-4e92-a218-96843ef7036a service nova] Acquired lock "refresh_cache-3d97b775-d6eb-4c8f-b951-11bcb0444adf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:11:54.983417 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-e5decd02-070e-4435-9f96-d2f9a0d05f6e req-bb757c67-ee24-4e92-a218-96843ef7036a service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Refreshing network info cache for port 47188850-53a4-4d18-8810-5b06dc353030 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:11:54.984639 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:11:54.991575 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:11:54.993907 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Instance spawned successfully.
May 28 01:11:54.994287 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:11:55.147726 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "4edb886b-df1e-42fd-9881-91fc07339c3f" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:55.147897 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "4edb886b-df1e-42fd-9881-91fc07339c3f" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:55.148127 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Rebooting instance
May 28 01:11:55.479632 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:11:55.481390 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930715.481233, 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:11:55.481499 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] VM Resumed (Lifecycle Event)
May 28 01:11:55.485478 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-e5decd02-070e-4435-9f96-d2f9a0d05f6e req-bb757c67-ee24-4e92-a218-96843ef7036a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:55.501184 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:11:55.501338 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:11:55.501708 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:11:55.501973 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:11:55.502288 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:11:55.502722 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:11:55.703026 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "refresh_cache-4edb886b-df1e-42fd-9881-91fc07339c3f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:11:55.703151 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquired lock "refresh_cache-4edb886b-df1e-42fd-9881-91fc07339c3f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:11:55.703217 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:11:55.803284 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-e5decd02-070e-4435-9f96-d2f9a0d05f6e req-bb757c67-ee24-4e92-a218-96843ef7036a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:55.922290 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-e5decd02-070e-4435-9f96-d2f9a0d05f6e req-bb757c67-ee24-4e92-a218-96843ef7036a service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Updated VIF entry in instance network info cache for port 47188850-53a4-4d18-8810-5b06dc353030. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:11:55.922782 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-e5decd02-070e-4435-9f96-d2f9a0d05f6e req-bb757c67-ee24-4e92-a218-96843ef7036a service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Updating instance_info_cache with network_info: [{"id": "47188850-53a4-4d18-8810-5b06dc353030", "address": "fa:16:3e:1c:df:ad", "network": {"id": "64f08667-4fa5-4522-98af-795ef337993e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-2036728215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a77c8c2778bf47d79d3119ed128f6608", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47188850-53", "ovs_interfaceid": "47188850-53a4-4d18-8810-5b06dc353030", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:11:55.984267 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:11:55.986023 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:11:56.009252 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Took 9.64 seconds to spawn the instance on the hypervisor.
May 28 01:11:56.010640 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:11:56.050151 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:56.205243 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:56.426718 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e5decd02-070e-4435-9f96-d2f9a0d05f6e req-bb757c67-ee24-4e92-a218-96843ef7036a service nova] Releasing lock "refresh_cache-3d97b775-d6eb-4c8f-b951-11bcb0444adf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:11:56.490837 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:11:56.499112 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:56.521225 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Took 18.39 seconds to build instance.
May 28 01:11:56.578828 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:56.617864 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Updating instance_info_cache with network_info: [{"id": "89446e5b-c447-4a2c-b547-03a71d82747b", "address": "fa:16:3e:fa:00:1f", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89446e5b-c4", "ovs_interfaceid": "89446e5b-c447-4a2c-b547-03a71d82747b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:11:56.970711 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-830ac3fd-6cf4-48be-a758-1cf625f40586 req-c276b597-e507-48a2-965f-1a05d090f3fb service nova] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Received event network-changed-94194a84-a05a-4791-a8d6-6c15f99969b2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:56.970882 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-830ac3fd-6cf4-48be-a758-1cf625f40586 req-c276b597-e507-48a2-965f-1a05d090f3fb service nova] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Refreshing instance network info cache due to event network-changed-94194a84-a05a-4791-a8d6-6c15f99969b2. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:11:56.971019 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-830ac3fd-6cf4-48be-a758-1cf625f40586 req-c276b597-e507-48a2-965f-1a05d090f3fb service nova] Acquiring lock "refresh_cache-87f7f5aa-3bd9-49d0-9f75-50f768acb6ef" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:11:56.971120 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-830ac3fd-6cf4-48be-a758-1cf625f40586 req-c276b597-e507-48a2-965f-1a05d090f3fb service nova] Acquired lock "refresh_cache-87f7f5aa-3bd9-49d0-9f75-50f768acb6ef" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:11:56.971235 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-830ac3fd-6cf4-48be-a758-1cf625f40586 req-c276b597-e507-48a2-965f-1a05d090f3fb service nova] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Refreshing network info cache for port 94194a84-a05a-4791-a8d6-6c15f99969b2 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:11:57.023153 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "87f7f5aa-3bd9-49d0-9f75-50f768acb6ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.901s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:57.040818 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b9885f09-44da-4bee-a18c-6159bde8253b req-50f5f1e6-7339-464c-9475-c36c140073c0 service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Received event network-changed-47188850-53a4-4d18-8810-5b06dc353030 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:57.040818 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b9885f09-44da-4bee-a18c-6159bde8253b req-50f5f1e6-7339-464c-9475-c36c140073c0 service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Refreshing instance network info cache due to event network-changed-47188850-53a4-4d18-8810-5b06dc353030. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:11:57.040818 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b9885f09-44da-4bee-a18c-6159bde8253b req-50f5f1e6-7339-464c-9475-c36c140073c0 service nova] Acquiring lock "refresh_cache-3d97b775-d6eb-4c8f-b951-11bcb0444adf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:11:57.040818 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b9885f09-44da-4bee-a18c-6159bde8253b req-50f5f1e6-7339-464c-9475-c36c140073c0 service nova] Acquired lock "refresh_cache-3d97b775-d6eb-4c8f-b951-11bcb0444adf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:11:57.040818 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b9885f09-44da-4bee-a18c-6159bde8253b req-50f5f1e6-7339-464c-9475-c36c140073c0 service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Refreshing network info cache for port 47188850-53a4-4d18-8810-5b06dc353030 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:11:57.119576 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Releasing lock "refresh_cache-4edb886b-df1e-42fd-9881-91fc07339c3f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:11:57.472918 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-830ac3fd-6cf4-48be-a758-1cf625f40586 req-c276b597-e507-48a2-965f-1a05d090f3fb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:57.545567 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-b9885f09-44da-4bee-a18c-6159bde8253b req-50f5f1e6-7339-464c-9475-c36c140073c0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:57.623414 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:11:57.780299 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-830ac3fd-6cf4-48be-a758-1cf625f40586 req-c276b597-e507-48a2-965f-1a05d090f3fb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:57.868562 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-b9885f09-44da-4bee-a18c-6159bde8253b req-50f5f1e6-7339-464c-9475-c36c140073c0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:57.932234 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-830ac3fd-6cf4-48be-a758-1cf625f40586 req-c276b597-e507-48a2-965f-1a05d090f3fb service nova] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Updated VIF entry in instance network info cache for port 94194a84-a05a-4791-a8d6-6c15f99969b2. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:11:57.932234 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-830ac3fd-6cf4-48be-a758-1cf625f40586 req-c276b597-e507-48a2-965f-1a05d090f3fb service nova] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Updating instance_info_cache with network_info: [{"id": "94194a84-a05a-4791-a8d6-6c15f99969b2", "address": "fa:16:3e:b6:e6:62", "network": {"id": "0be6df83-bfa0-4c90-aed3-88212317cb4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-252451076-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1880a27e1ad0432f914e086d7fffdeb4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94194a84-a0", "ovs_interfaceid": "94194a84-a05a-4791-a8d6-6c15f99969b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:11:57.998123 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b9885f09-44da-4bee-a18c-6159bde8253b req-50f5f1e6-7339-464c-9475-c36c140073c0 service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Updated VIF entry in instance network info cache for port 47188850-53a4-4d18-8810-5b06dc353030. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:11:57.998400 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b9885f09-44da-4bee-a18c-6159bde8253b req-50f5f1e6-7339-464c-9475-c36c140073c0 service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Updating instance_info_cache with network_info: [{"id": "47188850-53a4-4d18-8810-5b06dc353030", "address": "fa:16:3e:1c:df:ad", "network": {"id": "64f08667-4fa5-4522-98af-795ef337993e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-2036728215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a77c8c2778bf47d79d3119ed128f6608", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47188850-53", "ovs_interfaceid": "47188850-53a4-4d18-8810-5b06dc353030", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:11:58.433393 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-830ac3fd-6cf4-48be-a758-1cf625f40586 req-c276b597-e507-48a2-965f-1a05d090f3fb service nova] Releasing lock "refresh_cache-87f7f5aa-3bd9-49d0-9f75-50f768acb6ef" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:11:58.500697 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b9885f09-44da-4bee-a18c-6159bde8253b req-50f5f1e6-7339-464c-9475-c36c140073c0 service nova] Releasing lock "refresh_cache-3d97b775-d6eb-4c8f-b951-11bcb0444adf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:11:58.500856 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b9885f09-44da-4bee-a18c-6159bde8253b req-50f5f1e6-7339-464c-9475-c36c140073c0 service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Received event network-changed-47188850-53a4-4d18-8810-5b06dc353030 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:58.501024 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b9885f09-44da-4bee-a18c-6159bde8253b req-50f5f1e6-7339-464c-9475-c36c140073c0 service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Refreshing instance network info cache due to event network-changed-47188850-53a4-4d18-8810-5b06dc353030. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:11:58.501165 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b9885f09-44da-4bee-a18c-6159bde8253b req-50f5f1e6-7339-464c-9475-c36c140073c0 service nova] Acquiring lock "refresh_cache-3d97b775-d6eb-4c8f-b951-11bcb0444adf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:11:58.501241 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b9885f09-44da-4bee-a18c-6159bde8253b req-50f5f1e6-7339-464c-9475-c36c140073c0 service nova] Acquired lock "refresh_cache-3d97b775-d6eb-4c8f-b951-11bcb0444adf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:11:58.501348 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b9885f09-44da-4bee-a18c-6159bde8253b req-50f5f1e6-7339-464c-9475-c36c140073c0 service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Refreshing network info cache for port 47188850-53a4-4d18-8810-5b06dc353030 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:11:58.655630 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:58.661721 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:58.677230 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:58.684768 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:58.702743 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:58.707886 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:58.922111 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:58.928866 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:58.958065 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999726162000115 future=<Future at 0x7c98704e8ec0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:11:58.958508 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999283388000094 future=<Future at 0x7c98704e8ec0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:11:58.958661 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999089256999923 future=<Future at 0x7c98704e8ec0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:11:58.961383 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Instance destroyed successfully.
May 28 01:11:58.961383 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lazy-loading 'resources' on Instance uuid 4edb886b-df1e-42fd-9881-91fc07339c3f {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:11:59.003677 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-b9885f09-44da-4bee-a18c-6159bde8253b req-50f5f1e6-7339-464c-9475-c36c140073c0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:59.032886 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c5fbc075-6af2-4cb9-9b09-e89154fd6086 req-4d5a0f1b-d6d7-4e4f-8551-1ee2b4f058b5 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Received event network-vif-unplugged-89446e5b-c447-4a2c-b547-03a71d82747b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:59.033334 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c5fbc075-6af2-4cb9-9b09-e89154fd6086 req-4d5a0f1b-d6d7-4e4f-8551-1ee2b4f058b5 service nova] Acquiring lock "4edb886b-df1e-42fd-9881-91fc07339c3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:59.034363 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c5fbc075-6af2-4cb9-9b09-e89154fd6086 req-4d5a0f1b-d6d7-4e4f-8551-1ee2b4f058b5 service nova] Lock "4edb886b-df1e-42fd-9881-91fc07339c3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:59.034859 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c5fbc075-6af2-4cb9-9b09-e89154fd6086 req-4d5a0f1b-d6d7-4e4f-8551-1ee2b4f058b5 service nova] Lock "4edb886b-df1e-42fd-9881-91fc07339c3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:59.035023 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c5fbc075-6af2-4cb9-9b09-e89154fd6086 req-4d5a0f1b-d6d7-4e4f-8551-1ee2b4f058b5 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] No waiting events found dispatching network-vif-unplugged-89446e5b-c447-4a2c-b547-03a71d82747b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:11:59.035128 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-c5fbc075-6af2-4cb9-9b09-e89154fd6086 req-4d5a0f1b-d6d7-4e4f-8551-1ee2b4f058b5 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Received unexpected event network-vif-unplugged-89446e5b-c447-4a2c-b547-03a71d82747b for instance with vm_state active and task_state reboot_started_hard.
May 28 01:11:59.035245 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c5fbc075-6af2-4cb9-9b09-e89154fd6086 req-4d5a0f1b-d6d7-4e4f-8551-1ee2b4f058b5 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Received event network-vif-unplugged-89446e5b-c447-4a2c-b547-03a71d82747b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:11:59.038042 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c5fbc075-6af2-4cb9-9b09-e89154fd6086 req-4d5a0f1b-d6d7-4e4f-8551-1ee2b4f058b5 service nova] Acquiring lock "4edb886b-df1e-42fd-9881-91fc07339c3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:11:59.038208 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c5fbc075-6af2-4cb9-9b09-e89154fd6086 req-4d5a0f1b-d6d7-4e4f-8551-1ee2b4f058b5 service nova] Lock "4edb886b-df1e-42fd-9881-91fc07339c3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:11:59.038321 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c5fbc075-6af2-4cb9-9b09-e89154fd6086 req-4d5a0f1b-d6d7-4e4f-8551-1ee2b4f058b5 service nova] Lock "4edb886b-df1e-42fd-9881-91fc07339c3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:11:59.038436 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c5fbc075-6af2-4cb9-9b09-e89154fd6086 req-4d5a0f1b-d6d7-4e4f-8551-1ee2b4f058b5 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] No waiting events found dispatching network-vif-unplugged-89446e5b-c447-4a2c-b547-03a71d82747b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:11:59.038529 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-c5fbc075-6af2-4cb9-9b09-e89154fd6086 req-4d5a0f1b-d6d7-4e4f-8551-1ee2b4f058b5 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Received unexpected event network-vif-unplugged-89446e5b-c447-4a2c-b547-03a71d82747b for instance with vm_state active and task_state reboot_started_hard.
May 28 01:11:59.297575 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-b9885f09-44da-4bee-a18c-6159bde8253b req-50f5f1e6-7339-464c-9475-c36c140073c0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:11:59.448367 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b9885f09-44da-4bee-a18c-6159bde8253b req-50f5f1e6-7339-464c-9475-c36c140073c0 service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Updated VIF entry in instance network info cache for port 47188850-53a4-4d18-8810-5b06dc353030. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:11:59.448611 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b9885f09-44da-4bee-a18c-6159bde8253b req-50f5f1e6-7339-464c-9475-c36c140073c0 service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Updating instance_info_cache with network_info: [{"id": "47188850-53a4-4d18-8810-5b06dc353030", "address": "fa:16:3e:1c:df:ad", "network": {"id": "64f08667-4fa5-4522-98af-795ef337993e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-2036728215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a77c8c2778bf47d79d3119ed128f6608", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47188850-53", "ovs_interfaceid": "47188850-53a4-4d18-8810-5b06dc353030", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:11:59.463661 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:11:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2023787221',display_name='tempest-TestMinimumBasicScenario-server-2023787221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testminimumbasicscenario-server-2023787221',id=66,image_ref='b6771936-97f2-4073-bf9b-ccb3dc960886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeedL+sGgE99d8g4dPt6DoVfxM3FqutzbPgV98SfFKefq8Z1zEo+4lbRsyO452zYjWQAX6ig52TSFvOZYkOsNEfBbe8Eu2SMeWXnNbThabXFesSaOO5KPV8LcFHScA3OA==',key_name='tempest-TestMinimumBasicScenario-1787881822',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:11:23Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb2f65d208f44146903c7dcf0b143a8e',ramdisk_id='',reservation_id='r-yunb341z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6771936-97f2-4073-bf9b-ccb3dc960886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1681839017',owner_user_name='tempest-TestMinimumBasicScenario-1681839017-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:11:58Z,user_data=None,user_id='0505bf2e15ba44ad881b94106ae054a5',uuid=4edb886b-df1e-42fd-9881-91fc07339c3f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89446e5b-c447-4a2c-b547-03a71d82747b", "address": "fa:16:3e:fa:00:1f", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89446e5b-c4", "ovs_interfaceid": "89446e5b-c447-4a2c-b547-03a71d82747b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:11:59.463661 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Converting VIF {"id": "89446e5b-c447-4a2c-b547-03a71d82747b", "address": "fa:16:3e:fa:00:1f", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89446e5b-c4", "ovs_interfaceid": "89446e5b-c447-4a2c-b547-03a71d82747b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:11:59.464171 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:00:1f,bridge_name='br-int',has_traffic_filtering=True,id=89446e5b-c447-4a2c-b547-03a71d82747b,network=Network(d9534aa6-926a-458a-a1d0-8512d11fe6a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89446e5b-c4') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:11:59.464409 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:00:1f,bridge_name='br-int',has_traffic_filtering=True,id=89446e5b-c447-4a2c-b547-03a71d82747b,network=Network(d9534aa6-926a-458a-a1d0-8512d11fe6a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89446e5b-c4') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:11:59.466159 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:59.466447 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89446e5b-c4, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:11:59.467404 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:59.468102 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:11:59.469059 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:59.469806 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:59.469965 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e35016c-a8a5-41ca-abcd-6e708fb7b6a1) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:11:59.470443 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:59.470901 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:11:59.472466 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:11:59.474510 np0000001577 nova-compute[98319]: INFO os_vif [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:00:1f,bridge_name='br-int',has_traffic_filtering=True,id=89446e5b-c447-4a2c-b547-03a71d82747b,network=Network(d9534aa6-926a-458a-a1d0-8512d11fe6a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89446e5b-c4')
May 28 01:11:59.476009 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:11:59.476309 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:11:59.476455 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:11:59.476853 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:11:59.477118 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:11:59.477266 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:11:59.510167 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:59.510167 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:59.510167 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:59.510167 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:59.510167 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:59.510167 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:59.510167 np0000001577 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:59.510167 np0000001577 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:59.510167 np0000001577 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:59.510167 np0000001577 nova-compute[98319]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:59.510167 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:11:59.510167 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:11:59.510167 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:11:59.512869 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:59.512869 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:11:59.512869 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:59.512869 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:11:59.512869 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:59.512869 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:11:59.512869 np0000001577 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:59.512869 np0000001577 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:11:59.512869 np0000001577 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:59.512869 np0000001577 nova-compute[98319]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:11:59.512869 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:11:59.512869 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:11:59.512869 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:11:59.513152 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', '164'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', '165'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', '169'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', '170'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b', '172'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b', '173'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', '175'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', '176'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2', '177'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2', '178'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '180')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:11:59.513152 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', '175')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:11:59.514146 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', '176')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:11:59.515889 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c984c441800>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b'): ({'sdh'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:11:59.516090 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Removing multipathed devices sdg, sdh {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:11:59.516322 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Flush multipath device 33000000009502b69 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:11:59.557573 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:11:59.597562 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:11:59.643040 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Checking to see if SCSI volumes sdg, sdh have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:11:59.643168 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] SCSI volumes sdg, sdh have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:11:59.644337 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Checking to see if device paths {'sdg', 'sdh'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:11:59.655645 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Device paths {'sdg', 'sdh'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:11:59.655972 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:11:59.670124 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:59.709730 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 175, target: iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b, portal: 192.168.40.100,3260]
May 28 01:11:59.709730 np0000001577 nova-compute[98319]: Logout of [sid: 175, target: iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b, portal: 192.168.40.100,3260] successful.
May 28 01:11:59.709730 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:59.729515 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:59.741035 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:59.789676 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 176, target: iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b, portal: 192.168.50.100,3260]
May 28 01:11:59.789676 np0000001577 nova-compute[98319]: Logout of [sid: 176, target: iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b, portal: 192.168.50.100,3260] successful.
May 28 01:11:59.789676 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:59.813259 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:11:59.813462 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:11:59.813592 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] <== disconnect_volume: return (336ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:11:59.813734 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:11:59.818340 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Start _get_guest_xml network_info=[{"id": "89446e5b-c447-4a2c-b547-03a71d82747b", "address": "fa:16:3e:fa:00:1f", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89446e5b-c4", "ovs_interfaceid": "89446e5b-c447-4a2c-b547-03a71d82747b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b6771936-97f2-4073-bf9b-ccb3dc960886,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b6771936-97f2-4073-bf9b-ccb3dc960886'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, 'status': 'reserved', 'instance': '4edb886b-df1e-42fd-9881-91fc07339c3f', 'attached_at': '', 'detached_at': '', 'volume_id': 'f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'serial': 'f4367fd6-1652-4af4-a6b7-b55a2f5e737b'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '13dd473f-3c84-4a30-8c03-a32eabd74e74', 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:11:59.820192 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:11:59.821092 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='b6771936-97f2-4073-bf9b-ccb3dc960886', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-2023787221', uuid='4edb886b-df1e-42fd-9881-91fc07339c3f'), owner=OwnerMeta(userid='0505bf2e15ba44ad881b94106ae054a5', username='tempest-TestMinimumBasicScenario-1681839017-project-member', projectid='fb2f65d208f44146903c7dcf0b143a8e', projectname='tempest-TestMinimumBasicScenario-1681839017'), image=ImageMeta(id='b6771936-97f2-4073-bf9b-ccb3dc960886', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "89446e5b-c447-4a2c-b547-03a71d82747b", "address": "fa:16:3e:fa:00:1f", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89446e5b-c4", "ovs_interfaceid": "89446e5b-c447-4a2c-b547-03a71d82747b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930719.8208141) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:11:59.822062 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:11:59.822344 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:11:59.823577 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:11:59.823577 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:11:59.824248 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:11:59.824497 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b6771936-97f2-4073-bf9b-ccb3dc960886,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:11:59.824628 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:11:59.824732 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:11:59.824845 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:11:59.824928 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:11:59.825103 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:11:59.825229 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:11:59.825347 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:11:59.825476 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:11:59.825541 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:11:59.825701 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:11:59.825858 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4edb886b-df1e-42fd-9881-91fc07339c3f {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:11:59.950768 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b9885f09-44da-4bee-a18c-6159bde8253b req-50f5f1e6-7339-464c-9475-c36c140073c0 service nova] Releasing lock "refresh_cache-3d97b775-d6eb-4c8f-b951-11bcb0444adf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:12:00.327599 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Object Instance<4edb886b-df1e-42fd-9881-91fc07339c3f> lazy-loaded attributes: resources,vcpu_model {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:12:00.337504 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk.config --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:12:00.427393 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk.config --force-share --output=json" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:12:00.427885 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "/opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:00.428128 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "/opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:00.428922 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "/opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:00.429322 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:12:00.429800 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:12:00.429974 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:12:00.430488 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:12:00.430765 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:12:00.443013 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:12:00.443723 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:12:00.444231 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:12:00.444431 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:12:00.444860 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:12:00.445056 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:12:00.459133 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:12:00.459133 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:00.466149 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:12:00.466149 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:00.474216 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b] added
May 28 01:12:00.474216 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:12:00.474216 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:12:00.474216 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:12:00.474216 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:12:00.474216 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:12:00.474216 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:00.474426 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:12:00.474624 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0301(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:12:00.474851 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:12:00.476925 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b] added
May 28 01:12:00.476925 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:12:00.476925 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:12:00.476925 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:12:00.476925 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:12:00.476925 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:12:00.476925 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:00.477139 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:12:00.477203 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0321(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:12:00.477339 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:12:01.475336 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:12:01.477865 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:12:01.493160 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:12:01.493160 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:12:01.501682 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:12:01.501682 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:01.508101 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:01.516564 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:01.526881 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:01.526881 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:01.526881 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:01.526881 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:01.526881 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:01.526881 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:01.526881 np0000001577 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:12:01.526881 np0000001577 nova-compute[98319]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:12:01.526881 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:01.526881 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:01.526881 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:12:01.526881 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:01.526881 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:01.526881 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:01.526881 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:01.526881 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:01.526881 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:01.526881 np0000001577 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:12:01.526881 np0000001577 nova-compute[98319]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:12:01.526881 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:01.526881 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:01.526881 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:12:01.535859 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:01.535859 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:01.535859 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:01.535859 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:01.535859 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:01.535859 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:01.535859 np0000001577 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:12:01.535859 np0000001577 nova-compute[98319]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:12:01.535859 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:01.535859 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:01.535859 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:12:01.536278 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:01.536278 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:01.536278 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:01.536278 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:01.536278 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:01.536278 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:01.536278 np0000001577 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:12:01.536278 np0000001577 nova-compute[98319]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:12:01.536278 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:01.536278 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:01.536278 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:12:01.575148 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b, portal: 192.168.40.100,3260]
May 28 01:12:01.575148 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b, portal: 192.168.40.100,3260] successful.
May 28 01:12:01.575148 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:01.579523 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:01.587215 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b, portal: 192.168.50.100,3260]
May 28 01:12:01.587215 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b, portal: 192.168.50.100,3260] successful.
May 28 01:12:01.587215 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:01.587823 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:01.603997 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:01.614592 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:01.614592 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:01.614592 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:01.614592 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:01.614592 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:01.614592 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:01.614592 np0000001577 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:12:01.614592 np0000001577 nova-compute[98319]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:12:01.614592 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:01.614592 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:01.614592 np0000001577 nova-compute[98319]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:01.614592 np0000001577 nova-compute[98319]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:01.614592 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:12:01.614592 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:01.614592 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:01.614592 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:01.614592 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:01.614592 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:01.614592 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:01.614592 np0000001577 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:12:01.614592 np0000001577 nova-compute[98319]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:12:01.614592 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:01.614592 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:01.614592 np0000001577 nova-compute[98319]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:01.614592 np0000001577 nova-compute[98319]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:01.614592 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:12:01.616994 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:12:01.616994 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:12:01.616994 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] HCTL ('12', '-', '-', 0) found on session 181 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:12:01.616994 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:12:01.626417 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:01.626417 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:01.626417 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:01.626417 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:01.626417 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:01.626417 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:01.626417 np0000001577 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:12:01.626417 np0000001577 nova-compute[98319]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:12:01.626417 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:01.626417 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:01.626417 np0000001577 nova-compute[98319]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:01.626417 np0000001577 nova-compute[98319]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:01.626417 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:12:01.627367 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:01.627367 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:01.627367 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:01.627367 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:01.627367 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:01.627367 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:01.627367 np0000001577 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:12:01.627367 np0000001577 nova-compute[98319]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:12:01.627367 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:01.627367 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:01.627367 np0000001577 nova-compute[98319]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:01.627367 np0000001577 nova-compute[98319]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:01.627367 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:12:01.627367 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:12:01.627367 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:12:01.628084 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] HCTL ('13', '-', '-', 0) found on session 182 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:12:01.628146 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:12:01.639616 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Searching for a device in session 181 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:12:01.639939 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:12:01.645937 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Searching for a device in session 182 and hctl ['13', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:12:02.438711 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:02.645480 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Searching for a device in session 182 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:12:02.645978 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:12:03.459732 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Found WWN 33000000009502b69 for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:12:03.462621 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:12:03.462621 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '33000000009502b69', 'path': '/dev/dm-1', 'multipath_id': '33000000009502b69'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:12:03.462621 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000009502b69', 'path': '/dev/dm-1', 'multipath_id': '33000000009502b69'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:12:03.970053 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:11:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2023787221',display_name='tempest-TestMinimumBasicScenario-server-2023787221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testminimumbasicscenario-server-2023787221',id=66,image_ref='b6771936-97f2-4073-bf9b-ccb3dc960886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeedL+sGgE99d8g4dPt6DoVfxM3FqutzbPgV98SfFKefq8Z1zEo+4lbRsyO452zYjWQAX6ig52TSFvOZYkOsNEfBbe8Eu2SMeWXnNbThabXFesSaOO5KPV8LcFHScA3OA==',key_name='tempest-TestMinimumBasicScenario-1787881822',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:11:23Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb2f65d208f44146903c7dcf0b143a8e',ramdisk_id='',reservation_id='r-yunb341z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6771936-97f2-4073-bf9b-ccb3dc960886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1681839017',owner_user_name='tempest-TestMinimumBasicScenario-1681839017-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:11:58Z,user_data=None,user_id='0505bf2e15ba44ad881b94106ae054a5',uuid=4edb886b-df1e-42fd-9881-91fc07339c3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89446e5b-c447-4a2c-b547-03a71d82747b", "address": "fa:16:3e:fa:00:1f", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89446e5b-c4", "ovs_interfaceid": "89446e5b-c447-4a2c-b547-03a71d82747b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:12:03.970394 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Converting VIF {"id": "89446e5b-c447-4a2c-b547-03a71d82747b", "address": "fa:16:3e:fa:00:1f", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89446e5b-c4", "ovs_interfaceid": "89446e5b-c447-4a2c-b547-03a71d82747b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:12:03.971409 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:00:1f,bridge_name='br-int',has_traffic_filtering=True,id=89446e5b-c447-4a2c-b547-03a71d82747b,network=Network(d9534aa6-926a-458a-a1d0-8512d11fe6a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89446e5b-c4') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:12:03.972087 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lazy-loading 'pci_devices' on Instance uuid 4edb886b-df1e-42fd-9881-91fc07339c3f {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:12:04.197583 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:04.471384 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:04.473998 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Object Instance<4edb886b-df1e-42fd-9881-91fc07339c3f> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:12:04.475509 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] End _get_guest_xml xml=<domain type="qemu">
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:   <uuid>4edb886b-df1e-42fd-9881-91fc07339c3f</uuid>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:   <name>instance-00000042</name>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestMinimumBasicScenario-server-2023787221</nova:name>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:11:59</nova:creationTime>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <nova:image uuid="b6771936-97f2-4073-bf9b-ccb3dc960886">
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:         <nova:user uuid="0505bf2e15ba44ad881b94106ae054a5">tempest-TestMinimumBasicScenario-1681839017-project-member</nova:user>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:         <nova:project uuid="fb2f65d208f44146903c7dcf0b143a8e">tempest-TestMinimumBasicScenario-1681839017</nova:project>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="b6771936-97f2-4073-bf9b-ccb3dc960886"/>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:         <nova:port uuid="89446e5b-c447-4a2c-b547-03a71d82747b">
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:     <system>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <entry name="serial">4edb886b-df1e-42fd-9881-91fc07339c3f</entry>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <entry name="uuid">4edb886b-df1e-42fd-9881-91fc07339c3f</entry>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:     </system>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:   <os>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:   </os>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:   <features>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:   </features>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:   <devices>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk"/>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:     </disk>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk.config"/>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:     </disk>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <alias name="ua-f4367fd6-1652-4af4-a6b7-b55a2f5e737b"/>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-1"/>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <serial>f4367fd6-1652-4af4-a6b7-b55a2f5e737b</serial>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:     </disk>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:fa:00:1f"/>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <target dev="tap89446e5b-c4"/>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:     </interface>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/console.log" append="off"/>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:     </serial>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:     <video>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:     </video>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:     </rng>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:   </devices>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]: </domain>
May 28 01:12:04.475509 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:12:04.477981 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:12:04.569456 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:12:04.569950 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:12:04.652890 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:12:04.653363 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:12:04.653994 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4edb886b-df1e-42fd-9881-91fc07339c3f {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:12:05.156634 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Object Instance<4edb886b-df1e-42fd-9881-91fc07339c3f> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:12:05.156959 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40f6c6816480345643cb423b1fa0dc3e733a8eee --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:12:05.242288 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40f6c6816480345643cb423b1fa0dc3e733a8eee --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:12:05.242992 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:12:05.243216 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:12:05.340084 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:12:05.340786 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Cannot resize image /opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:12:05.341145 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lazy-loading 'migration_context' on Instance uuid 4edb886b-df1e-42fd-9881-91fc07339c3f {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:12:05.845945 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Object Instance<4edb886b-df1e-42fd-9881-91fc07339c3f> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:12:05.847054 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:11:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2023787221',display_name='tempest-TestMinimumBasicScenario-server-2023787221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testminimumbasicscenario-server-2023787221',id=66,image_ref='b6771936-97f2-4073-bf9b-ccb3dc960886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeedL+sGgE99d8g4dPt6DoVfxM3FqutzbPgV98SfFKefq8Z1zEo+4lbRsyO452zYjWQAX6ig52TSFvOZYkOsNEfBbe8Eu2SMeWXnNbThabXFesSaOO5KPV8LcFHScA3OA==',key_name='tempest-TestMinimumBasicScenario-1787881822',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:11:23Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='fb2f65d208f44146903c7dcf0b143a8e',ramdisk_id='',reservation_id='r-yunb341z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6771936-97f2-4073-bf9b-ccb3dc960886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1681839017',owner_user_name='tempest-TestMinimumBasicScenario-1681839017-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:11:58Z,user_data=None,user_id='0505bf2e15ba44ad881b94106ae054a5',uuid=4edb886b-df1e-42fd-9881-91fc07339c3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89446e5b-c447-4a2c-b547-03a71d82747b", "address": "fa:16:3e:fa:00:1f", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89446e5b-c4", "ovs_interfaceid": "89446e5b-c447-4a2c-b547-03a71d82747b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:12:05.847227 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Converting VIF {"id": "89446e5b-c447-4a2c-b547-03a71d82747b", "address": "fa:16:3e:fa:00:1f", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89446e5b-c4", "ovs_interfaceid": "89446e5b-c447-4a2c-b547-03a71d82747b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:12:05.847931 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:00:1f,bridge_name='br-int',has_traffic_filtering=True,id=89446e5b-c447-4a2c-b547-03a71d82747b,network=Network(d9534aa6-926a-458a-a1d0-8512d11fe6a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89446e5b-c4') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:12:05.848173 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:00:1f,bridge_name='br-int',has_traffic_filtering=True,id=89446e5b-c447-4a2c-b547-03a71d82747b,network=Network(d9534aa6-926a-458a-a1d0-8512d11fe6a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89446e5b-c4') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:12:05.848716 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:05.849015 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:12:05.849288 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:12:05.850047 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:05.850229 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3d8586ec-0d96-5355-a9d1-76fe97d5b62f', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:12:05.851025 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:05.851784 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:12:05.852259 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:05.853870 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:05.854076 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89446e5b-c4, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:12:05.854388 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89446e5b-c4, col_values=(('qos', UUID('dbd8e278-cdc6-421b-b7d0-8ade058c86ee')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:12:05.854534 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89446e5b-c4, col_values=(('external_ids', {'iface-id': '89446e5b-c447-4a2c-b547-03a71d82747b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:00:1f', 'vm-uuid': '4edb886b-df1e-42fd-9881-91fc07339c3f'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:12:05.855255 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:05.856320 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:12:05.861362 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:05.861730 np0000001577 nova-compute[98319]: INFO os_vif [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:00:1f,bridge_name='br-int',has_traffic_filtering=True,id=89446e5b-c447-4a2c-b547-03a71d82747b,network=Network(d9534aa6-926a-458a-a1d0-8512d11fe6a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89446e5b-c4')
May 28 01:12:06.308875 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:06.335537 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:06.335537 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:06.408724 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:06.583006 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:06.661264 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:06.662922 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:06.663831 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:06.686102 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:06.816639 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:07.079049 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Instance event wait completed in 0 seconds for  {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:12:07.080118 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Removed pending STOPPED event for 4edb886b-df1e-42fd-9881-91fc07339c3f due to new event <LifecycleEvent: 1779930727.0797064, 4edb886b-df1e-42fd-9881-91fc07339c3f => Resumed> {{(pid=98319) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 01:12:07.080368 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930727.0797064, 4edb886b-df1e-42fd-9881-91fc07339c3f => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:12:07.080608 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] VM Resumed (Lifecycle Event)
May 28 01:12:07.084068 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Instance rebooted successfully.
May 28 01:12:07.583757 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:12:07.585892 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:12:08.090256 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
May 28 01:12:08.090256 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930728.0892644, 4edb886b-df1e-42fd-9881-91fc07339c3f => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:12:08.090256 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] VM Started (Lifecycle Event)
May 28 01:12:08.528197 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:08.593587 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:12:08.599790 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:12:08.603560 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:12:08.603560 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:12:08.603560 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:12:08.603560 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] No VIF found with MAC fa:16:3e:fa:00:1f, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:12:08.603560 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:12:08.826504 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a3f7b0ed-6c84-4459-b057-dfd9b21c746d req-d9df3191-ab29-4e57-9b64-4f2bc984b4a8 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Received event network-vif-plugged-89446e5b-c447-4a2c-b547-03a71d82747b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:12:08.826749 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a3f7b0ed-6c84-4459-b057-dfd9b21c746d req-d9df3191-ab29-4e57-9b64-4f2bc984b4a8 service nova] Acquiring lock "4edb886b-df1e-42fd-9881-91fc07339c3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:08.826938 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a3f7b0ed-6c84-4459-b057-dfd9b21c746d req-d9df3191-ab29-4e57-9b64-4f2bc984b4a8 service nova] Lock "4edb886b-df1e-42fd-9881-91fc07339c3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:08.827054 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a3f7b0ed-6c84-4459-b057-dfd9b21c746d req-d9df3191-ab29-4e57-9b64-4f2bc984b4a8 service nova] Lock "4edb886b-df1e-42fd-9881-91fc07339c3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:08.827191 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a3f7b0ed-6c84-4459-b057-dfd9b21c746d req-d9df3191-ab29-4e57-9b64-4f2bc984b4a8 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] No waiting events found dispatching network-vif-plugged-89446e5b-c447-4a2c-b547-03a71d82747b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:12:08.827337 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-a3f7b0ed-6c84-4459-b057-dfd9b21c746d req-d9df3191-ab29-4e57-9b64-4f2bc984b4a8 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Received unexpected event network-vif-plugged-89446e5b-c447-4a2c-b547-03a71d82747b for instance with vm_state active and task_state None.
May 28 01:12:09.101328 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
May 28 01:12:09.111844 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-063f9d25-ab92-490f-ae0f-6d0a328e0674 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "4edb886b-df1e-42fd-9881-91fc07339c3f" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 13.964s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:10.878420 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-078c8192-d178-4fd7-8f34-74e007d2f7fe req-f1bda978-cd8f-4049-8392-d655ef171b16 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Received event network-vif-plugged-89446e5b-c447-4a2c-b547-03a71d82747b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:12:10.878420 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-078c8192-d178-4fd7-8f34-74e007d2f7fe req-f1bda978-cd8f-4049-8392-d655ef171b16 service nova] Acquiring lock "4edb886b-df1e-42fd-9881-91fc07339c3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:10.878420 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-078c8192-d178-4fd7-8f34-74e007d2f7fe req-f1bda978-cd8f-4049-8392-d655ef171b16 service nova] Lock "4edb886b-df1e-42fd-9881-91fc07339c3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:10.879003 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-078c8192-d178-4fd7-8f34-74e007d2f7fe req-f1bda978-cd8f-4049-8392-d655ef171b16 service nova] Lock "4edb886b-df1e-42fd-9881-91fc07339c3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:10.879003 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-078c8192-d178-4fd7-8f34-74e007d2f7fe req-f1bda978-cd8f-4049-8392-d655ef171b16 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] No waiting events found dispatching network-vif-plugged-89446e5b-c447-4a2c-b547-03a71d82747b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:12:10.879003 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-078c8192-d178-4fd7-8f34-74e007d2f7fe req-f1bda978-cd8f-4049-8392-d655ef171b16 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Received unexpected event network-vif-plugged-89446e5b-c447-4a2c-b547-03a71d82747b for instance with vm_state active and task_state None.
May 28 01:12:10.879452 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:11.582111 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:11.680834 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:11.681023 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:12.182699 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:12:12.725002 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:12.725171 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:12.728017 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:12:12.728139 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Claim successful on node np0000001577
May 28 01:12:13.958188 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0003735909999704745 future=<Future at 0x7c98704e8ec0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:12:13.958670 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:12:14.069662 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:12:14.069866 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:12:14.573573 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:12:15.079120 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.354s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:15.079538 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:12:15.185430 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "e4dca6bf-1591-46fa-8ade-a99fddf923a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:15.185698 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e4dca6bf-1591-46fa-8ade-a99fddf923a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:15.584860 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:12:15.585268 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:12:15.585624 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:12:15.585986 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:12:15.688908 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lazy-loading 'flavor' on Instance uuid e4dca6bf-1591-46fa-8ade-a99fddf923a7 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:12:15.710754 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18f4a9334b864b4b9104a4fe74f90c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5e86340fc8435f8e3c83322ba82560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:12:15.892122 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:16.092088 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:12:16.113286 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Successfully created port: 803c8519-51b8-4b25-8cee-11cf816398fa {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:12:16.575398 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Successfully updated port: 803c8519-51b8-4b25-8cee-11cf816398fa {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:12:16.584345 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:16.594517 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:12:16.639576 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ae3bdde4-e402-46b4-a2a0-0ea9b323bd0c req-3245a6fa-f172-42ee-b174-4a641c334efb service nova] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Received event network-changed-803c8519-51b8-4b25-8cee-11cf816398fa {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:12:16.639737 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-ae3bdde4-e402-46b4-a2a0-0ea9b323bd0c req-3245a6fa-f172-42ee-b174-4a641c334efb service nova] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Refreshing instance network info cache due to event network-changed-803c8519-51b8-4b25-8cee-11cf816398fa. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:12:16.639893 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ae3bdde4-e402-46b4-a2a0-0ea9b323bd0c req-3245a6fa-f172-42ee-b174-4a641c334efb service nova] Acquiring lock "refresh_cache-26af0b2c-7e35-4e53-85eb-71ddca16fbfa" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:12:16.640003 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ae3bdde4-e402-46b4-a2a0-0ea9b323bd0c req-3245a6fa-f172-42ee-b174-4a641c334efb service nova] Acquired lock "refresh_cache-26af0b2c-7e35-4e53-85eb-71ddca16fbfa" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:12:16.640141 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-ae3bdde4-e402-46b4-a2a0-0ea9b323bd0c req-3245a6fa-f172-42ee-b174-4a641c334efb service nova] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Refreshing network info cache for port 803c8519-51b8-4b25-8cee-11cf816398fa {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:12:16.694231 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e4dca6bf-1591-46fa-8ade-a99fddf923a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:17.077826 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "refresh_cache-26af0b2c-7e35-4e53-85eb-71ddca16fbfa" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:12:17.141795 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-ae3bdde4-e402-46b4-a2a0-0ea9b323bd0c req-3245a6fa-f172-42ee-b174-4a641c334efb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:12:17.194432 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-ae3bdde4-e402-46b4-a2a0-0ea9b323bd0c req-3245a6fa-f172-42ee-b174-4a641c334efb service nova] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:12:17.347994 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-ae3bdde4-e402-46b4-a2a0-0ea9b323bd0c req-3245a6fa-f172-42ee-b174-4a641c334efb service nova] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:12:17.601615 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:12:17.602409 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:12:17.602679 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Creating image(s)
May 28 01:12:17.603116 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "/opt/stack/data/nova/instances/26af0b2c-7e35-4e53-85eb-71ddca16fbfa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:17.603302 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "/opt/stack/data/nova/instances/26af0b2c-7e35-4e53-85eb-71ddca16fbfa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:17.607193 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "/opt/stack/data/nova/instances/26af0b2c-7e35-4e53-85eb-71ddca16fbfa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:17.607773 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:12:17.613355 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:12:17.615982 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:12:17.725085 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.109s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:12:17.725540 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:17.726156 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:17.726623 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:12:17.729242 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:12:17.729531 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:12:17.767520 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "e4dca6bf-1591-46fa-8ade-a99fddf923a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:17.767838 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e4dca6bf-1591-46fa-8ade-a99fddf923a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:17.768139 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Attaching volume 335404a4-ae14-42d9-aeb3-f6f69436ff1b to /dev/vdb
May 28 01:12:17.812027 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.082s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:12:17.812357 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/26af0b2c-7e35-4e53-85eb-71ddca16fbfa/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:12:17.828934 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:12:17.842307 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:12:17.851692 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ae3bdde4-e402-46b4-a2a0-0ea9b323bd0c req-3245a6fa-f172-42ee-b174-4a641c334efb service nova] Releasing lock "refresh_cache-26af0b2c-7e35-4e53-85eb-71ddca16fbfa" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:12:17.852441 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquired lock "refresh_cache-26af0b2c-7e35-4e53-85eb-71ddca16fbfa" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:12:17.852441 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:12:17.865024 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/26af0b2c-7e35-4e53-85eb-71ddca16fbfa/disk 1073741824" returned: 0 in 0.053s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:12:17.865835 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.140s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:17.866766 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:12:17.884267 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:12:17.928867 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:12:17.930948 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:12:17.940357 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:12:17.942018 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe65:fa89', 'fe80::583c:47ff:fea3:281d', 'fe80::fc16:3eff:fe42:895e', 'fe80::fc16:3eff:fe8e:8134', 'fe80::c813:dcff:fe9e:6381', 'fe80::fc16:3eff:fe1c:dfad', 'fe80::3c1c:87ff:fe8d:eb78', 'fe80::fc16:3eff:feb6:e662', 'fe80::1cf4:68ff:fe80:cb5', 'fe80::fc16:3eff:fefa:1f', 'fe80::d820:d3ff:fe1f:ca6e'] 
May 28 01:12:17.942144 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:12:17.942368 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:12:17.942798 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:12:17.943201 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Updating existing volume attachment record: d1fa6709-e72d-4636-bc84-68fa64294012 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:12:17.953354 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.087s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:12:17.953691 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Checking if we can resize image /opt/stack/data/nova/instances/26af0b2c-7e35-4e53-85eb-71ddca16fbfa/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:12:17.953882 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26af0b2c-7e35-4e53-85eb-71ddca16fbfa/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:12:18.038539 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26af0b2c-7e35-4e53-85eb-71ddca16fbfa/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:12:18.038915 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Cannot resize image /opt/stack/data/nova/instances/26af0b2c-7e35-4e53-85eb-71ddca16fbfa/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:12:18.039284 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:12:18.039463 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Ensure instance console log exists: /opt/stack/data/nova/instances/26af0b2c-7e35-4e53-85eb-71ddca16fbfa/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:12:18.039783 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:18.039995 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:18.040151 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:18.315539 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-99a7380b-7f84-46f8-a2aa-15fe079165f2 req-bed496b3-3e80-4d45-ba8c-28660505a30b service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Received event network-changed-47188850-53a4-4d18-8810-5b06dc353030 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:12:18.316009 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-99a7380b-7f84-46f8-a2aa-15fe079165f2 req-bed496b3-3e80-4d45-ba8c-28660505a30b service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Refreshing instance network info cache due to event network-changed-47188850-53a4-4d18-8810-5b06dc353030. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:12:18.316009 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-99a7380b-7f84-46f8-a2aa-15fe079165f2 req-bed496b3-3e80-4d45-ba8c-28660505a30b service nova] Acquiring lock "refresh_cache-3d97b775-d6eb-4c8f-b951-11bcb0444adf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:12:18.316009 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-99a7380b-7f84-46f8-a2aa-15fe079165f2 req-bed496b3-3e80-4d45-ba8c-28660505a30b service nova] Acquired lock "refresh_cache-3d97b775-d6eb-4c8f-b951-11bcb0444adf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:12:18.316156 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-99a7380b-7f84-46f8-a2aa-15fe079165f2 req-bed496b3-3e80-4d45-ba8c-28660505a30b service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Refreshing network info cache for port 47188850-53a4-4d18-8810-5b06dc353030 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:12:18.428047 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:12:18.502482 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:12:18.502821 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b', 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '335404a4-ae14-42d9-aeb3-f6f69436ff1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:12:18.502954 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:12:18.503309 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:12:18.503487 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b', 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '335404a4-ae14-42d9-aeb3-f6f69436ff1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:12:18.517103 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:12:18.518302 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:12:18.518804 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:12:18.519043 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:12:18.519383 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:12:18.519611 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.startup = automatic
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.session.scan = manual
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:12:18.532249 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:12:18.532249 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.startup = automatic
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.session.scan = manual
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:12:18.537960 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:12:18.537960 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:18.548010 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:18.558637 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:18.567140 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:18.567140 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:18.567140 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:18.567140 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:18.567140 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:18.567140 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:18.567140 np0000001577 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:12:18.567140 np0000001577 nova-compute[98319]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:12:18.567140 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:18.567140 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:18.567140 np0000001577 nova-compute[98319]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:18.567140 np0000001577 nova-compute[98319]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:18.567140 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:12:18.567537 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:18.567537 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:18.567537 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:18.567537 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:18.567537 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:18.567537 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:18.567537 np0000001577 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:12:18.567537 np0000001577 nova-compute[98319]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:12:18.567537 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:18.567537 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:18.567537 np0000001577 nova-compute[98319]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:18.567537 np0000001577 nova-compute[98319]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:18.567537 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:12:18.567537 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.048s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:12:18.567872 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:12:18.568387 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] HCTL ('10', '0', '0', 0) found on session 173 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:12:18.568486 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:12:18.593407 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:18.593407 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:18.593407 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:18.593407 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:18.593407 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:18.593407 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:18.593407 np0000001577 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:12:18.593407 np0000001577 nova-compute[98319]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:12:18.593407 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:18.593407 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:18.593407 np0000001577 nova-compute[98319]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:18.593407 np0000001577 nova-compute[98319]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:18.593407 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:12:18.593407 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:18.593407 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:18.593407 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:18.593407 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:18.593407 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:18.593407 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:18.593407 np0000001577 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:12:18.593407 np0000001577 nova-compute[98319]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:12:18.593407 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:18.593407 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:18.593407 np0000001577 nova-compute[98319]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:18.593407 np0000001577 nova-compute[98319]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:18.593407 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:12:18.593407 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.063s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:12:18.593407 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:12:18.593407 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] HCTL ('9', '0', '0', 0) found on session 172 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:12:18.593407 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Scanning host 9 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:12:18.599106 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:12:18.602224 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Searching for a device in session 173 and hctl ('10', '0', '0', 0) yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:12:18.602361 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '335404a4-ae14-42d9-aeb3-f6f69436ff1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:12:18.603381 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Searching for a device in session 172 and hctl ('9', '0', '0', 0) yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:12:18.603517 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '335404a4-ae14-42d9-aeb3-f6f69436ff1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:12:18.711789 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Updating instance_info_cache with network_info: [{"id": "803c8519-51b8-4b25-8cee-11cf816398fa", "address": "fa:16:3e:4a:3d:bf", "network": {"id": "c28bd5cb-6fe6-4196-89e2-40b572ab0547", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-985170360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0e5e86340fc8435f8e3c83322ba82560", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap803c8519-51", "ovs_interfaceid": "803c8519-51b8-4b25-8cee-11cf816398fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:12:18.819088 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-99a7380b-7f84-46f8-a2aa-15fe079165f2 req-bed496b3-3e80-4d45-ba8c-28660505a30b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:12:18.855288 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Acquiring lock "3d97b775-d6eb-4c8f-b951-11bcb0444adf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:18.855742 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Lock "3d97b775-d6eb-4c8f-b951-11bcb0444adf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:18.855912 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Acquiring lock "3d97b775-d6eb-4c8f-b951-11bcb0444adf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:18.856024 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Lock "3d97b775-d6eb-4c8f-b951-11bcb0444adf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:18.856132 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Lock "3d97b775-d6eb-4c8f-b951-11bcb0444adf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:18.858196 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Terminating instance
May 28 01:12:18.865872 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:18.866048 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:19.104537 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-99a7380b-7f84-46f8-a2aa-15fe079165f2 req-bed496b3-3e80-4d45-ba8c-28660505a30b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:12:19.213793 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Releasing lock "refresh_cache-26af0b2c-7e35-4e53-85eb-71ddca16fbfa" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:12:19.214036 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Instance network_info: |[{"id": "803c8519-51b8-4b25-8cee-11cf816398fa", "address": "fa:16:3e:4a:3d:bf", "network": {"id": "c28bd5cb-6fe6-4196-89e2-40b572ab0547", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-985170360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0e5e86340fc8435f8e3c83322ba82560", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap803c8519-51", "ovs_interfaceid": "803c8519-51b8-4b25-8cee-11cf816398fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:12:19.215806 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Start _get_guest_xml network_info=[{"id": "803c8519-51b8-4b25-8cee-11cf816398fa", "address": "fa:16:3e:4a:3d:bf", "network": {"id": "c28bd5cb-6fe6-4196-89e2-40b572ab0547", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-985170360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0e5e86340fc8435f8e3c83322ba82560", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap803c8519-51", "ovs_interfaceid": "803c8519-51b8-4b25-8cee-11cf816398fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:12:19.217793 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-99a7380b-7f84-46f8-a2aa-15fe079165f2 req-bed496b3-3e80-4d45-ba8c-28660505a30b service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Updated VIF entry in instance network info cache for port 47188850-53a4-4d18-8810-5b06dc353030. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:12:19.218141 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-99a7380b-7f84-46f8-a2aa-15fe079165f2 req-bed496b3-3e80-4d45-ba8c-28660505a30b service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Updating instance_info_cache with network_info: [{"id": "47188850-53a4-4d18-8810-5b06dc353030", "address": "fa:16:3e:1c:df:ad", "network": {"id": "64f08667-4fa5-4522-98af-795ef337993e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-2036728215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a77c8c2778bf47d79d3119ed128f6608", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47188850-53", "ovs_interfaceid": "47188850-53a4-4d18-8810-5b06dc353030", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:12:19.220496 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:12:19.221830 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-SnapshotDataIntegrityTests-server-496775262', uuid='26af0b2c-7e35-4e53-85eb-71ddca16fbfa'), owner=OwnerMeta(userid='18f4a9334b864b4b9104a4fe74f90c8c', username='tempest-SnapshotDataIntegrityTests-1488880081-project-member', projectid='0e5e86340fc8435f8e3c83322ba82560', projectname='tempest-SnapshotDataIntegrityTests-1488880081'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "803c8519-51b8-4b25-8cee-11cf816398fa", "address": "fa:16:3e:4a:3d:bf", "network": {"id": "c28bd5cb-6fe6-4196-89e2-40b572ab0547", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-985170360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0e5e86340fc8435f8e3c83322ba82560", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap803c8519-51", "ovs_interfaceid": "803c8519-51b8-4b25-8cee-11cf816398fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930739.2214043) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:12:19.223462 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:12:19.223506 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:12:19.224418 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:12:19.224990 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:12:19.225933 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:12:19.226374 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:12:19.226647 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:12:19.226787 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:12:19.227023 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:12:19.227162 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:12:19.227265 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:12:19.227415 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:12:19.227511 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:12:19.227738 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:12:19.227852 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:12:19.227969 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:12:19.241956 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-496775262',display_name='tempest-SnapshotDataIntegrityTests-server-496775262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-snapshotdataintegritytests-server-496775262',id=71,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGIclZBBgyW4qbcHhvzXUpNIEaZYL+gCHX0SCXTH/XCEXN7WldYmM2jTlcJTHOOZr+56lmTi54khabWnAOLEOEicXnBt/cwT7s56sQvd2t7fd/XGWhAq2fEN0hKO7odFw==',key_name='tempest-keypair-598473641',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e5e86340fc8435f8e3c83322ba82560',ramdisk_id='',reservation_id='r-t08nzvnx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1488880081',owner_user_name='tempest-SnapshotDataIntegrityTests-1488880081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:12:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18f4a9334b864b4b9104a4fe74f90c8c',uuid=26af0b2c-7e35-4e53-85eb-71ddca16fbfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "803c8519-51b8-4b25-8cee-11cf816398fa", "address": "fa:16:3e:4a:3d:bf", "network": {"id": "c28bd5cb-6fe6-4196-89e2-40b572ab0547", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-985170360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0e5e86340fc8435f8e3c83322ba82560", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap803c8519-51", "ovs_interfaceid": "803c8519-51b8-4b25-8cee-11cf816398fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:12:19.242320 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Converting VIF {"id": "803c8519-51b8-4b25-8cee-11cf816398fa", "address": "fa:16:3e:4a:3d:bf", "network": {"id": "c28bd5cb-6fe6-4196-89e2-40b572ab0547", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-985170360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0e5e86340fc8435f8e3c83322ba82560", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap803c8519-51", "ovs_interfaceid": "803c8519-51b8-4b25-8cee-11cf816398fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:12:19.242958 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:3d:bf,bridge_name='br-int',has_traffic_filtering=True,id=803c8519-51b8-4b25-8cee-11cf816398fa,network=Network(c28bd5cb-6fe6-4196-89e2-40b572ab0547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap803c8519-51') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:12:19.243701 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lazy-loading 'pci_devices' on Instance uuid 26af0b2c-7e35-4e53-85eb-71ddca16fbfa {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:12:19.361108 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:12:19.369770 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lazy-loading 'flavor' on Instance uuid 60b7855e-1385-4a4b-89c8-f3c0f71f3959 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:12:19.386636 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:19.390031 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:19.409513 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:19.413996 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:19.434588 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:19.437957 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:19.519173 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:12:19.670610 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999604295000154 future=<Future at 0x7c984c5ca5d0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:12:19.671238 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.998927236000327 future=<Future at 0x7c984c5ca5d0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:12:19.671335 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.998813645000155 future=<Future at 0x7c984c5ca5d0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:12:19.673203 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Instance destroyed successfully.
May 28 01:12:19.674507 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Lazy-loading 'resources' on Instance uuid 3d97b775-d6eb-4c8f-b951-11bcb0444adf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:12:19.720664 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-99a7380b-7f84-46f8-a2aa-15fe079165f2 req-bed496b3-3e80-4d45-ba8c-28660505a30b service nova] Releasing lock "refresh_cache-3d97b775-d6eb-4c8f-b951-11bcb0444adf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:12:19.746616 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] End _get_guest_xml xml=<domain type="qemu">
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:   <uuid>26af0b2c-7e35-4e53-85eb-71ddca16fbfa</uuid>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:   <name>instance-00000047</name>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-496775262</nova:name>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:12:19</nova:creationTime>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:         <nova:user uuid="18f4a9334b864b4b9104a4fe74f90c8c">tempest-SnapshotDataIntegrityTests-1488880081-project-member</nova:user>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:         <nova:project uuid="0e5e86340fc8435f8e3c83322ba82560">tempest-SnapshotDataIntegrityTests-1488880081</nova:project>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:         <nova:port uuid="803c8519-51b8-4b25-8cee-11cf816398fa">
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:     <system>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       <entry name="serial">26af0b2c-7e35-4e53-85eb-71ddca16fbfa</entry>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       <entry name="uuid">26af0b2c-7e35-4e53-85eb-71ddca16fbfa</entry>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:     </system>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:   <os>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:   </os>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:   <features>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:   </features>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:   <devices>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/26af0b2c-7e35-4e53-85eb-71ddca16fbfa/disk"/>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:     </disk>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/26af0b2c-7e35-4e53-85eb-71ddca16fbfa/disk.config"/>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:     </disk>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:4a:3d:bf"/>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       <target dev="tap803c8519-51"/>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:     </interface>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/26af0b2c-7e35-4e53-85eb-71ddca16fbfa/console.log" append="off"/>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:     </serial>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:     <video>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:     </video>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:     </rng>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:   </devices>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]: </domain>
May 28 01:12:19.746616 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:12:19.749918 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Preparing to wait for external event network-vif-plugged-803c8519-51b8-4b25-8cee-11cf816398fa {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:12:19.749918 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:19.749918 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:19.749918 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:19.749918 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-496775262',display_name='tempest-SnapshotDataIntegrityTests-server-496775262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-snapshotdataintegritytests-server-496775262',id=71,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGIclZBBgyW4qbcHhvzXUpNIEaZYL+gCHX0SCXTH/XCEXN7WldYmM2jTlcJTHOOZr+56lmTi54khabWnAOLEOEicXnBt/cwT7s56sQvd2t7fd/XGWhAq2fEN0hKO7odFw==',key_name='tempest-keypair-598473641',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e5e86340fc8435f8e3c83322ba82560',ramdisk_id='',reservation_id='r-t08nzvnx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1488880081',owner_user_name='tempest-SnapshotDataIntegrityTests-1488880081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:12:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18f4a9334b864b4b9104a4fe74f90c8c',uuid=26af0b2c-7e35-4e53-85eb-71ddca16fbfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "803c8519-51b8-4b25-8cee-11cf816398fa", "address": "fa:16:3e:4a:3d:bf", "network": {"id": "c28bd5cb-6fe6-4196-89e2-40b572ab0547", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-985170360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0e5e86340fc8435f8e3c83322ba82560", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap803c8519-51", "ovs_interfaceid": "803c8519-51b8-4b25-8cee-11cf816398fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:12:19.749918 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Converting VIF {"id": "803c8519-51b8-4b25-8cee-11cf816398fa", "address": "fa:16:3e:4a:3d:bf", "network": {"id": "c28bd5cb-6fe6-4196-89e2-40b572ab0547", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-985170360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0e5e86340fc8435f8e3c83322ba82560", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap803c8519-51", "ovs_interfaceid": "803c8519-51b8-4b25-8cee-11cf816398fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:12:19.749918 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:3d:bf,bridge_name='br-int',has_traffic_filtering=True,id=803c8519-51b8-4b25-8cee-11cf816398fa,network=Network(c28bd5cb-6fe6-4196-89e2-40b572ab0547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap803c8519-51') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:12:19.750536 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:3d:bf,bridge_name='br-int',has_traffic_filtering=True,id=803c8519-51b8-4b25-8cee-11cf816398fa,network=Network(c28bd5cb-6fe6-4196-89e2-40b572ab0547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap803c8519-51') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:12:19.750767 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:19.751089 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:12:19.751487 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:12:19.752339 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:19.752339 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e967cb34-3ea8-582d-8262-11da7d984c16', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:12:19.767788 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:19.767788 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:12:19.770720 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:19.774574 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:19.774574 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap803c8519-51, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:12:19.774574 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap803c8519-51, col_values=(('qos', UUID('353ca3b0-39ef-4c64-9e0a-3d6e949f6bf1')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:12:19.774574 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap803c8519-51, col_values=(('external_ids', {'iface-id': '803c8519-51b8-4b25-8cee-11cf816398fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:3d:bf', 'vm-uuid': '26af0b2c-7e35-4e53-85eb-71ddca16fbfa'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:12:19.774574 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:19.775845 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:12:19.783627 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:19.784567 np0000001577 nova-compute[98319]: INFO os_vif [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:3d:bf,bridge_name='br-int',has_traffic_filtering=True,id=803c8519-51b8-4b25-8cee-11cf816398fa,network=Network(c28bd5cb-6fe6-4196-89e2-40b572ab0547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap803c8519-51')
May 28 01:12:20.176332 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:11:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-360252113',display_name='tempest-TestVolumeBackupRestore-server-360252113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebackuprestore-server-360252113',id=69,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRC+jjHgNHXSNzrpZMrdee0djqvGr8I/hS9uam4yNO99qWRLtPFNi0B4hfd8xRMu8o90bDcNag4hltJerabiC38fg7dJIcRlTrBxsP1+p0XGySgscyGia8CISvY/KJWQw==',key_name='tempest-TestVolumeBackupRestore-541610086',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:11:52Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a77c8c2778bf47d79d3119ed128f6608',ramdisk_id='',reservation_id='r-sn60g2mu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBackupRestore-1871172420',owner_user_name='tempest-TestVolumeBackupRestore-1871172420-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:11:52Z,user_data=None,user_id='d6b37e0fb18f44cebefbd955aef64927',uuid=3d97b775-d6eb-4c8f-b951-11bcb0444adf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47188850-53a4-4d18-8810-5b06dc353030", "address": "fa:16:3e:1c:df:ad", "network": {"id": "64f08667-4fa5-4522-98af-795ef337993e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-2036728215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a77c8c2778bf47d79d3119ed128f6608", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47188850-53", "ovs_interfaceid": "47188850-53a4-4d18-8810-5b06dc353030", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:12:20.176635 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Converting VIF {"id": "47188850-53a4-4d18-8810-5b06dc353030", "address": "fa:16:3e:1c:df:ad", "network": {"id": "64f08667-4fa5-4522-98af-795ef337993e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-2036728215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a77c8c2778bf47d79d3119ed128f6608", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47188850-53", "ovs_interfaceid": "47188850-53a4-4d18-8810-5b06dc353030", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:12:20.177196 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:df:ad,bridge_name='br-int',has_traffic_filtering=True,id=47188850-53a4-4d18-8810-5b06dc353030,network=Network(64f08667-4fa5-4522-98af-795ef337993e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47188850-53') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:12:20.177468 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:df:ad,bridge_name='br-int',has_traffic_filtering=True,id=47188850-53a4-4d18-8810-5b06dc353030,network=Network(64f08667-4fa5-4522-98af-795ef337993e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47188850-53') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:12:20.178509 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:20.178764 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47188850-53, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:12:20.182046 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:20.183084 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:12:20.187666 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:20.188788 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:20.188968 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c0e312ae-c04d-49f3-864d-de9cc1db8d80) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:12:20.189461 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:20.189999 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:12:20.194891 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:20.196596 np0000001577 nova-compute[98319]: INFO os_vif [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:df:ad,bridge_name='br-int',has_traffic_filtering=True,id=47188850-53a4-4d18-8810-5b06dc353030,network=Network(64f08667-4fa5-4522-98af-795ef337993e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47188850-53')
May 28 01:12:20.197862 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:12:20.198101 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2', 'iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '655d9253-2209-439f-a631-a3c5b1bf6ed2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:12:20.198212 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:12:20.372704 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-58b8c268-bfe7-4230-8a46-d64728cc8977 req-89f8fff8-8bd3-4ea2-a429-1ad9b84db628 service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Received event network-vif-unplugged-47188850-53a4-4d18-8810-5b06dc353030 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:12:20.374613 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-58b8c268-bfe7-4230-8a46-d64728cc8977 req-89f8fff8-8bd3-4ea2-a429-1ad9b84db628 service nova] Acquiring lock "3d97b775-d6eb-4c8f-b951-11bcb0444adf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:20.374613 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-58b8c268-bfe7-4230-8a46-d64728cc8977 req-89f8fff8-8bd3-4ea2-a429-1ad9b84db628 service nova] Lock "3d97b775-d6eb-4c8f-b951-11bcb0444adf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:20.374613 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-58b8c268-bfe7-4230-8a46-d64728cc8977 req-89f8fff8-8bd3-4ea2-a429-1ad9b84db628 service nova] Lock "3d97b775-d6eb-4c8f-b951-11bcb0444adf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:20.374613 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-58b8c268-bfe7-4230-8a46-d64728cc8977 req-89f8fff8-8bd3-4ea2-a429-1ad9b84db628 service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] No waiting events found dispatching network-vif-unplugged-47188850-53a4-4d18-8810-5b06dc353030 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:12:20.374613 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-58b8c268-bfe7-4230-8a46-d64728cc8977 req-89f8fff8-8bd3-4ea2-a429-1ad9b84db628 service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Received event network-vif-unplugged-47188850-53a4-4d18-8810-5b06dc353030 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:12:20.374613 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-58b8c268-bfe7-4230-8a46-d64728cc8977 req-89f8fff8-8bd3-4ea2-a429-1ad9b84db628 service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Received event network-vif-unplugged-47188850-53a4-4d18-8810-5b06dc353030 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:12:20.374613 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-58b8c268-bfe7-4230-8a46-d64728cc8977 req-89f8fff8-8bd3-4ea2-a429-1ad9b84db628 service nova] Acquiring lock "3d97b775-d6eb-4c8f-b951-11bcb0444adf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:20.374613 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-58b8c268-bfe7-4230-8a46-d64728cc8977 req-89f8fff8-8bd3-4ea2-a429-1ad9b84db628 service nova] Lock "3d97b775-d6eb-4c8f-b951-11bcb0444adf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:20.374613 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-58b8c268-bfe7-4230-8a46-d64728cc8977 req-89f8fff8-8bd3-4ea2-a429-1ad9b84db628 service nova] Lock "3d97b775-d6eb-4c8f-b951-11bcb0444adf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:20.374613 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-58b8c268-bfe7-4230-8a46-d64728cc8977 req-89f8fff8-8bd3-4ea2-a429-1ad9b84db628 service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] No waiting events found dispatching network-vif-unplugged-47188850-53a4-4d18-8810-5b06dc353030 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:12:20.377638 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-58b8c268-bfe7-4230-8a46-d64728cc8977 req-89f8fff8-8bd3-4ea2-a429-1ad9b84db628 service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Received event network-vif-unplugged-47188850-53a4-4d18-8810-5b06dc353030 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:12:20.378374 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:20.534665 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Found WWN 330000000cd1c3072 for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:12:20.534949 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.032s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:12:20.535072 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] <== connect_volume: return (2032ms) {'type': 'block', 'scsi_wwn': '330000000cd1c3072', 'path': '/dev/dm-0', 'multipath_id': '330000000cd1c3072'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:12:20.535199 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cd1c3072', 'path': '/dev/dm-0', 'multipath_id': '330000000cd1c3072'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:12:20.535794 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.337s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:12:20.536160 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2', 'iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '655d9253-2209-439f-a631-a3c5b1bf6ed2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:12:20.536300 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:12:20.538293 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lazy-loading 'flavor' on Instance uuid e4dca6bf-1591-46fa-8ade-a99fddf923a7 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:12:20.565485 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:20.565485 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:20.565485 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:20.565485 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:20.565485 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:20.565485 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:20.565485 np0000001577 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:12:20.565485 np0000001577 nova-compute[98319]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:12:20.565485 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:20.565485 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:20.565485 np0000001577 nova-compute[98319]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:20.565485 np0000001577 nova-compute[98319]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:20.565485 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:12:20.565912 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:20.565912 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:20.565912 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:20.565912 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:20.565912 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:20.565912 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:20.565912 np0000001577 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:12:20.565912 np0000001577 nova-compute[98319]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2 (non-flash)
May 28 01:12:20.565912 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:20.565912 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:20.565912 np0000001577 nova-compute[98319]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:20.565912 np0000001577 nova-compute[98319]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:20.565912 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:12:20.565912 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', '164'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', '165'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', '169'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', '170'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b', '172'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b', '173'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2', '177'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2', '178'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', '182')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:12:20.565912 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2', '177')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:12:20.566887 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2', '178')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:12:20.567709 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c988c1c3e20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2'): ({'sdi'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:12:20.567911 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Removing multipathed devices sdf, sdi {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:12:20.568124 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Flush multipath device 330000000d5abb217 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:12:20.615029 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:12:20.656435 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:12:20.699886 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Checking to see if SCSI volumes sdf, sdi have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:12:20.700117 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] SCSI volumes sdf, sdi have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:12:20.701214 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Checking to see if device paths {'sdf', 'sdi'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:12:20.711741 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Device paths {'sdf', 'sdi'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:12:20.711925 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:12:20.722970 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:20.756064 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 177, target: iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2, portal: 192.168.40.100,3260]
May 28 01:12:20.756064 np0000001577 nova-compute[98319]: Logout of [sid: 177, target: iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2, portal: 192.168.40.100,3260] successful.
May 28 01:12:20.756064 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:20.775509 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:20.788111 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:20.821634 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 178, target: iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2, portal: 192.168.50.100,3260]
May 28 01:12:20.821634 np0000001577 nova-compute[98319]: Logout of [sid: 178, target: iqn.2023-03.storpool.com:os--volume-655d9253-2209-439f-a631-a3c5b1bf6ed2, portal: 192.168.50.100,3260] successful.
May 28 01:12:20.821634 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:20.842870 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:20.843063 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:12:20.843164 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] <== disconnect_volume: return (644ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:12:20.843271 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:12:20.843495 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Deleting instance files /opt/stack/data/nova/instances/3d97b775-d6eb-4c8f-b951-11bcb0444adf_del
May 28 01:12:20.843983 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Deletion of /opt/stack/data/nova/instances/3d97b775-d6eb-4c8f-b951-11bcb0444adf_del complete
May 28 01:12:21.041240 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Attempting to attach volume 335404a4-ae14-42d9-aeb3-f6f69436ff1b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:12:21.043167 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:12:21.043167 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:12:21.043167 np0000001577 nova-compute[98319]:   <alias name="ua-335404a4-ae14-42d9-aeb3-f6f69436ff1b"/>
May 28 01:12:21.043167 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 28 01:12:21.043167 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:12:21.043167 np0000001577 nova-compute[98319]:   <serial>335404a4-ae14-42d9-aeb3-f6f69436ff1b</serial>
May 28 01:12:21.043167 np0000001577 nova-compute[98319]:   <shareable/>
May 28 01:12:21.043167 np0000001577 nova-compute[98319]: </disk>
May 28 01:12:21.043167 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:12:21.303159 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:12:21.303275 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:12:21.303374 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] No VIF found with MAC fa:16:3e:4a:3d:bf, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:12:21.303877 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Using config drive
May 28 01:12:21.352512 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Took 1.99 seconds to destroy the instance on the hypervisor.
May 28 01:12:21.353175 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:12:21.353425 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:12:21.353513 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:12:21.353770 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:12:21.413995 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:12:21.515938 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:21.516110 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:21.516244 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Attaching volume 6b89c7f5-0e8c-47f0-9195-642fca1b6067 to /dev/vdb
May 28 01:12:21.553933 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:12:21.565064 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:12:21.585892 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:21.587997 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:12:21.639858 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:12:21.641959 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:12:21.653126 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:12:21.654330 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe65:fa89', 'fe80::583c:47ff:fea3:281d', 'fe80::fc16:3eff:fe42:895e', 'fe80::fc16:3eff:fe8e:8134', 'fe80::c813:dcff:fe9e:6381', 'fe80::fc16:3eff:feb6:e662', 'fe80::1cf4:68ff:fe80:cb5', 'fe80::fc16:3eff:fefa:1f', 'fe80::d820:d3ff:fe1f:ca6e'] 
May 28 01:12:21.654484 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:12:21.654645 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:12:21.655361 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:12:21.655628 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Updating existing volume attachment record: 6acd0543-7f30-4ef6-9e64-8e0fb29b644a {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:12:21.681776 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-25622f39-6205-4f5b-b1ee-4f02e4ef8d80 req-8fff82ba-d683-4a63-8681-76db38c5bd96 service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Received event network-vif-deleted-47188850-53a4-4d18-8810-5b06dc353030 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:12:21.682230 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-25622f39-6205-4f5b-b1ee-4f02e4ef8d80 req-8fff82ba-d683-4a63-8681-76db38c5bd96 service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Neutron deleted interface 47188850-53a4-4d18-8810-5b06dc353030; detaching it from the instance and deleting it from the info cache
May 28 01:12:21.686453 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-25622f39-6205-4f5b-b1ee-4f02e4ef8d80 req-8fff82ba-d683-4a63-8681-76db38c5bd96 service nova] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Detach interface failed, port_id=47188850-53a4-4d18-8810-5b06dc353030, reason: Instance 3d97b775-d6eb-4c8f-b951-11bcb0444adf could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:12:21.809110 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:12:21.914081 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Creating config drive at /opt/stack/data/nova/instances/26af0b2c-7e35-4e53-85eb-71ddca16fbfa/disk.config
May 28 01:12:21.917986 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/26af0b2c-7e35-4e53-85eb-71ddca16fbfa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpn2yskpj9 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:12:21.969679 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/26af0b2c-7e35-4e53-85eb-71ddca16fbfa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpn2yskpj9" returned: 0 in 0.051s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:12:22.140961 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:12:22.199903 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:12:22.200260 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067', 'iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b89c7f5-0e8c-47f0-9195-642fca1b6067', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:12:22.200413 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:12:22.202954 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:12:22.203153 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067', 'iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b89c7f5-0e8c-47f0-9195-642fca1b6067', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:12:22.216243 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:12:22.216903 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:12:22.217378 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:12:22.217564 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:12:22.218430 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:12:22.218660 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:12:22.228909 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:12:22.228909 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:22.234129 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:12:22.234129 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:22.242175 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067] added
May 28 01:12:22.242175 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:12:22.242175 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:12:22.242175 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:12:22.242175 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:12:22.242175 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:12:22.242175 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:22.242394 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:12:22.242537 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0249(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:12:22.242778 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:12:22.245432 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067] added
May 28 01:12:22.245432 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:12:22.245432 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:12:22.245432 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:12:22.245432 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:12:22.245432 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:12:22.245432 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:22.245631 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:12:22.245786 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0271(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:12:22.245926 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:12:22.375648 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:22.396760 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:22.398952 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:22.472364 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:22.643880 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Took 1.29 seconds to deallocate network for instance.
May 28 01:12:22.692452 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:22.695889 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:22.710970 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:12:22.711081 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:12:22.711131 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:12:22.711197 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No VIF found with MAC fa:16:3e:42:89:5e, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:12:22.715344 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:23.047528 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930743.046974, 26af0b2c-7e35-4e53-85eb-71ddca16fbfa => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:12:23.047528 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] VM Started (Lifecycle Event)
May 28 01:12:23.186654 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Took 0.54 seconds to detach 1 volumes for instance.
May 28 01:12:23.243231 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:12:23.246321 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:12:23.255226 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:12:23.255226 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:12:23.259934 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:12:23.259934 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:23.266783 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:23.272282 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:23.283116 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:23.283116 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:23.283116 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:23.283116 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:23.283116 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:23.283116 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:23.283116 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:23.283116 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:23.283116 np0000001577 nova-compute[98319]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:23.283116 np0000001577 nova-compute[98319]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:23.283116 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:12:23.283372 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:23.283372 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:23.283372 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:23.283372 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:23.283372 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:23.283372 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:23.283372 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:23.283372 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:23.283372 np0000001577 nova-compute[98319]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:23.283372 np0000001577 nova-compute[98319]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:23.283372 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:12:23.289835 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:23.289835 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:23.289835 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:23.289835 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:23.289835 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:23.289835 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:23.289835 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:23.289835 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:23.289835 np0000001577 nova-compute[98319]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:23.289835 np0000001577 nova-compute[98319]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:23.289835 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:12:23.290329 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:23.290329 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:23.290329 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:23.290329 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:23.290329 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:23.290329 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:23.290329 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:23.290329 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:23.290329 np0000001577 nova-compute[98319]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:23.290329 np0000001577 nova-compute[98319]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:23.290329 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:12:23.333754 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067, portal: 192.168.40.100,3260]
May 28 01:12:23.333754 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067, portal: 192.168.40.100,3260] successful.
May 28 01:12:23.333754 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:23.339568 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067, portal: 192.168.50.100,3260]
May 28 01:12:23.339568 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067, portal: 192.168.50.100,3260] successful.
May 28 01:12:23.339568 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:23.345584 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:23.351290 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:12:23.363219 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:23.363219 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:23.363219 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:23.363219 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:23.363219 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:23.363219 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:23.363219 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:23.363219 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:23.363219 np0000001577 nova-compute[98319]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:23.363219 np0000001577 nova-compute[98319]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:23.363219 np0000001577 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:12:23.363219 np0000001577 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:12:23.363219 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:12:23.363537 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:23.363537 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:23.363537 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:23.363537 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:23.363537 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:23.363537 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:23.363537 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:23.363537 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:23.363537 np0000001577 nova-compute[98319]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:23.363537 np0000001577 nova-compute[98319]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:23.363537 np0000001577 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:12:23.363537 np0000001577 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:12:23.363537 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:12:23.363796 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.146s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:12:23.363977 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:12:23.365364 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] HCTL ('11', '-', '-', 0) found on session 183 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:12:23.365800 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:12:23.370386 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:23.370386 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:23.370386 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:23.370386 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:23.370386 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:23.370386 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:23.370386 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:23.370386 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:23.370386 np0000001577 nova-compute[98319]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:23.370386 np0000001577 nova-compute[98319]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:23.370386 np0000001577 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:12:23.370386 np0000001577 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:12:23.370386 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:12:23.370715 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:23.370715 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:23.370715 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:23.370715 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:23.370715 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:23.370715 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:23.370715 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:23.370715 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:23.370715 np0000001577 nova-compute[98319]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:23.370715 np0000001577 nova-compute[98319]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:23.370715 np0000001577 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:12:23.370715 np0000001577 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:12:23.370715 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:12:23.370960 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:12:23.370960 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:12:23.371974 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] HCTL ('14', '-', '-', 0) found on session 184 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:12:23.372078 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:12:23.378364 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Searching for a device in session 183 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:12:23.378516 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b89c7f5-0e8c-47f0-9195-642fca1b6067', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:12:23.387013 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Searching for a device in session 184 and hctl ['14', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:12:23.550133 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:12:23.552023 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930743.551861, 26af0b2c-7e35-4e53-85eb-71ddca16fbfa => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:12:23.552129 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] VM Paused (Lifecycle Event)
May 28 01:12:23.691421 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:23.691523 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:23.735881 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-60432713-6946-4b50-ad75-e20ba4b17071 req-dd0bd5ff-8d5f-4e48-a9ac-93b40182e1b7 service nova] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Received event network-vif-plugged-803c8519-51b8-4b25-8cee-11cf816398fa {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:12:23.736742 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-60432713-6946-4b50-ad75-e20ba4b17071 req-dd0bd5ff-8d5f-4e48-a9ac-93b40182e1b7 service nova] Acquiring lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:23.736742 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-60432713-6946-4b50-ad75-e20ba4b17071 req-dd0bd5ff-8d5f-4e48-a9ac-93b40182e1b7 service nova] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:23.736742 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-60432713-6946-4b50-ad75-e20ba4b17071 req-dd0bd5ff-8d5f-4e48-a9ac-93b40182e1b7 service nova] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:23.736742 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-60432713-6946-4b50-ad75-e20ba4b17071 req-dd0bd5ff-8d5f-4e48-a9ac-93b40182e1b7 service nova] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Processing event network-vif-plugged-803c8519-51b8-4b25-8cee-11cf816398fa {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:12:23.737238 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-60432713-6946-4b50-ad75-e20ba4b17071 req-dd0bd5ff-8d5f-4e48-a9ac-93b40182e1b7 service nova] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Received event network-vif-plugged-803c8519-51b8-4b25-8cee-11cf816398fa {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:12:23.737238 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-60432713-6946-4b50-ad75-e20ba4b17071 req-dd0bd5ff-8d5f-4e48-a9ac-93b40182e1b7 service nova] Acquiring lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:23.737238 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-60432713-6946-4b50-ad75-e20ba4b17071 req-dd0bd5ff-8d5f-4e48-a9ac-93b40182e1b7 service nova] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:23.737238 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-60432713-6946-4b50-ad75-e20ba4b17071 req-dd0bd5ff-8d5f-4e48-a9ac-93b40182e1b7 service nova] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:23.737238 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-60432713-6946-4b50-ad75-e20ba4b17071 req-dd0bd5ff-8d5f-4e48-a9ac-93b40182e1b7 service nova] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] No waiting events found dispatching network-vif-plugged-803c8519-51b8-4b25-8cee-11cf816398fa {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:12:23.737350 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-60432713-6946-4b50-ad75-e20ba4b17071 req-dd0bd5ff-8d5f-4e48-a9ac-93b40182e1b7 service nova] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Received unexpected event network-vif-plugged-803c8519-51b8-4b25-8cee-11cf816398fa for instance with vm_state building and task_state spawning.
May 28 01:12:23.737711 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:12:23.740861 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:12:23.744290 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Instance spawned successfully.
May 28 01:12:23.744680 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:12:24.009507 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:12:24.009716 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:12:24.054137 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:12:24.057254 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930744.0570273, 26af0b2c-7e35-4e53-85eb-71ddca16fbfa => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:12:24.057361 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] VM Resumed (Lifecycle Event)
May 28 01:12:24.249971 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:12:24.250083 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:12:24.250328 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:12:24.250524 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:12:24.250777 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:12:24.250994 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:12:24.259980 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a34be69f-56e3-416d-a3e2-47a9dbb716c1 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e4dca6bf-1591-46fa-8ade-a99fddf923a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.492s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:24.387123 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Searching for a device in session 184 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:12:24.387123 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6b89c7f5-0e8c-47f0-9195-642fca1b6067', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:12:24.512024 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:12:24.559488 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:12:24.561430 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:12:24.757497 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Took 7.16 seconds to spawn the instance on the hypervisor.
May 28 01:12:24.757660 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:12:25.019590 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.328s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:25.064162 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:12:25.091873 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Deleted allocations for instance 3d97b775-d6eb-4c8f-b951-11bcb0444adf
May 28 01:12:25.190170 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:25.234531 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Found WWN 330000000f94ccfb0 for multipath device dm-3 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:12:25.234832 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:12:25.235000 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '330000000f94ccfb0', 'path': '/dev/dm-3', 'multipath_id': '330000000f94ccfb0'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:12:25.235113 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f94ccfb0', 'path': '/dev/dm-3', 'multipath_id': '330000000f94ccfb0'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:12:25.237740 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lazy-loading 'flavor' on Instance uuid 60b7855e-1385-4a4b-89c8-f3c0f71f3959 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:12:25.268966 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Took 12.58 seconds to build instance.
May 28 01:12:25.741270 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Attempting to attach volume 6b89c7f5-0e8c-47f0-9195-642fca1b6067 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:12:25.742947 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:12:25.742947 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:12:25.742947 np0000001577 nova-compute[98319]:   <alias name="ua-6b89c7f5-0e8c-47f0-9195-642fca1b6067"/>
May 28 01:12:25.742947 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-3"/>
May 28 01:12:25.742947 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:12:25.742947 np0000001577 nova-compute[98319]:   <serial>6b89c7f5-0e8c-47f0-9195-642fca1b6067</serial>
May 28 01:12:25.742947 np0000001577 nova-compute[98319]: </disk>
May 28 01:12:25.742947 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:12:25.770274 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46dcc585-14d6-4654-ac30-c8b36f258975 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.089s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:25.858379 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7066e13f-e2cb-41ce-86f7-7aed715145f5 req-8071657e-4df7-4d3d-b865-84f4dafdb69a service nova] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Received event network-changed-803c8519-51b8-4b25-8cee-11cf816398fa {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:12:25.858636 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7066e13f-e2cb-41ce-86f7-7aed715145f5 req-8071657e-4df7-4d3d-b865-84f4dafdb69a service nova] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Refreshing instance network info cache due to event network-changed-803c8519-51b8-4b25-8cee-11cf816398fa. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:12:25.858837 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7066e13f-e2cb-41ce-86f7-7aed715145f5 req-8071657e-4df7-4d3d-b865-84f4dafdb69a service nova] Acquiring lock "refresh_cache-26af0b2c-7e35-4e53-85eb-71ddca16fbfa" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:12:25.858951 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7066e13f-e2cb-41ce-86f7-7aed715145f5 req-8071657e-4df7-4d3d-b865-84f4dafdb69a service nova] Acquired lock "refresh_cache-26af0b2c-7e35-4e53-85eb-71ddca16fbfa" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:12:25.859100 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-7066e13f-e2cb-41ce-86f7-7aed715145f5 req-8071657e-4df7-4d3d-b865-84f4dafdb69a service nova] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Refreshing network info cache for port 803c8519-51b8-4b25-8cee-11cf816398fa {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:12:25.951011 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2752d758-67d5-4161-a900-57591dd7ec96 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "e4dca6bf-1591-46fa-8ade-a99fddf923a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:25.951119 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2752d758-67d5-4161-a900-57591dd7ec96 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e4dca6bf-1591-46fa-8ade-a99fddf923a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:26.100304 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8a9995ce-f177-4648-a761-ef70d6f56f91 tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Lock "3d97b775-d6eb-4c8f-b951-11bcb0444adf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.244s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:26.363839 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-7066e13f-e2cb-41ce-86f7-7aed715145f5 req-8071657e-4df7-4d3d-b865-84f4dafdb69a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:12:26.453091 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-2752d758-67d5-4161-a900-57591dd7ec96 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Detaching volume 335404a4-ae14-42d9-aeb3-f6f69436ff1b
May 28 01:12:26.494837 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-2752d758-67d5-4161-a900-57591dd7ec96 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Attempting to driver detach volume 335404a4-ae14-42d9-aeb3-f6f69436ff1b from mountpoint /dev/vdb
May 28 01:12:26.501955 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2752d758-67d5-4161-a900-57591dd7ec96 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Found disk vdb by alias ua-335404a4-ae14-42d9-aeb3-f6f69436ff1b {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:12:26.502984 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2752d758-67d5-4161-a900-57591dd7ec96 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Found disk vdb by alias ua-335404a4-ae14-42d9-aeb3-f6f69436ff1b {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:12:26.503092 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2752d758-67d5-4161-a900-57591dd7ec96 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Attempting to detach device vdb from instance e4dca6bf-1591-46fa-8ade-a99fddf923a7 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:12:26.503292 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-2752d758-67d5-4161-a900-57591dd7ec96 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:12:26.503292 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:12:26.503292 np0000001577 nova-compute[98319]:   <alias name="ua-335404a4-ae14-42d9-aeb3-f6f69436ff1b"/>
May 28 01:12:26.503292 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 28 01:12:26.503292 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:12:26.503292 np0000001577 nova-compute[98319]:   <serial>335404a4-ae14-42d9-aeb3-f6f69436ff1b</serial>
May 28 01:12:26.503292 np0000001577 nova-compute[98319]:   <shareable/>
May 28 01:12:26.503292 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:12:26.503292 np0000001577 nova-compute[98319]: </disk>
May 28 01:12:26.503292 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:12:26.508026 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2752d758-67d5-4161-a900-57591dd7ec96 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Successfully detached device vdb from instance e4dca6bf-1591-46fa-8ade-a99fddf923a7 from the persistent domain config.
May 28 01:12:26.508142 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2752d758-67d5-4161-a900-57591dd7ec96 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] (1/8): Attempting to detach device vdb with device alias ua-335404a4-ae14-42d9-aeb3-f6f69436ff1b from instance e4dca6bf-1591-46fa-8ade-a99fddf923a7 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:12:26.508339 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-2752d758-67d5-4161-a900-57591dd7ec96 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:12:26.508339 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:12:26.508339 np0000001577 nova-compute[98319]:   <alias name="ua-335404a4-ae14-42d9-aeb3-f6f69436ff1b"/>
May 28 01:12:26.508339 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 28 01:12:26.508339 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:12:26.508339 np0000001577 nova-compute[98319]:   <serial>335404a4-ae14-42d9-aeb3-f6f69436ff1b</serial>
May 28 01:12:26.508339 np0000001577 nova-compute[98319]:   <shareable/>
May 28 01:12:26.508339 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:12:26.508339 np0000001577 nova-compute[98319]: </disk>
May 28 01:12:26.508339 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:12:26.588597 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:26.680861 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-7066e13f-e2cb-41ce-86f7-7aed715145f5 req-8071657e-4df7-4d3d-b865-84f4dafdb69a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:12:26.822922 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-7066e13f-e2cb-41ce-86f7-7aed715145f5 req-8071657e-4df7-4d3d-b865-84f4dafdb69a service nova] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Updated VIF entry in instance network info cache for port 803c8519-51b8-4b25-8cee-11cf816398fa. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:12:26.823369 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-7066e13f-e2cb-41ce-86f7-7aed715145f5 req-8071657e-4df7-4d3d-b865-84f4dafdb69a service nova] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Updating instance_info_cache with network_info: [{"id": "803c8519-51b8-4b25-8cee-11cf816398fa", "address": "fa:16:3e:4a:3d:bf", "network": {"id": "c28bd5cb-6fe6-4196-89e2-40b572ab0547", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-985170360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0e5e86340fc8435f8e3c83322ba82560", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap803c8519-51", "ovs_interfaceid": "803c8519-51b8-4b25-8cee-11cf816398fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:12:27.014877 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930747.0144796, e4dca6bf-1591-46fa-8ade-a99fddf923a7 => ua-335404a4-ae14-42d9-aeb3-f6f69436ff1b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:12:27.016031 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2752d758-67d5-4161-a900-57591dd7ec96 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-335404a4-ae14-42d9-aeb3-f6f69436ff1b for instance e4dca6bf-1591-46fa-8ade-a99fddf923a7 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:12:27.018511 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2752d758-67d5-4161-a900-57591dd7ec96 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Successfully detached device vdb from instance e4dca6bf-1591-46fa-8ade-a99fddf923a7 from the live domain config.
May 28 01:12:27.326657 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7066e13f-e2cb-41ce-86f7-7aed715145f5 req-8071657e-4df7-4d3d-b865-84f4dafdb69a service nova] Releasing lock "refresh_cache-26af0b2c-7e35-4e53-85eb-71ddca16fbfa" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:12:27.385005 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:12:27.385109 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:12:27.385189 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:12:27.385275 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] No VIF found with MAC fa:16:3e:8e:81:34, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:12:27.558390 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2752d758-67d5-4161-a900-57591dd7ec96 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Detected multiple connections on this host for volume: 335404a4-ae14-42d9-aeb3-f6f69436ff1b, skipping target disconnect.
May 28 01:12:28.115172 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-2752d758-67d5-4161-a900-57591dd7ec96 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lazy-loading 'flavor' on Instance uuid e4dca6bf-1591-46fa-8ade-a99fddf923a7 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:12:28.230644 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:28.614206 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "14694771-0e2d-420f-8b96-7bd28ffcf4c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:28.614379 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "14694771-0e2d-420f-8b96-7bd28ffcf4c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:28.932879 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-966a3ef7-2b46-48e4-9940-4d0e76f7afae tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.417s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:29.127188 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2752d758-67d5-4161-a900-57591dd7ec96 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e4dca6bf-1591-46fa-8ade-a99fddf923a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.176s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:29.128150 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:12:29.172742 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "e4dca6bf-1591-46fa-8ade-a99fddf923a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:29.172906 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e4dca6bf-1591-46fa-8ade-a99fddf923a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:29.173101 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "e4dca6bf-1591-46fa-8ade-a99fddf923a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:29.173243 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e4dca6bf-1591-46fa-8ade-a99fddf923a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:29.173310 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e4dca6bf-1591-46fa-8ade-a99fddf923a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:29.175932 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Terminating instance
May 28 01:12:29.490846 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:29.677677 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:29.677857 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:29.682130 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:12:29.682272 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Claim successful on node np0000001577
May 28 01:12:29.684331 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:12:29.716648 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:29.719016 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:29.741716 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:29.891614 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:29.897663 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:29.928232 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-29751539-fa89-43ee-a9f1-f76aa6f9a189 req-013258f7-b707-432e-93a9-8ad0be7c8c74 service nova] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Received event network-vif-unplugged-7117ae99-9818-42a9-9110-9bf8e26c3a34 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:12:29.928636 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-29751539-fa89-43ee-a9f1-f76aa6f9a189 req-013258f7-b707-432e-93a9-8ad0be7c8c74 service nova] Acquiring lock "e4dca6bf-1591-46fa-8ade-a99fddf923a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:29.928801 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-29751539-fa89-43ee-a9f1-f76aa6f9a189 req-013258f7-b707-432e-93a9-8ad0be7c8c74 service nova] Lock "e4dca6bf-1591-46fa-8ade-a99fddf923a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:29.928934 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-29751539-fa89-43ee-a9f1-f76aa6f9a189 req-013258f7-b707-432e-93a9-8ad0be7c8c74 service nova] Lock "e4dca6bf-1591-46fa-8ade-a99fddf923a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:29.929035 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-29751539-fa89-43ee-a9f1-f76aa6f9a189 req-013258f7-b707-432e-93a9-8ad0be7c8c74 service nova] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] No waiting events found dispatching network-vif-unplugged-7117ae99-9818-42a9-9110-9bf8e26c3a34 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:12:29.929132 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-29751539-fa89-43ee-a9f1-f76aa6f9a189 req-013258f7-b707-432e-93a9-8ad0be7c8c74 service nova] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Received event network-vif-unplugged-7117ae99-9818-42a9-9110-9bf8e26c3a34 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:12:29.987916 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:29.994197 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:30.014327 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999755565999749 future=<Future at 0x7c988c035e50 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:12:30.018591 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Instance destroyed successfully.
May 28 01:12:30.019478 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lazy-loading 'resources' on Instance uuid e4dca6bf-1591-46fa-8ade-a99fddf923a7 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:12:30.190851 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:30.523498 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:11:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-382052642',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumemultiattachtests-server-382052642',id=67,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZPR0Gj39BZcWrRlU1NY4uwBiAIpfhz5q66W9RrzOpiQ/np/JXsGVyBJNTTO+6yHZcqzSOevY1HNVzn2A/GM7sX1gKgxLatKq6sG+HtO56znleQjhIEua31xTu77Jqhlg==',key_name='tempest-keypair-2138912526',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:11:36Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07f3bdd3aef04045aac40e4b851915e1',ramdisk_id='',reservation_id='r-0njxzlyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-1632400240',owner_user_name='tempest-VolumeMultiattachTests-1632400240-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:11:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ae6af3cf5df464bbc9da74d825ddb4e',uuid=e4dca6bf-1591-46fa-8ade-a99fddf923a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7117ae99-9818-42a9-9110-9bf8e26c3a34", "address": "fa:16:3e:42:89:5e", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7117ae99-98", "ovs_interfaceid": "7117ae99-9818-42a9-9110-9bf8e26c3a34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:12:30.523725 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Converting VIF {"id": "7117ae99-9818-42a9-9110-9bf8e26c3a34", "address": "fa:16:3e:42:89:5e", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7117ae99-98", "ovs_interfaceid": "7117ae99-9818-42a9-9110-9bf8e26c3a34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:12:30.524389 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:89:5e,bridge_name='br-int',has_traffic_filtering=True,id=7117ae99-9818-42a9-9110-9bf8e26c3a34,network=Network(7357480b-2ba7-465c-88fe-aaf2e8f7a673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7117ae99-98') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:12:30.524699 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:89:5e,bridge_name='br-int',has_traffic_filtering=True,id=7117ae99-9818-42a9-9110-9bf8e26c3a34,network=Network(7357480b-2ba7-465c-88fe-aaf2e8f7a673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7117ae99-98') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:12:30.526447 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:30.526447 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7117ae99-98, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:12:30.528442 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:30.529389 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:12:30.530007 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:30.530127 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=21ce1f61-e9d2-43bc-b1d8-3e470cacb97d) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:12:30.530587 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:30.531088 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:12:30.532334 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:30.533323 np0000001577 nova-compute[98319]: INFO os_vif [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:89:5e,bridge_name='br-int',has_traffic_filtering=True,id=7117ae99-9818-42a9-9110-9bf8e26c3a34,network=Network(7357480b-2ba7-465c-88fe-aaf2e8f7a673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7117ae99-98')
May 28 01:12:30.571626 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:12:30.571925 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b', 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '335404a4-ae14-42d9-aeb3-f6f69436ff1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:12:30.572046 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:12:30.572339 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:12:30.572627 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b', 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '335404a4-ae14-42d9-aeb3-f6f69436ff1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:12:30.572744 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:12:30.604019 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:30.604019 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:30.604019 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:30.604019 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:30.604019 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:30.604019 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:30.604019 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:30.604019 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:30.604019 np0000001577 nova-compute[98319]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:30.604019 np0000001577 nova-compute[98319]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:30.604019 np0000001577 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:12:30.604019 np0000001577 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:12:30.604019 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:12:30.604452 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:30.604452 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:12:30.604452 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:30.604452 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:12:30.604452 np0000001577 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:30.604452 np0000001577 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b (non-flash)
May 28 01:12:30.604452 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:30.604452 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:12:30.604452 np0000001577 nova-compute[98319]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:30.604452 np0000001577 nova-compute[98319]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:12:30.604452 np0000001577 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:12:30.604452 np0000001577 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:12:30.604452 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:12:30.604452 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', '164'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', '165'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', '169'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', '170'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b', '172'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b', '173'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067', '183'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067', '184')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:12:30.604452 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b', '172')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:12:30.605428 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b', '173')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:12:30.606368 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c988c01c860>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b'): ({'sde'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:12:30.606567 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Removing multipathed devices sde, sdd {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:12:30.606801 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Flush multipath device 330000000cd1c3072 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:12:31.025777 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "a8238177-e440-46c2-a71e-2920d023a9ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:31.026218 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "a8238177-e440-46c2-a71e-2920d023a9ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:31.081725 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:12:31.081931 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:12:31.433694 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:31.529673 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:12:31.585832 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:12:31.595343 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:31.761571 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-43270b2d-f90f-4bcd-81ad-2ac4becd76af req-ef326c85-3e87-4625-9637-b535d2d1b6e1 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Received event network-changed-89446e5b-c447-4a2c-b547-03a71d82747b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:12:31.761571 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-43270b2d-f90f-4bcd-81ad-2ac4becd76af req-ef326c85-3e87-4625-9637-b535d2d1b6e1 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Refreshing instance network info cache due to event network-changed-89446e5b-c447-4a2c-b547-03a71d82747b. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:12:31.761571 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-43270b2d-f90f-4bcd-81ad-2ac4becd76af req-ef326c85-3e87-4625-9637-b535d2d1b6e1 service nova] Acquiring lock "refresh_cache-4edb886b-df1e-42fd-9881-91fc07339c3f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:12:31.761571 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-43270b2d-f90f-4bcd-81ad-2ac4becd76af req-ef326c85-3e87-4625-9637-b535d2d1b6e1 service nova] Acquired lock "refresh_cache-4edb886b-df1e-42fd-9881-91fc07339c3f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:12:31.761571 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-43270b2d-f90f-4bcd-81ad-2ac4becd76af req-ef326c85-3e87-4625-9637-b535d2d1b6e1 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Refreshing network info cache for port 89446e5b-c447-4a2c-b547-03a71d82747b {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:12:31.995387 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c80f5b4e-359f-42fe-b2a6-daba57e0e612 req-39bacce1-cb6f-46b5-98ec-4d0ddfcd255f service nova] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Received event network-vif-unplugged-7117ae99-9818-42a9-9110-9bf8e26c3a34 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:12:31.995842 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c80f5b4e-359f-42fe-b2a6-daba57e0e612 req-39bacce1-cb6f-46b5-98ec-4d0ddfcd255f service nova] Acquiring lock "e4dca6bf-1591-46fa-8ade-a99fddf923a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:31.996004 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c80f5b4e-359f-42fe-b2a6-daba57e0e612 req-39bacce1-cb6f-46b5-98ec-4d0ddfcd255f service nova] Lock "e4dca6bf-1591-46fa-8ade-a99fddf923a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:31.996126 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c80f5b4e-359f-42fe-b2a6-daba57e0e612 req-39bacce1-cb6f-46b5-98ec-4d0ddfcd255f service nova] Lock "e4dca6bf-1591-46fa-8ade-a99fddf923a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:31.996235 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c80f5b4e-359f-42fe-b2a6-daba57e0e612 req-39bacce1-cb6f-46b5-98ec-4d0ddfcd255f service nova] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] No waiting events found dispatching network-vif-unplugged-7117ae99-9818-42a9-9110-9bf8e26c3a34 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:12:31.997244 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c80f5b4e-359f-42fe-b2a6-daba57e0e612 req-39bacce1-cb6f-46b5-98ec-4d0ddfcd255f service nova] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Received event network-vif-unplugged-7117ae99-9818-42a9-9110-9bf8e26c3a34 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:12:31.997244 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c80f5b4e-359f-42fe-b2a6-daba57e0e612 req-39bacce1-cb6f-46b5-98ec-4d0ddfcd255f service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Received event network-changed-89446e5b-c447-4a2c-b547-03a71d82747b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:12:31.997244 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c80f5b4e-359f-42fe-b2a6-daba57e0e612 req-39bacce1-cb6f-46b5-98ec-4d0ddfcd255f service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Refreshing instance network info cache due to event network-changed-89446e5b-c447-4a2c-b547-03a71d82747b. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:12:31.997244 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c80f5b4e-359f-42fe-b2a6-daba57e0e612 req-39bacce1-cb6f-46b5-98ec-4d0ddfcd255f service nova] Acquiring lock "refresh_cache-4edb886b-df1e-42fd-9881-91fc07339c3f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:12:32.091310 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:32.099087 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.421s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:32.099396 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.008s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:32.099542 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:12:32.104760 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:12:32.107564 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Claim successful on node np0000001577
May 28 01:12:32.262357 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-43270b2d-f90f-4bcd-81ad-2ac4becd76af req-ef326c85-3e87-4625-9637-b535d2d1b6e1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:12:32.362630 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "4edb886b-df1e-42fd-9881-91fc07339c3f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:32.363460 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "4edb886b-df1e-42fd-9881-91fc07339c3f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:32.559983 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-43270b2d-f90f-4bcd-81ad-2ac4becd76af req-ef326c85-3e87-4625-9637-b535d2d1b6e1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:12:32.606239 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:12:32.607657 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:12:32.607919 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:12:32.608112 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:12:32.693425 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae6c3c6a50b24a58af140f523fb73374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1880a27e1ad0432f914e086d7fffdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:12:32.701575 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-43270b2d-f90f-4bcd-81ad-2ac4becd76af req-ef326c85-3e87-4625-9637-b535d2d1b6e1 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Updated VIF entry in instance network info cache for port 89446e5b-c447-4a2c-b547-03a71d82747b. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:12:32.701911 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-43270b2d-f90f-4bcd-81ad-2ac4becd76af req-ef326c85-3e87-4625-9637-b535d2d1b6e1 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Updating instance_info_cache with network_info: [{"id": "89446e5b-c447-4a2c-b547-03a71d82747b", "address": "fa:16:3e:fa:00:1f", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89446e5b-c4", "ovs_interfaceid": "89446e5b-c447-4a2c-b547-03a71d82747b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:12:32.864978 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Detaching volume f4367fd6-1652-4af4-a6b7-b55a2f5e737b
May 28 01:12:32.901319 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Attempting to driver detach volume f4367fd6-1652-4af4-a6b7-b55a2f5e737b from mountpoint /dev/vdb
May 28 01:12:32.908586 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Found disk vdb by alias ua-f4367fd6-1652-4af4-a6b7-b55a2f5e737b {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:12:32.909885 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Found disk vdb by alias ua-f4367fd6-1652-4af4-a6b7-b55a2f5e737b {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:12:32.909999 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Attempting to detach device vdb from instance 4edb886b-df1e-42fd-9881-91fc07339c3f from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:12:32.910186 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:12:32.910186 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:12:32.910186 np0000001577 nova-compute[98319]:   <alias name="ua-f4367fd6-1652-4af4-a6b7-b55a2f5e737b"/>
May 28 01:12:32.910186 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 28 01:12:32.910186 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:12:32.910186 np0000001577 nova-compute[98319]:   <serial>f4367fd6-1652-4af4-a6b7-b55a2f5e737b</serial>
May 28 01:12:32.910186 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 01:12:32.910186 np0000001577 nova-compute[98319]: </disk>
May 28 01:12:32.910186 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:12:32.916606 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Successfully detached device vdb from instance 4edb886b-df1e-42fd-9881-91fc07339c3f from the persistent domain config.
May 28 01:12:32.916693 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] (1/8): Attempting to detach device vdb with device alias ua-f4367fd6-1652-4af4-a6b7-b55a2f5e737b from instance 4edb886b-df1e-42fd-9881-91fc07339c3f from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:12:32.916901 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:12:32.916901 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:12:32.916901 np0000001577 nova-compute[98319]:   <alias name="ua-f4367fd6-1652-4af4-a6b7-b55a2f5e737b"/>
May 28 01:12:32.916901 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 28 01:12:32.916901 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:12:32.916901 np0000001577 nova-compute[98319]:   <serial>f4367fd6-1652-4af4-a6b7-b55a2f5e737b</serial>
May 28 01:12:32.916901 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 01:12:32.916901 np0000001577 nova-compute[98319]: </disk>
May 28 01:12:32.916901 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:12:33.112967 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:12:33.157573 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Successfully created port: 26c13825-b801-4d7c-ad2d-62db205cea2d {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:12:33.203794 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-43270b2d-f90f-4bcd-81ad-2ac4becd76af req-ef326c85-3e87-4625-9637-b535d2d1b6e1 service nova] Releasing lock "refresh_cache-4edb886b-df1e-42fd-9881-91fc07339c3f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:12:33.204228 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c80f5b4e-359f-42fe-b2a6-daba57e0e612 req-39bacce1-cb6f-46b5-98ec-4d0ddfcd255f service nova] Acquired lock "refresh_cache-4edb886b-df1e-42fd-9881-91fc07339c3f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:12:33.204388 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-c80f5b4e-359f-42fe-b2a6-daba57e0e612 req-39bacce1-cb6f-46b5-98ec-4d0ddfcd255f service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Refreshing network info cache for port 89446e5b-c447-4a2c-b547-03a71d82747b {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:12:33.458919 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930753.4586244, 4edb886b-df1e-42fd-9881-91fc07339c3f => ua-f4367fd6-1652-4af4-a6b7-b55a2f5e737b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:12:33.460615 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-f4367fd6-1652-4af4-a6b7-b55a2f5e737b for instance 4edb886b-df1e-42fd-9881-91fc07339c3f {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:12:33.464373 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Successfully detached device vdb from instance 4edb886b-df1e-42fd-9881-91fc07339c3f from the live domain config.
May 28 01:12:33.465596 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:12:33.465951 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:12:33.466129 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:12:33.568676 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:12:33.569070 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:12:33.620234 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:12:33.705930 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Successfully updated port: 26c13825-b801-4d7c-ad2d-62db205cea2d {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:12:33.707557 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-c80f5b4e-359f-42fe-b2a6-daba57e0e612 req-39bacce1-cb6f-46b5-98ec-4d0ddfcd255f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:12:33.833537 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-eacff62a-e0d9-4f4a-ad2c-0fe308d9840b req-1b90da51-ce57-48c7-b635-6c7c26e1e83a service nova] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Received event network-changed-26c13825-b801-4d7c-ad2d-62db205cea2d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:12:33.833744 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-eacff62a-e0d9-4f4a-ad2c-0fe308d9840b req-1b90da51-ce57-48c7-b635-6c7c26e1e83a service nova] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Refreshing instance network info cache due to event network-changed-26c13825-b801-4d7c-ad2d-62db205cea2d. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:12:33.834100 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-eacff62a-e0d9-4f4a-ad2c-0fe308d9840b req-1b90da51-ce57-48c7-b635-6c7c26e1e83a service nova] Acquiring lock "refresh_cache-14694771-0e2d-420f-8b96-7bd28ffcf4c2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:12:33.834578 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-eacff62a-e0d9-4f4a-ad2c-0fe308d9840b req-1b90da51-ce57-48c7-b635-6c7c26e1e83a service nova] Acquired lock "refresh_cache-14694771-0e2d-420f-8b96-7bd28ffcf4c2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:12:33.834854 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-eacff62a-e0d9-4f4a-ad2c-0fe308d9840b req-1b90da51-ce57-48c7-b635-6c7c26e1e83a service nova] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Refreshing network info cache for port 26c13825-b801-4d7c-ad2d-62db205cea2d {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:12:33.998965 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-c80f5b4e-359f-42fe-b2a6-daba57e0e612 req-39bacce1-cb6f-46b5-98ec-4d0ddfcd255f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:12:34.071525 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:12:34.112830 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-c80f5b4e-359f-42fe-b2a6-daba57e0e612 req-39bacce1-cb6f-46b5-98ec-4d0ddfcd255f service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Updated VIF entry in instance network info cache for port 89446e5b-c447-4a2c-b547-03a71d82747b. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:12:34.113056 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-c80f5b4e-359f-42fe-b2a6-daba57e0e612 req-39bacce1-cb6f-46b5-98ec-4d0ddfcd255f service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Updating instance_info_cache with network_info: [{"id": "89446e5b-c447-4a2c-b547-03a71d82747b", "address": "fa:16:3e:fa:00:1f", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89446e5b-c4", "ovs_interfaceid": "89446e5b-c447-4a2c-b547-03a71d82747b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:12:34.124004 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Booting with volume 9a753a23-1f81-48d4-8c7a-9eada0c1cc1e at /dev/vda
May 28 01:12:34.157748 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:12:34.169210 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:12:34.188057 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:12:34.212154 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "refresh_cache-14694771-0e2d-420f-8b96-7bd28ffcf4c2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:12:34.230791 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:12:34.231710 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:12:34.238729 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:12:34.239942 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe65:fa89', 'fe80::583c:47ff:fea3:281d', 'fe80::fc16:3eff:fe8e:8134', 'fe80::c813:dcff:fe9e:6381', 'fe80::fc16:3eff:feb6:e662', 'fe80::1cf4:68ff:fe80:cb5', 'fe80::fc16:3eff:fefa:1f', 'fe80::d820:d3ff:fe1f:ca6e', 'fe80::fc16:3eff:fe4a:3dbf', 'fe80::4416:94ff:febb:9b7b'] 
May 28 01:12:34.240093 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:12:34.240219 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:12:34.240713 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] <== get_connector_properties: return (82ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:12:34.240960 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Updating existing volume attachment record: 3826c541-90b4-4255-8b2e-bedd21391cca {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:12:34.336668 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-eacff62a-e0d9-4f4a-ad2c-0fe308d9840b req-1b90da51-ce57-48c7-b635-6c7c26e1e83a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:12:34.389601 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-eacff62a-e0d9-4f4a-ad2c-0fe308d9840b req-1b90da51-ce57-48c7-b635-6c7c26e1e83a service nova] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:12:34.502788 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-eacff62a-e0d9-4f4a-ad2c-0fe308d9840b req-1b90da51-ce57-48c7-b635-6c7c26e1e83a service nova] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:12:34.579508 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.480s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:34.579929 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:12:34.614925 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c80f5b4e-359f-42fe-b2a6-daba57e0e612 req-39bacce1-cb6f-46b5-98ec-4d0ddfcd255f service nova] Releasing lock "refresh_cache-4edb886b-df1e-42fd-9881-91fc07339c3f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:12:34.670780 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0005668819999300467 future=<Future at 0x7c984c5ca5d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:12:34.671223 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Emitting event <LifecycleEvent: 1779930739.6700838, 3d97b775-d6eb-4c8f-b951-11bcb0444adf => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:12:34.671383 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:12:34.671594 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] VM Stopped (Lifecycle Event)
May 28 01:12:34.672836 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=10.341239349999796 future=<Future at 0x7c988c035e50 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:12:34.673500 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=10.34054944699983 future=<Future at 0x7c988c035e50 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:12:35.004997 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-eacff62a-e0d9-4f4a-ad2c-0fe308d9840b req-1b90da51-ce57-48c7-b635-6c7c26e1e83a service nova] Releasing lock "refresh_cache-14694771-0e2d-420f-8b96-7bd28ffcf4c2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:12:35.005402 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquired lock "refresh_cache-14694771-0e2d-420f-8b96-7bd28ffcf4c2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:12:35.005591 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:12:35.087535 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:12:35.087535 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:12:35.087535 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:12:35.087535 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:12:35.146507 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96f4ee9375c440d6abf68f2aa230b0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6ee814419446dcb5025c68fb0f4ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:12:35.174462 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 3d97b775-d6eb-4c8f-b951-11bcb0444adf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:12:35.531820 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:35.566624 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:12:35.572742 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Successfully created port: 57fd91a3-455a-4f47-9966-6b70f2fa6e8d {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:12:35.588561 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:12:35.717221 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:12:35.834711 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Updating instance_info_cache with network_info: [{"id": "26c13825-b801-4d7c-ad2d-62db205cea2d", "address": "fa:16:3e:04:7d:17", "network": {"id": "0be6df83-bfa0-4c90-aed3-88212317cb4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-252451076-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1880a27e1ad0432f914e086d7fffdeb4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c13825-b8", "ovs_interfaceid": "26c13825-b801-4d7c-ad2d-62db205cea2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:12:36.049605 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Successfully updated port: 57fd91a3-455a-4f47-9966-6b70f2fa6e8d {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:12:36.093853 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:12:36.153797 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a3e9769d-6c85-4040-aeb5-7862adeb681c req-0c1b1db3-5a27-4def-99a9-8f1e74843650 service nova] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Received event network-changed-57fd91a3-455a-4f47-9966-6b70f2fa6e8d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:12:36.153912 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a3e9769d-6c85-4040-aeb5-7862adeb681c req-0c1b1db3-5a27-4def-99a9-8f1e74843650 service nova] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Refreshing instance network info cache due to event network-changed-57fd91a3-455a-4f47-9966-6b70f2fa6e8d. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:12:36.154083 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a3e9769d-6c85-4040-aeb5-7862adeb681c req-0c1b1db3-5a27-4def-99a9-8f1e74843650 service nova] Acquiring lock "refresh_cache-a8238177-e440-46c2-a71e-2920d023a9ce" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:12:36.154169 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a3e9769d-6c85-4040-aeb5-7862adeb681c req-0c1b1db3-5a27-4def-99a9-8f1e74843650 service nova] Acquired lock "refresh_cache-a8238177-e440-46c2-a71e-2920d023a9ce" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:12:36.154259 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-a3e9769d-6c85-4040-aeb5-7862adeb681c req-0c1b1db3-5a27-4def-99a9-8f1e74843650 service nova] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Refreshing network info cache for port 57fd91a3-455a-4f47-9966-6b70f2fa6e8d {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:12:36.332170 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:12:36.332989 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:12:36.333209 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Creating image(s)
May 28 01:12:36.333465 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:12:36.333604 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Ensure instance console log exists: /opt/stack/data/nova/instances/14694771-0e2d-420f-8b96-7bd28ffcf4c2/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:12:36.333807 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:36.333966 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:36.334076 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:36.335132 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Releasing lock "refresh_cache-14694771-0e2d-420f-8b96-7bd28ffcf4c2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:12:36.335340 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Instance network_info: |[{"id": "26c13825-b801-4d7c-ad2d-62db205cea2d", "address": "fa:16:3e:04:7d:17", "network": {"id": "0be6df83-bfa0-4c90-aed3-88212317cb4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-252451076-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1880a27e1ad0432f914e086d7fffdeb4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c13825-b8", "ovs_interfaceid": "26c13825-b801-4d7c-ad2d-62db205cea2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:12:36.335803 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Start _get_guest_xml network_info=[{"id": "26c13825-b801-4d7c-ad2d-62db205cea2d", "address": "fa:16:3e:04:7d:17", "network": {"id": "0be6df83-bfa0-4c90-aed3-88212317cb4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-252451076-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1880a27e1ad0432f914e086d7fffdeb4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c13825-b8", "ovs_interfaceid": "26c13825-b801-4d7c-ad2d-62db205cea2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '14694771-0e2d-420f-8b96-7bd28ffcf4c2', 'attached_at': '', 'detached_at': '', 'volume_id': '9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', 'serial': '9a753a23-1f81-48d4-8c7a-9eada0c1cc1e'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '3826c541-90b4-4255-8b2e-bedd21391cca', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:12:36.338033 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:12:36.338903 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-450528518', uuid='14694771-0e2d-420f-8b96-7bd28ffcf4c2'), owner=OwnerMeta(userid='ae6c3c6a50b24a58af140f523fb73374', username='tempest-TestVolumeBootPatternV346-1741753090-project-member', projectid='1880a27e1ad0432f914e086d7fffdeb4', projectname='tempest-TestVolumeBootPatternV346-1741753090'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "26c13825-b801-4d7c-ad2d-62db205cea2d", "address": "fa:16:3e:04:7d:17", "network": {"id": "0be6df83-bfa0-4c90-aed3-88212317cb4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-252451076-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1880a27e1ad0432f914e086d7fffdeb4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c13825-b8", "ovs_interfaceid": "26c13825-b801-4d7c-ad2d-62db205cea2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930756.3386319) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:12:36.339769 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:12:36.340061 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:12:36.340817 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:12:36.340977 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:12:36.341695 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:12:36.341942 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:12:36.342073 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:12:36.342160 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:12:36.342270 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:12:36.342344 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:12:36.342428 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:12:36.342572 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:12:36.342676 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:12:36.342774 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:12:36.342879 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:12:36.342995 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:12:36.351919 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:12:36.352158 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:12:36.352269 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:12:36.550622 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "refresh_cache-a8238177-e440-46c2-a71e-2920d023a9ce" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:12:36.592381 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:36.659066 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-a3e9769d-6c85-4040-aeb5-7862adeb681c req-0c1b1db3-5a27-4def-99a9-8f1e74843650 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:12:36.729817 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-a3e9769d-6c85-4040-aeb5-7862adeb681c req-0c1b1db3-5a27-4def-99a9-8f1e74843650 service nova] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:12:36.848756 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-a3e9769d-6c85-4040-aeb5-7862adeb681c req-0c1b1db3-5a27-4def-99a9-8f1e74843650 service nova] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:12:37.103259 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:12:37.103984 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:12:37.104185 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Creating image(s)
May 28 01:12:37.104589 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8238177-e440-46c2-a71e-2920d023a9ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:37.104747 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "/opt/stack/data/nova/instances/a8238177-e440-46c2-a71e-2920d023a9ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:37.105141 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "/opt/stack/data/nova/instances/a8238177-e440-46c2-a71e-2920d023a9ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:37.105616 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:12:37.108126 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:12:37.109069 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:12:37.195568 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:12:37.195989 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:37.196427 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:37.196868 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:12:37.199298 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:12:37.199564 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:12:37.293303 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.093s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:12:37.293723 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/a8238177-e440-46c2-a71e-2920d023a9ce/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:12:37.350004 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/a8238177-e440-46c2-a71e-2920d023a9ce/disk 1073741824" returned: 0 in 0.056s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:12:37.353482 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a3e9769d-6c85-4040-aeb5-7862adeb681c req-0c1b1db3-5a27-4def-99a9-8f1e74843650 service nova] Releasing lock "refresh_cache-a8238177-e440-46c2-a71e-2920d023a9ce" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:12:37.354220 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.157s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:37.354437 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquired lock "refresh_cache-a8238177-e440-46c2-a71e-2920d023a9ce" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:12:37.354683 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:12:37.356014 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:12:37.455117 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.099s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:12:37.455532 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8238177-e440-46c2-a71e-2920d023a9ce/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:12:37.455827 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8238177-e440-46c2-a71e-2920d023a9ce/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:12:37.560294 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8238177-e440-46c2-a71e-2920d023a9ce/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:12:37.560682 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Cannot resize image /opt/stack/data/nova/instances/a8238177-e440-46c2-a71e-2920d023a9ce/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:12:37.561042 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:12:37.561196 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Ensure instance console log exists: /opt/stack/data/nova/instances/a8238177-e440-46c2-a71e-2920d023a9ce/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:12:37.561503 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:37.561733 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:37.561855 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:37.931331 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:12:38.059269 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:12:38.169593 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Updating instance_info_cache with network_info: [{"id": "57fd91a3-455a-4f47-9966-6b70f2fa6e8d", "address": "fa:16:3e:4f:6f:bc", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57fd91a3-45", "ovs_interfaceid": "57fd91a3-455a-4f47-9966-6b70f2fa6e8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:12:38.671236 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Releasing lock "refresh_cache-a8238177-e440-46c2-a71e-2920d023a9ce" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:12:38.671236 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Instance network_info: |[{"id": "57fd91a3-455a-4f47-9966-6b70f2fa6e8d", "address": "fa:16:3e:4f:6f:bc", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57fd91a3-45", "ovs_interfaceid": "57fd91a3-455a-4f47-9966-6b70f2fa6e8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:12:38.672931 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Start _get_guest_xml network_info=[{"id": "57fd91a3-455a-4f47-9966-6b70f2fa6e8d", "address": "fa:16:3e:4f:6f:bc", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57fd91a3-45", "ovs_interfaceid": "57fd91a3-455a-4f47-9966-6b70f2fa6e8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:12:38.677091 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:12:38.678250 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-20848501', uuid='a8238177-e440-46c2-a71e-2920d023a9ce'), owner=OwnerMeta(userid='96f4ee9375c440d6abf68f2aa230b0c5', username='tempest-AttachVolumeNegativeTest-1272396699-project-member', projectid='1d6ee814419446dcb5025c68fb0f4ce9', projectname='tempest-AttachVolumeNegativeTest-1272396699'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "57fd91a3-455a-4f47-9966-6b70f2fa6e8d", "address": "fa:16:3e:4f:6f:bc", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57fd91a3-45", "ovs_interfaceid": "57fd91a3-455a-4f47-9966-6b70f2fa6e8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930758.677913) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:12:38.679220 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:12:38.679617 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:12:38.680441 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:12:38.680624 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:12:38.681453 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:12:38.681774 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:12:38.681911 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:12:38.681995 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:12:38.682113 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:12:38.682194 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:12:38.682280 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:12:38.682428 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:12:38.682520 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:12:38.682655 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:12:38.682776 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:12:38.682890 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:12:38.692724 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:12:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-20848501',display_name='tempest-AttachVolumeNegativeTest-server-20848501',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumenegativetest-server-20848501',id=73,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7qkbljm0GARSz2o4HBvg3yX1Lr+z7iitOPvaW4rdCn3oKGlM0efBso+KkQ5fByFBpTekl+ZNC6M7ACovRaW+i37X8FjTGQ1ZsyZnfMus6DHbdCmkHmE2Q3w2QW+INcVw==',key_name='tempest-keypair-689322827',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d6ee814419446dcb5025c68fb0f4ce9',ramdisk_id='',reservation_id='r-uhgu30tc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1272396699',owner_user_name='tempest-AttachVolumeNegativeTest-1272396699-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:12:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f4ee9375c440d6abf68f2aa230b0c5',uuid=a8238177-e440-46c2-a71e-2920d023a9ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57fd91a3-455a-4f47-9966-6b70f2fa6e8d", "address": "fa:16:3e:4f:6f:bc", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57fd91a3-45", "ovs_interfaceid": "57fd91a3-455a-4f47-9966-6b70f2fa6e8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:12:38.692889 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Converting VIF {"id": "57fd91a3-455a-4f47-9966-6b70f2fa6e8d", "address": "fa:16:3e:4f:6f:bc", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57fd91a3-45", "ovs_interfaceid": "57fd91a3-455a-4f47-9966-6b70f2fa6e8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:12:38.693405 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6f:bc,bridge_name='br-int',has_traffic_filtering=True,id=57fd91a3-455a-4f47-9966-6b70f2fa6e8d,network=Network(f8ce4f22-7484-451c-b0df-2e7318e070f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57fd91a3-45') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:12:38.694215 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lazy-loading 'pci_devices' on Instance uuid a8238177-e440-46c2-a71e-2920d023a9ce {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:12:39.196687 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] End _get_guest_xml xml=<domain type="qemu">
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:   <uuid>a8238177-e440-46c2-a71e-2920d023a9ce</uuid>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:   <name>instance-00000049</name>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       <nova:name>tempest-AttachVolumeNegativeTest-server-20848501</nova:name>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:12:38</nova:creationTime>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:         <nova:user uuid="96f4ee9375c440d6abf68f2aa230b0c5">tempest-AttachVolumeNegativeTest-1272396699-project-member</nova:user>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:         <nova:project uuid="1d6ee814419446dcb5025c68fb0f4ce9">tempest-AttachVolumeNegativeTest-1272396699</nova:project>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:         <nova:port uuid="57fd91a3-455a-4f47-9966-6b70f2fa6e8d">
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:     <system>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       <entry name="serial">a8238177-e440-46c2-a71e-2920d023a9ce</entry>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       <entry name="uuid">a8238177-e440-46c2-a71e-2920d023a9ce</entry>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:     </system>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:   <os>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:   </os>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:   <features>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:   </features>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:   <devices>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/a8238177-e440-46c2-a71e-2920d023a9ce/disk"/>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:     </disk>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/a8238177-e440-46c2-a71e-2920d023a9ce/disk.config"/>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:     </disk>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:4f:6f:bc"/>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       <target dev="tap57fd91a3-45"/>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:     </interface>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/a8238177-e440-46c2-a71e-2920d023a9ce/console.log" append="off"/>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:     </serial>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:     <video>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:     </video>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:     </rng>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:   </devices>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]: </domain>
May 28 01:12:39.196687 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:12:39.199084 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Preparing to wait for external event network-vif-plugged-57fd91a3-455a-4f47-9966-6b70f2fa6e8d {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:12:39.199084 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "a8238177-e440-46c2-a71e-2920d023a9ce-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:39.199084 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "a8238177-e440-46c2-a71e-2920d023a9ce-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:39.199084 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "a8238177-e440-46c2-a71e-2920d023a9ce-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:39.199084 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:12:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-20848501',display_name='tempest-AttachVolumeNegativeTest-server-20848501',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumenegativetest-server-20848501',id=73,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7qkbljm0GARSz2o4HBvg3yX1Lr+z7iitOPvaW4rdCn3oKGlM0efBso+KkQ5fByFBpTekl+ZNC6M7ACovRaW+i37X8FjTGQ1ZsyZnfMus6DHbdCmkHmE2Q3w2QW+INcVw==',key_name='tempest-keypair-689322827',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d6ee814419446dcb5025c68fb0f4ce9',ramdisk_id='',reservation_id='r-uhgu30tc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1272396699',owner_user_name='tempest-AttachVolumeNegativeTest-1272396699-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:12:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f4ee9375c440d6abf68f2aa230b0c5',uuid=a8238177-e440-46c2-a71e-2920d023a9ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57fd91a3-455a-4f47-9966-6b70f2fa6e8d", "address": "fa:16:3e:4f:6f:bc", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57fd91a3-45", "ovs_interfaceid": "57fd91a3-455a-4f47-9966-6b70f2fa6e8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:12:39.199084 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Converting VIF {"id": "57fd91a3-455a-4f47-9966-6b70f2fa6e8d", "address": "fa:16:3e:4f:6f:bc", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57fd91a3-45", "ovs_interfaceid": "57fd91a3-455a-4f47-9966-6b70f2fa6e8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:12:39.199084 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6f:bc,bridge_name='br-int',has_traffic_filtering=True,id=57fd91a3-455a-4f47-9966-6b70f2fa6e8d,network=Network(f8ce4f22-7484-451c-b0df-2e7318e070f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57fd91a3-45') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:12:39.199084 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6f:bc,bridge_name='br-int',has_traffic_filtering=True,id=57fd91a3-455a-4f47-9966-6b70f2fa6e8d,network=Network(f8ce4f22-7484-451c-b0df-2e7318e070f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57fd91a3-45') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:12:39.201073 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:39.201073 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:12:39.201073 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:12:39.202213 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:39.202213 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '12cc9635-25ee-5953-a9e9-bfec441a8b30', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:12:39.203832 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:39.204802 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:12:39.207475 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:39.207475 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57fd91a3-45, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:12:39.207475 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap57fd91a3-45, col_values=(('qos', UUID('dee6eff7-d47b-43c5-af27-c920b0237453')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:12:39.207475 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap57fd91a3-45, col_values=(('external_ids', {'iface-id': '57fd91a3-455a-4f47-9966-6b70f2fa6e8d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:6f:bc', 'vm-uuid': 'a8238177-e440-46c2-a71e-2920d023a9ce'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:12:39.208011 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:39.209616 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:12:39.213676 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:39.214503 np0000001577 nova-compute[98319]: INFO os_vif [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6f:bc,bridge_name='br-int',has_traffic_filtering=True,id=57fd91a3-455a-4f47-9966-6b70f2fa6e8d,network=Network(f8ce4f22-7484-451c-b0df-2e7318e070f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57fd91a3-45')
May 28 01:12:40.728228 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:12:40.728635 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:12:40.728635 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] No VIF found with MAC fa:16:3e:4f:6f:bc, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:12:40.728903 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Using config drive
May 28 01:12:41.233288 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:12:41.334418 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Creating config drive at /opt/stack/data/nova/instances/a8238177-e440-46c2-a71e-2920d023a9ce/disk.config
May 28 01:12:41.338051 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a8238177-e440-46c2-a71e-2920d023a9ce/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj80uc2je {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:12:41.388989 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a8238177-e440-46c2-a71e-2920d023a9ce/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj80uc2je" returned: 0 in 0.051s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:12:41.594128 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:41.746208 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:41.772712 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:41.775670 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:41.843227 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:41.894488 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:41.895392 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:41.963456 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6596ef0e-b1d5-4fb8-85c0-fe1a30be5273 req-3540e7c5-cb93-4311-ab54-2a5ef0c7bd44 service nova] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Received event network-vif-plugged-57fd91a3-455a-4f47-9966-6b70f2fa6e8d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:12:41.964053 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6596ef0e-b1d5-4fb8-85c0-fe1a30be5273 req-3540e7c5-cb93-4311-ab54-2a5ef0c7bd44 service nova] Acquiring lock "a8238177-e440-46c2-a71e-2920d023a9ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:41.964228 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6596ef0e-b1d5-4fb8-85c0-fe1a30be5273 req-3540e7c5-cb93-4311-ab54-2a5ef0c7bd44 service nova] Lock "a8238177-e440-46c2-a71e-2920d023a9ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:41.964352 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6596ef0e-b1d5-4fb8-85c0-fe1a30be5273 req-3540e7c5-cb93-4311-ab54-2a5ef0c7bd44 service nova] Lock "a8238177-e440-46c2-a71e-2920d023a9ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:41.964461 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6596ef0e-b1d5-4fb8-85c0-fe1a30be5273 req-3540e7c5-cb93-4311-ab54-2a5ef0c7bd44 service nova] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Processing event network-vif-plugged-57fd91a3-455a-4f47-9966-6b70f2fa6e8d {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:12:41.980109 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:12:41.980620 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:12:42.370961 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930762.370494, a8238177-e440-46c2-a71e-2920d023a9ce => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:12:42.371256 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:12:42.371386 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] VM Started (Lifecycle Event)
May 28 01:12:42.373229 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:12:42.375821 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Instance spawned successfully.
May 28 01:12:42.376128 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:12:42.874581 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:12:42.876762 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:12:42.882219 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:12:42.882317 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:12:42.882742 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:12:42.882817 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:12:42.883039 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:12:42.883265 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:12:43.380364 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:12:43.380612 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930763.380436, a8238177-e440-46c2-a71e-2920d023a9ce => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:12:43.380739 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] VM Paused (Lifecycle Event)
May 28 01:12:43.388083 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Took 6.28 seconds to spawn the instance on the hypervisor.
May 28 01:12:43.388230 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:12:43.883378 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:12:43.885323 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930763.885091, a8238177-e440-46c2-a71e-2920d023a9ce => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:12:43.885502 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] VM Resumed (Lifecycle Event)
May 28 01:12:43.896188 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Took 11.86 seconds to build instance.
May 28 01:12:43.978029 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:12:43.978177 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 01:12:43.978360 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:12:44.015418 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6b9336b6-f388-4521-b2f5-5fd747b59389 req-ba67c987-b8a8-46b9-997d-c1c6d5be3dc4 service nova] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Received event network-vif-plugged-57fd91a3-455a-4f47-9966-6b70f2fa6e8d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:12:44.015794 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6b9336b6-f388-4521-b2f5-5fd747b59389 req-ba67c987-b8a8-46b9-997d-c1c6d5be3dc4 service nova] Acquiring lock "a8238177-e440-46c2-a71e-2920d023a9ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:44.015939 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6b9336b6-f388-4521-b2f5-5fd747b59389 req-ba67c987-b8a8-46b9-997d-c1c6d5be3dc4 service nova] Lock "a8238177-e440-46c2-a71e-2920d023a9ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:44.016052 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6b9336b6-f388-4521-b2f5-5fd747b59389 req-ba67c987-b8a8-46b9-997d-c1c6d5be3dc4 service nova] Lock "a8238177-e440-46c2-a71e-2920d023a9ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:44.016154 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6b9336b6-f388-4521-b2f5-5fd747b59389 req-ba67c987-b8a8-46b9-997d-c1c6d5be3dc4 service nova] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] No waiting events found dispatching network-vif-plugged-57fd91a3-455a-4f47-9966-6b70f2fa6e8d {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:12:44.016266 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-6b9336b6-f388-4521-b2f5-5fd747b59389 req-ba67c987-b8a8-46b9-997d-c1c6d5be3dc4 service nova] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Received unexpected event network-vif-plugged-57fd91a3-455a-4f47-9966-6b70f2fa6e8d for instance with vm_state active and task_state None.
May 28 01:12:44.208520 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:44.390679 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:12:44.392970 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:12:44.398389 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "a8238177-e440-46c2-a71e-2920d023a9ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.372s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:44.482914 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:44.483094 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:44.483214 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:44.483334 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Auditing locally available compute resources for np0000001577 (node: np0000001577) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 01:12:44.982625 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-72c05de7-e9c0-4a21-bc69-e3822f9424ba req-87ba0153-725b-42a9-90b2-f95c621ddfa5 service nova] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Received event network-changed-57fd91a3-455a-4f47-9966-6b70f2fa6e8d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:12:44.982949 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-72c05de7-e9c0-4a21-bc69-e3822f9424ba req-87ba0153-725b-42a9-90b2-f95c621ddfa5 service nova] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Refreshing instance network info cache due to event network-changed-57fd91a3-455a-4f47-9966-6b70f2fa6e8d. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:12:44.982949 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-72c05de7-e9c0-4a21-bc69-e3822f9424ba req-87ba0153-725b-42a9-90b2-f95c621ddfa5 service nova] Acquiring lock "refresh_cache-a8238177-e440-46c2-a71e-2920d023a9ce" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:12:44.983046 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-72c05de7-e9c0-4a21-bc69-e3822f9424ba req-87ba0153-725b-42a9-90b2-f95c621ddfa5 service nova] Acquired lock "refresh_cache-a8238177-e440-46c2-a71e-2920d023a9ce" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:12:44.983186 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-72c05de7-e9c0-4a21-bc69-e3822f9424ba req-87ba0153-725b-42a9-90b2-f95c621ddfa5 service nova] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Refreshing network info cache for port 57fd91a3-455a-4f47-9966-6b70f2fa6e8d {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:12:45.014498 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00032393900028182543 future=<Future at 0x7c988c035e50 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:12:45.015216 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Emitting event <LifecycleEvent: 1779930750.0139925, e4dca6bf-1591-46fa-8ade-a99fddf923a7 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:12:45.015592 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:12:45.015778 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] VM Stopped (Lifecycle Event)
May 28 01:12:45.485038 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-72c05de7-e9c0-4a21-bc69-e3822f9424ba req-87ba0153-725b-42a9-90b2-f95c621ddfa5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:12:45.508875 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b7855e-1385-4a4b-89c8-f3c0f71f3959/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:12:45.524451 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:12:45.534291 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: deleting, current DB power_state: 1, VM power_state: 4 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:12:45.607955 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b7855e-1385-4a4b-89c8-f3c0f71f3959/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:12:45.608469 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b7855e-1385-4a4b-89c8-f3c0f71f3959/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:12:45.709240 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60b7855e-1385-4a4b-89c8-f3c0f71f3959/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:12:45.711224 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:12:45.715903 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4dca6bf-1591-46fa-8ade-a99fddf923a7/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:12:45.817649 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4dca6bf-1591-46fa-8ade-a99fddf923a7/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:12:45.822175 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-72c05de7-e9c0-4a21-bc69-e3822f9424ba req-87ba0153-725b-42a9-90b2-f95c621ddfa5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:12:45.824025 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4dca6bf-1591-46fa-8ade-a99fddf923a7/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:12:45.911198 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4dca6bf-1591-46fa-8ade-a99fddf923a7/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:12:45.916420 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:12:45.996761 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-72c05de7-e9c0-4a21-bc69-e3822f9424ba req-87ba0153-725b-42a9-90b2-f95c621ddfa5 service nova] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Updated VIF entry in instance network info cache for port 57fd91a3-455a-4f47-9966-6b70f2fa6e8d. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:12:45.997259 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-72c05de7-e9c0-4a21-bc69-e3822f9424ba req-87ba0153-725b-42a9-90b2-f95c621ddfa5 service nova] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Updating instance_info_cache with network_info: [{"id": "57fd91a3-455a-4f47-9966-6b70f2fa6e8d", "address": "fa:16:3e:4f:6f:bc", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57fd91a3-45", "ovs_interfaceid": "57fd91a3-455a-4f47-9966-6b70f2fa6e8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:12:46.008268 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:12:46.008803 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:12:46.038946 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-051aa347-bb8b-40ec-af6e-f87ea645b91f tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] During sync_power_state the instance has a pending task (deleting). Skip.
May 28 01:12:46.103203 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:12:46.103445 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-2 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:12:46.103586 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-5 (vdc) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:12:46.103762 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-0 (vdd) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:12:46.108413 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:12:46.110006 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:12:46.196217 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:12:46.196704 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:12:46.280231 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:12:46.284453 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8238177-e440-46c2-a71e-2920d023a9ce/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:12:46.371021 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8238177-e440-46c2-a71e-2920d023a9ce/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:12:46.371421 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8238177-e440-46c2-a71e-2920d023a9ce/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:12:46.454836 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8238177-e440-46c2-a71e-2920d023a9ce/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:12:46.460822 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26af0b2c-7e35-4e53-85eb-71ddca16fbfa/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:12:46.501223 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-72c05de7-e9c0-4a21-bc69-e3822f9424ba req-87ba0153-725b-42a9-90b2-f95c621ddfa5 service nova] Releasing lock "refresh_cache-a8238177-e440-46c2-a71e-2920d023a9ce" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:12:46.557299 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26af0b2c-7e35-4e53-85eb-71ddca16fbfa/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:12:46.557997 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26af0b2c-7e35-4e53-85eb-71ddca16fbfa/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:12:46.599104 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:46.644920 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26af0b2c-7e35-4e53-85eb-71ddca16fbfa/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:12:46.648816 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:12:46.649923 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:12:46.694398 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "env LANG=C uptime" returned: 0 in 0.044s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:12:46.694959 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Hypervisor/Node resource view: name=np0000001577 free_ram=11888MB free_disk=72.63141632080078GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 01:12:46.695165 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:12:46.695510 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:12:47.752579 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance e8151422-37a0-4b7a-914f-34dc2979ead9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:12:47.752579 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 4edb886b-df1e-42fd-9881-91fc07339c3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:12:47.752579 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance e4dca6bf-1591-46fa-8ade-a99fddf923a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:12:47.752579 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 60b7855e-1385-4a4b-89c8-f3c0f71f3959 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:12:47.752579 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:12:47.752579 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 26af0b2c-7e35-4e53-85eb-71ddca16fbfa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:12:47.752579 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 14694771-0e2d-420f-8b96-7bd28ffcf4c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:12:47.753177 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance a8238177-e440-46c2-a71e-2920d023a9ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:12:47.753437 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 01:12:47.753669 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Final resource view: name=np0000001577 phys_ram=24030MB used_ram=2048MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:12:46 up 44 min,  2 users,  load average: 3.99, 5.03, 4.27\n', 'num_instances': '8', 'num_vm_active': '7', 'num_task_None': '6', 'num_os_type_None': '8', 'num_proj_07f3bdd3aef04045aac40e4b851915e1': '2', 'io_workload': '1', 'num_proj_fb2f65d208f44146903c7dcf0b143a8e': '1', 'num_task_deleting': '1', 'num_proj_1d6ee814419446dcb5025c68fb0f4ce9': '2', 'num_proj_1880a27e1ad0432f914e086d7fffdeb4': '2', 'num_proj_0e5e86340fc8435f8e3c83322ba82560': '1', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 01:12:48.104504 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:12:48.105780 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:12:48.607627 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:12:49.113636 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Compute_service record updated for np0000001577:np0000001577 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 01:12:49.113636 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.418s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:12:49.114375 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:12:49.210596 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:51.598167 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:52.110198 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:12:52.110450 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:12:52.110667 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:12:52.110853 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:12:52.111023 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:12:52.111185 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:12:52.111400 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.87 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:12:54.211209 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:56.181167 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:12:56.600297 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:12:59.211759 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:01.601149 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:04.108168 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:04.108639 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:04.212985 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:04.611605 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lazy-loading 'flavor' on Instance uuid 26af0b2c-7e35-4e53-85eb-71ddca16fbfa {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:13:05.616750 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:06.602380 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:06.675203 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:06.675203 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:06.675203 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Attaching volume e9ceefa1-99e8-44e6-a7f9-5659e115b355 to /dev/vdb
May 28 01:13:06.706821 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:13:06.715994 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:13:06.737567 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:13:06.777978 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:13:06.778492 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:13:06.786211 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:13:06.787645 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe65:fa89', 'fe80::583c:47ff:fea3:281d', 'fe80::fc16:3eff:fe8e:8134', 'fe80::c813:dcff:fe9e:6381', 'fe80::fc16:3eff:feb6:e662', 'fe80::1cf4:68ff:fe80:cb5', 'fe80::fc16:3eff:fefa:1f', 'fe80::d820:d3ff:fe1f:ca6e', 'fe80::fc16:3eff:fe4a:3dbf', 'fe80::4416:94ff:febb:9b7b', 'fe80::fc16:3eff:fe4f:6fbc'] 
May 28 01:13:06.787935 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:13:06.788142 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:13:06.788463 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] <== get_connector_properties: return (81ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:13:06.789562 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Updating existing volume attachment record: 790eff9e-581f-455e-bd07-7247733a7a02 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:13:07.335860 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:13:07.336577 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355', 'iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e9ceefa1-99e8-44e6-a7f9-5659e115b355', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:13:07.336577 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:13:09.216569 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:11.604104 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:14.215700 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:19.216723 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:21.606953 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:21.672772 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1fcf95ef-666a-4b7d-a5d4-0ee964b373df tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "a8238177-e440-46c2-a71e-2920d023a9ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:21.672978 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1fcf95ef-666a-4b7d-a5d4-0ee964b373df tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "a8238177-e440-46c2-a71e-2920d023a9ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:21.673173 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1fcf95ef-666a-4b7d-a5d4-0ee964b373df tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "a8238177-e440-46c2-a71e-2920d023a9ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:21.673299 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1fcf95ef-666a-4b7d-a5d4-0ee964b373df tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "a8238177-e440-46c2-a71e-2920d023a9ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:21.673402 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1fcf95ef-666a-4b7d-a5d4-0ee964b373df tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "a8238177-e440-46c2-a71e-2920d023a9ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:21.675605 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-1fcf95ef-666a-4b7d-a5d4-0ee964b373df tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Terminating instance
May 28 01:13:22.178338 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-1fcf95ef-666a-4b7d-a5d4-0ee964b373df tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:13:22.197196 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:22.199515 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:22.216995 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:22.328593 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a0deeb5a-aa68-409b-a982-c883ac9dfc3a req-e1d87c8e-45b6-42ce-92cc-e68d575bcb04 service nova] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Received event network-vif-unplugged-57fd91a3-455a-4f47-9966-6b70f2fa6e8d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:13:22.329560 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a0deeb5a-aa68-409b-a982-c883ac9dfc3a req-e1d87c8e-45b6-42ce-92cc-e68d575bcb04 service nova] Acquiring lock "a8238177-e440-46c2-a71e-2920d023a9ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:22.329771 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a0deeb5a-aa68-409b-a982-c883ac9dfc3a req-e1d87c8e-45b6-42ce-92cc-e68d575bcb04 service nova] Lock "a8238177-e440-46c2-a71e-2920d023a9ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:22.329930 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a0deeb5a-aa68-409b-a982-c883ac9dfc3a req-e1d87c8e-45b6-42ce-92cc-e68d575bcb04 service nova] Lock "a8238177-e440-46c2-a71e-2920d023a9ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:22.330092 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a0deeb5a-aa68-409b-a982-c883ac9dfc3a req-e1d87c8e-45b6-42ce-92cc-e68d575bcb04 service nova] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] No waiting events found dispatching network-vif-unplugged-57fd91a3-455a-4f47-9966-6b70f2fa6e8d {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:13:22.330239 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a0deeb5a-aa68-409b-a982-c883ac9dfc3a req-e1d87c8e-45b6-42ce-92cc-e68d575bcb04 service nova] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Received event network-vif-unplugged-57fd91a3-455a-4f47-9966-6b70f2fa6e8d for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:13:22.363845 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:22.369281 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:22.488759 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999709799999891 future=<Future at 0x7c984c431d90 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:13:22.489259 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.99921186499978 future=<Future at 0x7c984c431d90 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:13:22.489511 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.998949326999991 future=<Future at 0x7c984c431d90 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:13:22.490986 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Instance destroyed successfully.
May 28 01:13:22.491362 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-1fcf95ef-666a-4b7d-a5d4-0ee964b373df tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lazy-loading 'resources' on Instance uuid a8238177-e440-46c2-a71e-2920d023a9ce {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:13:22.993485 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-1fcf95ef-666a-4b7d-a5d4-0ee964b373df tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:12:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-20848501',display_name='tempest-AttachVolumeNegativeTest-server-20848501',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumenegativetest-server-20848501',id=73,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7qkbljm0GARSz2o4HBvg3yX1Lr+z7iitOPvaW4rdCn3oKGlM0efBso+KkQ5fByFBpTekl+ZNC6M7ACovRaW+i37X8FjTGQ1ZsyZnfMus6DHbdCmkHmE2Q3w2QW+INcVw==',key_name='tempest-keypair-689322827',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:12:43Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d6ee814419446dcb5025c68fb0f4ce9',ramdisk_id='',reservation_id='r-uhgu30tc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1272396699',owner_user_name='tempest-AttachVolumeNegativeTest-1272396699-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:12:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f4ee9375c440d6abf68f2aa230b0c5',uuid=a8238177-e440-46c2-a71e-2920d023a9ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57fd91a3-455a-4f47-9966-6b70f2fa6e8d", "address": "fa:16:3e:4f:6f:bc", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57fd91a3-45", "ovs_interfaceid": "57fd91a3-455a-4f47-9966-6b70f2fa6e8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:13:22.994079 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-1fcf95ef-666a-4b7d-a5d4-0ee964b373df tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Converting VIF {"id": "57fd91a3-455a-4f47-9966-6b70f2fa6e8d", "address": "fa:16:3e:4f:6f:bc", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57fd91a3-45", "ovs_interfaceid": "57fd91a3-455a-4f47-9966-6b70f2fa6e8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:13:22.994266 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-1fcf95ef-666a-4b7d-a5d4-0ee964b373df tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:6f:bc,bridge_name='br-int',has_traffic_filtering=True,id=57fd91a3-455a-4f47-9966-6b70f2fa6e8d,network=Network(f8ce4f22-7484-451c-b0df-2e7318e070f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57fd91a3-45') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:13:22.994483 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-1fcf95ef-666a-4b7d-a5d4-0ee964b373df tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:6f:bc,bridge_name='br-int',has_traffic_filtering=True,id=57fd91a3-455a-4f47-9966-6b70f2fa6e8d,network=Network(f8ce4f22-7484-451c-b0df-2e7318e070f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57fd91a3-45') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:13:22.996616 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:22.996709 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57fd91a3-45, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:13:22.997766 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:22.998563 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:13:22.998810 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:22.999559 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:22.999740 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dee6eff7-d47b-43c5-af27-c920b0237453) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:13:23.000161 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:23.000656 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:13:23.000804 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:23.002367 np0000001577 nova-compute[98319]: INFO os_vif [None req-1fcf95ef-666a-4b7d-a5d4-0ee964b373df tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:6f:bc,bridge_name='br-int',has_traffic_filtering=True,id=57fd91a3-455a-4f47-9966-6b70f2fa6e8d,network=Network(f8ce4f22-7484-451c-b0df-2e7318e070f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57fd91a3-45')
May 28 01:13:23.002657 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-1fcf95ef-666a-4b7d-a5d4-0ee964b373df tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Deleting instance files /opt/stack/data/nova/instances/a8238177-e440-46c2-a71e-2920d023a9ce_del
May 28 01:13:23.003283 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-1fcf95ef-666a-4b7d-a5d4-0ee964b373df tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Deletion of /opt/stack/data/nova/instances/a8238177-e440-46c2-a71e-2920d023a9ce_del complete
May 28 01:13:23.508338 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-1fcf95ef-666a-4b7d-a5d4-0ee964b373df tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Took 1.33 seconds to destroy the instance on the hypervisor.
May 28 01:13:23.508686 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-1fcf95ef-666a-4b7d-a5d4-0ee964b373df tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:13:23.508869 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:13:23.508982 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:13:23.509241 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:13:23.591201 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:13:23.889051 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:23.950738 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-57dd5461-7a2f-4ed5-9f19-c20ea5c3f118 req-d128b058-8ae7-4a70-b146-a9fcdd6cc5f0 service nova] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Received event network-vif-deleted-57fd91a3-455a-4f47-9966-6b70f2fa6e8d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:13:23.950894 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-57dd5461-7a2f-4ed5-9f19-c20ea5c3f118 req-d128b058-8ae7-4a70-b146-a9fcdd6cc5f0 service nova] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Neutron deleted interface 57fd91a3-455a-4f47-9966-6b70f2fa6e8d; detaching it from the instance and deleting it from the info cache
May 28 01:13:23.952704 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-57dd5461-7a2f-4ed5-9f19-c20ea5c3f118 req-d128b058-8ae7-4a70-b146-a9fcdd6cc5f0 service nova] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Detach interface failed, port_id=57fd91a3-455a-4f47-9966-6b70f2fa6e8d, reason: Instance a8238177-e440-46c2-a71e-2920d023a9ce could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:13:24.377806 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7f5661d7-106f-4186-b7da-2f9879ea8db8 req-c56e5d0f-4288-41fa-b0c0-b92b8e962202 service nova] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Received event network-vif-unplugged-57fd91a3-455a-4f47-9966-6b70f2fa6e8d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:13:24.378098 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7f5661d7-106f-4186-b7da-2f9879ea8db8 req-c56e5d0f-4288-41fa-b0c0-b92b8e962202 service nova] Acquiring lock "a8238177-e440-46c2-a71e-2920d023a9ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:24.378138 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7f5661d7-106f-4186-b7da-2f9879ea8db8 req-c56e5d0f-4288-41fa-b0c0-b92b8e962202 service nova] Lock "a8238177-e440-46c2-a71e-2920d023a9ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:24.378258 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7f5661d7-106f-4186-b7da-2f9879ea8db8 req-c56e5d0f-4288-41fa-b0c0-b92b8e962202 service nova] Lock "a8238177-e440-46c2-a71e-2920d023a9ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:24.378364 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7f5661d7-106f-4186-b7da-2f9879ea8db8 req-c56e5d0f-4288-41fa-b0c0-b92b8e962202 service nova] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] No waiting events found dispatching network-vif-unplugged-57fd91a3-455a-4f47-9966-6b70f2fa6e8d {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:13:24.378477 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7f5661d7-106f-4186-b7da-2f9879ea8db8 req-c56e5d0f-4288-41fa-b0c0-b92b8e962202 service nova] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Received event network-vif-unplugged-57fd91a3-455a-4f47-9966-6b70f2fa6e8d for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:13:24.409275 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:13:24.910963 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Took 1.40 seconds to deallocate network for instance.
May 28 01:13:25.415760 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1fcf95ef-666a-4b7d-a5d4-0ee964b373df tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:25.416178 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1fcf95ef-666a-4b7d-a5d4-0ee964b373df tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:25.749443 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1fcf95ef-666a-4b7d-a5d4-0ee964b373df tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:13:25.749645 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-1fcf95ef-666a-4b7d-a5d4-0ee964b373df tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:13:26.251964 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-1fcf95ef-666a-4b7d-a5d4-0ee964b373df tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:13:26.758186 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1fcf95ef-666a-4b7d-a5d4-0ee964b373df tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.342s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:26.798805 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-1fcf95ef-666a-4b7d-a5d4-0ee964b373df tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Deleted allocations for instance a8238177-e440-46c2-a71e-2920d023a9ce
May 28 01:13:27.805604 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1fcf95ef-666a-4b7d-a5d4-0ee964b373df tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "a8238177-e440-46c2-a71e-2920d023a9ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.133s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:28.001174 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:28.916036 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:28.916527 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:29.418730 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Detaching volume 6b89c7f5-0e8c-47f0-9195-642fca1b6067
May 28 01:13:29.451884 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Attempting to driver detach volume 6b89c7f5-0e8c-47f0-9195-642fca1b6067 from mountpoint /dev/vdb
May 28 01:13:29.455886 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Found disk vdb by alias ua-6b89c7f5-0e8c-47f0-9195-642fca1b6067 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:13:29.456923 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Found disk vdb by alias ua-6b89c7f5-0e8c-47f0-9195-642fca1b6067 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:13:29.457036 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Attempting to detach device vdb from instance 60b7855e-1385-4a4b-89c8-f3c0f71f3959 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:13:29.457257 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:13:29.457257 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:13:29.457257 np0000001577 nova-compute[98319]:   <alias name="ua-6b89c7f5-0e8c-47f0-9195-642fca1b6067"/>
May 28 01:13:29.457257 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-3"/>
May 28 01:13:29.457257 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:13:29.457257 np0000001577 nova-compute[98319]:   <serial>6b89c7f5-0e8c-47f0-9195-642fca1b6067</serial>
May 28 01:13:29.457257 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:13:29.457257 np0000001577 nova-compute[98319]: </disk>
May 28 01:13:29.457257 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:13:29.461567 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Successfully detached device vdb from instance 60b7855e-1385-4a4b-89c8-f3c0f71f3959 from the persistent domain config.
May 28 01:13:29.461722 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] (1/8): Attempting to detach device vdb with device alias ua-6b89c7f5-0e8c-47f0-9195-642fca1b6067 from instance 60b7855e-1385-4a4b-89c8-f3c0f71f3959 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:13:29.461922 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:13:29.461922 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:13:29.461922 np0000001577 nova-compute[98319]:   <alias name="ua-6b89c7f5-0e8c-47f0-9195-642fca1b6067"/>
May 28 01:13:29.461922 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-3"/>
May 28 01:13:29.461922 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:13:29.461922 np0000001577 nova-compute[98319]:   <serial>6b89c7f5-0e8c-47f0-9195-642fca1b6067</serial>
May 28 01:13:29.461922 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:13:29.461922 np0000001577 nova-compute[98319]: </disk>
May 28 01:13:29.461922 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:13:29.917005 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930809.916657, 60b7855e-1385-4a4b-89c8-f3c0f71f3959 => ua-6b89c7f5-0e8c-47f0-9195-642fca1b6067> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:13:29.917875 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-6b89c7f5-0e8c-47f0-9195-642fca1b6067 for instance 60b7855e-1385-4a4b-89c8-f3c0f71f3959 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:13:29.919791 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Successfully detached device vdb from instance 60b7855e-1385-4a4b-89c8-f3c0f71f3959 from the live domain config.
May 28 01:13:29.920832 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:13:29.921098 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067', 'iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b89c7f5-0e8c-47f0-9195-642fca1b6067', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:13:29.921221 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:13:30.636508 np0000001577 nova-compute[98319]: WARNING os_brick.exception [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Flushing 330000000cd1c3072 failed: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 28 01:13:30.636662 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:13:30.687927 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:13:30.732016 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:13:30.732189 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:13:30.733422 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:13:30.744218 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:13:30.744462 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:13:30.755989 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:30.792378 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 172, target: iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b, portal: 192.168.40.100,3260]
May 28 01:13:30.792378 np0000001577 nova-compute[98319]: Logout of [sid: 172, target: iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b, portal: 192.168.40.100,3260] successful.
May 28 01:13:30.792378 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:30.811012 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:30.821837 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:30.857790 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 173, target: iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b, portal: 192.168.50.100,3260]
May 28 01:13:30.857790 np0000001577 nova-compute[98319]: Logout of [sid: 173, target: iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b, portal: 192.168.50.100,3260] successful.
May 28 01:13:30.857790 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:30.875230 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:30.875352 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Removing multipath device map 330000000cd1c3072 to stop multipathd from monitoring the device. {{(pid=98319) _cleanup_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1009}}
May 28 01:13:30.875648 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Multipath 330000000cd1c3072 no longer present {{(pid=98319) multipath_del_map /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:894}}
May 28 01:13:30.875817 np0000001577 nova-compute[98319]: WARNING os_brick.initiator.connectors.iscsi [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] There were errors removing {'sde', 'sdd'}, leftovers may remain in the system
May 28 01:13:30.876033 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 60.304s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:13:30.877422 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] <== disconnect_volume: exception (60304ms)
May 28 01:13:30.877422 np0000001577 nova-compute[98319]: Chained Exception #1
May 28 01:13:30.877422 np0000001577 nova-compute[98319]:         Traceback (most recent call last):
May 28 01:13:30.877422 np0000001577 nova-compute[98319]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py", line 396, in remove_connection
May 28 01:13:30.877422 np0000001577 nova-compute[98319]:             self.flush_multipath_device(multipath_name)
May 28 01:13:30.877422 np0000001577 nova-compute[98319]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py", line 475, in flush_multipath_device
May 28 01:13:30.877422 np0000001577 nova-compute[98319]:             self._execute('multipath', '-f', device_map_name, run_as_root=True,
May 28 01:13:30.877422 np0000001577 nova-compute[98319]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/executor.py", line 53, in _execute
May 28 01:13:30.877422 np0000001577 nova-compute[98319]:             result = self.__execute(*args, **kwargs)
May 28 01:13:30.877422 np0000001577 nova-compute[98319]:                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:13:30.877422 np0000001577 nova-compute[98319]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 173, in execute
May 28 01:13:30.877422 np0000001577 nova-compute[98319]:             return execute_root(*cmd, **kwargs)
May 28 01:13:30.877422 np0000001577 nova-compute[98319]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:13:30.877422 np0000001577 nova-compute[98319]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 315, in _wrap
May 28 01:13:30.877422 np0000001577 nova-compute[98319]:             return self.channel.remote_call(name, args, kwargs, r_call_timeout)
May 28 01:13:30.877422 np0000001577 nova-compute[98319]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:13:30.877422 np0000001577 nova-compute[98319]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 266, in remote_call
May 28 01:13:30.877422 np0000001577 nova-compute[98319]:             raise exc_type(*result[2])
May 28 01:13:30.877422 np0000001577 nova-compute[98319]:         oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 28 01:13:30.877422 np0000001577 nova-compute[98319]:         Command: multipath -f 330000000cd1c3072
May 28 01:13:30.877422 np0000001577 nova-compute[98319]:         Exit code: 1
May 28 01:13:30.877422 np0000001577 nova-compute[98319]:         Stdout: ''
May 28 01:13:30.877422 np0000001577 nova-compute[98319]:         Stderr: '2671.255773 | 330000000cd1c3072: map in use\n'
May 28 01:13:30.877422 np0000001577 nova-compute[98319]:          {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:188}}
May 28 01:13:30.878133 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Ignoring Volume Error on vol 335404a4-ae14-42d9-aeb3-f6f69436ff1b during delete
May 28 01:13:30.878133 np0000001577 nova-compute[98319]: Chained Exception #1
May 28 01:13:30.878133 np0000001577 nova-compute[98319]:         Traceback (most recent call last):
May 28 01:13:30.878133 np0000001577 nova-compute[98319]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py", line 396, in remove_connection
May 28 01:13:30.878133 np0000001577 nova-compute[98319]:             self.flush_multipath_device(multipath_name)
May 28 01:13:30.878133 np0000001577 nova-compute[98319]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py", line 475, in flush_multipath_device
May 28 01:13:30.878133 np0000001577 nova-compute[98319]:             self._execute('multipath', '-f', device_map_name, run_as_root=True,
May 28 01:13:30.878133 np0000001577 nova-compute[98319]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/executor.py", line 53, in _execute
May 28 01:13:30.878133 np0000001577 nova-compute[98319]:             result = self.__execute(*args, **kwargs)
May 28 01:13:30.878133 np0000001577 nova-compute[98319]:                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:13:30.878133 np0000001577 nova-compute[98319]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 173, in execute
May 28 01:13:30.878133 np0000001577 nova-compute[98319]:             return execute_root(*cmd, **kwargs)
May 28 01:13:30.878133 np0000001577 nova-compute[98319]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:13:30.878133 np0000001577 nova-compute[98319]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 315, in _wrap
May 28 01:13:30.878133 np0000001577 nova-compute[98319]:             return self.channel.remote_call(name, args, kwargs, r_call_timeout)
May 28 01:13:30.878133 np0000001577 nova-compute[98319]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 01:13:30.878133 np0000001577 nova-compute[98319]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 266, in remote_call
May 28 01:13:30.878133 np0000001577 nova-compute[98319]:             raise exc_type(*result[2])
May 28 01:13:30.878133 np0000001577 nova-compute[98319]:         oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 28 01:13:30.878133 np0000001577 nova-compute[98319]:         Command: multipath -f 330000000cd1c3072
May 28 01:13:30.878133 np0000001577 nova-compute[98319]:         Exit code: 1
May 28 01:13:30.878133 np0000001577 nova-compute[98319]:         Stdout: ''
May 28 01:13:30.878133 np0000001577 nova-compute[98319]:         Stderr: '2671.255773 | 330000000cd1c3072: map in use\n'
May 28 01:13:30.878133 np0000001577 nova-compute[98319]:         : os_brick.exception.ExceptionChainer:
May 28 01:13:30.878133 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Deleting instance files /opt/stack/data/nova/instances/e4dca6bf-1591-46fa-8ade-a99fddf923a7_del
May 28 01:13:30.878781 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 57.412s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:13:30.879192 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:13:30.879353 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:13:30.880574 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Deletion of /opt/stack/data/nova/instances/e4dca6bf-1591-46fa-8ade-a99fddf923a7_del complete
May 28 01:13:30.906492 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:30.906492 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:30.906492 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:30.906492 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:30.906492 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:30.906492 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:30.906492 np0000001577 nova-compute[98319]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:13:30.906492 np0000001577 nova-compute[98319]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:13:30.906492 np0000001577 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:30.906492 np0000001577 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:30.906492 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:13:30.906492 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:30.906492 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:30.906492 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:30.906492 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:30.906492 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:30.906492 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:30.906492 np0000001577 nova-compute[98319]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:13:30.906492 np0000001577 nova-compute[98319]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b (non-flash)
May 28 01:13:30.906492 np0000001577 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:30.906492 np0000001577 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:30.906492 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:13:30.907089 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', '164'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', '165'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', '169'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', '170'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067', '183'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067', '184')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:13:30.907089 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', '181')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:13:30.907769 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b', '182')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:13:30.908502 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c984c7742c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b'): ({'sdh'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:13:30.908682 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Removing multipathed devices sdg, sdh {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:13:30.908887 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Flush multipath device 33000000009502b69 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:13:30.945087 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:13:30.983970 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:13:31.035910 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Checking to see if SCSI volumes sdg, sdh have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:13:31.036093 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] SCSI volumes sdg, sdh have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:13:31.038186 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Checking to see if device paths {'sdg', 'sdh'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:13:31.048904 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Device paths {'sdg', 'sdh'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:13:31.049091 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:13:31.060525 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:31.091572 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 181, target: iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b, portal: 192.168.40.100,3260]
May 28 01:13:31.091572 np0000001577 nova-compute[98319]: Logout of [sid: 181, target: iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b, portal: 192.168.40.100,3260] successful.
May 28 01:13:31.091572 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:31.108538 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:31.118902 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:31.152049 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 182, target: iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b, portal: 192.168.50.100,3260]
May 28 01:13:31.152049 np0000001577 nova-compute[98319]: Logout of [sid: 182, target: iqn.2023-03.storpool.com:os--volume-f4367fd6-1652-4af4-a6b7-b55a2f5e737b, portal: 192.168.50.100,3260] successful.
May 28 01:13:31.152049 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:31.168217 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:31.168355 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:13:31.168679 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] <== disconnect_volume: return (57703ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:13:31.168800 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:13:31.169243 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 54.817s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:13:31.170720 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:13:31.181185 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:13:31.181674 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:13:31.182271 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:13:31.182452 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:13:31.182856 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:13:31.183018 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:13:31.196587 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:13:31.196587 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:31.207035 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:13:31.207035 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:31.211779 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e] added
May 28 01:13:31.211779 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:13:31.211779 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:13:31.211779 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:13:31.211779 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:13:31.211779 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:13:31.211779 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:31.212016 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:13:31.212129 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0296(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:13:31.212287 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:13:31.217995 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e] added
May 28 01:13:31.217995 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:13:31.217995 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:13:31.217995 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:13:31.217995 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:13:31.217995 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:13:31.217995 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:31.218166 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:13:31.218297 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0352(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:13:31.218428 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:13:31.385810 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Took 61.70 seconds to destroy the instance on the hypervisor.
May 28 01:13:31.386269 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:13:31.386581 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:13:31.386661 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:13:31.386866 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:13:31.439241 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:13:31.713343 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lazy-loading 'flavor' on Instance uuid 4edb886b-df1e-42fd-9881-91fc07339c3f {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:13:31.865176 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-460c1c14-b97b-4fe1-9d12-d5249423fd4e req-551a40ec-adfb-4a62-b0ce-a580ff4d210f service nova] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Received event network-vif-deleted-7117ae99-9818-42a9-9110-9bf8e26c3a34 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:13:31.865562 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-460c1c14-b97b-4fe1-9d12-d5249423fd4e req-551a40ec-adfb-4a62-b0ce-a580ff4d210f service nova] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Neutron deleted interface 7117ae99-9818-42a9-9110-9bf8e26c3a34; detaching it from the instance and deleting it from the info cache
May 28 01:13:31.867755 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-460c1c14-b97b-4fe1-9d12-d5249423fd4e req-551a40ec-adfb-4a62-b0ce-a580ff4d210f service nova] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Detach interface failed, port_id=7117ae99-9818-42a9-9110-9bf8e26c3a34, reason: Instance e4dca6bf-1591-46fa-8ade-a99fddf923a7 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:13:32.212740 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:13:32.218859 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:13:32.226149 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:13:32.226149 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:13:32.231583 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:13:32.231583 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:32.237264 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:32.243157 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:32.251822 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:32.251822 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:32.251822 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:32.251822 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:32.251822 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:32.251822 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:32.251822 np0000001577 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:32.251822 np0000001577 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:32.251822 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:13:32.252041 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:32.252041 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:32.252041 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:32.252041 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:32.252041 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:32.252041 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:32.252041 np0000001577 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:32.252041 np0000001577 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:32.252041 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:13:32.258610 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:32.258610 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:32.258610 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:32.258610 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:32.258610 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:32.258610 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:32.258610 np0000001577 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:32.258610 np0000001577 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:32.258610 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:13:32.258835 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:32.258835 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:32.258835 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:32.258835 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:32.258835 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:32.258835 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:32.258835 np0000001577 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:32.258835 np0000001577 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:32.258835 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:13:32.286107 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:13:32.304917 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e, portal: 192.168.40.100,3260]
May 28 01:13:32.304917 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e, portal: 192.168.40.100,3260] successful.
May 28 01:13:32.304917 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:32.312461 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e, portal: 192.168.50.100,3260]
May 28 01:13:32.312461 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e, portal: 192.168.50.100,3260] successful.
May 28 01:13:32.312461 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:32.319031 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:32.323949 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:32.334719 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:32.334719 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:32.334719 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:32.334719 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:32.334719 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:32.334719 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:32.334719 np0000001577 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:32.334719 np0000001577 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:32.334719 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:32.334719 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:32.334719 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:13:32.335042 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:32.335042 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:32.335042 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:32.335042 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:32.335042 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:32.335042 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:32.335042 np0000001577 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:32.335042 np0000001577 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:32.335042 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:32.335042 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:32.335042 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:13:32.335042 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:13:32.335290 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:13:32.336287 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] HCTL ('9', '-', '-', 0) found on session 185 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:13:32.336396 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:13:32.340899 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:32.340899 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:32.340899 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:32.340899 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:32.340899 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:32.340899 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:32.340899 np0000001577 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:32.340899 np0000001577 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:32.340899 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:32.340899 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:32.340899 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:13:32.341124 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:32.341124 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:32.341124 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:32.341124 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:32.341124 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:32.341124 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:32.341124 np0000001577 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:32.341124 np0000001577 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:32.341124 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:32.341124 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:32.341124 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:13:32.341322 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.158s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:13:32.341322 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:13:32.342157 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] HCTL ('10', '-', '-', 0) found on session 186 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:13:32.342273 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:13:32.350324 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Searching for a device in session 185 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:13:32.350383 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:13:32.354811 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Searching for a device in session 186 and hctl ['10', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:13:32.718794 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-949d8c74-2c69-4d06-a1f5-eb497eabfa5a tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "4edb886b-df1e-42fd-9881-91fc07339c3f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 60.356s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:32.789056 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Took 1.40 seconds to deallocate network for instance.
May 28 01:13:32.801398 np0000001577 nova-compute[98319]: WARNING nova.volume.cinder [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Attachment d1fa6709-e72d-4636-bc84-68fa64294012 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = d1fa6709-e72d-4636-bc84-68fa64294012. (HTTP 404) (Request-ID: req-9cb3cef8-e870-4b69-a0a5-4bb3e168df83)
May 28 01:13:32.801640 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e4dca6bf-1591-46fa-8ade-a99fddf923a7] Took 0.01 seconds to detach 1 volumes for instance.
May 28 01:13:33.002158 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:33.305933 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:33.306240 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:33.355263 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Searching for a device in session 186 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:13:33.355434 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:13:33.588115 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:13:33.588283 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:13:34.090623 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:13:34.197452 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Found WWN 330000000807c0322 for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:13:34.197732 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:13:34.197882 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] <== connect_volume: return (57845ms) {'type': 'block', 'scsi_wwn': '330000000807c0322', 'path': '/dev/dm-1', 'multipath_id': '330000000807c0322'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:13:34.197994 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000807c0322', 'path': '/dev/dm-1', 'multipath_id': '330000000807c0322'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:13:34.198617 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 26.862s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:13:34.198784 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355', 'iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e9ceefa1-99e8-44e6-a7f9-5659e115b355', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:13:34.211309 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:13:34.212027 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:13:34.212731 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:13:34.212928 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:13:34.213321 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:13:34.213965 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:13:34.224361 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:13:34.224361 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:34.228670 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:13:34.228670 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:34.234919 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355] added
May 28 01:13:34.234919 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:13:34.234919 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:13:34.234919 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:13:34.234919 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:13:34.234919 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:13:34.234919 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:34.235086 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:13:34.235169 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0223(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:13:34.235283 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:13:34.239138 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355] added
May 28 01:13:34.239138 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:13:34.239138 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:13:34.239138 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:13:34.239138 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:13:34.239138 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:13:34.239138 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:34.239281 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:13:34.239412 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0255(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:13:34.239559 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:13:34.443871 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-91eb061a-35f9-413e-9d10-47099ea092ef tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "4edb886b-df1e-42fd-9881-91fc07339c3f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:34.444239 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-91eb061a-35f9-413e-9d10-47099ea092ef tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "4edb886b-df1e-42fd-9881-91fc07339c3f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:34.444239 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-91eb061a-35f9-413e-9d10-47099ea092ef tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "4edb886b-df1e-42fd-9881-91fc07339c3f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:34.444328 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-91eb061a-35f9-413e-9d10-47099ea092ef tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "4edb886b-df1e-42fd-9881-91fc07339c3f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:34.444408 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-91eb061a-35f9-413e-9d10-47099ea092ef tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "4edb886b-df1e-42fd-9881-91fc07339c3f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:34.446081 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-91eb061a-35f9-413e-9d10-47099ea092ef tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Terminating instance
May 28 01:13:34.596377 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.290s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:34.636987 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Deleted allocations for instance e4dca6bf-1591-46fa-8ade-a99fddf923a7
May 28 01:13:34.703137 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:12:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-450528518',display_name='tempest-TestVolumeBootPatternV346-server-450528518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpatternv346-server-450528518',id=72,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVWY4QoBnaZDYOWaArJ/7QlZgas19ONKFmLBsMYnYVbIzysBHI36jsC/mhPh5mksxpK90KxpnHzrQ+Wzjpk7QaghElQPXWAxvS1jJK+U849tPzycoi0imxOiGvSEHAJHA==',key_name='tempest-keypair-1322410097',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1880a27e1ad0432f914e086d7fffdeb4',ramdisk_id='',reservation_id='r-s0c5roth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1741753090',owner_user_name='tempest-TestVolumeBootPatternV346-1741753090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:12:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae6c3c6a50b24a58af140f523fb73374',uuid=14694771-0e2d-420f-8b96-7bd28ffcf4c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26c13825-b801-4d7c-ad2d-62db205cea2d", "address": "fa:16:3e:04:7d:17", "network": {"id": "0be6df83-bfa0-4c90-aed3-88212317cb4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-252451076-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1880a27e1ad0432f914e086d7fffdeb4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c13825-b8", "ovs_interfaceid": "26c13825-b801-4d7c-ad2d-62db205cea2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:13:34.703344 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Converting VIF {"id": "26c13825-b801-4d7c-ad2d-62db205cea2d", "address": "fa:16:3e:04:7d:17", "network": {"id": "0be6df83-bfa0-4c90-aed3-88212317cb4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-252451076-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1880a27e1ad0432f914e086d7fffdeb4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c13825-b8", "ovs_interfaceid": "26c13825-b801-4d7c-ad2d-62db205cea2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:13:34.703739 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:7d:17,bridge_name='br-int',has_traffic_filtering=True,id=26c13825-b801-4d7c-ad2d-62db205cea2d,network=Network(0be6df83-bfa0-4c90-aed3-88212317cb4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c13825-b8') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:13:34.704283 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lazy-loading 'pci_devices' on Instance uuid 14694771-0e2d-420f-8b96-7bd28ffcf4c2 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:13:34.948271 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-91eb061a-35f9-413e-9d10-47099ea092ef tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:13:34.972603 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:34.974674 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:34.989953 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:35.008170 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:35.086852 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8eef5b4c-4ea8-4864-9039-13b9b378b2df req-0f176dbd-83c6-462a-b8c6-d43e078b1d24 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Received event network-vif-unplugged-89446e5b-c447-4a2c-b547-03a71d82747b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:13:35.087022 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8eef5b4c-4ea8-4864-9039-13b9b378b2df req-0f176dbd-83c6-462a-b8c6-d43e078b1d24 service nova] Acquiring lock "4edb886b-df1e-42fd-9881-91fc07339c3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:35.087178 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8eef5b4c-4ea8-4864-9039-13b9b378b2df req-0f176dbd-83c6-462a-b8c6-d43e078b1d24 service nova] Lock "4edb886b-df1e-42fd-9881-91fc07339c3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:35.087281 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8eef5b4c-4ea8-4864-9039-13b9b378b2df req-0f176dbd-83c6-462a-b8c6-d43e078b1d24 service nova] Lock "4edb886b-df1e-42fd-9881-91fc07339c3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:35.087390 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8eef5b4c-4ea8-4864-9039-13b9b378b2df req-0f176dbd-83c6-462a-b8c6-d43e078b1d24 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] No waiting events found dispatching network-vif-unplugged-89446e5b-c447-4a2c-b547-03a71d82747b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:13:35.087814 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8eef5b4c-4ea8-4864-9039-13b9b378b2df req-0f176dbd-83c6-462a-b8c6-d43e078b1d24 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Received event network-vif-unplugged-89446e5b-c447-4a2c-b547-03a71d82747b for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:13:35.207142 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] End _get_guest_xml xml=<domain type="qemu">
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:   <uuid>14694771-0e2d-420f-8b96-7bd28ffcf4c2</uuid>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:   <name>instance-00000048</name>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestVolumeBootPatternV346-server-450528518</nova:name>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:12:36</nova:creationTime>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       <nova:image uuid="">
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:         <nova:user uuid="ae6c3c6a50b24a58af140f523fb73374">tempest-TestVolumeBootPatternV346-1741753090-project-member</nova:user>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:         <nova:project uuid="1880a27e1ad0432f914e086d7fffdeb4">tempest-TestVolumeBootPatternV346-1741753090</nova:project>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:         <nova:port uuid="26c13825-b801-4d7c-ad2d-62db205cea2d">
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:     <system>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       <entry name="serial">14694771-0e2d-420f-8b96-7bd28ffcf4c2</entry>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       <entry name="uuid">14694771-0e2d-420f-8b96-7bd28ffcf4c2</entry>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:     </system>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:   <os>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:   </os>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:   <features>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:   </features>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:   <devices>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/14694771-0e2d-420f-8b96-7bd28ffcf4c2/disk.config"/>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:     </disk>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       <alias name="ua-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e"/>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-1"/>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       <serial>9a753a23-1f81-48d4-8c7a-9eada0c1cc1e</serial>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:     </disk>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:04:7d:17"/>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       <target dev="tap26c13825-b8"/>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:     </interface>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/14694771-0e2d-420f-8b96-7bd28ffcf4c2/console.log" append="off"/>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:     </serial>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:     <video>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:     </video>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:     </rng>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:   </devices>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]: </domain>
May 28 01:13:35.207142 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:13:35.209528 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Preparing to wait for external event network-vif-plugged-26c13825-b801-4d7c-ad2d-62db205cea2d {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:13:35.209528 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "14694771-0e2d-420f-8b96-7bd28ffcf4c2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:35.209528 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "14694771-0e2d-420f-8b96-7bd28ffcf4c2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:35.209528 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "14694771-0e2d-420f-8b96-7bd28ffcf4c2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:35.209528 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:12:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-450528518',display_name='tempest-TestVolumeBootPatternV346-server-450528518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpatternv346-server-450528518',id=72,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVWY4QoBnaZDYOWaArJ/7QlZgas19ONKFmLBsMYnYVbIzysBHI36jsC/mhPh5mksxpK90KxpnHzrQ+Wzjpk7QaghElQPXWAxvS1jJK+U849tPzycoi0imxOiGvSEHAJHA==',key_name='tempest-keypair-1322410097',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1880a27e1ad0432f914e086d7fffdeb4',ramdisk_id='',reservation_id='r-s0c5roth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1741753090',owner_user_name='tempest-TestVolumeBootPatternV346-1741753090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:12:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae6c3c6a50b24a58af140f523fb73374',uuid=14694771-0e2d-420f-8b96-7bd28ffcf4c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26c13825-b801-4d7c-ad2d-62db205cea2d", "address": "fa:16:3e:04:7d:17", "network": {"id": "0be6df83-bfa0-4c90-aed3-88212317cb4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-252451076-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1880a27e1ad0432f914e086d7fffdeb4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c13825-b8", "ovs_interfaceid": "26c13825-b801-4d7c-ad2d-62db205cea2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:13:35.209528 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Converting VIF {"id": "26c13825-b801-4d7c-ad2d-62db205cea2d", "address": "fa:16:3e:04:7d:17", "network": {"id": "0be6df83-bfa0-4c90-aed3-88212317cb4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-252451076-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1880a27e1ad0432f914e086d7fffdeb4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c13825-b8", "ovs_interfaceid": "26c13825-b801-4d7c-ad2d-62db205cea2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:13:35.209528 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:7d:17,bridge_name='br-int',has_traffic_filtering=True,id=26c13825-b801-4d7c-ad2d-62db205cea2d,network=Network(0be6df83-bfa0-4c90-aed3-88212317cb4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c13825-b8') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:13:35.209933 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:7d:17,bridge_name='br-int',has_traffic_filtering=True,id=26c13825-b801-4d7c-ad2d-62db205cea2d,network=Network(0be6df83-bfa0-4c90-aed3-88212317cb4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c13825-b8') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:13:35.209933 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:35.210057 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:13:35.210215 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:13:35.210910 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:35.211063 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3460de18-174c-507c-abf9-950ae2cd6453', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:13:35.211860 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:35.212524 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:13:35.217223 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:35.218761 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:35.218885 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26c13825-b8, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:13:35.219128 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26c13825-b8, col_values=(('qos', UUID('b6a3cb98-48c1-4d31-ab62-adc8a483eb18')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:13:35.219289 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26c13825-b8, col_values=(('external_ids', {'iface-id': '26c13825-b801-4d7c-ad2d-62db205cea2d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:7d:17', 'vm-uuid': '14694771-0e2d-420f-8b96-7bd28ffcf4c2'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:13:35.219908 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:35.220914 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:13:35.228502 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:35.229132 np0000001577 nova-compute[98319]: INFO os_vif [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:7d:17,bridge_name='br-int',has_traffic_filtering=True,id=26c13825-b801-4d7c-ad2d-62db205cea2d,network=Network(0be6df83-bfa0-4c90-aed3-88212317cb4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c13825-b8')
May 28 01:13:35.235681 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:13:35.239952 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:13:35.249663 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:13:35.249663 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:13:35.255121 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:13:35.255121 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:35.262242 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999339552000038 future=<Future at 0x7c984c7d6450 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:13:35.263345 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Instance destroyed successfully.
May 28 01:13:35.263813 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:35.264193 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-91eb061a-35f9-413e-9d10-47099ea092ef tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lazy-loading 'resources' on Instance uuid 4edb886b-df1e-42fd-9881-91fc07339c3f {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:13:35.269317 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:35.280924 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:35.280924 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:35.280924 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:35.280924 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:35.280924 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:35.280924 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:35.280924 np0000001577 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:35.280924 np0000001577 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:35.280924 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:35.280924 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:35.280924 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:13:35.281231 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:35.281231 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:35.281231 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:35.281231 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:35.281231 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:35.281231 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:35.281231 np0000001577 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:35.281231 np0000001577 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:35.281231 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:35.281231 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:35.281231 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:13:35.286043 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:35.286043 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:35.286043 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:35.286043 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:35.286043 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:35.286043 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:35.286043 np0000001577 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:35.286043 np0000001577 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:35.286043 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:35.286043 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:35.286043 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:13:35.286338 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:35.286338 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:35.286338 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:35.286338 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:35.286338 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:35.286338 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:35.286338 np0000001577 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:35.286338 np0000001577 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:35.286338 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:35.286338 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:35.286338 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:13:35.334170 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355, portal: 192.168.40.100,3260]
May 28 01:13:35.334170 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355, portal: 192.168.40.100,3260] successful.
May 28 01:13:35.334170 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:35.341625 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355, portal: 192.168.50.100,3260]
May 28 01:13:35.341625 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355, portal: 192.168.50.100,3260] successful.
May 28 01:13:35.341625 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:35.347970 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:35.354206 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:35.369331 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:35.369331 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:35.369331 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:35.369331 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:35.369331 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:35.369331 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:35.369331 np0000001577 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:35.369331 np0000001577 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:35.369331 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:35.369331 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:35.369331 np0000001577 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355 (non-flash)
May 28 01:13:35.369331 np0000001577 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355 (non-flash)
May 28 01:13:35.369331 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:13:35.369696 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:35.369696 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:35.369696 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:35.369696 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:35.369696 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:35.369696 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:35.369696 np0000001577 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:35.369696 np0000001577 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:35.369696 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:35.369696 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:35.369696 np0000001577 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355 (non-flash)
May 28 01:13:35.369696 np0000001577 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355 (non-flash)
May 28 01:13:35.369696 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:13:35.369696 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:13:35.369971 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:13:35.370755 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] HCTL ('12', '-', '-', 0) found on session 187 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:13:35.370852 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:13:35.376235 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:35.376235 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:35.376235 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:35.376235 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:35.376235 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:35.376235 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:35.376235 np0000001577 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:35.376235 np0000001577 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:35.376235 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:35.376235 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:35.376235 np0000001577 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355 (non-flash)
May 28 01:13:35.376235 np0000001577 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355 (non-flash)
May 28 01:13:35.376235 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:13:35.376672 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:35.376672 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:35.376672 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:35.376672 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:35.376672 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:35.376672 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:35.376672 np0000001577 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:35.376672 np0000001577 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:35.376672 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:35.376672 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:35.376672 np0000001577 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355 (non-flash)
May 28 01:13:35.376672 np0000001577 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355 (non-flash)
May 28 01:13:35.376672 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:13:35.376672 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:13:35.376946 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:13:35.377660 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] HCTL ('13', '-', '-', 0) found on session 188 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:13:35.377750 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:13:35.385071 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Searching for a device in session 187 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:13:35.385640 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e9ceefa1-99e8-44e6-a7f9-5659e115b355', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:13:35.391671 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Searching for a device in session 188 and hctl ['13', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:13:35.644017 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5e892958-529d-4838-b395-ea8c22aa9b9c tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e4dca6bf-1591-46fa-8ade-a99fddf923a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 66.471s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:35.766402 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-91eb061a-35f9-413e-9d10-47099ea092ef tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:11:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2023787221',display_name='tempest-TestMinimumBasicScenario-server-2023787221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testminimumbasicscenario-server-2023787221',id=66,image_ref='b6771936-97f2-4073-bf9b-ccb3dc960886',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeedL+sGgE99d8g4dPt6DoVfxM3FqutzbPgV98SfFKefq8Z1zEo+4lbRsyO452zYjWQAX6ig52TSFvOZYkOsNEfBbe8Eu2SMeWXnNbThabXFesSaOO5KPV8LcFHScA3OA==',key_name='tempest-TestMinimumBasicScenario-1787881822',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:11:23Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb2f65d208f44146903c7dcf0b143a8e',ramdisk_id='',reservation_id='r-yunb341z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6771936-97f2-4073-bf9b-ccb3dc960886',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1681839017',owner_user_name='tempest-TestMinimumBasicScenario-1681839017-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:12:09Z,user_data=None,user_id='0505bf2e15ba44ad881b94106ae054a5',uuid=4edb886b-df1e-42fd-9881-91fc07339c3f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89446e5b-c447-4a2c-b547-03a71d82747b", "address": "fa:16:3e:fa:00:1f", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89446e5b-c4", "ovs_interfaceid": "89446e5b-c447-4a2c-b547-03a71d82747b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:13:35.766633 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-91eb061a-35f9-413e-9d10-47099ea092ef tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Converting VIF {"id": "89446e5b-c447-4a2c-b547-03a71d82747b", "address": "fa:16:3e:fa:00:1f", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89446e5b-c4", "ovs_interfaceid": "89446e5b-c447-4a2c-b547-03a71d82747b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:13:35.766993 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-91eb061a-35f9-413e-9d10-47099ea092ef tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:00:1f,bridge_name='br-int',has_traffic_filtering=True,id=89446e5b-c447-4a2c-b547-03a71d82747b,network=Network(d9534aa6-926a-458a-a1d0-8512d11fe6a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89446e5b-c4') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:13:35.767187 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-91eb061a-35f9-413e-9d10-47099ea092ef tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:00:1f,bridge_name='br-int',has_traffic_filtering=True,id=89446e5b-c447-4a2c-b547-03a71d82747b,network=Network(d9534aa6-926a-458a-a1d0-8512d11fe6a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89446e5b-c4') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:13:35.768126 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:35.768353 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89446e5b-c4, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:13:35.769313 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:35.770106 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:13:35.774831 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:35.775366 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:35.775510 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dbd8e278-cdc6-421b-b7d0-8ade058c86ee) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:13:35.775995 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:35.776374 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:13:35.780440 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:35.781931 np0000001577 nova-compute[98319]: INFO os_vif [None req-91eb061a-35f9-413e-9d10-47099ea092ef tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:00:1f,bridge_name='br-int',has_traffic_filtering=True,id=89446e5b-c447-4a2c-b547-03a71d82747b,network=Network(d9534aa6-926a-458a-a1d0-8512d11fe6a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89446e5b-c4')
May 28 01:13:35.782187 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-91eb061a-35f9-413e-9d10-47099ea092ef tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Deleting instance files /opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f_del
May 28 01:13:35.782854 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-91eb061a-35f9-413e-9d10-47099ea092ef tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Deletion of /opt/stack/data/nova/instances/4edb886b-df1e-42fd-9881-91fc07339c3f_del complete
May 28 01:13:36.287874 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-91eb061a-35f9-413e-9d10-47099ea092ef tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Took 1.34 seconds to destroy the instance on the hypervisor.
May 28 01:13:36.288438 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-91eb061a-35f9-413e-9d10-47099ea092ef tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:13:36.288784 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:13:36.288921 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:13:36.289200 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:13:36.343196 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:13:36.390750 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Searching for a device in session 188 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:13:36.390884 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e9ceefa1-99e8-44e6-a7f9-5659e115b355', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:13:36.581957 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7740c014-e075-4771-9e10-ecf43b04fb5d req-155f5c15-e3ce-4375-914c-9144231ca380 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Received event network-vif-deleted-89446e5b-c447-4a2c-b547-03a71d82747b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:13:36.582078 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-7740c014-e075-4771-9e10-ecf43b04fb5d req-155f5c15-e3ce-4375-914c-9144231ca380 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Neutron deleted interface 89446e5b-c447-4a2c-b547-03a71d82747b; detaching it from the instance and deleting it from the info cache
May 28 01:13:36.583715 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7740c014-e075-4771-9e10-ecf43b04fb5d req-155f5c15-e3ce-4375-914c-9144231ca380 service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Detach interface failed, port_id=89446e5b-c447-4a2c-b547-03a71d82747b, reason: Instance 4edb886b-df1e-42fd-9881-91fc07339c3f could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:13:36.584947 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e57c88e7-9d8e-4a33-92c2-6f9ab516ab80 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "e8151422-37a0-4b7a-914f-34dc2979ead9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:36.584947 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e57c88e7-9d8e-4a33-92c2-6f9ab516ab80 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:36.743930 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:13:36.744364 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:13:36.744364 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] No VIF found with MAC fa:16:3e:04:7d:17, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:13:36.744527 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Using config drive
May 28 01:13:37.043069 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:13:37.086913 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e57c88e7-9d8e-4a33-92c2-6f9ab516ab80 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Detaching volume 335404a4-ae14-42d9-aeb3-f6f69436ff1b
May 28 01:13:37.120785 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-e57c88e7-9d8e-4a33-92c2-6f9ab516ab80 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Attempting to driver detach volume 335404a4-ae14-42d9-aeb3-f6f69436ff1b from mountpoint /dev/vdd
May 28 01:13:37.125315 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e57c88e7-9d8e-4a33-92c2-6f9ab516ab80 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Found disk vdd by alias ua-335404a4-ae14-42d9-aeb3-f6f69436ff1b {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:13:37.126841 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e57c88e7-9d8e-4a33-92c2-6f9ab516ab80 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Found disk vdd by alias ua-335404a4-ae14-42d9-aeb3-f6f69436ff1b {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:13:37.126988 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e57c88e7-9d8e-4a33-92c2-6f9ab516ab80 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Attempting to detach device vdd from instance e8151422-37a0-4b7a-914f-34dc2979ead9 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:13:37.127263 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-e57c88e7-9d8e-4a33-92c2-6f9ab516ab80 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:13:37.127263 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:13:37.127263 np0000001577 nova-compute[98319]:   <alias name="ua-335404a4-ae14-42d9-aeb3-f6f69436ff1b"/>
May 28 01:13:37.127263 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 28 01:13:37.127263 np0000001577 nova-compute[98319]:   <target dev="vdd" bus="virtio"/>
May 28 01:13:37.127263 np0000001577 nova-compute[98319]:   <serial>335404a4-ae14-42d9-aeb3-f6f69436ff1b</serial>
May 28 01:13:37.127263 np0000001577 nova-compute[98319]:   <shareable/>
May 28 01:13:37.127263 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x09" function="0x0"/>
May 28 01:13:37.127263 np0000001577 nova-compute[98319]: </disk>
May 28 01:13:37.127263 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:13:37.133967 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-e57c88e7-9d8e-4a33-92c2-6f9ab516ab80 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Successfully detached device vdd from instance e8151422-37a0-4b7a-914f-34dc2979ead9 from the persistent domain config.
May 28 01:13:37.134143 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e57c88e7-9d8e-4a33-92c2-6f9ab516ab80 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] (1/8): Attempting to detach device vdd with device alias ua-335404a4-ae14-42d9-aeb3-f6f69436ff1b from instance e8151422-37a0-4b7a-914f-34dc2979ead9 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:13:37.134447 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-e57c88e7-9d8e-4a33-92c2-6f9ab516ab80 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:13:37.134447 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:13:37.134447 np0000001577 nova-compute[98319]:   <alias name="ua-335404a4-ae14-42d9-aeb3-f6f69436ff1b"/>
May 28 01:13:37.134447 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 28 01:13:37.134447 np0000001577 nova-compute[98319]:   <target dev="vdd" bus="virtio"/>
May 28 01:13:37.134447 np0000001577 nova-compute[98319]:   <serial>335404a4-ae14-42d9-aeb3-f6f69436ff1b</serial>
May 28 01:13:37.134447 np0000001577 nova-compute[98319]:   <shareable/>
May 28 01:13:37.134447 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x09" function="0x0"/>
May 28 01:13:37.134447 np0000001577 nova-compute[98319]: </disk>
May 28 01:13:37.134447 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:13:37.141211 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5d32de95-7e12-4f25-ac64-c39fda0c2d79 req-2d507228-a56f-416d-b832-a4565098e4ae service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Received event network-vif-unplugged-89446e5b-c447-4a2c-b547-03a71d82747b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:13:37.141366 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5d32de95-7e12-4f25-ac64-c39fda0c2d79 req-2d507228-a56f-416d-b832-a4565098e4ae service nova] Acquiring lock "4edb886b-df1e-42fd-9881-91fc07339c3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:37.141515 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5d32de95-7e12-4f25-ac64-c39fda0c2d79 req-2d507228-a56f-416d-b832-a4565098e4ae service nova] Lock "4edb886b-df1e-42fd-9881-91fc07339c3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:37.141635 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5d32de95-7e12-4f25-ac64-c39fda0c2d79 req-2d507228-a56f-416d-b832-a4565098e4ae service nova] Lock "4edb886b-df1e-42fd-9881-91fc07339c3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:37.141761 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5d32de95-7e12-4f25-ac64-c39fda0c2d79 req-2d507228-a56f-416d-b832-a4565098e4ae service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] No waiting events found dispatching network-vif-unplugged-89446e5b-c447-4a2c-b547-03a71d82747b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:13:37.142050 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5d32de95-7e12-4f25-ac64-c39fda0c2d79 req-2d507228-a56f-416d-b832-a4565098e4ae service nova] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Received event network-vif-unplugged-89446e5b-c447-4a2c-b547-03a71d82747b for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:13:37.226841 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Found WWN 3300000007a5072b4 for multipath device dm-10 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:13:37.227129 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:13:37.227513 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] <== connect_volume: return (29890ms) {'type': 'block', 'scsi_wwn': '3300000007a5072b4', 'path': '/dev/dm-10', 'multipath_id': '3300000007a5072b4'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:13:37.227692 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007a5072b4', 'path': '/dev/dm-10', 'multipath_id': '3300000007a5072b4'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:13:37.228074 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 7.307s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:13:37.228453 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067', 'iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b89c7f5-0e8c-47f0-9195-642fca1b6067', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:13:37.228670 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:13:37.230903 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lazy-loading 'flavor' on Instance uuid 26af0b2c-7e35-4e53-85eb-71ddca16fbfa {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:13:37.248965 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:13:37.255694 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:37.255694 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:37.255694 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:37.255694 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:37.255694 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:37.255694 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:37.255694 np0000001577 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:37.255694 np0000001577 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:37.255694 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:37.255694 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:37.255694 np0000001577 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355 (non-flash)
May 28 01:13:37.255694 np0000001577 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355 (non-flash)
May 28 01:13:37.255694 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:13:37.256147 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:37.256147 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:37.256147 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:37.256147 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:37.256147 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:37.256147 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:37.256147 np0000001577 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:37.256147 np0000001577 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067 (non-flash)
May 28 01:13:37.256147 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:37.256147 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:37.256147 np0000001577 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355 (non-flash)
May 28 01:13:37.256147 np0000001577 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355 (non-flash)
May 28 01:13:37.256147 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:13:37.256147 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', '164'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', '165'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', '169'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', '170'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067', '183'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067', '184'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', '185'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355', '187'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355', '188')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:13:37.256147 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067', '183')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:13:37.257526 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067', '184')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:13:37.258626 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c98705e8540>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067'): ({'sdi'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:13:37.258834 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Removing multipathed devices sdf, sdi {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:13:37.259081 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Flush multipath device 330000000f94ccfb0 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:13:37.295613 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:13:37.351922 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:13:37.375377 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Creating config drive at /opt/stack/data/nova/instances/14694771-0e2d-420f-8b96-7bd28ffcf4c2/disk.config
May 28 01:13:37.379047 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/14694771-0e2d-420f-8b96-7bd28ffcf4c2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8r749e3y {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:13:37.405197 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Checking to see if SCSI volumes sdf, sdi have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:13:37.405476 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] SCSI volumes sdf, sdi have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:13:37.407765 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Checking to see if device paths {'sdf', 'sdi'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:13:37.422943 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Device paths {'sdf', 'sdi'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:13:37.423300 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:13:37.434754 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:37.435637 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/14694771-0e2d-420f-8b96-7bd28ffcf4c2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8r749e3y" returned: 0 in 0.056s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:13:37.478623 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 183, target: iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067, portal: 192.168.40.100,3260]
May 28 01:13:37.478623 np0000001577 nova-compute[98319]: Logout of [sid: 183, target: iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067, portal: 192.168.40.100,3260] successful.
May 28 01:13:37.478623 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:37.489145 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0005097309999655408 future=<Future at 0x7c984c431d90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:13:37.489145 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:13:37.489329 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=12.772372454000106 future=<Future at 0x7c984c7d6450 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:13:37.489329 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=12.77227436200019 future=<Future at 0x7c984c7d6450 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:13:37.490915 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Emitting event <LifecycleEvent: 1779930802.4883802, a8238177-e440-46c2-a71e-2920d023a9ce => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:13:37.490915 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] VM Stopped (Lifecycle Event)
May 28 01:13:37.497772 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:37.509033 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:37.541020 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 184, target: iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067, portal: 192.168.50.100,3260]
May 28 01:13:37.541020 np0000001577 nova-compute[98319]: Logout of [sid: 184, target: iqn.2023-03.storpool.com:os--volume-6b89c7f5-0e8c-47f0-9195-642fca1b6067, portal: 192.168.50.100,3260] successful.
May 28 01:13:37.541020 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:37.544875 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Took 1.26 seconds to deallocate network for instance.
May 28 01:13:37.564396 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:37.564748 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:13:37.564871 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] <== disconnect_volume: return (7643ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:13:37.564993 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:13:37.621375 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930817.6210177, e8151422-37a0-4b7a-914f-34dc2979ead9 => ua-335404a4-ae14-42d9-aeb3-f6f69436ff1b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:13:37.624045 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e57c88e7-9d8e-4a33-92c2-6f9ab516ab80 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Start waiting for the detach event from libvirt for device vdd with device alias ua-335404a4-ae14-42d9-aeb3-f6f69436ff1b for instance e8151422-37a0-4b7a-914f-34dc2979ead9 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:13:37.626928 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-e57c88e7-9d8e-4a33-92c2-6f9ab516ab80 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Successfully detached device vdd from instance e8151422-37a0-4b7a-914f-34dc2979ead9 from the live domain config.
May 28 01:13:37.654900 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e57c88e7-9d8e-4a33-92c2-6f9ab516ab80 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:13:37.655200 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57c88e7-9d8e-4a33-92c2-6f9ab516ab80 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b', 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '335404a4-ae14-42d9-aeb3-f6f69436ff1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:13:37.655322 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e57c88e7-9d8e-4a33-92c2-6f9ab516ab80 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:13:37.733627 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Attempting to attach volume e9ceefa1-99e8-44e6-a7f9-5659e115b355 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:13:37.735053 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:13:37.735053 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:13:37.735053 np0000001577 nova-compute[98319]:   <alias name="ua-e9ceefa1-99e8-44e6-a7f9-5659e115b355"/>
May 28 01:13:37.735053 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-10"/>
May 28 01:13:37.735053 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:13:37.735053 np0000001577 nova-compute[98319]:   <serial>e9ceefa1-99e8-44e6-a7f9-5659e115b355</serial>
May 28 01:13:37.735053 np0000001577 nova-compute[98319]: </disk>
May 28 01:13:37.735053 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:13:37.994285 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:37.996137 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-62e8ca72-9a7f-4df6-9368-cd3c6233b21a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: a8238177-e440-46c2-a71e-2920d023a9ce] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:13:38.018796 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:38.053178 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-91eb061a-35f9-413e-9d10-47099ea092ef tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:38.053333 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-91eb061a-35f9-413e-9d10-47099ea092ef tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:38.097749 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:38.109081 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lazy-loading 'flavor' on Instance uuid 60b7855e-1385-4a4b-89c8-f3c0f71f3959 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:13:38.153731 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:38.153731 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:38.351416 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-91eb061a-35f9-413e-9d10-47099ea092ef tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:13:38.351416 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-91eb061a-35f9-413e-9d10-47099ea092ef tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:13:38.643740 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e3088d86-ca9e-4c83-a490-5b66f70b00b4 req-6c347716-42d6-457f-a3a9-38626dd26ecb service nova] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Received event network-vif-plugged-26c13825-b801-4d7c-ad2d-62db205cea2d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:13:38.643823 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e3088d86-ca9e-4c83-a490-5b66f70b00b4 req-6c347716-42d6-457f-a3a9-38626dd26ecb service nova] Acquiring lock "14694771-0e2d-420f-8b96-7bd28ffcf4c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:38.643980 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e3088d86-ca9e-4c83-a490-5b66f70b00b4 req-6c347716-42d6-457f-a3a9-38626dd26ecb service nova] Lock "14694771-0e2d-420f-8b96-7bd28ffcf4c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:38.644091 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e3088d86-ca9e-4c83-a490-5b66f70b00b4 req-6c347716-42d6-457f-a3a9-38626dd26ecb service nova] Lock "14694771-0e2d-420f-8b96-7bd28ffcf4c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:38.644197 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e3088d86-ca9e-4c83-a490-5b66f70b00b4 req-6c347716-42d6-457f-a3a9-38626dd26ecb service nova] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Processing event network-vif-plugged-26c13825-b801-4d7c-ad2d-62db205cea2d {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:13:38.644332 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e3088d86-ca9e-4c83-a490-5b66f70b00b4 req-6c347716-42d6-457f-a3a9-38626dd26ecb service nova] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Received event network-vif-plugged-26c13825-b801-4d7c-ad2d-62db205cea2d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:13:38.644440 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e3088d86-ca9e-4c83-a490-5b66f70b00b4 req-6c347716-42d6-457f-a3a9-38626dd26ecb service nova] Acquiring lock "14694771-0e2d-420f-8b96-7bd28ffcf4c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:38.644668 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e3088d86-ca9e-4c83-a490-5b66f70b00b4 req-6c347716-42d6-457f-a3a9-38626dd26ecb service nova] Lock "14694771-0e2d-420f-8b96-7bd28ffcf4c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:38.644668 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e3088d86-ca9e-4c83-a490-5b66f70b00b4 req-6c347716-42d6-457f-a3a9-38626dd26ecb service nova] Lock "14694771-0e2d-420f-8b96-7bd28ffcf4c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:38.644792 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e3088d86-ca9e-4c83-a490-5b66f70b00b4 req-6c347716-42d6-457f-a3a9-38626dd26ecb service nova] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] No waiting events found dispatching network-vif-plugged-26c13825-b801-4d7c-ad2d-62db205cea2d {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:13:38.644856 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-e3088d86-ca9e-4c83-a490-5b66f70b00b4 req-6c347716-42d6-457f-a3a9-38626dd26ecb service nova] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Received unexpected event network-vif-plugged-26c13825-b801-4d7c-ad2d-62db205cea2d for instance with vm_state building and task_state spawning.
May 28 01:13:38.692054 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930818.6917353, 14694771-0e2d-420f-8b96-7bd28ffcf4c2 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:13:38.692190 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] VM Started (Lifecycle Event)
May 28 01:13:38.693402 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:13:38.696167 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:13:38.697825 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Instance spawned successfully.
May 28 01:13:38.698043 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:13:38.854370 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-91eb061a-35f9-413e-9d10-47099ea092ef tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:13:39.115563 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-327ada72-05cf-4a3f-8857-e08868a2ea27 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 10.199s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:39.194325 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:13:39.196413 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:13:39.205280 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:13:39.205413 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:13:39.205708 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:13:39.205894 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:13:39.206121 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:13:39.206314 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:13:39.346126 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f0f05a7f-4e6b-4cc0-b4cf-59b214a5af49 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:39.346313 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f0f05a7f-4e6b-4cc0-b4cf-59b214a5af49 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:39.346539 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f0f05a7f-4e6b-4cc0-b4cf-59b214a5af49 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:39.346703 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f0f05a7f-4e6b-4cc0-b4cf-59b214a5af49 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:39.346818 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f0f05a7f-4e6b-4cc0-b4cf-59b214a5af49 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:39.348791 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-f0f05a7f-4e6b-4cc0-b4cf-59b214a5af49 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Terminating instance
May 28 01:13:39.362450 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-91eb061a-35f9-413e-9d10-47099ea092ef tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.309s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:39.404960 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-91eb061a-35f9-413e-9d10-47099ea092ef tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Deleted allocations for instance 4edb886b-df1e-42fd-9881-91fc07339c3f
May 28 01:13:39.435339 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:13:39.435501 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:13:39.435626 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:13:39.435767 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] No VIF found with MAC fa:16:3e:4a:3d:bf, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:13:39.698924 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:13:39.699217 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930819.6990187, 14694771-0e2d-420f-8b96-7bd28ffcf4c2 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:13:39.699350 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] VM Paused (Lifecycle Event)
May 28 01:13:39.712201 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Took 63.38 seconds to spawn the instance on the hypervisor.
May 28 01:13:39.712388 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:13:39.811117 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e57c88e7-9d8e-4a33-92c2-6f9ab516ab80 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.156s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:13:39.811497 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57c88e7-9d8e-4a33-92c2-6f9ab516ab80 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b', 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '335404a4-ae14-42d9-aeb3-f6f69436ff1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:13:39.811664 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57c88e7-9d8e-4a33-92c2-6f9ab516ab80 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:13:39.838061 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57c88e7-9d8e-4a33-92c2-6f9ab516ab80 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:39.838061 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:39.838061 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:39.838061 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:39.838061 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:39.838061 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:39.838061 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:39.838061 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:39.838061 np0000001577 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355 (non-flash)
May 28 01:13:39.838061 np0000001577 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355 (non-flash)
May 28 01:13:39.838061 np0000001577 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34f09347-325e-489b-92ef-0a67fbf8bdbb (non-flash)
May 28 01:13:39.838061 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:13:39.838391 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57c88e7-9d8e-4a33-92c2-6f9ab516ab80 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:39.838391 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:39.838391 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:39.838391 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:39.838391 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:39.838391 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:39.838391 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:39.838391 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:39.838391 np0000001577 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355 (non-flash)
May 28 01:13:39.838391 np0000001577 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355 (non-flash)
May 28 01:13:39.838391 np0000001577 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34f09347-325e-489b-92ef-0a67fbf8bdbb (non-flash)
May 28 01:13:39.838391 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:13:39.838391 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57c88e7-9d8e-4a33-92c2-6f9ab516ab80 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', '164'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', '165'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', '169'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', '170'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', '185'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355', '187'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355', '188'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-34f09347-325e-489b-92ef-0a67fbf8bdbb', '189')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:13:39.838391 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57c88e7-9d8e-4a33-92c2-6f9ab516ab80 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b, 0): [] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:13:39.838391 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57c88e7-9d8e-4a33-92c2-6f9ab516ab80 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b') {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 01:13:39.838755 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57c88e7-9d8e-4a33-92c2-6f9ab516ab80 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b, 0): [] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:13:39.838755 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57c88e7-9d8e-4a33-92c2-6f9ab516ab80 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-335404a4-ae14-42d9-aeb3-f6f69436ff1b') {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 01:13:39.838755 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57c88e7-9d8e-4a33-92c2-6f9ab516ab80 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c984c43f380>, {}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:13:39.838825 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57c88e7-9d8e-4a33-92c2-6f9ab516ab80 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Disconnecting from: [] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:13:39.838994 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e57c88e7-9d8e-4a33-92c2-6f9ab516ab80 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.028s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:13:39.839090 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e57c88e7-9d8e-4a33-92c2-6f9ab516ab80 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] <== disconnect_volume: return (2183ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:13:39.839191 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e57c88e7-9d8e-4a33-92c2-6f9ab516ab80 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:13:39.851255 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-f0f05a7f-4e6b-4cc0-b4cf-59b214a5af49 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:13:39.877025 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:39.880688 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:39.896841 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:39.899829 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:39.924168 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:40.018965 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-19cb48c1-f607-4345-898f-5dc6ad1bd752 req-5858af25-530f-4bd4-aaf0-49de937827bf service nova] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Received event network-vif-unplugged-aef634ef-906c-43a3-bea0-bb5e3c94930f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:13:40.020045 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-19cb48c1-f607-4345-898f-5dc6ad1bd752 req-5858af25-530f-4bd4-aaf0-49de937827bf service nova] Acquiring lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:40.020194 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-19cb48c1-f607-4345-898f-5dc6ad1bd752 req-5858af25-530f-4bd4-aaf0-49de937827bf service nova] Lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:40.020314 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-19cb48c1-f607-4345-898f-5dc6ad1bd752 req-5858af25-530f-4bd4-aaf0-49de937827bf service nova] Lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:40.020471 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-19cb48c1-f607-4345-898f-5dc6ad1bd752 req-5858af25-530f-4bd4-aaf0-49de937827bf service nova] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] No waiting events found dispatching network-vif-unplugged-aef634ef-906c-43a3-bea0-bb5e3c94930f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:13:40.020833 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-19cb48c1-f607-4345-898f-5dc6ad1bd752 req-5858af25-530f-4bd4-aaf0-49de937827bf service nova] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Received event network-vif-unplugged-aef634ef-906c-43a3-bea0-bb5e3c94930f for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:13:40.147879 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:40.154621 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:40.182160 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Instance destroyed successfully.
May 28 01:13:40.182365 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-f0f05a7f-4e6b-4cc0-b4cf-59b214a5af49 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lazy-loading 'resources' on Instance uuid 60b7855e-1385-4a4b-89c8-f3c0f71f3959 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:13:40.202114 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:13:40.204885 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930820.2046592, 14694771-0e2d-420f-8b96-7bd28ffcf4c2 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:13:40.204942 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] VM Resumed (Lifecycle Event)
May 28 01:13:40.219612 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Took 70.58 seconds to build instance.
May 28 01:13:40.383231 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-e57c88e7-9d8e-4a33-92c2-6f9ab516ab80 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lazy-loading 'flavor' on Instance uuid e8151422-37a0-4b7a-914f-34dc2979ead9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:13:40.412561 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-91eb061a-35f9-413e-9d10-47099ea092ef tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "4edb886b-df1e-42fd-9881-91fc07339c3f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.968s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:40.684513 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-f0f05a7f-4e6b-4cc0-b4cf-59b214a5af49 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:11:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2128136567',display_name='tempest-AttachVolumeNegativeTest-server-2128136567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumenegativetest-server-2128136567',id=68,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYRZOi0t1E+A/XLsfiwOo3P1+BvmJexWcY7jagSwno7Tm3CSiuhdXMOYCFihWyhsojoeIDDGzYPwL25/nioA/fjoV6Dx0RNTEMVEpkWnRccRwe4J0Emm1ErCLWSxUs0Bw==',key_name='tempest-keypair-260657815',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:11:39Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d6ee814419446dcb5025c68fb0f4ce9',ramdisk_id='',reservation_id='r-k60ql0b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1272396699',owner_user_name='tempest-AttachVolumeNegativeTest-1272396699-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:11:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f4ee9375c440d6abf68f2aa230b0c5',uuid=60b7855e-1385-4a4b-89c8-f3c0f71f3959,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aef634ef-906c-43a3-bea0-bb5e3c94930f", "address": "fa:16:3e:8e:81:34", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef634ef-90", "ovs_interfaceid": "aef634ef-906c-43a3-bea0-bb5e3c94930f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:13:40.684782 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f0f05a7f-4e6b-4cc0-b4cf-59b214a5af49 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Converting VIF {"id": "aef634ef-906c-43a3-bea0-bb5e3c94930f", "address": "fa:16:3e:8e:81:34", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef634ef-90", "ovs_interfaceid": "aef634ef-906c-43a3-bea0-bb5e3c94930f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:13:40.685524 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f0f05a7f-4e6b-4cc0-b4cf-59b214a5af49 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:81:34,bridge_name='br-int',has_traffic_filtering=True,id=aef634ef-906c-43a3-bea0-bb5e3c94930f,network=Network(f8ce4f22-7484-451c-b0df-2e7318e070f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaef634ef-90') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:13:40.685771 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-f0f05a7f-4e6b-4cc0-b4cf-59b214a5af49 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:81:34,bridge_name='br-int',has_traffic_filtering=True,id=aef634ef-906c-43a3-bea0-bb5e3c94930f,network=Network(f8ce4f22-7484-451c-b0df-2e7318e070f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaef634ef-90') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:13:40.687014 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:40.687239 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaef634ef-90, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:13:40.688218 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:40.689043 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:13:40.689312 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:40.689937 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:40.690085 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=48ebe492-ed89-4119-8d20-f81109d5c0d7) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:13:40.690513 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:40.691045 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:13:40.692740 np0000001577 nova-compute[98319]: INFO os_vif [None req-f0f05a7f-4e6b-4cc0-b4cf-59b214a5af49 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:81:34,bridge_name='br-int',has_traffic_filtering=True,id=aef634ef-906c-43a3-bea0-bb5e3c94930f,network=Network(f8ce4f22-7484-451c-b0df-2e7318e070f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaef634ef-90')
May 28 01:13:40.692981 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f0f05a7f-4e6b-4cc0-b4cf-59b214a5af49 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Deleting instance files /opt/stack/data/nova/instances/60b7855e-1385-4a4b-89c8-f3c0f71f3959_del
May 28 01:13:40.693678 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f0f05a7f-4e6b-4cc0-b4cf-59b214a5af49 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Deletion of /opt/stack/data/nova/instances/60b7855e-1385-4a4b-89c8-f3c0f71f3959_del complete
May 28 01:13:40.707027 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:13:40.710035 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:13:40.720839 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "14694771-0e2d-420f-8b96-7bd28ffcf4c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 72.106s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:40.979605 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bda47b52-66a5-43b5-83b0-999cb7f70ddd tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 34.307s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:41.198977 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-f0f05a7f-4e6b-4cc0-b4cf-59b214a5af49 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Took 1.35 seconds to destroy the instance on the hypervisor.
May 28 01:13:41.199575 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-f0f05a7f-4e6b-4cc0-b4cf-59b214a5af49 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:13:41.201377 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:13:41.201563 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:13:41.201822 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:13:41.213956 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.99968481299993 future=<Future at 0x7c98705bc680 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:13:41.290950 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:13:41.393280 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e57c88e7-9d8e-4a33-92c2-6f9ab516ab80 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.807s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:41.611942 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:41.820075 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f77d94a0-c358-4285-a2ec-ffd6923c8729 req-b3c0a75b-d59d-43cc-a8d3-529e9719343c service nova] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Received event network-vif-deleted-aef634ef-906c-43a3-bea0-bb5e3c94930f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:13:41.820351 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-f77d94a0-c358-4285-a2ec-ffd6923c8729 req-b3c0a75b-d59d-43cc-a8d3-529e9719343c service nova] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Neutron deleted interface aef634ef-906c-43a3-bea0-bb5e3c94930f; detaching it from the instance and deleting it from the info cache
May 28 01:13:41.821686 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-f77d94a0-c358-4285-a2ec-ffd6923c8729 req-b3c0a75b-d59d-43cc-a8d3-529e9719343c service nova] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Detach interface failed, port_id=aef634ef-906c-43a3-bea0-bb5e3c94930f, reason: Instance 60b7855e-1385-4a4b-89c8-f3c0f71f3959 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:13:41.988058 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "e8151422-37a0-4b7a-914f-34dc2979ead9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:41.988058 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:42.084767 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e1dac644-f703-412a-8b2d-a74f7d49f7f4 req-09fb87f0-8ba7-4c32-9735-45fb13bf1dac service nova] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Received event network-vif-unplugged-aef634ef-906c-43a3-bea0-bb5e3c94930f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:13:42.084959 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e1dac644-f703-412a-8b2d-a74f7d49f7f4 req-09fb87f0-8ba7-4c32-9735-45fb13bf1dac service nova] Acquiring lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:42.085135 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e1dac644-f703-412a-8b2d-a74f7d49f7f4 req-09fb87f0-8ba7-4c32-9735-45fb13bf1dac service nova] Lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:42.085282 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e1dac644-f703-412a-8b2d-a74f7d49f7f4 req-09fb87f0-8ba7-4c32-9735-45fb13bf1dac service nova] Lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:42.085528 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e1dac644-f703-412a-8b2d-a74f7d49f7f4 req-09fb87f0-8ba7-4c32-9735-45fb13bf1dac service nova] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] No waiting events found dispatching network-vif-unplugged-aef634ef-906c-43a3-bea0-bb5e3c94930f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:13:42.085617 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e1dac644-f703-412a-8b2d-a74f7d49f7f4 req-09fb87f0-8ba7-4c32-9735-45fb13bf1dac service nova] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Received event network-vif-unplugged-aef634ef-906c-43a3-bea0-bb5e3c94930f for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:13:42.085730 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e1dac644-f703-412a-8b2d-a74f7d49f7f4 req-09fb87f0-8ba7-4c32-9735-45fb13bf1dac service nova] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Received event network-changed-26c13825-b801-4d7c-ad2d-62db205cea2d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:13:42.085857 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e1dac644-f703-412a-8b2d-a74f7d49f7f4 req-09fb87f0-8ba7-4c32-9735-45fb13bf1dac service nova] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Refreshing instance network info cache due to event network-changed-26c13825-b801-4d7c-ad2d-62db205cea2d. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:13:42.086022 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e1dac644-f703-412a-8b2d-a74f7d49f7f4 req-09fb87f0-8ba7-4c32-9735-45fb13bf1dac service nova] Acquiring lock "refresh_cache-14694771-0e2d-420f-8b96-7bd28ffcf4c2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:13:42.086136 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e1dac644-f703-412a-8b2d-a74f7d49f7f4 req-09fb87f0-8ba7-4c32-9735-45fb13bf1dac service nova] Acquired lock "refresh_cache-14694771-0e2d-420f-8b96-7bd28ffcf4c2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:13:42.086282 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-e1dac644-f703-412a-8b2d-a74f7d49f7f4 req-09fb87f0-8ba7-4c32-9735-45fb13bf1dac service nova] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Refreshing network info cache for port 26c13825-b801-4d7c-ad2d-62db205cea2d {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:13:42.260020 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:13:42.489217 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Detaching volume e92af439-ed11-4ca7-994a-5580fa2498cc
May 28 01:13:42.524851 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Attempting to driver detach volume e92af439-ed11-4ca7-994a-5580fa2498cc from mountpoint /dev/vdc
May 28 01:13:42.575274 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e92af439-ed11-4ca7-994a-5580fa2498cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-5'}, 'status': 'reserved', 'instance': 'e8151422-37a0-4b7a-914f-34dc2979ead9', 'attached_at': '', 'detached_at': '', 'volume_id': 'e92af439-ed11-4ca7-994a-5580fa2498cc', 'serial': 'e92af439-ed11-4ca7-994a-5580fa2498cc'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 01:13:42.579782 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Found disk vdc by alias ua-e92af439-ed11-4ca7-994a-5580fa2498cc {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:13:42.581078 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Found disk vdc by alias ua-e92af439-ed11-4ca7-994a-5580fa2498cc {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:13:42.581167 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Attempting to detach device vdc from instance e8151422-37a0-4b7a-914f-34dc2979ead9 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:13:42.581382 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:13:42.581382 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:13:42.581382 np0000001577 nova-compute[98319]:   <alias name="ua-e92af439-ed11-4ca7-994a-5580fa2498cc"/>
May 28 01:13:42.581382 np0000001577 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-5"/>
May 28 01:13:42.581382 np0000001577 nova-compute[98319]:   <target dev="vdc" bus="virtio"/>
May 28 01:13:42.581382 np0000001577 nova-compute[98319]:   <serial>e92af439-ed11-4ca7-994a-5580fa2498cc</serial>
May 28 01:13:42.581382 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 01:13:42.581382 np0000001577 nova-compute[98319]:   <encryption format="luks">
May 28 01:13:42.581382 np0000001577 nova-compute[98319]:     <secret type="passphrase" uuid="749153a9-c5bf-448d-aa49-d547c0857e73"/>
May 28 01:13:42.581382 np0000001577 nova-compute[98319]:   </encryption>
May 28 01:13:42.581382 np0000001577 nova-compute[98319]: </disk>
May 28 01:13:42.581382 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:13:42.589431 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-e1dac644-f703-412a-8b2d-a74f7d49f7f4 req-09fb87f0-8ba7-4c32-9735-45fb13bf1dac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:13:42.595082 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Successfully detached device vdc from instance e8151422-37a0-4b7a-914f-34dc2979ead9 from the persistent domain config.
May 28 01:13:42.595244 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] (1/8): Attempting to detach device vdc with device alias ua-e92af439-ed11-4ca7-994a-5580fa2498cc from instance e8151422-37a0-4b7a-914f-34dc2979ead9 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:13:42.595704 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:13:42.595704 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:13:42.595704 np0000001577 nova-compute[98319]:   <alias name="ua-e92af439-ed11-4ca7-994a-5580fa2498cc"/>
May 28 01:13:42.595704 np0000001577 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-5"/>
May 28 01:13:42.595704 np0000001577 nova-compute[98319]:   <target dev="vdc" bus="virtio"/>
May 28 01:13:42.595704 np0000001577 nova-compute[98319]:   <serial>e92af439-ed11-4ca7-994a-5580fa2498cc</serial>
May 28 01:13:42.595704 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 01:13:42.595704 np0000001577 nova-compute[98319]:   <encryption format="luks">
May 28 01:13:42.595704 np0000001577 nova-compute[98319]:     <secret type="passphrase" uuid="749153a9-c5bf-448d-aa49-d547c0857e73"/>
May 28 01:13:42.595704 np0000001577 nova-compute[98319]:   </encryption>
May 28 01:13:42.595704 np0000001577 nova-compute[98319]: </disk>
May 28 01:13:42.595704 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:13:42.766055 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Took 1.56 seconds to deallocate network for instance.
May 28 01:13:42.921307 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-e1dac644-f703-412a-8b2d-a74f7d49f7f4 req-09fb87f0-8ba7-4c32-9735-45fb13bf1dac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:13:43.063267 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-e1dac644-f703-412a-8b2d-a74f7d49f7f4 req-09fb87f0-8ba7-4c32-9735-45fb13bf1dac service nova] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Updated VIF entry in instance network info cache for port 26c13825-b801-4d7c-ad2d-62db205cea2d. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:13:43.063517 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-e1dac644-f703-412a-8b2d-a74f7d49f7f4 req-09fb87f0-8ba7-4c32-9735-45fb13bf1dac service nova] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Updating instance_info_cache with network_info: [{"id": "26c13825-b801-4d7c-ad2d-62db205cea2d", "address": "fa:16:3e:04:7d:17", "network": {"id": "0be6df83-bfa0-4c90-aed3-88212317cb4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-252451076-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1880a27e1ad0432f914e086d7fffdeb4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c13825-b8", "ovs_interfaceid": "26c13825-b801-4d7c-ad2d-62db205cea2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:13:43.168703 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930823.1683705, e8151422-37a0-4b7a-914f-34dc2979ead9 => ua-e92af439-ed11-4ca7-994a-5580fa2498cc> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:13:43.174169 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-e92af439-ed11-4ca7-994a-5580fa2498cc for instance e8151422-37a0-4b7a-914f-34dc2979ead9 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:13:43.176497 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Successfully detached device vdc from instance e8151422-37a0-4b7a-914f-34dc2979ead9 from the live domain config.
May 28 01:13:43.178966 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:13:43.178966 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e92af439-ed11-4ca7-994a-5580fa2498cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:13:43.179134 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:13:43.179366 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:13:43.179630 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e92af439-ed11-4ca7-994a-5580fa2498cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:13:43.179737 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:13:43.206226 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:43.206226 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:43.206226 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:43.206226 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:43.206226 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:43.206226 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:43.206226 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:43.206226 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:43.206226 np0000001577 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355 (non-flash)
May 28 01:13:43.206226 np0000001577 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355 (non-flash)
May 28 01:13:43.206226 np0000001577 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34f09347-325e-489b-92ef-0a67fbf8bdbb (non-flash)
May 28 01:13:43.206226 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:13:43.206668 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:43.206668 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:43.206668 np0000001577 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:43.206668 np0000001577 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc (non-flash)
May 28 01:13:43.206668 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:43.206668 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:43.206668 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:43.206668 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:43.206668 np0000001577 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355 (non-flash)
May 28 01:13:43.206668 np0000001577 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355 (non-flash)
May 28 01:13:43.206668 np0000001577 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34f09347-325e-489b-92ef-0a67fbf8bdbb (non-flash)
May 28 01:13:43.206668 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:13:43.206668 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', '164'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', '165'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', '169'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', '170'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', '185'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355', '187'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355', '188'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-34f09347-325e-489b-92ef-0a67fbf8bdbb', '189')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:13:43.206938 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', '169')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:13:43.207718 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc', '170')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:13:43.208552 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c9870420cc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc'): ({'sdn'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:13:43.209009 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Removing multipathed devices sdm, sdn {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:13:43.209201 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Flush multipath device 330000000842784d6 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:13:43.244328 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:13:43.272524 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f0f05a7f-4e6b-4cc0-b4cf-59b214a5af49 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:43.273316 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f0f05a7f-4e6b-4cc0-b4cf-59b214a5af49 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:43.283968 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:13:43.324038 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Checking to see if SCSI volumes sdm, sdn have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:13:43.324196 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] SCSI volumes sdm, sdn have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:13:43.325513 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Checking to see if device paths {'sdm', 'sdn'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:13:43.337907 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Device paths {'sdm', 'sdn'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:13:43.338080 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:13:43.346991 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:43.391693 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 169, target: iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc, portal: 192.168.40.100,3260]
May 28 01:13:43.391693 np0000001577 nova-compute[98319]: Logout of [sid: 169, target: iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc, portal: 192.168.40.100,3260] successful.
May 28 01:13:43.391693 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:43.419808 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:43.430434 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:43.478251 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 170, target: iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc, portal: 192.168.50.100,3260]
May 28 01:13:43.478251 np0000001577 nova-compute[98319]: Logout of [sid: 170, target: iqn.2023-03.storpool.com:os--volume-e92af439-ed11-4ca7-994a-5580fa2498cc, portal: 192.168.50.100,3260] successful.
May 28 01:13:43.478251 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:43.497734 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:43.500233 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:13:43.500233 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] <== disconnect_volume: return (321ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:13:43.500233 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:13:43.565278 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e1dac644-f703-412a-8b2d-a74f7d49f7f4 req-09fb87f0-8ba7-4c32-9735-45fb13bf1dac service nova] Releasing lock "refresh_cache-14694771-0e2d-420f-8b96-7bd28ffcf4c2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:13:43.566936 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f0f05a7f-4e6b-4cc0-b4cf-59b214a5af49 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:13:43.567108 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-f0f05a7f-4e6b-4cc0-b4cf-59b214a5af49 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:13:43.978392 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:13:43.978681 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:13:44.044201 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lazy-loading 'flavor' on Instance uuid e8151422-37a0-4b7a-914f-34dc2979ead9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:13:44.069225 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-f0f05a7f-4e6b-4cc0-b4cf-59b214a5af49 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:13:44.319816 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "78222e75-5ee3-4478-8f29-391c88192956" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:44.320170 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "78222e75-5ee3-4478-8f29-391c88192956" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:44.574586 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f0f05a7f-4e6b-4cc0-b4cf-59b214a5af49 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.301s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:44.622377 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-f0f05a7f-4e6b-4cc0-b4cf-59b214a5af49 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Deleted allocations for instance 60b7855e-1385-4a4b-89c8-f3c0f71f3959
May 28 01:13:44.821587 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:13:44.977910 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:13:45.051714 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ca96a3f8-cc20-48e1-a3b4-3372238da0fb tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.064s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:45.273947 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "e8151422-37a0-4b7a-914f-34dc2979ead9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:45.274155 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:45.364025 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:45.364327 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:45.368576 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:13:45.368826 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Claim successful on node np0000001577
May 28 01:13:45.482525 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:45.629646 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f0f05a7f-4e6b-4cc0-b4cf-59b214a5af49 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "60b7855e-1385-4a4b-89c8-f3c0f71f3959" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.283s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:45.692830 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:45.777112 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Detaching volume dcba93e1-027e-4d13-816c-65749a70f47b
May 28 01:13:45.817180 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Attempting to driver detach volume dcba93e1-027e-4d13-816c-65749a70f47b from mountpoint /dev/vdb
May 28 01:13:45.822371 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Found disk vdb by alias ua-dcba93e1-027e-4d13-816c-65749a70f47b {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:13:45.823855 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Found disk vdb by alias ua-dcba93e1-027e-4d13-816c-65749a70f47b {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:13:45.823975 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Attempting to detach device vdb from instance e8151422-37a0-4b7a-914f-34dc2979ead9 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:13:45.824286 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:13:45.824286 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:13:45.824286 np0000001577 nova-compute[98319]:   <alias name="ua-dcba93e1-027e-4d13-816c-65749a70f47b"/>
May 28 01:13:45.824286 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-2"/>
May 28 01:13:45.824286 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:13:45.824286 np0000001577 nova-compute[98319]:   <serial>dcba93e1-027e-4d13-816c-65749a70f47b</serial>
May 28 01:13:45.824286 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:13:45.824286 np0000001577 nova-compute[98319]: </disk>
May 28 01:13:45.824286 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:13:45.830294 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Successfully detached device vdb from instance e8151422-37a0-4b7a-914f-34dc2979ead9 from the persistent domain config.
May 28 01:13:45.830465 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] (1/8): Attempting to detach device vdb with device alias ua-dcba93e1-027e-4d13-816c-65749a70f47b from instance e8151422-37a0-4b7a-914f-34dc2979ead9 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:13:45.830699 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:13:45.830699 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:13:45.830699 np0000001577 nova-compute[98319]:   <alias name="ua-dcba93e1-027e-4d13-816c-65749a70f47b"/>
May 28 01:13:45.830699 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-2"/>
May 28 01:13:45.830699 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:13:45.830699 np0000001577 nova-compute[98319]:   <serial>dcba93e1-027e-4d13-816c-65749a70f47b</serial>
May 28 01:13:45.830699 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:13:45.830699 np0000001577 nova-compute[98319]: </disk>
May 28 01:13:45.830699 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:13:46.302714 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930826.3022618, e8151422-37a0-4b7a-914f-34dc2979ead9 => ua-dcba93e1-027e-4d13-816c-65749a70f47b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:13:46.306890 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-dcba93e1-027e-4d13-816c-65749a70f47b for instance e8151422-37a0-4b7a-914f-34dc2979ead9 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:13:46.312076 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Successfully detached device vdb from instance e8151422-37a0-4b7a-914f-34dc2979ead9 from the live domain config.
May 28 01:13:46.313326 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:13:46.313700 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcba93e1-027e-4d13-816c-65749a70f47b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:13:46.313817 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:13:46.314096 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:13:46.314329 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcba93e1-027e-4d13-816c-65749a70f47b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:13:46.314438 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:13:46.343977 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:46.343977 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:46.343977 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:46.343977 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:46.343977 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:46.343977 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:46.343977 np0000001577 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355 (non-flash)
May 28 01:13:46.343977 np0000001577 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355 (non-flash)
May 28 01:13:46.343977 np0000001577 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34f09347-325e-489b-92ef-0a67fbf8bdbb (non-flash)
May 28 01:13:46.343977 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:13:46.344415 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsi session list stdout=tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:46.344415 np0000001577 nova-compute[98319]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b (non-flash)
May 28 01:13:46.344415 np0000001577 nova-compute[98319]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:46.344415 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:46.344415 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:46.344415 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:46.344415 np0000001577 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355 (non-flash)
May 28 01:13:46.344415 np0000001577 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355 (non-flash)
May 28 01:13:46.344415 np0000001577 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34f09347-325e-489b-92ef-0a67fbf8bdbb (non-flash)
May 28 01:13:46.344415 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:13:46.344415 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', '164'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', '165'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', '185'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355', '187'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355', '188'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-34f09347-325e-489b-92ef-0a67fbf8bdbb', '189')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:13:46.344797 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', '165')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:13:46.345505 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b', '164')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:13:46.346375 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c98704b6ac0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b'): ({'sdc'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:13:46.346623 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:13:46.346900 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Flush multipath device 33000000094011810 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:13:46.377197 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:13:46.426174 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:13:46.470021 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:13:46.470186 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:13:46.471370 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:13:46.483108 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:13:46.483258 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:13:46.495847 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:46.532023 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 165, target: iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b, portal: 192.168.40.100,3260]
May 28 01:13:46.532023 np0000001577 nova-compute[98319]: Logout of [sid: 165, target: iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b, portal: 192.168.40.100,3260] successful.
May 28 01:13:46.532023 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:46.560842 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:46.575310 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:46.612610 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 164, target: iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b, portal: 192.168.50.100,3260]
May 28 01:13:46.612610 np0000001577 nova-compute[98319]: Logout of [sid: 164, target: iqn.2023-03.storpool.com:os--volume-dcba93e1-027e-4d13-816c-65749a70f47b, portal: 192.168.50.100,3260] successful.
May 28 01:13:46.612610 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:46.614603 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:46.627881 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:46.628120 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:13:46.628260 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] <== disconnect_volume: return (314ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:13:46.628398 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:13:46.667875 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:13:46.668053 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:13:47.170459 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:13:47.176255 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lazy-loading 'flavor' on Instance uuid e8151422-37a0-4b7a-914f-34dc2979ead9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:13:47.681329 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.317s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:47.682874 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:13:47.684876 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 2.202s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:47.685264 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:47.685400 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Auditing locally available compute resources for np0000001577 (node: np0000001577) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 01:13:48.189261 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-55de5a1f-a835-428e-b4dd-d6f549c4427e tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.915s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:48.190070 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:13:48.190206 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:13:48.190879 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:13:48.191084 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:13:48.252317 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0505bf2e15ba44ad881b94106ae054a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2f65d208f44146903c7dcf0b143a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:13:48.511647 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "f0e996d3-b051-421c-b00c-1dbc6971f8e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:48.512096 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "f0e996d3-b051-421c-b00c-1dbc6971f8e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:48.675454 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Successfully created port: d2012ded-4851-468b-9f75-d2adb6cca344 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:13:48.694132 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:13:48.717699 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:13:48.801110 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:13:48.801627 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:13:48.891281 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:13:48.895890 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:13:48.898096 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26af0b2c-7e35-4e53-85eb-71ddca16fbfa/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:13:48.994858 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26af0b2c-7e35-4e53-85eb-71ddca16fbfa/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:13:48.995500 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26af0b2c-7e35-4e53-85eb-71ddca16fbfa/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:13:49.022921 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:13:49.114853 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26af0b2c-7e35-4e53-85eb-71ddca16fbfa/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:13:49.115184 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-10 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:13:49.124257 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:13:49.128407 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:13:49.129250 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:13:49.184377 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "env LANG=C uptime" returned: 0 in 0.054s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:13:49.185646 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Successfully updated port: d2012ded-4851-468b-9f75-d2adb6cca344 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:13:49.187113 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Hypervisor/Node resource view: name=np0000001577 free_ram=12190MB free_disk=72.71617126464844GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 01:13:49.187272 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:49.187449 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:49.197119 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:13:49.230006 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-24c44813-5bfb-4ee2-a023-a436ce5c3140 req-d2bf5023-f6aa-45b9-a7dc-94a52c49871f service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Received event network-changed-d2012ded-4851-468b-9f75-d2adb6cca344 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:13:49.230127 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-24c44813-5bfb-4ee2-a023-a436ce5c3140 req-d2bf5023-f6aa-45b9-a7dc-94a52c49871f service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Refreshing instance network info cache due to event network-changed-d2012ded-4851-468b-9f75-d2adb6cca344. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:13:49.230297 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-24c44813-5bfb-4ee2-a023-a436ce5c3140 req-d2bf5023-f6aa-45b9-a7dc-94a52c49871f service nova] Acquiring lock "refresh_cache-78222e75-5ee3-4478-8f29-391c88192956" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:13:49.230388 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-24c44813-5bfb-4ee2-a023-a436ce5c3140 req-d2bf5023-f6aa-45b9-a7dc-94a52c49871f service nova] Acquired lock "refresh_cache-78222e75-5ee3-4478-8f29-391c88192956" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:13:49.230815 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-24c44813-5bfb-4ee2-a023-a436ce5c3140 req-d2bf5023-f6aa-45b9-a7dc-94a52c49871f service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Refreshing network info cache for port d2012ded-4851-468b-9f75-d2adb6cca344 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:13:49.573584 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:49.690735 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "refresh_cache-78222e75-5ee3-4478-8f29-391c88192956" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:13:49.733717 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-24c44813-5bfb-4ee2-a023-a436ce5c3140 req-d2bf5023-f6aa-45b9-a7dc-94a52c49871f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:13:49.791051 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-24c44813-5bfb-4ee2-a023-a436ce5c3140 req-d2bf5023-f6aa-45b9-a7dc-94a52c49871f service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:13:49.908601 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-24c44813-5bfb-4ee2-a023-a436ce5c3140 req-d2bf5023-f6aa-45b9-a7dc-94a52c49871f service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:13:50.223329 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:13:50.225283 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:13:50.225811 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Creating image(s)
May 28 01:13:50.226254 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "/opt/stack/data/nova/instances/78222e75-5ee3-4478-8f29-391c88192956/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:50.226493 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "/opt/stack/data/nova/instances/78222e75-5ee3-4478-8f29-391c88192956/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:50.227183 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "/opt/stack/data/nova/instances/78222e75-5ee3-4478-8f29-391c88192956/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:50.227467 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "4c467f17aff73e445ca59c858a845a88d8381bf1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:50.228005 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "4c467f17aff73e445ca59c858a845a88d8381bf1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:50.262179 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0005781779996141267 future=<Future at 0x7c984c7d6450 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:13:50.262312 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:13:50.262366 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=5.951251051999861 future=<Future at 0x7c98705bc680 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:13:50.262429 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=5.9511819330000435 future=<Future at 0x7c98705bc680 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:13:50.263200 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Emitting event <LifecycleEvent: 1779930815.2615004, 4edb886b-df1e-42fd-9881-91fc07339c3f => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:13:50.263468 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] VM Stopped (Lifecycle Event)
May 28 01:13:50.303582 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance e8151422-37a0-4b7a-914f-34dc2979ead9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:13:50.303758 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:13:50.303875 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 26af0b2c-7e35-4e53-85eb-71ddca16fbfa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:13:50.303990 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 14694771-0e2d-420f-8b96-7bd28ffcf4c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:13:50.304054 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 78222e75-5ee3-4478-8f29-391c88192956 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:13:50.410655 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-24c44813-5bfb-4ee2-a023-a436ce5c3140 req-d2bf5023-f6aa-45b9-a7dc-94a52c49871f service nova] Releasing lock "refresh_cache-78222e75-5ee3-4478-8f29-391c88192956" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:13:50.410655 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquired lock "refresh_cache-78222e75-5ee3-4478-8f29-391c88192956" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:13:50.410914 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:13:50.561065 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:50.561267 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:50.666218 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:13:50.668449 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:13:50.668757 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c467f17aff73e445ca59c858a845a88d8381bf1.part --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:13:50.698357 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:50.767571 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-6ed9f18e-f22b-486c-bd7f-fc036b00bce2 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 4edb886b-df1e-42fd-9881-91fc07339c3f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:13:50.807196 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance f0e996d3-b051-421c-b00c-1dbc6971f8e6 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 28 01:13:50.807429 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 01:13:50.807662 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Final resource view: name=np0000001577 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:13:49 up 45 min,  2 users,  load average: 2.81, 4.45, 4.12\n', 'num_instances': '5', 'num_vm_active': '4', 'num_task_None': '4', 'num_os_type_None': '5', 'num_proj_07f3bdd3aef04045aac40e4b851915e1': '1', 'io_workload': '1', 'num_proj_1880a27e1ad0432f914e086d7fffdeb4': '2', 'num_proj_0e5e86340fc8435f8e3c83322ba82560': '1', 'num_vm_building': '1', 'num_task_networking': '1', 'num_proj_fb2f65d208f44146903c7dcf0b143a8e': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 01:13:50.846463 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c467f17aff73e445ca59c858a845a88d8381bf1.part --force-share --output=json" returned: 0 in 0.178s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:13:50.846860 np0000001577 nova-compute[98319]: DEBUG nova.virt.images [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] f9481693-46f4-404f-9366-9056d8343587 was qcow2, converting to raw {{(pid=98319) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 01:13:50.847361 np0000001577 nova-compute[98319]: DEBUG nova.privsep.utils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 01:13:50.848350 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4c467f17aff73e445ca59c858a845a88d8381bf1.part /opt/stack/data/nova/instances/_base/4c467f17aff73e445ca59c858a845a88d8381bf1.converted {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:13:50.984839 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4c467f17aff73e445ca59c858a845a88d8381bf1.part /opt/stack/data/nova/instances/_base/4c467f17aff73e445ca59c858a845a88d8381bf1.converted" returned: 0 in 0.136s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:13:50.989636 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c467f17aff73e445ca59c858a845a88d8381bf1.converted --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:13:51.010726 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:13:51.064013 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Detaching volume e9ceefa1-99e8-44e6-a7f9-5659e115b355
May 28 01:13:51.077869 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c467f17aff73e445ca59c858a845a88d8381bf1.converted --force-share --output=json" returned: 0 in 0.088s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:13:51.081487 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "4c467f17aff73e445ca59c858a845a88d8381bf1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.853s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:51.082173 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:13:51.085466 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:13:51.086758 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c467f17aff73e445ca59c858a845a88d8381bf1 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:13:51.136129 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Attempting to driver detach volume e9ceefa1-99e8-44e6-a7f9-5659e115b355 from mountpoint /dev/vdb
May 28 01:13:51.149068 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Found disk vdb by alias ua-e9ceefa1-99e8-44e6-a7f9-5659e115b355 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:13:51.150036 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Found disk vdb by alias ua-e9ceefa1-99e8-44e6-a7f9-5659e115b355 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:13:51.150189 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Attempting to detach device vdb from instance 26af0b2c-7e35-4e53-85eb-71ddca16fbfa from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:13:51.150502 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:13:51.150502 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:13:51.150502 np0000001577 nova-compute[98319]:   <alias name="ua-e9ceefa1-99e8-44e6-a7f9-5659e115b355"/>
May 28 01:13:51.150502 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-10"/>
May 28 01:13:51.150502 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:13:51.150502 np0000001577 nova-compute[98319]:   <serial>e9ceefa1-99e8-44e6-a7f9-5659e115b355</serial>
May 28 01:13:51.150502 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:13:51.150502 np0000001577 nova-compute[98319]: </disk>
May 28 01:13:51.150502 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:13:51.156311 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Successfully detached device vdb from instance 26af0b2c-7e35-4e53-85eb-71ddca16fbfa from the persistent domain config.
May 28 01:13:51.156504 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] (1/8): Attempting to detach device vdb with device alias ua-e9ceefa1-99e8-44e6-a7f9-5659e115b355 from instance 26af0b2c-7e35-4e53-85eb-71ddca16fbfa from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:13:51.156808 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:13:51.156808 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:13:51.156808 np0000001577 nova-compute[98319]:   <alias name="ua-e9ceefa1-99e8-44e6-a7f9-5659e115b355"/>
May 28 01:13:51.156808 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-10"/>
May 28 01:13:51.156808 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:13:51.156808 np0000001577 nova-compute[98319]:   <serial>e9ceefa1-99e8-44e6-a7f9-5659e115b355</serial>
May 28 01:13:51.156808 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:13:51.156808 np0000001577 nova-compute[98319]: </disk>
May 28 01:13:51.156808 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:13:51.183385 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c467f17aff73e445ca59c858a845a88d8381bf1 --force-share --output=json" returned: 0 in 0.096s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:13:51.183848 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "4c467f17aff73e445ca59c858a845a88d8381bf1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:51.184298 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "4c467f17aff73e445ca59c858a845a88d8381bf1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:51.184788 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:13:51.188009 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:13:51.189462 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c467f17aff73e445ca59c858a845a88d8381bf1 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:13:51.215245 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:13:51.215689 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:13:51.277940 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:13:51.286093 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c467f17aff73e445ca59c858a845a88d8381bf1 --force-share --output=json" returned: 0 in 0.097s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:13:51.286888 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4c467f17aff73e445ca59c858a845a88d8381bf1,backing_fmt=raw /opt/stack/data/nova/instances/78222e75-5ee3-4478-8f29-391c88192956/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:13:51.377142 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4c467f17aff73e445ca59c858a845a88d8381bf1,backing_fmt=raw /opt/stack/data/nova/instances/78222e75-5ee3-4478-8f29-391c88192956/disk 1073741824" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:13:51.377807 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "4c467f17aff73e445ca59c858a845a88d8381bf1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:51.378265 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c467f17aff73e445ca59c858a845a88d8381bf1 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:13:51.459390 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Updating instance_info_cache with network_info: [{"id": "d2012ded-4851-468b-9f75-d2adb6cca344", "address": "fa:16:3e:04:74:31", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2012ded-48", "ovs_interfaceid": "d2012ded-4851-468b-9f75-d2adb6cca344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:13:51.495890 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c467f17aff73e445ca59c858a845a88d8381bf1 --force-share --output=json" returned: 0 in 0.117s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:13:51.496369 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Checking if we can resize image /opt/stack/data/nova/instances/78222e75-5ee3-4478-8f29-391c88192956/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:13:51.496651 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78222e75-5ee3-4478-8f29-391c88192956/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:13:51.586988 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930831.5862997, 26af0b2c-7e35-4e53-85eb-71ddca16fbfa => ua-e9ceefa1-99e8-44e6-a7f9-5659e115b355> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:13:51.587192 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e9ceefa1-99e8-44e6-a7f9-5659e115b355 for instance 26af0b2c-7e35-4e53-85eb-71ddca16fbfa {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:13:51.589665 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Successfully detached device vdb from instance 26af0b2c-7e35-4e53-85eb-71ddca16fbfa from the live domain config.
May 28 01:13:51.592007 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:13:51.592007 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355', 'iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e9ceefa1-99e8-44e6-a7f9-5659e115b355', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:13:51.592007 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:13:51.592007 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:13:51.592007 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355', 'iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e9ceefa1-99e8-44e6-a7f9-5659e115b355', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:13:51.592007 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:13:51.610245 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78222e75-5ee3-4478-8f29-391c88192956/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:13:51.610602 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Cannot resize image /opt/stack/data/nova/instances/78222e75-5ee3-4478-8f29-391c88192956/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:13:51.610877 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:13:51.611062 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Ensure instance console log exists: /opt/stack/data/nova/instances/78222e75-5ee3-4478-8f29-391c88192956/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:13:51.611281 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:51.611451 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:51.611583 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:51.617937 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:51.621983 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:51.621983 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:51.621983 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:51.621983 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:51.621983 np0000001577 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355 (non-flash)
May 28 01:13:51.621983 np0000001577 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355 (non-flash)
May 28 01:13:51.621983 np0000001577 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34f09347-325e-489b-92ef-0a67fbf8bdbb (non-flash)
May 28 01:13:51.621983 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:13:51.621983 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:51.621983 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:13:51.621983 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:51.621983 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:13:51.621983 np0000001577 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355 (non-flash)
May 28 01:13:51.621983 np0000001577 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355 (non-flash)
May 28 01:13:51.621983 np0000001577 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-34f09347-325e-489b-92ef-0a67fbf8bdbb (non-flash)
May 28 01:13:51.621983 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:13:51.621983 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', '185'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355', '187'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355', '188'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-34f09347-325e-489b-92ef-0a67fbf8bdbb', '189')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:13:51.621983 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355', '187')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:13:51.622938 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355', '188')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:13:51.624011 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c984c52cc20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355'): ({'sdh'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:13:51.624410 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Removing multipathed devices sdg, sdh {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:13:51.624752 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Flush multipath device 3300000007a5072b4 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:13:51.665948 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:13:51.724436 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:13:51.729966 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:13:51.793138 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Checking to see if SCSI volumes sdg, sdh have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:13:51.793138 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] SCSI volumes sdg, sdh have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:13:51.793138 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Checking to see if device paths {'sdg', 'sdh'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:13:51.803709 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Device paths {'sdg', 'sdh'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:13:51.803709 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:13:51.814511 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:51.847555 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 187, target: iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355, portal: 192.168.40.100,3260]
May 28 01:13:51.847555 np0000001577 nova-compute[98319]: Logout of [sid: 187, target: iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355, portal: 192.168.40.100,3260] successful.
May 28 01:13:51.847555 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:51.862649 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:51.874372 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:51.901449 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 188, target: iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355, portal: 192.168.50.100,3260]
May 28 01:13:51.901449 np0000001577 nova-compute[98319]: Logout of [sid: 188, target: iqn.2023-03.storpool.com:os--volume-e9ceefa1-99e8-44e6-a7f9-5659e115b355, portal: 192.168.50.100,3260] successful.
May 28 01:13:51.901449 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:51.915325 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:51.915325 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:13:51.915325 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] <== disconnect_volume: return (324ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:13:51.915325 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:13:51.962444 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Releasing lock "refresh_cache-78222e75-5ee3-4478-8f29-391c88192956" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:13:51.962947 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Instance network_info: |[{"id": "d2012ded-4851-468b-9f75-d2adb6cca344", "address": "fa:16:3e:04:74:31", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2012ded-48", "ovs_interfaceid": "d2012ded-4851-468b-9f75-d2adb6cca344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:13:51.964445 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Start _get_guest_xml network_info=[{"id": "d2012ded-4851-468b-9f75-d2adb6cca344", "address": "fa:16:3e:04:74:31", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2012ded-48", "ovs_interfaceid": "d2012ded-4851-468b-9f75-d2adb6cca344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:13:42Z,direct_url=<?>,disk_format='qcow2',id=f9481693-46f4-404f-9366-9056d8343587,min_disk=0,min_ram=0,name='tempest-scenario-img--943619693',owner='fb2f65d208f44146903c7dcf0b143a8e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:13:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'f9481693-46f4-404f-9366-9056d8343587'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:13:51.966712 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:13:51.967775 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f9481693-46f4-404f-9366-9056d8343587', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-31442484', uuid='78222e75-5ee3-4478-8f29-391c88192956'), owner=OwnerMeta(userid='0505bf2e15ba44ad881b94106ae054a5', username='tempest-TestMinimumBasicScenario-1681839017-project-member', projectid='fb2f65d208f44146903c7dcf0b143a8e', projectname='tempest-TestMinimumBasicScenario-1681839017'), image=ImageMeta(id='f9481693-46f4-404f-9366-9056d8343587', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d2012ded-4851-468b-9f75-d2adb6cca344", "address": "fa:16:3e:04:74:31", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2012ded-48", "ovs_interfaceid": "d2012ded-4851-468b-9f75-d2adb6cca344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930831.9674425) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:13:51.968779 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:13:51.969084 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:13:51.969921 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:13:51.970085 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:13:51.970884 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:13:51.971157 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T01:13:42Z,direct_url=<?>,disk_format='qcow2',id=f9481693-46f4-404f-9366-9056d8343587,min_disk=0,min_ram=0,name='tempest-scenario-img--943619693',owner='fb2f65d208f44146903c7dcf0b143a8e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T01:13:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:13:51.971294 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:13:51.971382 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:13:51.971540 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:13:51.971677 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:13:51.971797 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:13:51.971984 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:13:51.972110 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:13:51.972254 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:13:51.972407 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:13:51.972556 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:13:51.982933 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:13:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-31442484',display_name='tempest-TestMinimumBasicScenario-server-31442484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testminimumbasicscenario-server-31442484',id=74,image_ref='f9481693-46f4-404f-9366-9056d8343587',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHH6vLtnRBTetrR7YVT1x2n8DmihILEefk0Iy29RavOvxpRjx6tNxMsYGHg09zAPg7pE+9oRyljcKUmFSH1hDGIQozvsixLn9Pak0BluCn0AVB3Ws1R0gaUu4tntO7uQBQ==',key_name='tempest-TestMinimumBasicScenario-1202106926',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb2f65d208f44146903c7dcf0b143a8e',ramdisk_id='',reservation_id='r-pc3qnw2a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9481693-46f4-404f-9366-9056d8343587',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1681839017',owner_user_name='tempest-TestMinimumBasicScenario-1681839017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:13:49Z,user_data=None,user_id='0505bf2e15ba44ad881b94106ae054a5',uuid=78222e75-5ee3-4478-8f29-391c88192956,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2012ded-4851-468b-9f75-d2adb6cca344", "address": "fa:16:3e:04:74:31", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2012ded-48", "ovs_interfaceid": "d2012ded-4851-468b-9f75-d2adb6cca344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:13:51.983099 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Converting VIF {"id": "d2012ded-4851-468b-9f75-d2adb6cca344", "address": "fa:16:3e:04:74:31", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2012ded-48", "ovs_interfaceid": "d2012ded-4851-468b-9f75-d2adb6cca344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:13:51.983676 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:74:31,bridge_name='br-int',has_traffic_filtering=True,id=d2012ded-4851-468b-9f75-d2adb6cca344,network=Network(d9534aa6-926a-458a-a1d0-8512d11fe6a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2012ded-48') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:13:51.984139 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lazy-loading 'pci_devices' on Instance uuid 78222e75-5ee3-4478-8f29-391c88192956 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:13:52.032575 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c76df837-3048-4cff-9b20-ded4fd0826e6 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "e8151422-37a0-4b7a-914f-34dc2979ead9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:52.032575 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c76df837-3048-4cff-9b20-ded4fd0826e6 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:52.032575 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c76df837-3048-4cff-9b20-ded4fd0826e6 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "e8151422-37a0-4b7a-914f-34dc2979ead9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:52.032575 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c76df837-3048-4cff-9b20-ded4fd0826e6 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:52.032575 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c76df837-3048-4cff-9b20-ded4fd0826e6 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:52.033411 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-c76df837-3048-4cff-9b20-ded4fd0826e6 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Terminating instance
May 28 01:13:52.231677 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Compute_service record updated for np0000001577:np0000001577 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 01:13:52.231875 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.044s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:52.232291 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.659s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:52.232694 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:13:52.235560 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:13:52.235759 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Claim successful on node np0000001577
May 28 01:13:52.464095 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lazy-loading 'flavor' on Instance uuid 26af0b2c-7e35-4e53-85eb-71ddca16fbfa {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:13:52.486674 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] End _get_guest_xml xml=<domain type="qemu">
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:   <uuid>78222e75-5ee3-4478-8f29-391c88192956</uuid>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:   <name>instance-0000004a</name>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestMinimumBasicScenario-server-31442484</nova:name>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:13:51</nova:creationTime>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       <nova:image uuid="f9481693-46f4-404f-9366-9056d8343587">
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:         <nova:properties/>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:         <nova:user uuid="0505bf2e15ba44ad881b94106ae054a5">tempest-TestMinimumBasicScenario-1681839017-project-member</nova:user>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:         <nova:project uuid="fb2f65d208f44146903c7dcf0b143a8e">tempest-TestMinimumBasicScenario-1681839017</nova:project>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="f9481693-46f4-404f-9366-9056d8343587"/>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:         <nova:port uuid="d2012ded-4851-468b-9f75-d2adb6cca344">
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:     <system>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       <entry name="serial">78222e75-5ee3-4478-8f29-391c88192956</entry>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       <entry name="uuid">78222e75-5ee3-4478-8f29-391c88192956</entry>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:     </system>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:   <os>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:   </os>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:   <features>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:   </features>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:   <devices>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/78222e75-5ee3-4478-8f29-391c88192956/disk"/>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:     </disk>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/78222e75-5ee3-4478-8f29-391c88192956/disk.config"/>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:     </disk>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:04:74:31"/>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       <target dev="tapd2012ded-48"/>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:     </interface>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/78222e75-5ee3-4478-8f29-391c88192956/console.log" append="off"/>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:     </serial>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:     <video>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:     </video>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:     </rng>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:   </devices>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]: </domain>
May 28 01:13:52.486674 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:13:52.488687 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Preparing to wait for external event network-vif-plugged-d2012ded-4851-468b-9f75-d2adb6cca344 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:13:52.488687 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "78222e75-5ee3-4478-8f29-391c88192956-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:52.488687 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "78222e75-5ee3-4478-8f29-391c88192956-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:52.488687 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "78222e75-5ee3-4478-8f29-391c88192956-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:52.488687 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:13:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-31442484',display_name='tempest-TestMinimumBasicScenario-server-31442484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testminimumbasicscenario-server-31442484',id=74,image_ref='f9481693-46f4-404f-9366-9056d8343587',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHH6vLtnRBTetrR7YVT1x2n8DmihILEefk0Iy29RavOvxpRjx6tNxMsYGHg09zAPg7pE+9oRyljcKUmFSH1hDGIQozvsixLn9Pak0BluCn0AVB3Ws1R0gaUu4tntO7uQBQ==',key_name='tempest-TestMinimumBasicScenario-1202106926',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb2f65d208f44146903c7dcf0b143a8e',ramdisk_id='',reservation_id='r-pc3qnw2a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9481693-46f4-404f-9366-9056d8343587',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1681839017',owner_user_name='tempest-TestMinimumBasicScenario-1681839017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:13:49Z,user_data=None,user_id='0505bf2e15ba44ad881b94106ae054a5',uuid=78222e75-5ee3-4478-8f29-391c88192956,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2012ded-4851-468b-9f75-d2adb6cca344", "address": "fa:16:3e:04:74:31", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2012ded-48", "ovs_interfaceid": "d2012ded-4851-468b-9f75-d2adb6cca344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:13:52.488687 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Converting VIF {"id": "d2012ded-4851-468b-9f75-d2adb6cca344", "address": "fa:16:3e:04:74:31", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2012ded-48", "ovs_interfaceid": "d2012ded-4851-468b-9f75-d2adb6cca344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:13:52.488687 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:74:31,bridge_name='br-int',has_traffic_filtering=True,id=d2012ded-4851-468b-9f75-d2adb6cca344,network=Network(d9534aa6-926a-458a-a1d0-8512d11fe6a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2012ded-48') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:13:52.488997 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:74:31,bridge_name='br-int',has_traffic_filtering=True,id=d2012ded-4851-468b-9f75-d2adb6cca344,network=Network(d9534aa6-926a-458a-a1d0-8512d11fe6a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2012ded-48') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:13:52.489159 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:52.489414 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:13:52.489701 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:13:52.490269 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:52.490632 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79134410-8371-5715-9b44-2c58efcb4023', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:13:52.501051 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:52.501777 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:13:52.503746 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:52.503879 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2012ded-48, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:13:52.504145 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd2012ded-48, col_values=(('qos', UUID('f9832bb5-0000-4983-9e25-f30c9788af96')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:13:52.504288 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd2012ded-48, col_values=(('external_ids', {'iface-id': 'd2012ded-4851-468b-9f75-d2adb6cca344', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:74:31', 'vm-uuid': '78222e75-5ee3-4478-8f29-391c88192956'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:13:52.504940 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:52.505962 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:13:52.509815 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:52.510608 np0000001577 nova-compute[98319]: INFO os_vif [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:74:31,bridge_name='br-int',has_traffic_filtering=True,id=d2012ded-4851-468b-9f75-d2adb6cca344,network=Network(d9534aa6-926a-458a-a1d0-8512d11fe6a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2012ded-48')
May 28 01:13:52.536955 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-c76df837-3048-4cff-9b20-ded4fd0826e6 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:13:52.557918 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:52.560698 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:52.579148 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:52.580832 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:52.607810 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:52.700991 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7784c229-8820-491a-a928-090403f5de4a req-663341fb-418e-44cc-a8c6-07a9ae5ce36a service nova] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Received event network-vif-unplugged-f9933e16-d9fb-47e4-9e9a-3ba073b1a35f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:13:52.701916 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7784c229-8820-491a-a928-090403f5de4a req-663341fb-418e-44cc-a8c6-07a9ae5ce36a service nova] Acquiring lock "e8151422-37a0-4b7a-914f-34dc2979ead9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:52.701916 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7784c229-8820-491a-a928-090403f5de4a req-663341fb-418e-44cc-a8c6-07a9ae5ce36a service nova] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:52.701916 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7784c229-8820-491a-a928-090403f5de4a req-663341fb-418e-44cc-a8c6-07a9ae5ce36a service nova] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:52.701916 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7784c229-8820-491a-a928-090403f5de4a req-663341fb-418e-44cc-a8c6-07a9ae5ce36a service nova] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] No waiting events found dispatching network-vif-unplugged-f9933e16-d9fb-47e4-9e9a-3ba073b1a35f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:13:52.701916 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7784c229-8820-491a-a928-090403f5de4a req-663341fb-418e-44cc-a8c6-07a9ae5ce36a service nova] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Received event network-vif-unplugged-f9933e16-d9fb-47e4-9e9a-3ba073b1a35f for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:13:52.846373 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999124884000139 future=<Future at 0x7c984c6dcfb0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:13:52.850043 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Instance destroyed successfully.
May 28 01:13:52.850352 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-c76df837-3048-4cff-9b20-ded4fd0826e6 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lazy-loading 'resources' on Instance uuid e8151422-37a0-4b7a-914f-34dc2979ead9 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:13:53.232748 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:13:53.232989 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:13:53.233195 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:13:53.233369 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:13:53.233563 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:13:53.233745 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:13:53.233862 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 01:13:53.234070 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 38.74 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:13:53.353612 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-c76df837-3048-4cff-9b20-ded4fd0826e6 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:09:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-334526556',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumemultiattachtests-server-334526556',id=64,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZPR0Gj39BZcWrRlU1NY4uwBiAIpfhz5q66W9RrzOpiQ/np/JXsGVyBJNTTO+6yHZcqzSOevY1HNVzn2A/GM7sX1gKgxLatKq6sG+HtO56znleQjhIEua31xTu77Jqhlg==',key_name='tempest-keypair-2138912526',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:10:10Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07f3bdd3aef04045aac40e4b851915e1',ramdisk_id='',reservation_id='r-9yd6l23b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-1632400240',owner_user_name='tempest-VolumeMultiattachTests-1632400240-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:10:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ae6af3cf5df464bbc9da74d825ddb4e',uuid=e8151422-37a0-4b7a-914f-34dc2979ead9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9933e16-d9fb-47e4-9e9a-3ba073b1a35f", "address": "fa:16:3e:65:fa:89", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9933e16-d9", "ovs_interfaceid": "f9933e16-d9fb-47e4-9e9a-3ba073b1a35f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:13:53.353836 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c76df837-3048-4cff-9b20-ded4fd0826e6 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Converting VIF {"id": "f9933e16-d9fb-47e4-9e9a-3ba073b1a35f", "address": "fa:16:3e:65:fa:89", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9933e16-d9", "ovs_interfaceid": "f9933e16-d9fb-47e4-9e9a-3ba073b1a35f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:13:53.354465 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c76df837-3048-4cff-9b20-ded4fd0826e6 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:fa:89,bridge_name='br-int',has_traffic_filtering=True,id=f9933e16-d9fb-47e4-9e9a-3ba073b1a35f,network=Network(7357480b-2ba7-465c-88fe-aaf2e8f7a673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9933e16-d9') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:13:53.354750 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-c76df837-3048-4cff-9b20-ded4fd0826e6 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:fa:89,bridge_name='br-int',has_traffic_filtering=True,id=f9933e16-d9fb-47e4-9e9a-3ba073b1a35f,network=Network(7357480b-2ba7-465c-88fe-aaf2e8f7a673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9933e16-d9') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:13:53.356417 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:53.357073 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9933e16-d9, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:13:53.360000 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:53.360643 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:13:53.366247 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:53.367156 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:53.367287 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ccd80b53-cb27-4286-be39-1f3516ea376a) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:13:53.367742 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:53.368159 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:13:53.373681 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:53.376916 np0000001577 nova-compute[98319]: INFO os_vif [None req-c76df837-3048-4cff-9b20-ded4fd0826e6 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:fa:89,bridge_name='br-int',has_traffic_filtering=True,id=f9933e16-d9fb-47e4-9e9a-3ba073b1a35f,network=Network(7357480b-2ba7-465c-88fe-aaf2e8f7a673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9933e16-d9')
May 28 01:13:53.377162 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c76df837-3048-4cff-9b20-ded4fd0826e6 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Deleting instance files /opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9_del
May 28 01:13:53.377843 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c76df837-3048-4cff-9b20-ded4fd0826e6 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Deletion of /opt/stack/data/nova/instances/e8151422-37a0-4b7a-914f-34dc2979ead9_del complete
May 28 01:13:53.471341 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9300ea1b-cb1c-44d0-838a-9431258c70eb tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.910s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:53.526186 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:13:53.526246 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:13:53.882855 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-c76df837-3048-4cff-9b20-ded4fd0826e6 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Took 1.35 seconds to destroy the instance on the hypervisor.
May 28 01:13:53.883367 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-c76df837-3048-4cff-9b20-ded4fd0826e6 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:13:53.883758 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:13:53.883903 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:13:53.884161 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:13:53.969552 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:13:54.028677 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:13:54.033863 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:13:54.034034 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:13:54.034207 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] No VIF found with MAC fa:16:3e:04:74:31, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:13:54.034781 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Using config drive
May 28 01:13:54.232907 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1ffb238c-6be9-4663-8c73-605967b425a4 req-06572724-c913-4781-a9a5-bce13fb496f5 service nova] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Received event network-vif-deleted-f9933e16-d9fb-47e4-9e9a-3ba073b1a35f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:13:54.233227 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-1ffb238c-6be9-4663-8c73-605967b425a4 req-06572724-c913-4781-a9a5-bce13fb496f5 service nova] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Neutron deleted interface f9933e16-d9fb-47e4-9e9a-3ba073b1a35f; detaching it from the instance and deleting it from the info cache
May 28 01:13:54.234724 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1ffb238c-6be9-4663-8c73-605967b425a4 req-06572724-c913-4781-a9a5-bce13fb496f5 service nova] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Detach interface failed, port_id=f9933e16-d9fb-47e4-9e9a-3ba073b1a35f, reason: Instance e8151422-37a0-4b7a-914f-34dc2979ead9 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:13:54.537136 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.305s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:54.537526 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:13:54.543027 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:13:54.648406 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Creating config drive at /opt/stack/data/nova/instances/78222e75-5ee3-4478-8f29-391c88192956/disk.config
May 28 01:13:54.651379 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/78222e75-5ee3-4478-8f29-391c88192956/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpr7qdh_16 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:13:54.687355 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:13:54.703271 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/78222e75-5ee3-4478-8f29-391c88192956/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpr7qdh_16" returned: 0 in 0.052s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:13:54.752655 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6eb69a47-095a-48a3-baf1-7ccbaf374a74 req-362f4bd2-0120-44c1-859c-b8980dd42b27 service nova] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Received event network-vif-unplugged-f9933e16-d9fb-47e4-9e9a-3ba073b1a35f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:13:54.753206 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6eb69a47-095a-48a3-baf1-7ccbaf374a74 req-362f4bd2-0120-44c1-859c-b8980dd42b27 service nova] Acquiring lock "e8151422-37a0-4b7a-914f-34dc2979ead9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:54.753404 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6eb69a47-095a-48a3-baf1-7ccbaf374a74 req-362f4bd2-0120-44c1-859c-b8980dd42b27 service nova] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:54.753564 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6eb69a47-095a-48a3-baf1-7ccbaf374a74 req-362f4bd2-0120-44c1-859c-b8980dd42b27 service nova] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:54.753719 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6eb69a47-095a-48a3-baf1-7ccbaf374a74 req-362f4bd2-0120-44c1-859c-b8980dd42b27 service nova] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] No waiting events found dispatching network-vif-unplugged-f9933e16-d9fb-47e4-9e9a-3ba073b1a35f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:13:54.753856 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6eb69a47-095a-48a3-baf1-7ccbaf374a74 req-362f4bd2-0120-44c1-859c-b8980dd42b27 service nova] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Received event network-vif-unplugged-f9933e16-d9fb-47e4-9e9a-3ba073b1a35f for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:13:54.940852 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:54.941144 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:55.047833 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:13:55.047985 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:13:55.048468 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:13:55.048730 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:13:55.081655 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:55.102908 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:55.106394 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:55.124603 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96f4ee9375c440d6abf68f2aa230b0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6ee814419446dcb5025c68fb0f4ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:13:55.174177 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:55.191890 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Took 1.31 seconds to deallocate network for instance.
May 28 01:13:55.430321 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:55.434004 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:55.436888 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:55.437491 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:55.444451 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lazy-loading 'flavor' on Instance uuid 26af0b2c-7e35-4e53-85eb-71ddca16fbfa {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:13:55.455575 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:55.550612 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:13:55.592559 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Successfully created port: 1718f886-da55-4687-b4b4-7874a8099d6f {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:13:55.698522 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c76df837-3048-4cff-9b20-ded4fd0826e6 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:55.698522 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c76df837-3048-4cff-9b20-ded4fd0826e6 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:55.829781 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930835.829406, 78222e75-5ee3-4478-8f29-391c88192956 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:13:55.829915 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 78222e75-5ee3-4478-8f29-391c88192956] VM Started (Lifecycle Event)
May 28 01:13:55.984727 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c76df837-3048-4cff-9b20-ded4fd0826e6 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:13:55.985189 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-c76df837-3048-4cff-9b20-ded4fd0826e6 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:13:56.012112 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Successfully updated port: 1718f886-da55-4687-b4b4-7874a8099d6f {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:13:56.054132 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:13:56.214060 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0003976030002377229 future=<Future at 0x7c98705bc680 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:13:56.214706 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Emitting event <LifecycleEvent: 1779930821.2135246, 60b7855e-1385-4a4b-89c8-f3c0f71f3959 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:13:56.215113 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:13:56.215356 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] VM Stopped (Lifecycle Event)
May 28 01:13:56.216370 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=11.629115056000046 future=<Future at 0x7c984c6dcfb0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:13:56.216502 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=11.628979034000167 future=<Future at 0x7c984c6dcfb0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:13:56.280021 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-720d539f-b2af-414d-b804-1f66fd0f09a5 req-236028c2-0e99-463e-ad42-624c5c32c5cc service nova] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Received event network-changed-1718f886-da55-4687-b4b4-7874a8099d6f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:13:56.280145 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-720d539f-b2af-414d-b804-1f66fd0f09a5 req-236028c2-0e99-463e-ad42-624c5c32c5cc service nova] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Refreshing instance network info cache due to event network-changed-1718f886-da55-4687-b4b4-7874a8099d6f. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:13:56.280291 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-720d539f-b2af-414d-b804-1f66fd0f09a5 req-236028c2-0e99-463e-ad42-624c5c32c5cc service nova] Acquiring lock "refresh_cache-f0e996d3-b051-421c-b00c-1dbc6971f8e6" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:13:56.280373 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-720d539f-b2af-414d-b804-1f66fd0f09a5 req-236028c2-0e99-463e-ad42-624c5c32c5cc service nova] Acquired lock "refresh_cache-f0e996d3-b051-421c-b00c-1dbc6971f8e6" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:13:56.280495 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-720d539f-b2af-414d-b804-1f66fd0f09a5 req-236028c2-0e99-463e-ad42-624c5c32c5cc service nova] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Refreshing network info cache for port 1718f886-da55-4687-b4b4-7874a8099d6f {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:13:56.335677 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:13:56.338679 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930836.337258, 78222e75-5ee3-4478-8f29-391c88192956 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:13:56.338679 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 78222e75-5ee3-4478-8f29-391c88192956] VM Paused (Lifecycle Event)
May 28 01:13:56.450696 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:56.487278 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-c76df837-3048-4cff-9b20-ded4fd0826e6 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:13:56.513829 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "refresh_cache-f0e996d3-b051-421c-b00c-1dbc6971f8e6" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:13:56.619481 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:56.718011 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-75a51122-5078-4925-8be2-702b069ae8c3 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 60b7855e-1385-4a4b-89c8-f3c0f71f3959] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:13:56.782635 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-720d539f-b2af-414d-b804-1f66fd0f09a5 req-236028c2-0e99-463e-ad42-624c5c32c5cc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:13:56.801582 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c3447219-47e5-493f-be93-0a55aa0c58f0 req-9918653e-8616-4c79-837a-05bbb86ae502 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Received event network-vif-plugged-d2012ded-4851-468b-9f75-d2adb6cca344 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:13:56.801775 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c3447219-47e5-493f-be93-0a55aa0c58f0 req-9918653e-8616-4c79-837a-05bbb86ae502 service nova] Acquiring lock "78222e75-5ee3-4478-8f29-391c88192956-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:56.801935 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c3447219-47e5-493f-be93-0a55aa0c58f0 req-9918653e-8616-4c79-837a-05bbb86ae502 service nova] Lock "78222e75-5ee3-4478-8f29-391c88192956-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:56.802056 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c3447219-47e5-493f-be93-0a55aa0c58f0 req-9918653e-8616-4c79-837a-05bbb86ae502 service nova] Lock "78222e75-5ee3-4478-8f29-391c88192956-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:56.802163 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c3447219-47e5-493f-be93-0a55aa0c58f0 req-9918653e-8616-4c79-837a-05bbb86ae502 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Processing event network-vif-plugged-d2012ded-4851-468b-9f75-d2adb6cca344 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:13:56.802286 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c3447219-47e5-493f-be93-0a55aa0c58f0 req-9918653e-8616-4c79-837a-05bbb86ae502 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Received event network-vif-plugged-d2012ded-4851-468b-9f75-d2adb6cca344 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:13:56.802405 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c3447219-47e5-493f-be93-0a55aa0c58f0 req-9918653e-8616-4c79-837a-05bbb86ae502 service nova] Acquiring lock "78222e75-5ee3-4478-8f29-391c88192956-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:56.802517 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c3447219-47e5-493f-be93-0a55aa0c58f0 req-9918653e-8616-4c79-837a-05bbb86ae502 service nova] Lock "78222e75-5ee3-4478-8f29-391c88192956-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:56.802634 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c3447219-47e5-493f-be93-0a55aa0c58f0 req-9918653e-8616-4c79-837a-05bbb86ae502 service nova] Lock "78222e75-5ee3-4478-8f29-391c88192956-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:56.802751 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c3447219-47e5-493f-be93-0a55aa0c58f0 req-9918653e-8616-4c79-837a-05bbb86ae502 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] No waiting events found dispatching network-vif-plugged-d2012ded-4851-468b-9f75-d2adb6cca344 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:13:56.802860 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-c3447219-47e5-493f-be93-0a55aa0c58f0 req-9918653e-8616-4c79-837a-05bbb86ae502 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Received unexpected event network-vif-plugged-d2012ded-4851-468b-9f75-d2adb6cca344 for instance with vm_state building and task_state spawning.
May 28 01:13:56.804020 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:13:56.805997 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:13:56.808287 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Instance spawned successfully.
May 28 01:13:56.808625 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:13:56.836708 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-720d539f-b2af-414d-b804-1f66fd0f09a5 req-236028c2-0e99-463e-ad42-624c5c32c5cc service nova] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:13:56.840313 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:13:56.842156 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930836.841933, 78222e75-5ee3-4478-8f29-391c88192956 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:13:56.843690 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 78222e75-5ee3-4478-8f29-391c88192956] VM Resumed (Lifecycle Event)
May 28 01:13:56.965475 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-720d539f-b2af-414d-b804-1f66fd0f09a5 req-236028c2-0e99-463e-ad42-624c5c32c5cc service nova] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:13:56.993409 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c76df837-3048-4cff-9b20-ded4fd0826e6 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.295s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:57.039516 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-c76df837-3048-4cff-9b20-ded4fd0826e6 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Deleted allocations for instance e8151422-37a0-4b7a-914f-34dc2979ead9
May 28 01:13:57.062141 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:13:57.062999 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:13:57.063204 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Creating image(s)
May 28 01:13:57.063639 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0e996d3-b051-421c-b00c-1dbc6971f8e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:57.063803 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "/opt/stack/data/nova/instances/f0e996d3-b051-421c-b00c-1dbc6971f8e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:57.064512 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "/opt/stack/data/nova/instances/f0e996d3-b051-421c-b00c-1dbc6971f8e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:57.064993 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:13:57.067532 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:13:57.068535 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:13:57.155992 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.087s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:13:57.156488 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:57.157000 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:57.157479 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:13:57.159965 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:13:57.160309 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:13:57.249946 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:13:57.249946 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/f0e996d3-b051-421c-b00c-1dbc6971f8e6/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:13:57.309652 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/f0e996d3-b051-421c-b00c-1dbc6971f8e6/disk 1073741824" returned: 0 in 0.060s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:13:57.310246 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.153s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:57.312773 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:13:57.334230 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:13:57.334398 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:13:57.335141 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:13:57.335376 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:13:57.335756 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:13:57.336371 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:13:57.346114 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:13:57.348293 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:13:57.404467 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:13:57.405562 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0e996d3-b051-421c-b00c-1dbc6971f8e6/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:13:57.405562 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0e996d3-b051-421c-b00c-1dbc6971f8e6/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:13:57.469865 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-720d539f-b2af-414d-b804-1f66fd0f09a5 req-236028c2-0e99-463e-ad42-624c5c32c5cc service nova] Releasing lock "refresh_cache-f0e996d3-b051-421c-b00c-1dbc6971f8e6" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:13:57.471101 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquired lock "refresh_cache-f0e996d3-b051-421c-b00c-1dbc6971f8e6" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:13:57.471324 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:13:57.517252 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0e996d3-b051-421c-b00c-1dbc6971f8e6/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:13:57.517599 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Cannot resize image /opt/stack/data/nova/instances/f0e996d3-b051-421c-b00c-1dbc6971f8e6/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:13:57.517923 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:13:57.518065 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Ensure instance console log exists: /opt/stack/data/nova/instances/f0e996d3-b051-421c-b00c-1dbc6971f8e6/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:13:57.518305 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:57.518509 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:57.518645 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:57.522464 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:57.522628 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:57.522842 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Attaching volume 36704a98-c5f2-4757-8b65-70dc5aeda73d to /dev/vdb
May 28 01:13:57.560174 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:13:57.570620 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:13:57.590462 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:13:57.640400 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:13:57.641011 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:13:57.650493 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:13:57.651874 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:feb6:e662', 'fe80::1cf4:68ff:fe80:cb5', 'fe80::fc16:3eff:fe4a:3dbf', 'fe80::4416:94ff:febb:9b7b', 'fe80::fc16:3eff:fe04:7d17', 'fe80::fc16:3eff:fe04:7431', 'fe80::d820:d3ff:fe1f:ca6e'] 
May 28 01:13:57.651982 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:13:57.652206 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:13:57.652325 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:13:57.652555 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Updating existing volume attachment record: 91d58ebd-fb8a-4178-b4b9-079e2a0fcb02 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:13:57.843556 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Took 7.62 seconds to spawn the instance on the hypervisor.
May 28 01:13:57.843766 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:13:57.852122 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 78222e75-5ee3-4478-8f29-391c88192956] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:13:58.028013 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:13:58.062199 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c76df837-3048-4cff-9b20-ded4fd0826e6 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "e8151422-37a0-4b7a-914f-34dc2979ead9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.031s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:58.167495 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:13:58.206312 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:13:58.206689 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d', 'iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '36704a98-c5f2-4757-8b65-70dc5aeda73d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:13:58.206885 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:13:58.282888 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Updating instance_info_cache with network_info: [{"id": "1718f886-da55-4687-b4b4-7874a8099d6f", "address": "fa:16:3e:cc:2a:78", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1718f886-da", "ovs_interfaceid": "1718f886-da55-4687-b4b4-7874a8099d6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:13:58.352825 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Took 13.03 seconds to build instance.
May 28 01:13:58.369299 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:58.784726 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Releasing lock "refresh_cache-f0e996d3-b051-421c-b00c-1dbc6971f8e6" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:13:58.785163 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Instance network_info: |[{"id": "1718f886-da55-4687-b4b4-7874a8099d6f", "address": "fa:16:3e:cc:2a:78", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1718f886-da", "ovs_interfaceid": "1718f886-da55-4687-b4b4-7874a8099d6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:13:58.786952 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Start _get_guest_xml network_info=[{"id": "1718f886-da55-4687-b4b4-7874a8099d6f", "address": "fa:16:3e:cc:2a:78", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1718f886-da", "ovs_interfaceid": "1718f886-da55-4687-b4b4-7874a8099d6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:13:58.789219 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:13:58.790287 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1359249260', uuid='f0e996d3-b051-421c-b00c-1dbc6971f8e6'), owner=OwnerMeta(userid='96f4ee9375c440d6abf68f2aa230b0c5', username='tempest-AttachVolumeNegativeTest-1272396699-project-member', projectid='1d6ee814419446dcb5025c68fb0f4ce9', projectname='tempest-AttachVolumeNegativeTest-1272396699'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1718f886-da55-4687-b4b4-7874a8099d6f", "address": "fa:16:3e:cc:2a:78", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1718f886-da", "ovs_interfaceid": "1718f886-da55-4687-b4b4-7874a8099d6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930838.7899923) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:13:58.791389 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:13:58.791943 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:13:58.792681 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:13:58.792828 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:13:58.793645 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:13:58.793930 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:13:58.794091 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:13:58.794140 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:13:58.794234 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:13:58.794313 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:13:58.794408 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:13:58.794573 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:13:58.794682 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:13:58.794787 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:13:58.794879 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:13:58.794987 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:13:58.806455 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:13:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1359249260',display_name='tempest-AttachVolumeNegativeTest-server-1359249260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumenegativetest-server-1359249260',id=75,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOS2twTc2sfNktE0xgfhJeI/MkqLEDH/2QEe1EkGYxHjXkouK7+f7QVy26njpXZ3OV/jZtF1TQXBOf817BIqWZJj/yTvUoR6lyiPUf9nmr18zsBjbUeXCu86Qu8rscvANA==',key_name='tempest-keypair-21329551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d6ee814419446dcb5025c68fb0f4ce9',ramdisk_id='',reservation_id='r-xrzdqj04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1272396699',owner_user_name='tempest-AttachVolumeNegativeTest-1272396699-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:13:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f4ee9375c440d6abf68f2aa230b0c5',uuid=f0e996d3-b051-421c-b00c-1dbc6971f8e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1718f886-da55-4687-b4b4-7874a8099d6f", "address": "fa:16:3e:cc:2a:78", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1718f886-da", "ovs_interfaceid": "1718f886-da55-4687-b4b4-7874a8099d6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:13:58.806455 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Converting VIF {"id": "1718f886-da55-4687-b4b4-7874a8099d6f", "address": "fa:16:3e:cc:2a:78", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1718f886-da", "ovs_interfaceid": "1718f886-da55-4687-b4b4-7874a8099d6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:13:58.806455 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:2a:78,bridge_name='br-int',has_traffic_filtering=True,id=1718f886-da55-4687-b4b4-7874a8099d6f,network=Network(f8ce4f22-7484-451c-b0df-2e7318e070f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1718f886-da') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:13:58.806455 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lazy-loading 'pci_devices' on Instance uuid f0e996d3-b051-421c-b00c-1dbc6971f8e6 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:13:58.855245 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "78222e75-5ee3-4478-8f29-391c88192956" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.535s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:59.308595 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] End _get_guest_xml xml=<domain type="qemu">
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:   <uuid>f0e996d3-b051-421c-b00c-1dbc6971f8e6</uuid>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:   <name>instance-0000004b</name>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1359249260</nova:name>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:13:58</nova:creationTime>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:         <nova:user uuid="96f4ee9375c440d6abf68f2aa230b0c5">tempest-AttachVolumeNegativeTest-1272396699-project-member</nova:user>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:         <nova:project uuid="1d6ee814419446dcb5025c68fb0f4ce9">tempest-AttachVolumeNegativeTest-1272396699</nova:project>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:         <nova:port uuid="1718f886-da55-4687-b4b4-7874a8099d6f">
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:     <system>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       <entry name="serial">f0e996d3-b051-421c-b00c-1dbc6971f8e6</entry>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       <entry name="uuid">f0e996d3-b051-421c-b00c-1dbc6971f8e6</entry>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:     </system>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:   <os>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:   </os>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:   <features>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:   </features>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:   <devices>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/f0e996d3-b051-421c-b00c-1dbc6971f8e6/disk"/>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:     </disk>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/f0e996d3-b051-421c-b00c-1dbc6971f8e6/disk.config"/>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:     </disk>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:cc:2a:78"/>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       <target dev="tap1718f886-da"/>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:     </interface>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/f0e996d3-b051-421c-b00c-1dbc6971f8e6/console.log" append="off"/>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:     </serial>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:     <video>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:     </video>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:     </rng>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:   </devices>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]: </domain>
May 28 01:13:59.308595 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:13:59.310793 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Preparing to wait for external event network-vif-plugged-1718f886-da55-4687-b4b4-7874a8099d6f {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:13:59.310793 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "f0e996d3-b051-421c-b00c-1dbc6971f8e6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:13:59.310793 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "f0e996d3-b051-421c-b00c-1dbc6971f8e6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:13:59.310793 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "f0e996d3-b051-421c-b00c-1dbc6971f8e6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:13:59.310793 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:13:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1359249260',display_name='tempest-AttachVolumeNegativeTest-server-1359249260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumenegativetest-server-1359249260',id=75,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOS2twTc2sfNktE0xgfhJeI/MkqLEDH/2QEe1EkGYxHjXkouK7+f7QVy26njpXZ3OV/jZtF1TQXBOf817BIqWZJj/yTvUoR6lyiPUf9nmr18zsBjbUeXCu86Qu8rscvANA==',key_name='tempest-keypair-21329551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d6ee814419446dcb5025c68fb0f4ce9',ramdisk_id='',reservation_id='r-xrzdqj04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1272396699',owner_user_name='tempest-AttachVolumeNegativeTest-1272396699-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:13:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f4ee9375c440d6abf68f2aa230b0c5',uuid=f0e996d3-b051-421c-b00c-1dbc6971f8e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1718f886-da55-4687-b4b4-7874a8099d6f", "address": "fa:16:3e:cc:2a:78", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1718f886-da", "ovs_interfaceid": "1718f886-da55-4687-b4b4-7874a8099d6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:13:59.311023 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Converting VIF {"id": "1718f886-da55-4687-b4b4-7874a8099d6f", "address": "fa:16:3e:cc:2a:78", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1718f886-da", "ovs_interfaceid": "1718f886-da55-4687-b4b4-7874a8099d6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:13:59.311681 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:2a:78,bridge_name='br-int',has_traffic_filtering=True,id=1718f886-da55-4687-b4b4-7874a8099d6f,network=Network(f8ce4f22-7484-451c-b0df-2e7318e070f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1718f886-da') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:13:59.312048 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:2a:78,bridge_name='br-int',has_traffic_filtering=True,id=1718f886-da55-4687-b4b4-7874a8099d6f,network=Network(f8ce4f22-7484-451c-b0df-2e7318e070f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1718f886-da') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:13:59.313049 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:59.313049 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:13:59.313049 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:13:59.314496 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:59.314496 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bb935f73-5a99-574a-92e7-573df9fbbb04', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:13:59.316180 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:59.316180 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:13:59.318295 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:59.320157 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:59.320419 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1718f886-da, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:13:59.320862 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1718f886-da, col_values=(('qos', UUID('7004d99e-e68c-434d-ad5c-ce51ae3e76a0')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:13:59.321078 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1718f886-da, col_values=(('external_ids', {'iface-id': '1718f886-da55-4687-b4b4-7874a8099d6f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:2a:78', 'vm-uuid': 'f0e996d3-b051-421c-b00c-1dbc6971f8e6'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:13:59.322172 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:59.323272 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:13:59.329057 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:13:59.329569 np0000001577 nova-compute[98319]: INFO os_vif [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:2a:78,bridge_name='br-int',has_traffic_filtering=True,id=1718f886-da55-4687-b4b4-7874a8099d6f,network=Network(f8ce4f22-7484-451c-b0df-2e7318e070f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1718f886-da')
May 28 01:13:59.461057 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.254s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:13:59.461241 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d', 'iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '36704a98-c5f2-4757-8b65-70dc5aeda73d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:13:59.475319 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:13:59.475738 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:13:59.476178 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:13:59.476367 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:13:59.476685 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:13:59.476869 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:13:59.489869 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:13:59.489869 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:59.493964 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:13:59.493964 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:59.501516 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d] added
May 28 01:13:59.501516 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:13:59.501516 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:13:59.501516 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:13:59.501516 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:13:59.501516 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:13:59.501516 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:59.501753 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:13:59.502232 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0255(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:13:59.502232 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:13:59.506560 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d] added
May 28 01:13:59.506560 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:13:59.506560 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:13:59.506560 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:13:59.506560 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:13:59.506560 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:13:59.506560 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:13:59.506873 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:13:59.506931 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.03(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:13:59.507080 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:14:00.502420 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:14:00.507501 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:14:00.513823 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:14:00.513823 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:14:00.521399 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:14:00.521399 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:00.530840 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:00.538620 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:00.548312 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:00.548312 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:00.548312 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:00.548312 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:00.548312 np0000001577 nova-compute[98319]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0937cac5-e3db-484b-99de-8982d5116691 (non-flash)
May 28 01:14:00.548312 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:00.548525 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:00.548525 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:00.548525 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:00.548525 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:00.548525 np0000001577 nova-compute[98319]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0937cac5-e3db-484b-99de-8982d5116691 (non-flash)
May 28 01:14:00.548525 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:00.561831 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:00.561831 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:00.561831 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:00.561831 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:00.561831 np0000001577 nova-compute[98319]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0937cac5-e3db-484b-99de-8982d5116691 (non-flash)
May 28 01:14:00.561831 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:00.561831 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:00.561831 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:00.561831 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:00.561831 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:00.561831 np0000001577 nova-compute[98319]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0937cac5-e3db-484b-99de-8982d5116691 (non-flash)
May 28 01:14:00.561831 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:00.595781 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d, portal: 192.168.50.100,3260]
May 28 01:14:00.595781 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d, portal: 192.168.50.100,3260] successful.
May 28 01:14:00.595781 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:00.603747 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d, portal: 192.168.40.100,3260]
May 28 01:14:00.603747 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d, portal: 192.168.40.100,3260] successful.
May 28 01:14:00.603747 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:00.611347 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:00.615774 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:00.626927 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:00.626927 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:00.626927 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:00.626927 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:00.626927 np0000001577 nova-compute[98319]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0937cac5-e3db-484b-99de-8982d5116691 (non-flash)
May 28 01:14:00.626927 np0000001577 nova-compute[98319]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d (non-flash)
May 28 01:14:00.626927 np0000001577 nova-compute[98319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d (non-flash)
May 28 01:14:00.626927 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:00.627227 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:00.627227 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:00.627227 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:00.627227 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:00.627227 np0000001577 nova-compute[98319]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0937cac5-e3db-484b-99de-8982d5116691 (non-flash)
May 28 01:14:00.627227 np0000001577 nova-compute[98319]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d (non-flash)
May 28 01:14:00.627227 np0000001577 nova-compute[98319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d (non-flash)
May 28 01:14:00.627227 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:00.627474 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:14:00.628591 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:14:00.628591 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] HCTL ('8', '-', '-', 0) found on session 191 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:14:00.628591 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:14:00.638592 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:00.638592 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:00.638592 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:00.638592 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:00.638592 np0000001577 nova-compute[98319]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0937cac5-e3db-484b-99de-8982d5116691 (non-flash)
May 28 01:14:00.638592 np0000001577 nova-compute[98319]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d (non-flash)
May 28 01:14:00.638592 np0000001577 nova-compute[98319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d (non-flash)
May 28 01:14:00.638592 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:00.639315 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:00.639315 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:00.639315 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:00.639315 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:00.639315 np0000001577 nova-compute[98319]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0937cac5-e3db-484b-99de-8982d5116691 (non-flash)
May 28 01:14:00.639315 np0000001577 nova-compute[98319]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d (non-flash)
May 28 01:14:00.639315 np0000001577 nova-compute[98319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d (non-flash)
May 28 01:14:00.639315 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:00.639315 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.162s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:14:00.639315 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:14:00.640788 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] HCTL ('11', '-', '-', 0) found on session 192 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:14:00.640788 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:14:00.647777 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Searching for a device in session 191 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:14:00.647957 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '36704a98-c5f2-4757-8b65-70dc5aeda73d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:14:00.658171 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Searching for a device in session 192 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:14:00.658312 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '36704a98-c5f2-4757-8b65-70dc5aeda73d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:14:00.814798 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "78222e75-5ee3-4478-8f29-391c88192956" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:00.815190 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "78222e75-5ee3-4478-8f29-391c88192956" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:00.844783 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:14:00.844889 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:14:00.844986 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] No VIF found with MAC fa:16:3e:cc:2a:78, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:14:00.845345 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Using config drive
May 28 01:14:01.318103 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lazy-loading 'flavor' on Instance uuid 78222e75-5ee3-4478-8f29-391c88192956 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:14:01.356463 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:14:01.463732 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Creating config drive at /opt/stack/data/nova/instances/f0e996d3-b051-421c-b00c-1dbc6971f8e6/disk.config
May 28 01:14:01.466293 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f0e996d3-b051-421c-b00c-1dbc6971f8e6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5g4z9sxt {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:14:01.479493 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:14:01.612116 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f0e996d3-b051-421c-b00c-1dbc6971f8e6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5g4z9sxt" returned: 0 in 0.146s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:14:01.621314 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:01.995309 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:02.022348 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:02.026839 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:02.120569 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:02.120569 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:02.124244 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:02.211996 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2bd1b272-1caf-4849-97c4-798883251487 req-a21ece32-6c97-4cbb-82f2-efa198e882cf service nova] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Received event network-vif-plugged-1718f886-da55-4687-b4b4-7874a8099d6f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:14:02.212460 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2bd1b272-1caf-4849-97c4-798883251487 req-a21ece32-6c97-4cbb-82f2-efa198e882cf service nova] Acquiring lock "f0e996d3-b051-421c-b00c-1dbc6971f8e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:02.212729 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2bd1b272-1caf-4849-97c4-798883251487 req-a21ece32-6c97-4cbb-82f2-efa198e882cf service nova] Lock "f0e996d3-b051-421c-b00c-1dbc6971f8e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:02.213119 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2bd1b272-1caf-4849-97c4-798883251487 req-a21ece32-6c97-4cbb-82f2-efa198e882cf service nova] Lock "f0e996d3-b051-421c-b00c-1dbc6971f8e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:02.213190 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2bd1b272-1caf-4849-97c4-798883251487 req-a21ece32-6c97-4cbb-82f2-efa198e882cf service nova] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Processing event network-vif-plugged-1718f886-da55-4687-b4b4-7874a8099d6f {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:14:02.323723 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "78222e75-5ee3-4478-8f29-391c88192956" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:02.366512 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:02.369819 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:02.371858 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:02.374761 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:02.401942 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:02.500747 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Found WWN 33000000069dd14cc for multipath device dm-2 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:14:02.501157 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:14:02.502569 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] <== connect_volume: return (4294ms) {'type': 'block', 'scsi_wwn': '33000000069dd14cc', 'path': '/dev/dm-2', 'multipath_id': '33000000069dd14cc'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:14:02.502569 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000069dd14cc', 'path': '/dev/dm-2', 'multipath_id': '33000000069dd14cc'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:14:02.510975 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lazy-loading 'flavor' on Instance uuid 26af0b2c-7e35-4e53-85eb-71ddca16fbfa {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:14:02.625905 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:14:02.794459 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930842.7940283, f0e996d3-b051-421c-b00c-1dbc6971f8e6 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:14:02.794759 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] VM Started (Lifecycle Event)
May 28 01:14:02.797818 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:14:02.801496 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:14:02.804584 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Instance spawned successfully.
May 28 01:14:02.805040 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:14:03.013502 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Attempting to attach volume 36704a98-c5f2-4757-8b65-70dc5aeda73d with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:14:03.017117 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:14:03.017117 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:14:03.017117 np0000001577 nova-compute[98319]:   <alias name="ua-36704a98-c5f2-4757-8b65-70dc5aeda73d"/>
May 28 01:14:03.017117 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-2"/>
May 28 01:14:03.017117 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:14:03.017117 np0000001577 nova-compute[98319]:   <serial>36704a98-c5f2-4757-8b65-70dc5aeda73d</serial>
May 28 01:14:03.017117 np0000001577 nova-compute[98319]: </disk>
May 28 01:14:03.017117 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:14:03.210297 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:03.210510 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:03.214345 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:14:03.214636 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Claim successful on node np0000001577
May 28 01:14:03.299262 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:14:03.304769 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:14:03.311814 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:14:03.311945 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:14:03.312215 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:14:03.312425 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:14:03.312676 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:14:03.312881 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:14:03.411963 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "78222e75-5ee3-4478-8f29-391c88192956" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:03.412096 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "78222e75-5ee3-4478-8f29-391c88192956" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:03.412227 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Attaching volume df4d5d8b-5acd-4732-924d-127e9d6dc11c to /dev/vdb
May 28 01:14:03.448752 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:14:03.459892 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:14:03.483474 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:14:03.529904 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:14:03.530352 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:14:03.539572 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:14:03.540619 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:feb6:e662', 'fe80::1cf4:68ff:fe80:cb5', 'fe80::fc16:3eff:fe4a:3dbf', 'fe80::4416:94ff:febb:9b7b', 'fe80::fc16:3eff:fe04:7d17', 'fe80::fc16:3eff:fe04:7431', 'fe80::d820:d3ff:fe1f:ca6e', 'fe80::fc16:3eff:fecc:2a78', 'fe80::c813:dcff:fe9e:6381'] 
May 28 01:14:03.540838 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:14:03.541006 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:14:03.541281 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:14:03.542562 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Updating existing volume attachment record: edd8a45c-e32c-4d5e-a0e7-732f72a23682 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:14:03.808072 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:14:03.808751 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930843.8082974, f0e996d3-b051-421c-b00c-1dbc6971f8e6 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:14:03.808751 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] VM Paused (Lifecycle Event)
May 28 01:14:03.817262 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Took 6.75 seconds to spawn the instance on the hypervisor.
May 28 01:14:03.818566 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:14:04.104041 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:14:04.104490 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c', 'iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df4d5d8b-5acd-4732-924d-127e9d6dc11c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:14:04.104678 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:14:04.105089 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:14:04.105295 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c', 'iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df4d5d8b-5acd-4732-924d-127e9d6dc11c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:14:04.117662 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:14:04.118426 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:14:04.119003 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:14:04.119187 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:14:04.119859 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:14:04.120112 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:14:04.132566 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:14:04.132566 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:04.140319 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:14:04.140319 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:04.147461 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c] added
May 28 01:14:04.147461 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:14:04.147461 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:14:04.147461 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:14:04.147461 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:14:04.147461 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:14:04.147461 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:04.147773 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:14:04.147846 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0286(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:14:04.148600 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:14:04.151339 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c] added
May 28 01:14:04.151339 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:14:04.151339 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:14:04.151339 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:14:04.151339 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:14:04.151339 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:14:04.151339 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:04.151606 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:14:04.151606 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0316(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:14:04.151766 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:14:04.292798 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7893fc34-120b-482e-9f1e-c8a7b838d0ba req-4c118da4-fc25-49ca-89fc-1a976cf03bdf service nova] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Received event network-vif-plugged-1718f886-da55-4687-b4b4-7874a8099d6f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:14:04.292798 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7893fc34-120b-482e-9f1e-c8a7b838d0ba req-4c118da4-fc25-49ca-89fc-1a976cf03bdf service nova] Acquiring lock "f0e996d3-b051-421c-b00c-1dbc6971f8e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:04.292798 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7893fc34-120b-482e-9f1e-c8a7b838d0ba req-4c118da4-fc25-49ca-89fc-1a976cf03bdf service nova] Lock "f0e996d3-b051-421c-b00c-1dbc6971f8e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:04.292798 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7893fc34-120b-482e-9f1e-c8a7b838d0ba req-4c118da4-fc25-49ca-89fc-1a976cf03bdf service nova] Lock "f0e996d3-b051-421c-b00c-1dbc6971f8e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:04.292798 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7893fc34-120b-482e-9f1e-c8a7b838d0ba req-4c118da4-fc25-49ca-89fc-1a976cf03bdf service nova] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] No waiting events found dispatching network-vif-plugged-1718f886-da55-4687-b4b4-7874a8099d6f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:14:04.292798 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-7893fc34-120b-482e-9f1e-c8a7b838d0ba req-4c118da4-fc25-49ca-89fc-1a976cf03bdf service nova] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Received unexpected event network-vif-plugged-1718f886-da55-4687-b4b4-7874a8099d6f for instance with vm_state active and task_state None.
May 28 01:14:04.314020 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:14:04.316259 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930844.3160129, f0e996d3-b051-421c-b00c-1dbc6971f8e6 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:14:04.316408 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] VM Resumed (Lifecycle Event)
May 28 01:14:04.324632 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:04.333056 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Took 14.80 seconds to build instance.
May 28 01:14:04.543153 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:14:04.543348 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:14:04.668967 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:14:04.669097 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:14:04.669196 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:14:04.669296 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] No VIF found with MAC fa:16:3e:4a:3d:bf, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:14:04.820147 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:14:04.826017 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:14:04.836271 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "f0e996d3-b051-421c-b00c-1dbc6971f8e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.322s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:04.852649 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-31ef6d20-6a3f-4b72-ad6c-443ff4a50d4b req-d4449a48-c895-44cc-9add-f0ad70d4c874 service nova] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Received event network-changed-1718f886-da55-4687-b4b4-7874a8099d6f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:14:04.853884 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-31ef6d20-6a3f-4b72-ad6c-443ff4a50d4b req-d4449a48-c895-44cc-9add-f0ad70d4c874 service nova] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Refreshing instance network info cache due to event network-changed-1718f886-da55-4687-b4b4-7874a8099d6f. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:14:04.854090 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-31ef6d20-6a3f-4b72-ad6c-443ff4a50d4b req-d4449a48-c895-44cc-9add-f0ad70d4c874 service nova] Acquiring lock "refresh_cache-f0e996d3-b051-421c-b00c-1dbc6971f8e6" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:14:04.854186 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-31ef6d20-6a3f-4b72-ad6c-443ff4a50d4b req-d4449a48-c895-44cc-9add-f0ad70d4c874 service nova] Acquired lock "refresh_cache-f0e996d3-b051-421c-b00c-1dbc6971f8e6" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:14:04.854323 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-31ef6d20-6a3f-4b72-ad6c-443ff4a50d4b req-d4449a48-c895-44cc-9add-f0ad70d4c874 service nova] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Refreshing network info cache for port 1718f886-da55-4687-b4b4-7874a8099d6f {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:14:05.048628 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:14:05.148998 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:14:05.153998 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:14:05.162167 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:14:05.162167 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:14:05.167908 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:14:05.167908 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:05.174880 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:05.179878 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:05.190148 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:05.190148 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:05.190148 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:05.190148 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:05.190148 np0000001577 nova-compute[98319]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0937cac5-e3db-484b-99de-8982d5116691 (non-flash)
May 28 01:14:05.190148 np0000001577 nova-compute[98319]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d (non-flash)
May 28 01:14:05.190148 np0000001577 nova-compute[98319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d (non-flash)
May 28 01:14:05.190148 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:05.191310 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:05.191310 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:05.191310 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:05.191310 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:05.191310 np0000001577 nova-compute[98319]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0937cac5-e3db-484b-99de-8982d5116691 (non-flash)
May 28 01:14:05.191310 np0000001577 nova-compute[98319]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d (non-flash)
May 28 01:14:05.191310 np0000001577 nova-compute[98319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d (non-flash)
May 28 01:14:05.191310 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:05.200671 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:05.200671 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:05.200671 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:05.200671 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:05.200671 np0000001577 nova-compute[98319]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0937cac5-e3db-484b-99de-8982d5116691 (non-flash)
May 28 01:14:05.200671 np0000001577 nova-compute[98319]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d (non-flash)
May 28 01:14:05.200671 np0000001577 nova-compute[98319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d (non-flash)
May 28 01:14:05.200671 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:05.201026 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:05.201026 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:05.201026 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:05.201026 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:05.201026 np0000001577 nova-compute[98319]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0937cac5-e3db-484b-99de-8982d5116691 (non-flash)
May 28 01:14:05.201026 np0000001577 nova-compute[98319]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d (non-flash)
May 28 01:14:05.201026 np0000001577 nova-compute[98319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d (non-flash)
May 28 01:14:05.201026 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:05.231090 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c, portal: 192.168.40.100,3260]
May 28 01:14:05.231090 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c, portal: 192.168.40.100,3260] successful.
May 28 01:14:05.231090 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:05.241743 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c, portal: 192.168.50.100,3260]
May 28 01:14:05.241743 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c, portal: 192.168.50.100,3260] successful.
May 28 01:14:05.241743 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:05.247234 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:05.253833 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:05.271243 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:05.271243 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:05.271243 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:05.271243 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:05.271243 np0000001577 nova-compute[98319]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0937cac5-e3db-484b-99de-8982d5116691 (non-flash)
May 28 01:14:05.271243 np0000001577 nova-compute[98319]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d (non-flash)
May 28 01:14:05.271243 np0000001577 nova-compute[98319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d (non-flash)
May 28 01:14:05.271243 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:05.271243 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:05.271243 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:05.271243 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:05.271243 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:05.271243 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:05.271243 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:05.271243 np0000001577 nova-compute[98319]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0937cac5-e3db-484b-99de-8982d5116691 (non-flash)
May 28 01:14:05.271243 np0000001577 nova-compute[98319]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d (non-flash)
May 28 01:14:05.271243 np0000001577 nova-compute[98319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d (non-flash)
May 28 01:14:05.271243 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:05.271243 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:05.271243 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:05.272175 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:14:05.272175 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:14:05.273074 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] HCTL ('12', '-', '-', 0) found on session 193 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:14:05.273230 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:14:05.274082 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:05.274082 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:05.274082 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:05.274082 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:05.274082 np0000001577 nova-compute[98319]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0937cac5-e3db-484b-99de-8982d5116691 (non-flash)
May 28 01:14:05.274082 np0000001577 nova-compute[98319]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d (non-flash)
May 28 01:14:05.274082 np0000001577 nova-compute[98319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d (non-flash)
May 28 01:14:05.274082 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:05.274082 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:05.274082 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:05.274341 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:05.274341 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:05.274341 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:05.274341 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:05.274341 np0000001577 nova-compute[98319]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0937cac5-e3db-484b-99de-8982d5116691 (non-flash)
May 28 01:14:05.274341 np0000001577 nova-compute[98319]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d (non-flash)
May 28 01:14:05.274341 np0000001577 nova-compute[98319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d (non-flash)
May 28 01:14:05.274341 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:05.274341 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:05.274341 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:05.274640 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:14:05.274757 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:14:05.275585 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] HCTL ('13', '-', '-', 0) found on session 194 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:14:05.275690 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:14:05.286105 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Searching for a device in session 193 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:14:05.286105 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df4d5d8b-5acd-4732-924d-127e9d6dc11c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:14:05.293102 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Searching for a device in session 194 and hctl ['13', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:14:05.357104 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-31ef6d20-6a3f-4b72-ad6c-443ff4a50d4b req-d4449a48-c895-44cc-9add-f0ad70d4c874 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:14:05.554638 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.344s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:05.554992 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:14:05.699045 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-31ef6d20-6a3f-4b72-ad6c-443ff4a50d4b req-d4449a48-c895-44cc-9add-f0ad70d4c874 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:14:05.830147 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-31ef6d20-6a3f-4b72-ad6c-443ff4a50d4b req-d4449a48-c895-44cc-9add-f0ad70d4c874 service nova] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Updated VIF entry in instance network info cache for port 1718f886-da55-4687-b4b4-7874a8099d6f. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:14:05.830533 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-31ef6d20-6a3f-4b72-ad6c-443ff4a50d4b req-d4449a48-c895-44cc-9add-f0ad70d4c874 service nova] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Updating instance_info_cache with network_info: [{"id": "1718f886-da55-4687-b4b4-7874a8099d6f", "address": "fa:16:3e:cc:2a:78", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1718f886-da", "ovs_interfaceid": "1718f886-da55-4687-b4b4-7874a8099d6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:14:06.063570 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:14:06.063772 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:14:06.064044 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:14:06.064278 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:14:06.146318 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ae6af3cf5df464bbc9da74d825ddb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f3bdd3aef04045aac40e4b851915e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:14:06.230972 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6031fb7f-73d2-4d99-9be4-1ec403b223ad tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.708s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:06.293745 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Searching for a device in session 194 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:14:06.293745 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'df4d5d8b-5acd-4732-924d-127e9d6dc11c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:14:06.332920 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-31ef6d20-6a3f-4b72-ad6c-443ff4a50d4b req-d4449a48-c895-44cc-9add-f0ad70d4c874 service nova] Releasing lock "refresh_cache-f0e996d3-b051-421c-b00c-1dbc6971f8e6" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:14:06.568640 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:14:06.624160 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:07.071191 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:14:07.095277 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Successfully created port: 6ee40c30-d6de-4c91-b393-c66a3f3709e9 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:14:07.144079 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Found WWN 330000000e7aef9a8 for multipath device dm-3 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:14:07.144261 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:14:07.144414 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '330000000e7aef9a8', 'path': '/dev/dm-3', 'multipath_id': '330000000e7aef9a8'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:14:07.144523 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e7aef9a8', 'path': '/dev/dm-3', 'multipath_id': '330000000e7aef9a8'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:14:07.149881 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lazy-loading 'flavor' on Instance uuid 78222e75-5ee3-4478-8f29-391c88192956 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:14:07.621049 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Successfully updated port: 6ee40c30-d6de-4c91-b393-c66a3f3709e9 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:14:07.642611 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-233ef0bd-b0c5-4f0c-a475-a68c1e4311e1 req-b27a2d6d-5cda-4633-9cc3-9d1a01302fad service nova] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Received event network-changed-6ee40c30-d6de-4c91-b393-c66a3f3709e9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:14:07.643705 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-233ef0bd-b0c5-4f0c-a475-a68c1e4311e1 req-b27a2d6d-5cda-4633-9cc3-9d1a01302fad service nova] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Refreshing instance network info cache due to event network-changed-6ee40c30-d6de-4c91-b393-c66a3f3709e9. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:14:07.643897 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-233ef0bd-b0c5-4f0c-a475-a68c1e4311e1 req-b27a2d6d-5cda-4633-9cc3-9d1a01302fad service nova] Acquiring lock "refresh_cache-a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:14:07.643991 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-233ef0bd-b0c5-4f0c-a475-a68c1e4311e1 req-b27a2d6d-5cda-4633-9cc3-9d1a01302fad service nova] Acquired lock "refresh_cache-a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:14:07.644112 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-233ef0bd-b0c5-4f0c-a475-a68c1e4311e1 req-b27a2d6d-5cda-4633-9cc3-9d1a01302fad service nova] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Refreshing network info cache for port 6ee40c30-d6de-4c91-b393-c66a3f3709e9 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:14:07.653331 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Attempting to attach volume df4d5d8b-5acd-4732-924d-127e9d6dc11c with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:14:07.657176 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:14:07.657176 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:14:07.657176 np0000001577 nova-compute[98319]:   <alias name="ua-df4d5d8b-5acd-4732-924d-127e9d6dc11c"/>
May 28 01:14:07.657176 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-3"/>
May 28 01:14:07.657176 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:14:07.657176 np0000001577 nova-compute[98319]:   <serial>df4d5d8b-5acd-4732-924d-127e9d6dc11c</serial>
May 28 01:14:07.657176 np0000001577 nova-compute[98319]: </disk>
May 28 01:14:07.657176 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:14:07.845902 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00039142300011008047 future=<Future at 0x7c984c6dcfb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:14:07.846250 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] Emitting event <LifecycleEvent: 1779930832.8454099, e8151422-37a0-4b7a-914f-34dc2979ead9 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:14:07.846377 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:14:07.846507 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] VM Stopped (Lifecycle Event)
May 28 01:14:08.086595 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:14:08.087667 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:14:08.088245 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Creating image(s)
May 28 01:14:08.088850 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:08.089106 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "/opt/stack/data/nova/instances/a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:08.089774 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "/opt/stack/data/nova/instances/a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:08.090536 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:14:08.095440 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:14:08.097081 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:14:08.136307 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "refresh_cache-a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:14:08.148992 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-233ef0bd-b0c5-4f0c-a475-a68c1e4311e1 req-b27a2d6d-5cda-4633-9cc3-9d1a01302fad service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:14:08.228019 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-233ef0bd-b0c5-4f0c-a475-a68c1e4311e1 req-b27a2d6d-5cda-4633-9cc3-9d1a01302fad service nova] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:14:08.229479 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.131s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:14:08.230391 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:08.234614 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:08.234614 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:14:08.234929 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:14:08.235430 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:14:08.327995 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:14:08.331614 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:14:08.358356 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ce4e1e1d-32fc-4ef6-8c08-495e182e021f tempest-TestVolumeBackupRestore-1871172420 tempest-TestVolumeBackupRestore-1871172420-project-member] [instance: e8151422-37a0-4b7a-914f-34dc2979ead9] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:14:08.383111 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705/disk 1073741824" returned: 0 in 0.054s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:14:08.386827 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.152s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:08.386827 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:14:08.409124 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-233ef0bd-b0c5-4f0c-a475-a68c1e4311e1 req-b27a2d6d-5cda-4633-9cc3-9d1a01302fad service nova] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:14:08.479212 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.095s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:14:08.480115 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:14:08.480115 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:14:08.564415 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:14:08.568485 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Cannot resize image /opt/stack/data/nova/instances/a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:14:08.568485 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:14:08.568485 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Ensure instance console log exists: /opt/stack/data/nova/instances/a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:14:08.568485 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:08.568485 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:08.568485 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:08.912899 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-233ef0bd-b0c5-4f0c-a475-a68c1e4311e1 req-b27a2d6d-5cda-4633-9cc3-9d1a01302fad service nova] Releasing lock "refresh_cache-a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:14:08.913361 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquired lock "refresh_cache-a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:14:08.913540 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:14:09.326304 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:14:09.326738 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:14:09.326738 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:14:09.326738 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] No VIF found with MAC fa:16:3e:04:74:31, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:14:09.329815 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:09.488173 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:14:09.646296 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:14:09.787892 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Updating instance_info_cache with network_info: [{"id": "6ee40c30-d6de-4c91-b393-c66a3f3709e9", "address": "fa:16:3e:05:9d:82", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee40c30-d6", "ovs_interfaceid": "6ee40c30-d6de-4c91-b393-c66a3f3709e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:14:09.842806 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:09.842920 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:10.291318 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Releasing lock "refresh_cache-a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:14:10.292043 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Instance network_info: |[{"id": "6ee40c30-d6de-4c91-b393-c66a3f3709e9", "address": "fa:16:3e:05:9d:82", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee40c30-d6", "ovs_interfaceid": "6ee40c30-d6de-4c91-b393-c66a3f3709e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:14:10.292880 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Start _get_guest_xml network_info=[{"id": "6ee40c30-d6de-4c91-b393-c66a3f3709e9", "address": "fa:16:3e:05:9d:82", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee40c30-d6", "ovs_interfaceid": "6ee40c30-d6de-4c91-b393-c66a3f3709e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:14:10.297523 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:14:10.298941 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-2100651502', uuid='a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705'), owner=OwnerMeta(userid='0ae6af3cf5df464bbc9da74d825ddb4e', username='tempest-VolumeMultiattachTests-1632400240-project-member', projectid='07f3bdd3aef04045aac40e4b851915e1', projectname='tempest-VolumeMultiattachTests-1632400240'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6ee40c30-d6de-4c91-b393-c66a3f3709e9", "address": "fa:16:3e:05:9d:82", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee40c30-d6", "ovs_interfaceid": "6ee40c30-d6de-4c91-b393-c66a3f3709e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930850.2985828) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:14:10.302101 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:14:10.302512 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:14:10.304454 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:14:10.304695 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:14:10.305721 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:14:10.305922 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:14:10.306109 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:14:10.306232 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:14:10.306407 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:14:10.306779 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:14:10.306779 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:14:10.306779 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:14:10.306863 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:14:10.306995 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:14:10.307109 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:14:10.307217 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:14:10.317698 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:14:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-2100651502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumemultiattachtests-server-2100651502',id=76,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoRI/XlCY6dTJ3dCiu4Fr/JD4ry6gCL7jlTSBAo2aVwp7g7LcNpcI1C5p4V64ZCYYOBK5uCzCLJIAL6qt1+bPTgZuMpeB7A6e0GgWtfeHZ/T45eoDupm2A+X2TLLF+QOQ==',key_name='tempest-keypair-657526159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07f3bdd3aef04045aac40e4b851915e1',ramdisk_id='',reservation_id='r-60626355',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1632400240',owner_user_name='tempest-VolumeMultiattachTests-1632400240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:14:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ae6af3cf5df464bbc9da74d825ddb4e',uuid=a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ee40c30-d6de-4c91-b393-c66a3f3709e9", "address": "fa:16:3e:05:9d:82", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee40c30-d6", "ovs_interfaceid": "6ee40c30-d6de-4c91-b393-c66a3f3709e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:14:10.317698 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Converting VIF {"id": "6ee40c30-d6de-4c91-b393-c66a3f3709e9", "address": "fa:16:3e:05:9d:82", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee40c30-d6", "ovs_interfaceid": "6ee40c30-d6de-4c91-b393-c66a3f3709e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:14:10.318508 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:9d:82,bridge_name='br-int',has_traffic_filtering=True,id=6ee40c30-d6de-4c91-b393-c66a3f3709e9,network=Network(7357480b-2ba7-465c-88fe-aaf2e8f7a673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee40c30-d6') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:14:10.318962 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lazy-loading 'pci_devices' on Instance uuid a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:14:10.345293 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Detaching volume 36704a98-c5f2-4757-8b65-70dc5aeda73d
May 28 01:14:10.402175 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Attempting to driver detach volume 36704a98-c5f2-4757-8b65-70dc5aeda73d from mountpoint /dev/vdb
May 28 01:14:10.413103 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Found disk vdb by alias ua-36704a98-c5f2-4757-8b65-70dc5aeda73d {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:14:10.414378 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Found disk vdb by alias ua-36704a98-c5f2-4757-8b65-70dc5aeda73d {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:14:10.414959 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Attempting to detach device vdb from instance 26af0b2c-7e35-4e53-85eb-71ddca16fbfa from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:14:10.414959 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:14:10.414959 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:14:10.414959 np0000001577 nova-compute[98319]:   <alias name="ua-36704a98-c5f2-4757-8b65-70dc5aeda73d"/>
May 28 01:14:10.414959 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-2"/>
May 28 01:14:10.414959 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:14:10.414959 np0000001577 nova-compute[98319]:   <serial>36704a98-c5f2-4757-8b65-70dc5aeda73d</serial>
May 28 01:14:10.414959 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:14:10.414959 np0000001577 nova-compute[98319]: </disk>
May 28 01:14:10.414959 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:14:10.423259 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Successfully detached device vdb from instance 26af0b2c-7e35-4e53-85eb-71ddca16fbfa from the persistent domain config.
May 28 01:14:10.423259 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] (1/8): Attempting to detach device vdb with device alias ua-36704a98-c5f2-4757-8b65-70dc5aeda73d from instance 26af0b2c-7e35-4e53-85eb-71ddca16fbfa from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:14:10.423259 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:14:10.423259 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:14:10.423259 np0000001577 nova-compute[98319]:   <alias name="ua-36704a98-c5f2-4757-8b65-70dc5aeda73d"/>
May 28 01:14:10.423259 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-2"/>
May 28 01:14:10.423259 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:14:10.423259 np0000001577 nova-compute[98319]:   <serial>36704a98-c5f2-4757-8b65-70dc5aeda73d</serial>
May 28 01:14:10.423259 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:14:10.423259 np0000001577 nova-compute[98319]: </disk>
May 28 01:14:10.423259 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:14:10.824616 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] End _get_guest_xml xml=<domain type="qemu">
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:   <uuid>a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705</uuid>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:   <name>instance-0000004c</name>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       <nova:name>tempest-VolumeMultiattachTests-server-2100651502</nova:name>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:14:10</nova:creationTime>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:         <nova:user uuid="0ae6af3cf5df464bbc9da74d825ddb4e">tempest-VolumeMultiattachTests-1632400240-project-member</nova:user>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:         <nova:project uuid="07f3bdd3aef04045aac40e4b851915e1">tempest-VolumeMultiattachTests-1632400240</nova:project>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:         <nova:port uuid="6ee40c30-d6de-4c91-b393-c66a3f3709e9">
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:     <system>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       <entry name="serial">a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705</entry>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       <entry name="uuid">a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705</entry>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:     </system>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:   <os>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:   </os>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:   <features>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:   </features>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:   <devices>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705/disk"/>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:     </disk>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705/disk.config"/>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:     </disk>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:05:9d:82"/>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       <target dev="tap6ee40c30-d6"/>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:     </interface>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705/console.log" append="off"/>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:     </serial>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:     <video>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:     </video>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:     </rng>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:   </devices>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]: </domain>
May 28 01:14:10.824616 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:14:10.824616 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Preparing to wait for external event network-vif-plugged-6ee40c30-d6de-4c91-b393-c66a3f3709e9 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:14:10.824616 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:10.824616 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:10.824616 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:10.824616 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:14:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-2100651502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumemultiattachtests-server-2100651502',id=76,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoRI/XlCY6dTJ3dCiu4Fr/JD4ry6gCL7jlTSBAo2aVwp7g7LcNpcI1C5p4V64ZCYYOBK5uCzCLJIAL6qt1+bPTgZuMpeB7A6e0GgWtfeHZ/T45eoDupm2A+X2TLLF+QOQ==',key_name='tempest-keypair-657526159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07f3bdd3aef04045aac40e4b851915e1',ramdisk_id='',reservation_id='r-60626355',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1632400240',owner_user_name='tempest-VolumeMultiattachTests-1632400240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:14:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ae6af3cf5df464bbc9da74d825ddb4e',uuid=a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ee40c30-d6de-4c91-b393-c66a3f3709e9", "address": "fa:16:3e:05:9d:82", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee40c30-d6", "ovs_interfaceid": "6ee40c30-d6de-4c91-b393-c66a3f3709e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:14:10.824616 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Converting VIF {"id": "6ee40c30-d6de-4c91-b393-c66a3f3709e9", "address": "fa:16:3e:05:9d:82", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee40c30-d6", "ovs_interfaceid": "6ee40c30-d6de-4c91-b393-c66a3f3709e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:14:10.831562 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:9d:82,bridge_name='br-int',has_traffic_filtering=True,id=6ee40c30-d6de-4c91-b393-c66a3f3709e9,network=Network(7357480b-2ba7-465c-88fe-aaf2e8f7a673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee40c30-d6') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:14:10.831562 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:9d:82,bridge_name='br-int',has_traffic_filtering=True,id=6ee40c30-d6de-4c91-b393-c66a3f3709e9,network=Network(7357480b-2ba7-465c-88fe-aaf2e8f7a673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee40c30-d6') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:14:10.831562 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:10.831562 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:14:10.831562 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:14:10.831562 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:10.831562 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad5ef1df-2675-5edf-b8a6-0b12b405c5fe', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:14:10.836406 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:10.836406 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:14:10.836406 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:10.836406 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ee40c30-d6, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:14:10.836823 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6ee40c30-d6, col_values=(('qos', UUID('bab26324-03f4-4992-a8bb-9c78e4c4822f')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:14:10.837302 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6ee40c30-d6, col_values=(('external_ids', {'iface-id': '6ee40c30-d6de-4c91-b393-c66a3f3709e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:9d:82', 'vm-uuid': 'a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:14:10.839520 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:10.841067 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:14:10.847936 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:10.848741 np0000001577 nova-compute[98319]: INFO os_vif [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:9d:82,bridge_name='br-int',has_traffic_filtering=True,id=6ee40c30-d6de-4c91-b393-c66a3f3709e9,network=Network(7357480b-2ba7-465c-88fe-aaf2e8f7a673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee40c30-d6')
May 28 01:14:10.898916 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9614b005-6416-4d02-922d-e8bf213ce296 tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "78222e75-5ee3-4478-8f29-391c88192956" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.486s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:10.956769 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930850.95639, 26af0b2c-7e35-4e53-85eb-71ddca16fbfa => ua-36704a98-c5f2-4757-8b65-70dc5aeda73d> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:14:10.957978 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-36704a98-c5f2-4757-8b65-70dc5aeda73d for instance 26af0b2c-7e35-4e53-85eb-71ddca16fbfa {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:14:10.960042 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Successfully detached device vdb from instance 26af0b2c-7e35-4e53-85eb-71ddca16fbfa from the live domain config.
May 28 01:14:10.961058 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:14:10.961388 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d', 'iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '36704a98-c5f2-4757-8b65-70dc5aeda73d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:14:10.961493 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:14:10.961871 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:14:10.962142 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d', 'iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '36704a98-c5f2-4757-8b65-70dc5aeda73d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:14:10.962268 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:14:10.991240 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:10.991240 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:10.991240 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:10.991240 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:10.991240 np0000001577 nova-compute[98319]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0937cac5-e3db-484b-99de-8982d5116691 (non-flash)
May 28 01:14:10.991240 np0000001577 nova-compute[98319]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d (non-flash)
May 28 01:14:10.991240 np0000001577 nova-compute[98319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d (non-flash)
May 28 01:14:10.991240 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:10.991240 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:10.991240 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:10.991464 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:10.991464 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:10.991464 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:10.991464 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:10.991464 np0000001577 nova-compute[98319]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0937cac5-e3db-484b-99de-8982d5116691 (non-flash)
May 28 01:14:10.991464 np0000001577 nova-compute[98319]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d (non-flash)
May 28 01:14:10.991464 np0000001577 nova-compute[98319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d (non-flash)
May 28 01:14:10.991464 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:10.991464 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:10.991464 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:10.991464 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', '185'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0937cac5-e3db-484b-99de-8982d5116691', '190'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d', '191'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d', '192'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c', '193'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c', '194')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:14:10.991736 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d', '192')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:14:10.992759 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d', '191')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:14:10.993269 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c987058e200>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d'): ({'sdc'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:14:10.993467 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Removing multipathed devices sdf, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:14:10.993687 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Flush multipath device 33000000069dd14cc {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:14:11.026270 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:14:11.085448 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:14:11.151847 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Checking to see if SCSI volumes sdf, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:14:11.152019 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] SCSI volumes sdf, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:14:11.153208 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Checking to see if device paths {'sdf', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:14:11.163622 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Device paths {'sdf', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:14:11.163839 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:14:11.176030 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:11.211861 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 192, target: iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d, portal: 192.168.40.100,3260]
May 28 01:14:11.211861 np0000001577 nova-compute[98319]: Logout of [sid: 192, target: iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d, portal: 192.168.40.100,3260] successful.
May 28 01:14:11.211861 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:11.228986 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:11.239779 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:11.273751 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 191, target: iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d, portal: 192.168.50.100,3260]
May 28 01:14:11.273751 np0000001577 nova-compute[98319]: Logout of [sid: 191, target: iqn.2023-03.storpool.com:os--volume-36704a98-c5f2-4757-8b65-70dc5aeda73d, portal: 192.168.50.100,3260] successful.
May 28 01:14:11.273751 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:11.291064 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:11.291311 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:14:11.291461 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] <== disconnect_volume: return (329ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:14:11.291610 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:14:11.626648 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:11.838482 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lazy-loading 'flavor' on Instance uuid 26af0b2c-7e35-4e53-85eb-71ddca16fbfa {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:14:12.049916 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0e3be52e-550a-4c94-9e9e-999e98c786eb req-c11ba086-6761-438d-92ba-0cb06d399654 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Received event network-changed-d2012ded-4851-468b-9f75-d2adb6cca344 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:14:12.049916 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0e3be52e-550a-4c94-9e9e-999e98c786eb req-c11ba086-6761-438d-92ba-0cb06d399654 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Refreshing instance network info cache due to event network-changed-d2012ded-4851-468b-9f75-d2adb6cca344. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:14:12.050025 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0e3be52e-550a-4c94-9e9e-999e98c786eb req-c11ba086-6761-438d-92ba-0cb06d399654 service nova] Acquiring lock "refresh_cache-78222e75-5ee3-4478-8f29-391c88192956" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:14:12.050282 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0e3be52e-550a-4c94-9e9e-999e98c786eb req-c11ba086-6761-438d-92ba-0cb06d399654 service nova] Acquired lock "refresh_cache-78222e75-5ee3-4478-8f29-391c88192956" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:14:12.050335 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-0e3be52e-550a-4c94-9e9e-999e98c786eb req-c11ba086-6761-438d-92ba-0cb06d399654 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Refreshing network info cache for port d2012ded-4851-468b-9f75-d2adb6cca344 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:14:12.371278 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:14:12.371396 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:14:12.371498 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No VIF found with MAC fa:16:3e:05:9d:82, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:14:12.371903 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Using config drive
May 28 01:14:12.552647 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-0e3be52e-550a-4c94-9e9e-999e98c786eb req-c11ba086-6761-438d-92ba-0cb06d399654 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:14:12.845039 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d50925e8-dd35-4d00-a1aa-8143ab92e335 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:12.848464 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-0e3be52e-550a-4c94-9e9e-999e98c786eb req-c11ba086-6761-438d-92ba-0cb06d399654 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:14:12.876850 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:14:12.971654 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-0e3be52e-550a-4c94-9e9e-999e98c786eb req-c11ba086-6761-438d-92ba-0cb06d399654 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Updated VIF entry in instance network info cache for port d2012ded-4851-468b-9f75-d2adb6cca344. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:14:12.972163 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-0e3be52e-550a-4c94-9e9e-999e98c786eb req-c11ba086-6761-438d-92ba-0cb06d399654 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Updating instance_info_cache with network_info: [{"id": "d2012ded-4851-468b-9f75-d2adb6cca344", "address": "fa:16:3e:04:74:31", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2012ded-48", "ovs_interfaceid": "d2012ded-4851-468b-9f75-d2adb6cca344", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:14:13.005296 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Creating config drive at /opt/stack/data/nova/instances/a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705/disk.config
May 28 01:14:13.009723 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphgt5dcj7 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:14:13.069819 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphgt5dcj7" returned: 0 in 0.060s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:14:13.465828 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-35b0af57-fde8-43ee-830a-9d3cdef59c8c req-bcec4d20-9bca-45bb-b5f4-c85dee67d825 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Received event network-changed-d2012ded-4851-468b-9f75-d2adb6cca344 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:14:13.466297 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-35b0af57-fde8-43ee-830a-9d3cdef59c8c req-bcec4d20-9bca-45bb-b5f4-c85dee67d825 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Refreshing instance network info cache due to event network-changed-d2012ded-4851-468b-9f75-d2adb6cca344. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:14:13.466416 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-35b0af57-fde8-43ee-830a-9d3cdef59c8c req-bcec4d20-9bca-45bb-b5f4-c85dee67d825 service nova] Acquiring lock "refresh_cache-78222e75-5ee3-4478-8f29-391c88192956" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:14:13.474516 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0e3be52e-550a-4c94-9e9e-999e98c786eb req-c11ba086-6761-438d-92ba-0cb06d399654 service nova] Releasing lock "refresh_cache-78222e75-5ee3-4478-8f29-391c88192956" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:14:13.474902 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-35b0af57-fde8-43ee-830a-9d3cdef59c8c req-bcec4d20-9bca-45bb-b5f4-c85dee67d825 service nova] Acquired lock "refresh_cache-78222e75-5ee3-4478-8f29-391c88192956" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:14:13.475104 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-35b0af57-fde8-43ee-830a-9d3cdef59c8c req-bcec4d20-9bca-45bb-b5f4-c85dee67d825 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Refreshing network info cache for port d2012ded-4851-468b-9f75-d2adb6cca344 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:14:13.519179 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:13.551574 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:13.556650 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:13.636495 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:13.880727 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:13.882739 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:13.894413 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:13.903373 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:13.977482 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-35b0af57-fde8-43ee-830a-9d3cdef59c8c req-bcec4d20-9bca-45bb-b5f4-c85dee67d825 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:14:14.111417 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8d47692c-a313-4af8-a8c7-aee16f5c3841 req-46dab76a-899a-4ac4-aa17-bd04b81f2a9d service nova] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Received event network-vif-plugged-6ee40c30-d6de-4c91-b393-c66a3f3709e9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:14:14.111647 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8d47692c-a313-4af8-a8c7-aee16f5c3841 req-46dab76a-899a-4ac4-aa17-bd04b81f2a9d service nova] Acquiring lock "a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:14.111874 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8d47692c-a313-4af8-a8c7-aee16f5c3841 req-46dab76a-899a-4ac4-aa17-bd04b81f2a9d service nova] Lock "a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:14.111990 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8d47692c-a313-4af8-a8c7-aee16f5c3841 req-46dab76a-899a-4ac4-aa17-bd04b81f2a9d service nova] Lock "a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:14.112135 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8d47692c-a313-4af8-a8c7-aee16f5c3841 req-46dab76a-899a-4ac4-aa17-bd04b81f2a9d service nova] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Processing event network-vif-plugged-6ee40c30-d6de-4c91-b393-c66a3f3709e9 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:14:14.112292 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8d47692c-a313-4af8-a8c7-aee16f5c3841 req-46dab76a-899a-4ac4-aa17-bd04b81f2a9d service nova] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Received event network-vif-plugged-6ee40c30-d6de-4c91-b393-c66a3f3709e9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:14:14.115774 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8d47692c-a313-4af8-a8c7-aee16f5c3841 req-46dab76a-899a-4ac4-aa17-bd04b81f2a9d service nova] Acquiring lock "a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:14.115941 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8d47692c-a313-4af8-a8c7-aee16f5c3841 req-46dab76a-899a-4ac4-aa17-bd04b81f2a9d service nova] Lock "a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:14.116003 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8d47692c-a313-4af8-a8c7-aee16f5c3841 req-46dab76a-899a-4ac4-aa17-bd04b81f2a9d service nova] Lock "a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:14.116107 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8d47692c-a313-4af8-a8c7-aee16f5c3841 req-46dab76a-899a-4ac4-aa17-bd04b81f2a9d service nova] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] No waiting events found dispatching network-vif-plugged-6ee40c30-d6de-4c91-b393-c66a3f3709e9 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:14:14.116209 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-8d47692c-a313-4af8-a8c7-aee16f5c3841 req-46dab76a-899a-4ac4-aa17-bd04b81f2a9d service nova] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Received unexpected event network-vif-plugged-6ee40c30-d6de-4c91-b393-c66a3f3709e9 for instance with vm_state building and task_state spawning.
May 28 01:14:14.268515 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-35b0af57-fde8-43ee-830a-9d3cdef59c8c req-bcec4d20-9bca-45bb-b5f4-c85dee67d825 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:14:14.289532 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:14:14.289834 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930854.2895172, a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:14:14.290093 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] VM Started (Lifecycle Event)
May 28 01:14:14.292851 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:14:14.296006 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Instance spawned successfully.
May 28 01:14:14.296243 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:14:14.306473 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:14.306473 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:14.395568 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-35b0af57-fde8-43ee-830a-9d3cdef59c8c req-bcec4d20-9bca-45bb-b5f4-c85dee67d825 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Updated VIF entry in instance network info cache for port d2012ded-4851-468b-9f75-d2adb6cca344. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:14:14.395808 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-35b0af57-fde8-43ee-830a-9d3cdef59c8c req-bcec4d20-9bca-45bb-b5f4-c85dee67d825 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Updating instance_info_cache with network_info: [{"id": "d2012ded-4851-468b-9f75-d2adb6cca344", "address": "fa:16:3e:04:74:31", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2012ded-48", "ovs_interfaceid": "d2012ded-4851-468b-9f75-d2adb6cca344", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:14:14.800687 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:14:14.802829 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:14:14.804402 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:14:14.804519 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:14:14.805312 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:14:14.805312 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:14:14.805312 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:14:14.805556 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:14:14.809014 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lazy-loading 'flavor' on Instance uuid 26af0b2c-7e35-4e53-85eb-71ddca16fbfa {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:14:14.897531 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-35b0af57-fde8-43ee-830a-9d3cdef59c8c req-bcec4d20-9bca-45bb-b5f4-c85dee67d825 service nova] Releasing lock "refresh_cache-78222e75-5ee3-4478-8f29-391c88192956" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:14:15.308164 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:14:15.308854 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930855.3082452, a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:14:15.308854 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] VM Paused (Lifecycle Event)
May 28 01:14:15.312900 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Took 7.23 seconds to spawn the instance on the hypervisor.
May 28 01:14:15.313042 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:14:15.810750 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:14:15.812627 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930855.8124168, a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:14:15.812764 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] VM Resumed (Lifecycle Event)
May 28 01:14:15.819815 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:15.826975 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Took 12.69 seconds to build instance.
May 28 01:14:15.840992 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:16.314867 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:14:16.316650 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:14:16.328932 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5dfc23e5-fd99-4407-a124-168dd2cf87b9 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.208s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:16.369786 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4377799c-47ac-449a-9816-9c40d15fbe35 req-ad6ce016-77d2-45d8-bfa7-eeb8acad1549 service nova] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Received event network-changed-6ee40c30-d6de-4c91-b393-c66a3f3709e9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:14:16.369931 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-4377799c-47ac-449a-9816-9c40d15fbe35 req-ad6ce016-77d2-45d8-bfa7-eeb8acad1549 service nova] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Refreshing instance network info cache due to event network-changed-6ee40c30-d6de-4c91-b393-c66a3f3709e9. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:14:16.370068 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4377799c-47ac-449a-9816-9c40d15fbe35 req-ad6ce016-77d2-45d8-bfa7-eeb8acad1549 service nova] Acquiring lock "refresh_cache-a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:14:16.370190 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4377799c-47ac-449a-9816-9c40d15fbe35 req-ad6ce016-77d2-45d8-bfa7-eeb8acad1549 service nova] Acquired lock "refresh_cache-a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:14:16.370300 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-4377799c-47ac-449a-9816-9c40d15fbe35 req-ad6ce016-77d2-45d8-bfa7-eeb8acad1549 service nova] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Refreshing network info cache for port 6ee40c30-d6de-4c91-b393-c66a3f3709e9 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:14:16.627094 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:16.871954 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-4377799c-47ac-449a-9816-9c40d15fbe35 req-ad6ce016-77d2-45d8-bfa7-eeb8acad1549 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:14:16.881073 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:16.881179 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:16.881374 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Attaching volume b85f0ffa-2e08-4251-973c-6462a40ecbea to /dev/vdb
May 28 01:14:16.921476 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:14:16.934505 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:14:16.961378 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:14:17.016403 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:14:17.016403 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:14:17.025655 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:14:17.027896 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:feb6:e662', 'fe80::1cf4:68ff:fe80:cb5', 'fe80::fc16:3eff:fe4a:3dbf', 'fe80::4416:94ff:febb:9b7b', 'fe80::fc16:3eff:fe04:7d17', 'fe80::fc16:3eff:fe04:7431', 'fe80::d820:d3ff:fe1f:ca6e', 'fe80::fc16:3eff:fecc:2a78', 'fe80::c813:dcff:fe9e:6381', 'fe80::fc16:3eff:fe05:9d82', 'fe80::583c:47ff:fea3:281d'] 
May 28 01:14:17.028059 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:14:17.028193 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:14:17.028465 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:14:17.028731 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Updating existing volume attachment record: 3e32cb13-5621-4748-bdc3-5f1e7bd0e46e {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:14:17.172870 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-4377799c-47ac-449a-9816-9c40d15fbe35 req-ad6ce016-77d2-45d8-bfa7-eeb8acad1549 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:14:17.287089 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-4377799c-47ac-449a-9816-9c40d15fbe35 req-ad6ce016-77d2-45d8-bfa7-eeb8acad1549 service nova] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Updated VIF entry in instance network info cache for port 6ee40c30-d6de-4c91-b393-c66a3f3709e9. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:14:17.287424 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-4377799c-47ac-449a-9816-9c40d15fbe35 req-ad6ce016-77d2-45d8-bfa7-eeb8acad1549 service nova] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Updating instance_info_cache with network_info: [{"id": "6ee40c30-d6de-4c91-b393-c66a3f3709e9", "address": "fa:16:3e:05:9d:82", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee40c30-d6", "ovs_interfaceid": "6ee40c30-d6de-4c91-b393-c66a3f3709e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:14:17.582869 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:14:17.583499 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea', 'iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b85f0ffa-2e08-4251-973c-6462a40ecbea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:14:17.583499 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:14:17.789802 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4377799c-47ac-449a-9816-9c40d15fbe35 req-ad6ce016-77d2-45d8-bfa7-eeb8acad1549 service nova] Releasing lock "refresh_cache-a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:14:18.135975 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.552s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:14:18.136235 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea', 'iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b85f0ffa-2e08-4251-973c-6462a40ecbea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:14:18.149861 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:14:18.150277 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:14:18.150694 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:14:18.150901 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:14:18.153493 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:14:18.153493 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:14:18.162740 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:14:18.162740 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:18.168923 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:14:18.168923 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:18.176747 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea] added
May 28 01:14:18.176747 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:14:18.176747 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:14:18.176747 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:14:18.176747 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:14:18.176747 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:14:18.176747 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:18.177002 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:14:18.177196 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0262(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:14:18.177419 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:14:18.181270 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea] added
May 28 01:14:18.181270 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:14:18.181270 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:14:18.181270 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:14:18.181270 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:14:18.181270 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:14:18.181270 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:18.181453 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:14:18.181540 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0302(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:14:18.181701 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:14:19.177824 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:14:19.182114 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:14:19.190515 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:14:19.190515 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:14:19.195200 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:14:19.195200 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:19.202756 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:19.211469 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:19.221170 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:19.221170 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:19.221170 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:19.221170 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:19.221170 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:19.221170 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:19.221170 np0000001577 nova-compute[98319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:19.221170 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:19.221441 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:19.221441 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:19.221441 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:19.221441 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:19.221441 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:19.221441 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:19.221441 np0000001577 nova-compute[98319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:19.221441 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:19.228607 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:19.228607 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:19.228607 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:19.228607 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:19.228607 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:19.228607 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:19.228607 np0000001577 nova-compute[98319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:19.228607 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:19.228834 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:19.228834 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:19.228834 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:19.228834 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:19.228834 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:19.228834 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:19.228834 np0000001577 nova-compute[98319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:19.228834 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:19.262064 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea, portal: 192.168.40.100,3260]
May 28 01:14:19.262064 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea, portal: 192.168.40.100,3260] successful.
May 28 01:14:19.262064 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:19.272812 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea, portal: 192.168.50.100,3260]
May 28 01:14:19.272812 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea, portal: 192.168.50.100,3260] successful.
May 28 01:14:19.272812 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:19.273225 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:19.286138 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:19.292480 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:19.292480 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:19.292480 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:19.292480 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:19.292480 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:19.292480 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:19.292480 np0000001577 nova-compute[98319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:19.292480 np0000001577 nova-compute[98319]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea (non-flash)
May 28 01:14:19.292480 np0000001577 nova-compute[98319]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea (non-flash)
May 28 01:14:19.292480 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:19.292751 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:19.292751 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:19.292751 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:19.292751 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:19.292751 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:19.292751 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:19.292751 np0000001577 nova-compute[98319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:19.292751 np0000001577 nova-compute[98319]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea (non-flash)
May 28 01:14:19.292751 np0000001577 nova-compute[98319]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea (non-flash)
May 28 01:14:19.292751 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:19.293095 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:14:19.293225 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:14:19.294149 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] HCTL ('8', '-', '-', 0) found on session 196 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:14:19.294294 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:14:19.302421 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:19.302421 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:19.302421 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:19.302421 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:19.302421 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:19.302421 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:19.302421 np0000001577 nova-compute[98319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:19.302421 np0000001577 nova-compute[98319]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea (non-flash)
May 28 01:14:19.302421 np0000001577 nova-compute[98319]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea (non-flash)
May 28 01:14:19.302421 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:19.302868 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:19.302868 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:19.302868 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:19.302868 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:19.302868 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:19.302868 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:19.302868 np0000001577 nova-compute[98319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:19.302868 np0000001577 nova-compute[98319]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea (non-flash)
May 28 01:14:19.302868 np0000001577 nova-compute[98319]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea (non-flash)
May 28 01:14:19.302868 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:19.302868 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:14:19.302868 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:14:19.303850 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] HCTL ('11', '-', '-', 0) found on session 197 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:14:19.303956 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:14:19.315382 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Searching for a device in session 196 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:14:19.315382 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b85f0ffa-2e08-4251-973c-6462a40ecbea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:14:19.320401 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Searching for a device in session 197 and hctl ['11', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:14:20.320910 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Searching for a device in session 197 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:14:20.321496 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b85f0ffa-2e08-4251-973c-6462a40ecbea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:14:20.843474 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:21.168111 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Found WWN 330000000ee67ef77 for multipath device dm-2 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:14:21.168334 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:14:21.168554 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] <== connect_volume: return (3584ms) {'type': 'block', 'scsi_wwn': '330000000ee67ef77', 'path': '/dev/dm-2', 'multipath_id': '330000000ee67ef77'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:14:21.168703 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ee67ef77', 'path': '/dev/dm-2', 'multipath_id': '330000000ee67ef77'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:14:21.171660 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lazy-loading 'flavor' on Instance uuid 26af0b2c-7e35-4e53-85eb-71ddca16fbfa {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:14:21.628780 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:21.674597 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Attempting to attach volume b85f0ffa-2e08-4251-973c-6462a40ecbea with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:14:21.678409 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:14:21.678409 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:14:21.678409 np0000001577 nova-compute[98319]:   <alias name="ua-b85f0ffa-2e08-4251-973c-6462a40ecbea"/>
May 28 01:14:21.678409 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-2"/>
May 28 01:14:21.678409 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:14:21.678409 np0000001577 nova-compute[98319]:   <serial>b85f0ffa-2e08-4251-973c-6462a40ecbea</serial>
May 28 01:14:21.678409 np0000001577 nova-compute[98319]: </disk>
May 28 01:14:21.678409 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:14:23.341898 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:14:23.342265 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:14:23.342265 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:14:23.342265 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] No VIF found with MAC fa:16:3e:4a:3d:bf, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:14:24.172807 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-83e6e38d-ebcc-4c7b-9828-6ccc29e1db0c tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "78222e75-5ee3-4478-8f29-391c88192956" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:24.172892 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-83e6e38d-ebcc-4c7b-9828-6ccc29e1db0c tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "78222e75-5ee3-4478-8f29-391c88192956" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:24.173079 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-83e6e38d-ebcc-4c7b-9828-6ccc29e1db0c tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Rebooting instance
May 28 01:14:24.357088 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "622fc3c0-e8bc-408d-89da-ce248c8c007a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:24.357636 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "622fc3c0-e8bc-408d-89da-ce248c8c007a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:24.726370 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-83e6e38d-ebcc-4c7b-9828-6ccc29e1db0c tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "refresh_cache-78222e75-5ee3-4478-8f29-391c88192956" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:14:24.726486 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-83e6e38d-ebcc-4c7b-9828-6ccc29e1db0c tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquired lock "refresh_cache-78222e75-5ee3-4478-8f29-391c88192956" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:14:24.726634 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-83e6e38d-ebcc-4c7b-9828-6ccc29e1db0c tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:14:24.859743 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:14:24.889288 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b5cc8e52-d6e8-4d1a-bdec-01185f4c6290 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.008s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:25.228518 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-83e6e38d-ebcc-4c7b-9828-6ccc29e1db0c tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:14:25.412564 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:25.413003 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:25.415903 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:14:25.416022 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Claim successful on node np0000001577
May 28 01:14:25.497889 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-83e6e38d-ebcc-4c7b-9828-6ccc29e1db0c tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:14:25.643357 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-83e6e38d-ebcc-4c7b-9828-6ccc29e1db0c tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Updating instance_info_cache with network_info: [{"id": "d2012ded-4851-468b-9f75-d2adb6cca344", "address": "fa:16:3e:04:74:31", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2012ded-48", "ovs_interfaceid": "d2012ded-4851-468b-9f75-d2adb6cca344", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:14:25.849592 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:26.146145 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-83e6e38d-ebcc-4c7b-9828-6ccc29e1db0c tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Releasing lock "refresh_cache-78222e75-5ee3-4478-8f29-391c88192956" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:14:26.630434 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:26.654036 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-83e6e38d-ebcc-4c7b-9828-6ccc29e1db0c tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:14:26.837856 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:14:26.838630 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:14:27.343686 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:14:27.856189 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.441s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:27.857396 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:14:28.366995 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:14:28.367176 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:14:28.367435 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:14:28.367754 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:14:28.449795 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae6c3c6a50b24a58af140f523fb73374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1880a27e1ad0432f914e086d7fffdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:14:28.651497 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:28.651652 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:28.728289 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:28.868594 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Successfully created port: 428fb87f-367e-4210-8601-37acf6b0e21b {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:14:28.869852 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:14:29.154115 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Detaching volume b85f0ffa-2e08-4251-973c-6462a40ecbea
May 28 01:14:29.190939 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Attempting to driver detach volume b85f0ffa-2e08-4251-973c-6462a40ecbea from mountpoint /dev/vdb
May 28 01:14:29.194645 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Found disk vdb by alias ua-b85f0ffa-2e08-4251-973c-6462a40ecbea {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:14:29.195786 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Found disk vdb by alias ua-b85f0ffa-2e08-4251-973c-6462a40ecbea {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:14:29.195973 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Attempting to detach device vdb from instance 26af0b2c-7e35-4e53-85eb-71ddca16fbfa from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:14:29.196098 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:14:29.196098 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:14:29.196098 np0000001577 nova-compute[98319]:   <alias name="ua-b85f0ffa-2e08-4251-973c-6462a40ecbea"/>
May 28 01:14:29.196098 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-2"/>
May 28 01:14:29.196098 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:14:29.196098 np0000001577 nova-compute[98319]:   <serial>b85f0ffa-2e08-4251-973c-6462a40ecbea</serial>
May 28 01:14:29.196098 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:14:29.196098 np0000001577 nova-compute[98319]: </disk>
May 28 01:14:29.196098 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:14:29.200240 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Successfully detached device vdb from instance 26af0b2c-7e35-4e53-85eb-71ddca16fbfa from the persistent domain config.
May 28 01:14:29.200368 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] (1/8): Attempting to detach device vdb with device alias ua-b85f0ffa-2e08-4251-973c-6462a40ecbea from instance 26af0b2c-7e35-4e53-85eb-71ddca16fbfa from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:14:29.200608 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:14:29.200608 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:14:29.200608 np0000001577 nova-compute[98319]:   <alias name="ua-b85f0ffa-2e08-4251-973c-6462a40ecbea"/>
May 28 01:14:29.200608 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-2"/>
May 28 01:14:29.200608 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:14:29.200608 np0000001577 nova-compute[98319]:   <serial>b85f0ffa-2e08-4251-973c-6462a40ecbea</serial>
May 28 01:14:29.200608 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:14:29.200608 np0000001577 nova-compute[98319]: </disk>
May 28 01:14:29.200608 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:14:29.356008 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Successfully updated port: 428fb87f-367e-4210-8601-37acf6b0e21b {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:14:29.374237 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:14:29.422909 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b7d2d32b-743d-4196-a614-5992909ba607 req-6d430e8d-fe7f-4808-9917-3ba51ece3406 service nova] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Received event network-changed-428fb87f-367e-4210-8601-37acf6b0e21b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:14:29.423020 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-b7d2d32b-743d-4196-a614-5992909ba607 req-6d430e8d-fe7f-4808-9917-3ba51ece3406 service nova] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Refreshing instance network info cache due to event network-changed-428fb87f-367e-4210-8601-37acf6b0e21b. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:14:29.423185 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b7d2d32b-743d-4196-a614-5992909ba607 req-6d430e8d-fe7f-4808-9917-3ba51ece3406 service nova] Acquiring lock "refresh_cache-622fc3c0-e8bc-408d-89da-ce248c8c007a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:14:29.423300 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b7d2d32b-743d-4196-a614-5992909ba607 req-6d430e8d-fe7f-4808-9917-3ba51ece3406 service nova] Acquired lock "refresh_cache-622fc3c0-e8bc-408d-89da-ce248c8c007a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:14:29.423540 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b7d2d32b-743d-4196-a614-5992909ba607 req-6d430e8d-fe7f-4808-9917-3ba51ece3406 service nova] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Refreshing network info cache for port 428fb87f-367e-4210-8601-37acf6b0e21b {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:14:29.666824 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930869.6664631, 26af0b2c-7e35-4e53-85eb-71ddca16fbfa => ua-b85f0ffa-2e08-4251-973c-6462a40ecbea> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:14:29.668526 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-b85f0ffa-2e08-4251-973c-6462a40ecbea for instance 26af0b2c-7e35-4e53-85eb-71ddca16fbfa {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:14:29.670611 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Successfully detached device vdb from instance 26af0b2c-7e35-4e53-85eb-71ddca16fbfa from the live domain config.
May 28 01:14:29.671539 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:14:29.671792 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea', 'iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b85f0ffa-2e08-4251-973c-6462a40ecbea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:14:29.671921 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:14:29.672202 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:14:29.672443 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea', 'iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b85f0ffa-2e08-4251-973c-6462a40ecbea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:14:29.672577 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:14:29.695971 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:29.695971 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:29.695971 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:29.695971 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:29.695971 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:29.695971 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:29.695971 np0000001577 nova-compute[98319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:29.695971 np0000001577 nova-compute[98319]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea (non-flash)
May 28 01:14:29.695971 np0000001577 nova-compute[98319]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea (non-flash)
May 28 01:14:29.695971 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:29.696324 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:29.696324 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:29.696324 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:29.696324 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:29.696324 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:29.696324 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:29.696324 np0000001577 nova-compute[98319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:29.696324 np0000001577 nova-compute[98319]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea (non-flash)
May 28 01:14:29.696324 np0000001577 nova-compute[98319]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea (non-flash)
May 28 01:14:29.696324 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:29.696324 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', '185'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c', '193'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c', '194'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea', '197')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:14:29.696324 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea', '196')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:14:29.697140 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea', '197')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:14:29.697908 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c984c52cc20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea'): ({'sdf'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:14:29.698098 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Removing multipathed devices sdf, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:14:29.698300 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Flush multipath device 330000000ee67ef77 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:14:29.730995 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:14:29.773146 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:14:29.823830 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Checking to see if SCSI volumes sdf, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:14:29.823960 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] SCSI volumes sdf, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:14:29.824954 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Checking to see if device paths {'sdf', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:14:29.836203 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Device paths {'sdf', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:14:29.836385 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:14:29.846908 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:29.857826 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "refresh_cache-622fc3c0-e8bc-408d-89da-ce248c8c007a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:14:29.878323 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 196, target: iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea, portal: 192.168.40.100,3260]
May 28 01:14:29.878323 np0000001577 nova-compute[98319]: Logout of [sid: 196, target: iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea, portal: 192.168.40.100,3260] successful.
May 28 01:14:29.878323 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:29.879911 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Booting with volume 331fac1a-1b95-413e-a99f-a2cb5feae599 at /dev/vda
May 28 01:14:29.895865 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:29.907011 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:29.917908 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:14:29.927799 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-b7d2d32b-743d-4196-a614-5992909ba607 req-6d430e8d-fe7f-4808-9917-3ba51ece3406 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:14:29.931099 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:14:29.938851 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 197, target: iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea, portal: 192.168.50.100,3260]
May 28 01:14:29.938851 np0000001577 nova-compute[98319]: Logout of [sid: 197, target: iqn.2023-03.storpool.com:os--volume-b85f0ffa-2e08-4251-973c-6462a40ecbea, portal: 192.168.50.100,3260] successful.
May 28 01:14:29.938851 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:29.955327 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:14:29.973573 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:29.973573 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:14:29.973795 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] <== disconnect_volume: return (300ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:14:29.974020 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:14:30.003432 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:14:30.003698 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:14:30.011787 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b7d2d32b-743d-4196-a614-5992909ba607 req-6d430e8d-fe7f-4808-9917-3ba51ece3406 service nova] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:14:30.015472 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:14:30.017004 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:feb6:e662', 'fe80::1cf4:68ff:fe80:cb5', 'fe80::fc16:3eff:fe4a:3dbf', 'fe80::4416:94ff:febb:9b7b', 'fe80::fc16:3eff:fe04:7d17', 'fe80::fc16:3eff:fe04:7431', 'fe80::d820:d3ff:fe1f:ca6e', 'fe80::fc16:3eff:fecc:2a78', 'fe80::c813:dcff:fe9e:6381', 'fe80::fc16:3eff:fe05:9d82', 'fe80::583c:47ff:fea3:281d'] 
May 28 01:14:30.017145 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:14:30.017273 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:14:30.017742 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] <== get_connector_properties: return (99ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:14:30.017950 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Updating existing volume attachment record: 7069ba60-d80b-463b-9775-a44c44f2c8b7 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:14:30.089617 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:30.089617 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:30.108081 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:30.114630 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:30.137519 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:30.139563 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:30.216360 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-b7d2d32b-743d-4196-a614-5992909ba607 req-6d430e8d-fe7f-4808-9917-3ba51ece3406 service nova] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:14:30.236560 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8c89c2df-13f6-4d3f-9bda-7f8e37891f78 req-85ee5314-c2bf-4593-a848-f24bd6002bb9 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Received event network-vif-unplugged-d2012ded-4851-468b-9f75-d2adb6cca344 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:14:30.236872 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8c89c2df-13f6-4d3f-9bda-7f8e37891f78 req-85ee5314-c2bf-4593-a848-f24bd6002bb9 service nova] Acquiring lock "78222e75-5ee3-4478-8f29-391c88192956-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:30.236985 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8c89c2df-13f6-4d3f-9bda-7f8e37891f78 req-85ee5314-c2bf-4593-a848-f24bd6002bb9 service nova] Lock "78222e75-5ee3-4478-8f29-391c88192956-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:30.237115 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8c89c2df-13f6-4d3f-9bda-7f8e37891f78 req-85ee5314-c2bf-4593-a848-f24bd6002bb9 service nova] Lock "78222e75-5ee3-4478-8f29-391c88192956-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:30.237490 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8c89c2df-13f6-4d3f-9bda-7f8e37891f78 req-85ee5314-c2bf-4593-a848-f24bd6002bb9 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] No waiting events found dispatching network-vif-unplugged-d2012ded-4851-468b-9f75-d2adb6cca344 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:14:30.237655 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-8c89c2df-13f6-4d3f-9bda-7f8e37891f78 req-85ee5314-c2bf-4593-a848-f24bd6002bb9 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Received unexpected event network-vif-unplugged-d2012ded-4851-468b-9f75-d2adb6cca344 for instance with vm_state active and task_state reboot_started.
May 28 01:14:30.410202 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.998639099999764 future=<Future at 0x7c9884169160 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:14:30.410829 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.998014238999986 future=<Future at 0x7c9884169160 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:14:30.411192 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.997620525999992 future=<Future at 0x7c9884169160 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:14:30.527413 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lazy-loading 'flavor' on Instance uuid 26af0b2c-7e35-4e53-85eb-71ddca16fbfa {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:14:30.680663 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-83e6e38d-ebcc-4c7b-9828-6ccc29e1db0c tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Instance shutdown successfully.
May 28 01:14:30.718652 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b7d2d32b-743d-4196-a614-5992909ba607 req-6d430e8d-fe7f-4808-9917-3ba51ece3406 service nova] Releasing lock "refresh_cache-622fc3c0-e8bc-408d-89da-ce248c8c007a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:14:30.718983 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquired lock "refresh_cache-622fc3c0-e8bc-408d-89da-ce248c8c007a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:14:30.719122 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:14:30.848065 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:31.061564 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:31.086904 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:31.090953 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:31.170976 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:31.295107 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:14:31.406415 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:31.406415 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:31.408469 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:31.432182 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:31.467257 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:14:31.533759 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a6c736ef-1107-43bc-99ae-985b1ca63143 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.882s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:31.614524 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Updating instance_info_cache with network_info: [{"id": "428fb87f-367e-4210-8601-37acf6b0e21b", "address": "fa:16:3e:ae:ae:87", "network": {"id": "0be6df83-bfa0-4c90-aed3-88212317cb4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-252451076-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1880a27e1ad0432f914e086d7fffdeb4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap428fb87f-36", "ovs_interfaceid": "428fb87f-367e-4210-8601-37acf6b0e21b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:14:31.633291 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:31.826538 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Removed pending STOPPED event for 78222e75-5ee3-4478-8f29-391c88192956 due to new event <LifecycleEvent: 1779930871.8261597, 78222e75-5ee3-4478-8f29-391c88192956 => Resumed> {{(pid=98319) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 01:14:31.827024 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930871.8261597, 78222e75-5ee3-4478-8f29-391c88192956 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:14:31.827144 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 78222e75-5ee3-4478-8f29-391c88192956] VM Resumed (Lifecycle Event)
May 28 01:14:31.832801 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Instance running successfully.
May 28 01:14:31.833214 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-83e6e38d-ebcc-4c7b-9828-6ccc29e1db0c tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Instance soft rebooted successfully.
May 28 01:14:31.833420 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-83e6e38d-ebcc-4c7b-9828-6ccc29e1db0c tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:14:31.978071 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:14:31.978261 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98319) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 28 01:14:32.116285 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Releasing lock "refresh_cache-622fc3c0-e8bc-408d-89da-ce248c8c007a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:14:32.116694 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Instance network_info: |[{"id": "428fb87f-367e-4210-8601-37acf6b0e21b", "address": "fa:16:3e:ae:ae:87", "network": {"id": "0be6df83-bfa0-4c90-aed3-88212317cb4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-252451076-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1880a27e1ad0432f914e086d7fffdeb4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap428fb87f-36", "ovs_interfaceid": "428fb87f-367e-4210-8601-37acf6b0e21b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:14:32.134563 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:14:32.134563 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:14:32.134563 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Creating image(s)
May 28 01:14:32.134563 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:14:32.134563 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Ensure instance console log exists: /opt/stack/data/nova/instances/622fc3c0-e8bc-408d-89da-ce248c8c007a/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:14:32.134563 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:32.134563 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:32.134563 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:32.135278 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Start _get_guest_xml network_info=[{"id": "428fb87f-367e-4210-8601-37acf6b0e21b", "address": "fa:16:3e:ae:ae:87", "network": {"id": "0be6df83-bfa0-4c90-aed3-88212317cb4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-252451076-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1880a27e1ad0432f914e086d7fffdeb4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap428fb87f-36", "ovs_interfaceid": "428fb87f-367e-4210-8601-37acf6b0e21b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599', 'iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '331fac1a-1b95-413e-a99f-a2cb5feae599', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '622fc3c0-e8bc-408d-89da-ce248c8c007a', 'attached_at': '', 'detached_at': '', 'volume_id': '331fac1a-1b95-413e-a99f-a2cb5feae599', 'serial': '331fac1a-1b95-413e-a99f-a2cb5feae599'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '7069ba60-d80b-463b-9775-a44c44f2c8b7', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:14:32.137443 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:14:32.138408 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-1760217107', uuid='622fc3c0-e8bc-408d-89da-ce248c8c007a'), owner=OwnerMeta(userid='ae6c3c6a50b24a58af140f523fb73374', username='tempest-TestVolumeBootPatternV346-1741753090-project-member', projectid='1880a27e1ad0432f914e086d7fffdeb4', projectname='tempest-TestVolumeBootPatternV346-1741753090'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "428fb87f-367e-4210-8601-37acf6b0e21b", "address": "fa:16:3e:ae:ae:87", "network": {"id": "0be6df83-bfa0-4c90-aed3-88212317cb4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-252451076-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1880a27e1ad0432f914e086d7fffdeb4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap428fb87f-36", "ovs_interfaceid": "428fb87f-367e-4210-8601-37acf6b0e21b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930872.1381438) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:14:32.139466 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:14:32.139917 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:14:32.143561 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:14:32.143561 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:14:32.143561 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:14:32.143561 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:14:32.143561 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:14:32.143561 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:14:32.143561 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:14:32.143561 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:14:32.143561 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:14:32.143561 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:14:32.143561 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:14:32.143561 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:14:32.143561 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:14:32.143561 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:14:32.152452 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:14:32.152884 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599', 'iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '331fac1a-1b95-413e-a99f-a2cb5feae599', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:14:32.153740 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:14:32.153740 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:14:32.153740 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599', 'iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '331fac1a-1b95-413e-a99f-a2cb5feae599', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:14:32.165971 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:14:32.166478 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:14:32.166944 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:14:32.167129 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:14:32.167482 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:14:32.167668 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:14:32.178091 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:14:32.178091 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:32.182719 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:14:32.182719 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:32.190361 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599] added
May 28 01:14:32.190361 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:14:32.190361 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:14:32.190361 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:14:32.190361 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:14:32.190361 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:14:32.190361 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:32.190534 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:14:32.190669 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0235(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:14:32.190826 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:14:32.195009 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599] added
May 28 01:14:32.195009 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:14:32.195009 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:14:32.195009 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:14:32.195009 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:14:32.195009 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:14:32.195009 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:32.195260 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:14:32.195396 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0277(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:14:32.195517 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:14:32.298336 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0845eedf-e442-4e3e-a33b-a0c53460efb0 req-1f0e0953-44f2-4b4a-b06a-1a13603525b9 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Received event network-vif-unplugged-d2012ded-4851-468b-9f75-d2adb6cca344 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:14:32.298509 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0845eedf-e442-4e3e-a33b-a0c53460efb0 req-1f0e0953-44f2-4b4a-b06a-1a13603525b9 service nova] Acquiring lock "78222e75-5ee3-4478-8f29-391c88192956-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:32.298696 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0845eedf-e442-4e3e-a33b-a0c53460efb0 req-1f0e0953-44f2-4b4a-b06a-1a13603525b9 service nova] Lock "78222e75-5ee3-4478-8f29-391c88192956-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:32.298984 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0845eedf-e442-4e3e-a33b-a0c53460efb0 req-1f0e0953-44f2-4b4a-b06a-1a13603525b9 service nova] Lock "78222e75-5ee3-4478-8f29-391c88192956-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:32.299107 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0845eedf-e442-4e3e-a33b-a0c53460efb0 req-1f0e0953-44f2-4b4a-b06a-1a13603525b9 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] No waiting events found dispatching network-vif-unplugged-d2012ded-4851-468b-9f75-d2adb6cca344 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:14:32.299227 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-0845eedf-e442-4e3e-a33b-a0c53460efb0 req-1f0e0953-44f2-4b4a-b06a-1a13603525b9 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Received unexpected event network-vif-unplugged-d2012ded-4851-468b-9f75-d2adb6cca344 for instance with vm_state active and task_state None.
May 28 01:14:32.299346 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0845eedf-e442-4e3e-a33b-a0c53460efb0 req-1f0e0953-44f2-4b4a-b06a-1a13603525b9 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Received event network-vif-plugged-d2012ded-4851-468b-9f75-d2adb6cca344 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:14:32.299522 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0845eedf-e442-4e3e-a33b-a0c53460efb0 req-1f0e0953-44f2-4b4a-b06a-1a13603525b9 service nova] Acquiring lock "78222e75-5ee3-4478-8f29-391c88192956-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:32.299592 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0845eedf-e442-4e3e-a33b-a0c53460efb0 req-1f0e0953-44f2-4b4a-b06a-1a13603525b9 service nova] Lock "78222e75-5ee3-4478-8f29-391c88192956-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:32.299718 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0845eedf-e442-4e3e-a33b-a0c53460efb0 req-1f0e0953-44f2-4b4a-b06a-1a13603525b9 service nova] Lock "78222e75-5ee3-4478-8f29-391c88192956-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:32.299869 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0845eedf-e442-4e3e-a33b-a0c53460efb0 req-1f0e0953-44f2-4b4a-b06a-1a13603525b9 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] No waiting events found dispatching network-vif-plugged-d2012ded-4851-468b-9f75-d2adb6cca344 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:14:32.300165 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-0845eedf-e442-4e3e-a33b-a0c53460efb0 req-1f0e0953-44f2-4b4a-b06a-1a13603525b9 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Received unexpected event network-vif-plugged-d2012ded-4851-468b-9f75-d2adb6cca344 for instance with vm_state active and task_state None.
May 28 01:14:32.300165 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0845eedf-e442-4e3e-a33b-a0c53460efb0 req-1f0e0953-44f2-4b4a-b06a-1a13603525b9 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Received event network-vif-plugged-d2012ded-4851-468b-9f75-d2adb6cca344 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:14:32.300165 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0845eedf-e442-4e3e-a33b-a0c53460efb0 req-1f0e0953-44f2-4b4a-b06a-1a13603525b9 service nova] Acquiring lock "78222e75-5ee3-4478-8f29-391c88192956-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:32.300410 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0845eedf-e442-4e3e-a33b-a0c53460efb0 req-1f0e0953-44f2-4b4a-b06a-1a13603525b9 service nova] Lock "78222e75-5ee3-4478-8f29-391c88192956-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:32.300410 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0845eedf-e442-4e3e-a33b-a0c53460efb0 req-1f0e0953-44f2-4b4a-b06a-1a13603525b9 service nova] Lock "78222e75-5ee3-4478-8f29-391c88192956-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:32.300563 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0845eedf-e442-4e3e-a33b-a0c53460efb0 req-1f0e0953-44f2-4b4a-b06a-1a13603525b9 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] No waiting events found dispatching network-vif-plugged-d2012ded-4851-468b-9f75-d2adb6cca344 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:14:32.300563 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-0845eedf-e442-4e3e-a33b-a0c53460efb0 req-1f0e0953-44f2-4b4a-b06a-1a13603525b9 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Received unexpected event network-vif-plugged-d2012ded-4851-468b-9f75-d2adb6cca344 for instance with vm_state active and task_state None.
May 28 01:14:32.330067 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:14:32.332370 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:14:32.349801 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-83e6e38d-ebcc-4c7b-9828-6ccc29e1db0c tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "78222e75-5ee3-4478-8f29-391c88192956" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.177s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:32.480322 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 7.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:14:32.835570 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930872.835286, 78222e75-5ee3-4478-8f29-391c88192956 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:14:32.835730 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 78222e75-5ee3-4478-8f29-391c88192956] VM Started (Lifecycle Event)
May 28 01:14:33.067097 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:33.067473 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:33.191234 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:14:33.196008 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:14:33.202796 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:14:33.202796 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:14:33.210350 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:14:33.210350 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:33.216290 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:33.221504 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:33.230968 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:33.230968 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:33.230968 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:33.230968 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:33.230968 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:33.230968 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:33.230968 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:33.231277 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:33.231277 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:33.231277 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:33.231277 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:33.231277 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:33.231277 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:33.231277 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:33.235236 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:33.235236 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:33.235236 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:33.235236 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:33.235236 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:33.235236 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:33.235236 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:33.235445 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:33.235445 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:33.235445 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:33.235445 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:33.235445 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:33.235445 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:33.235445 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:33.264203 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599, portal: 192.168.50.100,3260]
May 28 01:14:33.264203 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599, portal: 192.168.50.100,3260] successful.
May 28 01:14:33.264203 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:33.274111 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599, portal: 192.168.40.100,3260]
May 28 01:14:33.274111 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599, portal: 192.168.40.100,3260] successful.
May 28 01:14:33.274111 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:33.278119 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:33.284938 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:33.293607 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:33.293607 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:33.293607 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:33.293607 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:33.293607 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:33.293607 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:33.293607 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:33.293607 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:33.293607 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:33.293607 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:33.293607 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:33.293607 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:33.293607 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:33.293607 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:33.293607 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:33.293607 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:33.293607 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:33.293607 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:33.293607 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.126s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:14:33.293607 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:14:33.294290 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] HCTL ('7', '-', '-', 0) found on session 198 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:14:33.294290 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:14:33.301278 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:33.301278 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:33.301278 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:33.301278 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:33.301278 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:33.301278 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:33.301278 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:33.301278 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:33.301278 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:33.302386 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:33.302386 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:33.302386 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:33.302386 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:33.302386 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:33.302386 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:33.302386 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:33.302386 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:33.302386 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:33.302386 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.134s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:14:33.302386 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:14:33.303706 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] HCTL ('8', '-', '-', 0) found on session 199 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:14:33.303706 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:14:33.308229 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Searching for a device in session 198 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:14:33.308338 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '331fac1a-1b95-413e-a99f-a2cb5feae599', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:14:33.317753 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Searching for a device in session 199 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:14:33.317753 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '331fac1a-1b95-413e-a99f-a2cb5feae599', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:14:33.337667 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:14:33.339583 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:14:33.570338 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lazy-loading 'flavor' on Instance uuid 26af0b2c-7e35-4e53-85eb-71ddca16fbfa {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:14:34.167722 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:14:34.579239 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:35.183926 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Found WWN 3300000005a861081 for multipath device dm-2 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:14:35.183926 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:14:35.183926 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] <== connect_volume: return (3029ms) {'type': 'block', 'scsi_wwn': '3300000005a861081', 'path': '/dev/dm-2', 'multipath_id': '3300000005a861081'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:14:35.183926 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005a861081', 'path': '/dev/dm-2', 'multipath_id': '3300000005a861081'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:14:35.642072 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:35.642606 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:35.642606 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Attaching volume e72eb595-519d-4f4b-a00a-2ce208c0ecef to /dev/vdb
May 28 01:14:35.672334 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:14:35.682124 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:14:35.690115 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:14:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1760217107',display_name='tempest-TestVolumeBootPatternV346-server-1760217107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpatternv346-server-1760217107',id=77,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH02rmsw6pKYutK8wZWIwQWpvB+AJDUQk7lliYqIX4sa4gPxCQsfqVNUtitoRFkRcrdylpjg/Oou2FD7NSsA6BHCL4gLqDcmAr0djGRBQiCd+X0Xokvox8I2NzoZAjwbDQ==',key_name='tempest-keypair-1980091552',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1880a27e1ad0432f914e086d7fffdeb4',ramdisk_id='',reservation_id='r-sp7wewec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1741753090',owner_user_name='tempest-TestVolumeBootPatternV346-1741753090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:14:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae6c3c6a50b24a58af140f523fb73374',uuid=622fc3c0-e8bc-408d-89da-ce248c8c007a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "428fb87f-367e-4210-8601-37acf6b0e21b", "address": "fa:16:3e:ae:ae:87", "network": {"id": "0be6df83-bfa0-4c90-aed3-88212317cb4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-252451076-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1880a27e1ad0432f914e086d7fffdeb4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap428fb87f-36", "ovs_interfaceid": "428fb87f-367e-4210-8601-37acf6b0e21b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:14:35.690115 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Converting VIF {"id": "428fb87f-367e-4210-8601-37acf6b0e21b", "address": "fa:16:3e:ae:ae:87", "network": {"id": "0be6df83-bfa0-4c90-aed3-88212317cb4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-252451076-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1880a27e1ad0432f914e086d7fffdeb4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap428fb87f-36", "ovs_interfaceid": "428fb87f-367e-4210-8601-37acf6b0e21b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:14:35.690770 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ae:87,bridge_name='br-int',has_traffic_filtering=True,id=428fb87f-367e-4210-8601-37acf6b0e21b,network=Network(0be6df83-bfa0-4c90-aed3-88212317cb4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap428fb87f-36') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:14:35.691628 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lazy-loading 'pci_devices' on Instance uuid 622fc3c0-e8bc-408d-89da-ce248c8c007a {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:14:35.701387 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:14:35.745815 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:14:35.746071 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:14:35.754133 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:14:35.755303 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:feb6:e662', 'fe80::1cf4:68ff:fe80:cb5', 'fe80::fc16:3eff:fe4a:3dbf', 'fe80::4416:94ff:febb:9b7b', 'fe80::fc16:3eff:fe04:7d17', 'fe80::fc16:3eff:fecc:2a78', 'fe80::c813:dcff:fe9e:6381', 'fe80::fc16:3eff:fe05:9d82', 'fe80::583c:47ff:fea3:281d', 'fe80::fc16:3eff:fe04:7431', 'fe80::d820:d3ff:fe1f:ca6e'] 
May 28 01:14:35.755416 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:14:35.755503 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:14:35.755750 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:14:35.755975 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Updating existing volume attachment record: d809512d-9c92-48be-b516-f52925977160 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:14:35.851104 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:36.196726 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] End _get_guest_xml xml=<domain type="qemu">
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:   <uuid>622fc3c0-e8bc-408d-89da-ce248c8c007a</uuid>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:   <name>instance-0000004d</name>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestVolumeBootPatternV346-server-1760217107</nova:name>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:14:32</nova:creationTime>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       <nova:image uuid="">
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:         <nova:user uuid="ae6c3c6a50b24a58af140f523fb73374">tempest-TestVolumeBootPatternV346-1741753090-project-member</nova:user>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:         <nova:project uuid="1880a27e1ad0432f914e086d7fffdeb4">tempest-TestVolumeBootPatternV346-1741753090</nova:project>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:         <nova:port uuid="428fb87f-367e-4210-8601-37acf6b0e21b">
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:     <system>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       <entry name="serial">622fc3c0-e8bc-408d-89da-ce248c8c007a</entry>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       <entry name="uuid">622fc3c0-e8bc-408d-89da-ce248c8c007a</entry>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:     </system>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:   <os>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:   </os>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:   <features>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:   </features>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:   <devices>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/622fc3c0-e8bc-408d-89da-ce248c8c007a/disk.config"/>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:     </disk>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       <alias name="ua-331fac1a-1b95-413e-a99f-a2cb5feae599"/>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-2"/>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       <serial>331fac1a-1b95-413e-a99f-a2cb5feae599</serial>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:     </disk>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:ae:ae:87"/>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       <target dev="tap428fb87f-36"/>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:     </interface>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/622fc3c0-e8bc-408d-89da-ce248c8c007a/console.log" append="off"/>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:     </serial>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:     <video>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:     </video>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:     </rng>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:   </devices>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]: </domain>
May 28 01:14:36.196726 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:14:36.196726 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Preparing to wait for external event network-vif-plugged-428fb87f-367e-4210-8601-37acf6b0e21b {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:14:36.196726 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "622fc3c0-e8bc-408d-89da-ce248c8c007a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:36.196726 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "622fc3c0-e8bc-408d-89da-ce248c8c007a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:36.196726 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "622fc3c0-e8bc-408d-89da-ce248c8c007a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:36.196726 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:14:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1760217107',display_name='tempest-TestVolumeBootPatternV346-server-1760217107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpatternv346-server-1760217107',id=77,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH02rmsw6pKYutK8wZWIwQWpvB+AJDUQk7lliYqIX4sa4gPxCQsfqVNUtitoRFkRcrdylpjg/Oou2FD7NSsA6BHCL4gLqDcmAr0djGRBQiCd+X0Xokvox8I2NzoZAjwbDQ==',key_name='tempest-keypair-1980091552',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1880a27e1ad0432f914e086d7fffdeb4',ramdisk_id='',reservation_id='r-sp7wewec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1741753090',owner_user_name='tempest-TestVolumeBootPatternV346-1741753090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:14:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae6c3c6a50b24a58af140f523fb73374',uuid=622fc3c0-e8bc-408d-89da-ce248c8c007a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "428fb87f-367e-4210-8601-37acf6b0e21b", "address": "fa:16:3e:ae:ae:87", "network": {"id": "0be6df83-bfa0-4c90-aed3-88212317cb4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-252451076-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1880a27e1ad0432f914e086d7fffdeb4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap428fb87f-36", "ovs_interfaceid": "428fb87f-367e-4210-8601-37acf6b0e21b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:14:36.196726 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Converting VIF {"id": "428fb87f-367e-4210-8601-37acf6b0e21b", "address": "fa:16:3e:ae:ae:87", "network": {"id": "0be6df83-bfa0-4c90-aed3-88212317cb4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-252451076-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1880a27e1ad0432f914e086d7fffdeb4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap428fb87f-36", "ovs_interfaceid": "428fb87f-367e-4210-8601-37acf6b0e21b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:14:36.200470 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ae:87,bridge_name='br-int',has_traffic_filtering=True,id=428fb87f-367e-4210-8601-37acf6b0e21b,network=Network(0be6df83-bfa0-4c90-aed3-88212317cb4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap428fb87f-36') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:14:36.200757 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ae:87,bridge_name='br-int',has_traffic_filtering=True,id=428fb87f-367e-4210-8601-37acf6b0e21b,network=Network(0be6df83-bfa0-4c90-aed3-88212317cb4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap428fb87f-36') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:14:36.201361 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:36.201659 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:14:36.201970 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:14:36.203468 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:36.203468 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3cb6c95d-5e73-5d81-8d58-1fbbd43f944c', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:14:36.204718 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:36.204718 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:14:36.206458 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:36.207968 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:36.208181 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap428fb87f-36, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:14:36.208606 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap428fb87f-36, col_values=(('qos', UUID('0318ec53-5dad-408b-aca8-68af21231101')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:14:36.208899 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap428fb87f-36, col_values=(('external_ids', {'iface-id': '428fb87f-367e-4210-8601-37acf6b0e21b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:ae:87', 'vm-uuid': '622fc3c0-e8bc-408d-89da-ce248c8c007a'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:14:36.210094 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:36.211987 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:14:36.215557 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:36.215557 np0000001577 nova-compute[98319]: INFO os_vif [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ae:87,bridge_name='br-int',has_traffic_filtering=True,id=428fb87f-367e-4210-8601-37acf6b0e21b,network=Network(0be6df83-bfa0-4c90-aed3-88212317cb4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap428fb87f-36')
May 28 01:14:36.303406 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:14:36.304075 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef', 'iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e72eb595-519d-4f4b-a00a-2ce208c0ecef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:14:36.304272 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:14:36.636493 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:37.457022 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.153s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:14:37.457485 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef', 'iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e72eb595-519d-4f4b-a00a-2ce208c0ecef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:14:37.468651 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:14:37.469284 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:14:37.469800 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:14:37.470018 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:14:37.470338 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:14:37.470919 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:14:37.484000 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:14:37.484000 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:37.488630 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:14:37.488630 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:37.500367 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef] added
May 28 01:14:37.500367 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:14:37.500367 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:14:37.500367 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:14:37.500367 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:14:37.500367 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:14:37.500367 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:37.500692 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef] added
May 28 01:14:37.500692 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:14:37.500692 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:14:37.500692 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:14:37.500692 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:14:37.500692 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:14:37.500692 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:37.500849 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:14:37.501089 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:14:37.501269 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.031(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:14:37.501471 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0303(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:14:37.501640 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:14:37.501738 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:14:37.732246 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:14:37.732422 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:14:37.732528 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] No VIF found with MAC fa:16:3e:ae:ae:87, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:14:37.733077 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Using config drive
May 28 01:14:38.238523 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:14:38.419808 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Creating config drive at /opt/stack/data/nova/instances/622fc3c0-e8bc-408d-89da-ce248c8c007a/disk.config
May 28 01:14:38.429675 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/622fc3c0-e8bc-408d-89da-ce248c8c007a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp79dtni77 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:14:38.492718 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/622fc3c0-e8bc-408d-89da-ce248c8c007a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp79dtni77" returned: 0 in 0.063s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:14:38.502764 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:14:38.503770 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:14:38.518077 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:14:38.518077 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:14:38.528650 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:14:38.528650 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:38.531649 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:38.541097 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:38.552517 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:38.552517 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:38.552517 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:38.552517 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:38.552517 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:38.552517 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:38.552517 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:38.552517 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:38.552517 np0000001577 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:38.552517 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:38.553039 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:38.553039 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:38.553039 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:38.553039 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:38.553039 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:38.553039 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:38.553039 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:38.553039 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:38.553039 np0000001577 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:38.553039 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:38.561889 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:38.561889 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:38.561889 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:38.561889 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:38.561889 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:38.561889 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:38.561889 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:38.561889 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:38.561889 np0000001577 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:38.561889 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:38.562241 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:38.562241 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:38.562241 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:38.562241 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:38.562241 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:38.562241 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:38.562241 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:38.562241 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:38.562241 np0000001577 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:38.562241 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:38.604263 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef, portal: 192.168.50.100,3260]
May 28 01:14:38.604263 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef, portal: 192.168.50.100,3260] successful.
May 28 01:14:38.604263 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:38.617569 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:38.618442 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef, portal: 192.168.40.100,3260]
May 28 01:14:38.618442 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef, portal: 192.168.40.100,3260] successful.
May 28 01:14:38.618442 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:38.638892 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:38.644217 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:38.644217 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:38.644217 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:38.644217 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:38.644217 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:38.644217 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:38.644217 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:38.644217 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:38.644217 np0000001577 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:38.644217 np0000001577 nova-compute[98319]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:38.644217 np0000001577 nova-compute[98319]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:38.644217 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:38.644513 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:38.644513 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:38.644513 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:38.644513 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:38.644513 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:38.644513 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:38.644513 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:38.644513 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:38.644513 np0000001577 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:38.644513 np0000001577 nova-compute[98319]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:38.644513 np0000001577 nova-compute[98319]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:38.644513 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:38.644776 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.174s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:14:38.644891 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:14:38.645900 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] HCTL ('14', '-', '-', 0) found on session 201 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:14:38.646037 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:14:38.656817 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:38.656817 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:38.656817 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:38.656817 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:38.656817 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:38.656817 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:38.656817 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:38.656817 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:38.656817 np0000001577 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:38.656817 np0000001577 nova-compute[98319]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:38.656817 np0000001577 nova-compute[98319]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:38.656817 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:38.657089 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:38.657089 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:38.657089 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:38.657089 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:38.657089 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:38.657089 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:38.657089 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:38.657089 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:38.657089 np0000001577 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:38.657089 np0000001577 nova-compute[98319]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:38.657089 np0000001577 nova-compute[98319]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:38.657089 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:38.657271 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.188s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:14:38.657395 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:14:38.661723 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] HCTL ('17', '-', '-', 0) found on session 202 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:14:38.661723 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:14:38.661723 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Searching for a device in session 201 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:14:38.661723 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e72eb595-519d-4f4b-a00a-2ce208c0ecef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:14:38.675191 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Searching for a device in session 202 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:14:38.675191 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e72eb595-519d-4f4b-a00a-2ce208c0ecef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:14:38.949040 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:38.949040 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:38.972025 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:39.064122 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:39.139774 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:39.141130 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:39.164416 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-691d704f-2ee5-42c3-93bc-63cb30300255 req-884f00c4-eec3-4062-a507-ee3268b0ce5e service nova] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Received event network-vif-plugged-428fb87f-367e-4210-8601-37acf6b0e21b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:14:39.164869 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-691d704f-2ee5-42c3-93bc-63cb30300255 req-884f00c4-eec3-4062-a507-ee3268b0ce5e service nova] Acquiring lock "622fc3c0-e8bc-408d-89da-ce248c8c007a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:39.165117 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-691d704f-2ee5-42c3-93bc-63cb30300255 req-884f00c4-eec3-4062-a507-ee3268b0ce5e service nova] Lock "622fc3c0-e8bc-408d-89da-ce248c8c007a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:39.165283 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-691d704f-2ee5-42c3-93bc-63cb30300255 req-884f00c4-eec3-4062-a507-ee3268b0ce5e service nova] Lock "622fc3c0-e8bc-408d-89da-ce248c8c007a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:39.165459 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-691d704f-2ee5-42c3-93bc-63cb30300255 req-884f00c4-eec3-4062-a507-ee3268b0ce5e service nova] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Processing event network-vif-plugged-428fb87f-367e-4210-8601-37acf6b0e21b {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:14:39.470773 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:14:39.748843 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930879.7484536, 622fc3c0-e8bc-408d-89da-ce248c8c007a => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:14:39.749423 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:14:39.749535 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] VM Started (Lifecycle Event)
May 28 01:14:39.751643 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:14:39.755785 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Instance spawned successfully.
May 28 01:14:39.756187 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:14:39.978328 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:14:40.254971 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:14:40.257924 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:14:40.263908 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:14:40.264057 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:14:40.264348 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:14:40.264568 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:14:40.264819 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:14:40.265032 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:14:40.458757 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:40.458925 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:40.480380 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:14:40.490886 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Found WWN 330000000699793cb for multipath device dm-11 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:14:40.491146 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:14:40.491319 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] <== connect_volume: return (4186ms) {'type': 'block', 'scsi_wwn': '330000000699793cb', 'path': '/dev/dm-11', 'multipath_id': '330000000699793cb'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:14:40.491465 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000699793cb', 'path': '/dev/dm-11', 'multipath_id': '330000000699793cb'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:14:40.493906 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lazy-loading 'flavor' on Instance uuid 26af0b2c-7e35-4e53-85eb-71ddca16fbfa {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:14:40.760993 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:14:40.762997 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930880.7615175, 622fc3c0-e8bc-408d-89da-ce248c8c007a => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:14:40.762997 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] VM Paused (Lifecycle Event)
May 28 01:14:40.771000 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Took 8.64 seconds to spawn the instance on the hypervisor.
May 28 01:14:40.771176 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:14:40.961857 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lazy-loading 'flavor' on Instance uuid a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:14:40.996634 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Attempting to attach volume e72eb595-519d-4f4b-a00a-2ce208c0ecef with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:14:40.997752 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:14:40.997752 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:14:40.997752 np0000001577 nova-compute[98319]:   <alias name="ua-e72eb595-519d-4f4b-a00a-2ce208c0ecef"/>
May 28 01:14:40.997752 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-11"/>
May 28 01:14:40.997752 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:14:40.997752 np0000001577 nova-compute[98319]:   <serial>e72eb595-519d-4f4b-a00a-2ce208c0ecef</serial>
May 28 01:14:40.997752 np0000001577 nova-compute[98319]: </disk>
May 28 01:14:40.997752 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:14:41.217989 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:41.252892 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d2f96b80-6e33-452f-93e0-befe3698ffd2 req-2ca08266-134a-48ff-958d-7ebc5eaf0c1f service nova] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Received event network-vif-plugged-428fb87f-367e-4210-8601-37acf6b0e21b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:14:41.253065 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d2f96b80-6e33-452f-93e0-befe3698ffd2 req-2ca08266-134a-48ff-958d-7ebc5eaf0c1f service nova] Acquiring lock "622fc3c0-e8bc-408d-89da-ce248c8c007a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:41.253220 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d2f96b80-6e33-452f-93e0-befe3698ffd2 req-2ca08266-134a-48ff-958d-7ebc5eaf0c1f service nova] Lock "622fc3c0-e8bc-408d-89da-ce248c8c007a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:41.253369 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d2f96b80-6e33-452f-93e0-befe3698ffd2 req-2ca08266-134a-48ff-958d-7ebc5eaf0c1f service nova] Lock "622fc3c0-e8bc-408d-89da-ce248c8c007a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:41.253509 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d2f96b80-6e33-452f-93e0-befe3698ffd2 req-2ca08266-134a-48ff-958d-7ebc5eaf0c1f service nova] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] No waiting events found dispatching network-vif-plugged-428fb87f-367e-4210-8601-37acf6b0e21b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:14:41.253681 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-d2f96b80-6e33-452f-93e0-befe3698ffd2 req-2ca08266-134a-48ff-958d-7ebc5eaf0c1f service nova] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Received unexpected event network-vif-plugged-428fb87f-367e-4210-8601-37acf6b0e21b for instance with vm_state active and task_state None.
May 28 01:14:41.264707 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:14:41.267400 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930881.267161, 622fc3c0-e8bc-408d-89da-ce248c8c007a => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:14:41.267524 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] VM Resumed (Lifecycle Event)
May 28 01:14:41.282741 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Took 15.92 seconds to build instance.
May 28 01:14:41.637574 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:41.773439 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:14:41.775800 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:14:41.784952 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "622fc3c0-e8bc-408d-89da-ce248c8c007a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.428s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:41.966216 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.507s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:42.194928 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "f0e996d3-b051-421c-b00c-1dbc6971f8e6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:42.195239 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "f0e996d3-b051-421c-b00c-1dbc6971f8e6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:42.647831 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:14:42.648102 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:14:42.648102 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:14:42.648294 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] No VIF found with MAC fa:16:3e:4a:3d:bf, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:14:42.697985 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lazy-loading 'flavor' on Instance uuid f0e996d3-b051-421c-b00c-1dbc6971f8e6 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:14:43.024224 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:43.024744 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:43.024744 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Attaching volume cb80b92d-0753-43c9-8e21-57c6f1f84329 to /dev/vdb
May 28 01:14:43.059660 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:14:43.069914 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:14:43.089611 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:14:43.132009 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:14:43.132289 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:14:43.140178 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:14:43.142527 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:feb6:e662', 'fe80::1cf4:68ff:fe80:cb5', 'fe80::fc16:3eff:fe4a:3dbf', 'fe80::4416:94ff:febb:9b7b', 'fe80::fc16:3eff:fe04:7d17', 'fe80::fc16:3eff:fecc:2a78', 'fe80::c813:dcff:fe9e:6381', 'fe80::fc16:3eff:fe05:9d82', 'fe80::583c:47ff:fea3:281d', 'fe80::fc16:3eff:fe04:7431', 'fe80::d820:d3ff:fe1f:ca6e', 'fe80::fc16:3eff:feae:ae87'] 
May 28 01:14:43.142688 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:14:43.142749 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:14:43.142991 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:14:43.143205 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Updating existing volume attachment record: adbbf931-51c9-400e-92f6-036dfeac8d78 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:14:43.314246 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9548018f-0fbd-4c27-a2d8-694375b15efc req-6bbdb84d-71ba-4868-95f1-cd48e122306d service nova] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Received event network-changed-428fb87f-367e-4210-8601-37acf6b0e21b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:14:43.314246 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9548018f-0fbd-4c27-a2d8-694375b15efc req-6bbdb84d-71ba-4868-95f1-cd48e122306d service nova] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Refreshing instance network info cache due to event network-changed-428fb87f-367e-4210-8601-37acf6b0e21b. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:14:43.314246 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9548018f-0fbd-4c27-a2d8-694375b15efc req-6bbdb84d-71ba-4868-95f1-cd48e122306d service nova] Acquiring lock "refresh_cache-622fc3c0-e8bc-408d-89da-ce248c8c007a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:14:43.314246 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9548018f-0fbd-4c27-a2d8-694375b15efc req-6bbdb84d-71ba-4868-95f1-cd48e122306d service nova] Acquired lock "refresh_cache-622fc3c0-e8bc-408d-89da-ce248c8c007a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:14:43.314246 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-9548018f-0fbd-4c27-a2d8-694375b15efc req-6bbdb84d-71ba-4868-95f1-cd48e122306d service nova] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Refreshing network info cache for port 428fb87f-367e-4210-8601-37acf6b0e21b {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:14:43.701520 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:14:43.701866 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329', 'iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cb80b92d-0753-43c9-8e21-57c6f1f84329', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:14:43.702011 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:14:43.702865 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "f0e996d3-b051-421c-b00c-1dbc6971f8e6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.507s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:43.704169 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:14:43.704665 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329', 'iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cb80b92d-0753-43c9-8e21-57c6f1f84329', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:14:43.715338 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:14:43.715737 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:14:43.716150 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:14:43.716369 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:14:43.716725 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:14:43.716904 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:14:43.728606 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:14:43.728606 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:43.733812 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:14:43.733812 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:43.740289 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329] added
May 28 01:14:43.740289 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:14:43.740289 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:14:43.740289 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:14:43.740289 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:14:43.740289 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:14:43.740289 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:43.740631 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:14:43.740631 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0242(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:14:43.740728 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:14:43.744232 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329] added
May 28 01:14:43.744232 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:14:43.744232 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:14:43.744232 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:14:43.744232 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:14:43.744232 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:14:43.744232 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:43.744466 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:14:43.744509 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0276(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:14:43.744632 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:14:43.815791 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-9548018f-0fbd-4c27-a2d8-694375b15efc req-6bbdb84d-71ba-4868-95f1-cd48e122306d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:14:44.176587 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-9548018f-0fbd-4c27-a2d8-694375b15efc req-6bbdb84d-71ba-4868-95f1-cd48e122306d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:14:44.190675 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e4fa5ace-3ab2-46c8-8215-fc6a84812250 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.548s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:44.334016 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-9548018f-0fbd-4c27-a2d8-694375b15efc req-6bbdb84d-71ba-4868-95f1-cd48e122306d service nova] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Updated VIF entry in instance network info cache for port 428fb87f-367e-4210-8601-37acf6b0e21b. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:14:44.334016 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-9548018f-0fbd-4c27-a2d8-694375b15efc req-6bbdb84d-71ba-4868-95f1-cd48e122306d service nova] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Updating instance_info_cache with network_info: [{"id": "428fb87f-367e-4210-8601-37acf6b0e21b", "address": "fa:16:3e:ae:ae:87", "network": {"id": "0be6df83-bfa0-4c90-aed3-88212317cb4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-252451076-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1880a27e1ad0432f914e086d7fffdeb4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap428fb87f-36", "ovs_interfaceid": "428fb87f-367e-4210-8601-37acf6b0e21b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:14:44.741144 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:14:44.745143 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:14:44.753164 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:14:44.753164 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:14:44.759644 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:14:44.759644 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:44.766023 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:44.772200 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:44.782662 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:44.782662 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:44.782662 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:44.782662 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:44.782662 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:44.782662 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:44.782662 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:44.782662 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:44.782662 np0000001577 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:44.782662 np0000001577 nova-compute[98319]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:44.782662 np0000001577 nova-compute[98319]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:44.782662 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:44.786247 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:44.786247 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:44.786247 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:44.786247 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:44.786247 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:44.786247 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:44.786247 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:44.786247 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:44.786247 np0000001577 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:44.786247 np0000001577 nova-compute[98319]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:44.786247 np0000001577 nova-compute[98319]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:44.786247 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:44.786247 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "f0e996d3-b051-421c-b00c-1dbc6971f8e6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:44.786247 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "f0e996d3-b051-421c-b00c-1dbc6971f8e6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:44.786247 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Attaching volume 70e29303-b357-4265-9f2e-a45ae87b9f69 to /dev/vdb
May 28 01:14:44.792387 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:44.792387 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:44.792387 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:44.792387 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:44.792387 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:44.792387 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:44.792387 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:44.792387 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:44.792387 np0000001577 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:44.792387 np0000001577 nova-compute[98319]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:44.792387 np0000001577 nova-compute[98319]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:44.792387 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:44.792635 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:44.792635 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:44.792635 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:44.792635 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:44.792635 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:44.792635 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:44.792635 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:44.792635 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:44.792635 np0000001577 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:44.792635 np0000001577 nova-compute[98319]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:44.792635 np0000001577 nova-compute[98319]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:44.792635 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:44.829098 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:14:44.833717 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329, portal: 192.168.50.100,3260]
May 28 01:14:44.833717 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329, portal: 192.168.50.100,3260] successful.
May 28 01:14:44.833717 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:44.839010 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9548018f-0fbd-4c27-a2d8-694375b15efc req-6bbdb84d-71ba-4868-95f1-cd48e122306d service nova] Releasing lock "refresh_cache-622fc3c0-e8bc-408d-89da-ce248c8c007a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:14:44.847908 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:44.848220 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:14:44.858283 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329, portal: 192.168.40.100,3260]
May 28 01:14:44.858283 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329, portal: 192.168.40.100,3260] successful.
May 28 01:14:44.858283 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:44.872295 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:44.872295 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:44.872295 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:44.872295 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:44.872295 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:44.872295 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:44.872295 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:44.872295 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:44.872295 np0000001577 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:44.872295 np0000001577 nova-compute[98319]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:44.872295 np0000001577 nova-compute[98319]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:44.872295 np0000001577 nova-compute[98319]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329 (non-flash)
May 28 01:14:44.872295 np0000001577 nova-compute[98319]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329 (non-flash)
May 28 01:14:44.872295 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:44.872901 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:44.872901 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:44.872901 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:44.872901 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:44.872901 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:44.872901 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:44.872901 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:44.872901 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:44.872901 np0000001577 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:44.872901 np0000001577 nova-compute[98319]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:44.872901 np0000001577 nova-compute[98319]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:44.872901 np0000001577 nova-compute[98319]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329 (non-flash)
May 28 01:14:44.872901 np0000001577 nova-compute[98319]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329 (non-flash)
May 28 01:14:44.872901 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:44.872901 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:14:44.873365 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:14:44.874109 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:44.875616 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] HCTL ('18', '-', '-', 0) found on session 203 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:14:44.875776 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:14:44.888711 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:14:44.902246 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:44.902246 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:44.902246 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:44.902246 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:44.902246 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:44.902246 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:44.902246 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:44.902246 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:44.902246 np0000001577 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:44.902246 np0000001577 nova-compute[98319]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:44.902246 np0000001577 nova-compute[98319]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:44.902246 np0000001577 nova-compute[98319]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329 (non-flash)
May 28 01:14:44.902246 np0000001577 nova-compute[98319]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329 (non-flash)
May 28 01:14:44.902246 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:44.904235 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:44.904235 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:44.904235 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:44.904235 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:44.904235 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:44.904235 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:44.904235 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:44.904235 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:44.904235 np0000001577 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:44.904235 np0000001577 nova-compute[98319]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:44.904235 np0000001577 nova-compute[98319]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:44.904235 np0000001577 nova-compute[98319]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329 (non-flash)
May 28 01:14:44.904235 np0000001577 nova-compute[98319]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329 (non-flash)
May 28 01:14:44.904235 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:44.905067 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.188s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:14:44.905228 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:14:44.907431 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Searching for a device in session 203 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:14:44.907955 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'cb80b92d-0753-43c9-8e21-57c6f1f84329', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:14:44.909492 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] HCTL ('19', '-', '-', 0) found on session 204 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:14:44.909640 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:14:44.926950 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Searching for a device in session 204 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:14:44.926950 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cb80b92d-0753-43c9-8e21-57c6f1f84329', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:14:44.942517 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:14:44.943112 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:14:44.955691 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:14:44.959459 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:feb6:e662', 'fe80::1cf4:68ff:fe80:cb5', 'fe80::fc16:3eff:fe4a:3dbf', 'fe80::4416:94ff:febb:9b7b', 'fe80::fc16:3eff:fe04:7d17', 'fe80::fc16:3eff:fecc:2a78', 'fe80::c813:dcff:fe9e:6381', 'fe80::fc16:3eff:fe05:9d82', 'fe80::583c:47ff:fea3:281d', 'fe80::fc16:3eff:fe04:7431', 'fe80::d820:d3ff:fe1f:ca6e', 'fe80::fc16:3eff:feae:ae87'] 
May 28 01:14:44.959459 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:14:44.959459 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:14:44.959459 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:14:44.959459 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Updating existing volume attachment record: b96fb031-50a7-42c3-b630-5d3f7cd4ad1f {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:14:45.409159 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00034228600043206825 future=<Future at 0x7c9884169160 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:14:45.409494 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:14:45.481082 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:14:45.526572 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:14:45.526572 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69', 'iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70e29303-b357-4265-9f2e-a45ae87b9f69', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:14:45.526572 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:14:45.718365 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:14:45.991417 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:45.991638 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:45.991778 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:45.991918 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Auditing locally available compute resources for np0000001577 (node: np0000001577) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 01:14:46.220299 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:46.638945 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:46.732660 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Found WWN 3300000003f161fb7 for multipath device dm-12 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:14:46.732994 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:14:46.733182 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '3300000003f161fb7', 'path': '/dev/dm-12', 'multipath_id': '3300000003f161fb7'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:14:46.733329 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003f161fb7', 'path': '/dev/dm-12', 'multipath_id': '3300000003f161fb7'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:14:46.733729 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.208s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:14:46.733729 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69', 'iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70e29303-b357-4265-9f2e-a45ae87b9f69', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:14:46.735773 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lazy-loading 'flavor' on Instance uuid a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:14:46.747364 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:14:46.747908 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:14:46.748328 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:14:46.748847 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:14:46.749118 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:14:46.749376 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:14:46.761954 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:14:46.761954 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:46.768468 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:14:46.768468 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:46.774870 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69] added
May 28 01:14:46.774870 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:14:46.774870 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:14:46.774870 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:14:46.774870 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:14:46.774870 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:14:46.774870 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:46.774870 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:14:46.774870 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0256(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:14:46.774870 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:14:46.779400 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69] added
May 28 01:14:46.779400 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:14:46.779400 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:14:46.779400 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:14:46.779400 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:14:46.779400 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:14:46.779400 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:46.779620 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:14:46.779698 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0306(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:14:46.779807 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:14:47.021722 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:14:47.112686 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:14:47.112806 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:14:47.203927 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:14:47.208729 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78222e75-5ee3-4478-8f29-391c88192956/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:14:47.243993 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Attempting to attach volume cb80b92d-0753-43c9-8e21-57c6f1f84329 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:14:47.247929 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:14:47.247929 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:14:47.247929 np0000001577 nova-compute[98319]:   <alias name="ua-cb80b92d-0753-43c9-8e21-57c6f1f84329"/>
May 28 01:14:47.247929 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-12"/>
May 28 01:14:47.247929 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:14:47.247929 np0000001577 nova-compute[98319]:   <serial>cb80b92d-0753-43c9-8e21-57c6f1f84329</serial>
May 28 01:14:47.247929 np0000001577 nova-compute[98319]:   <shareable/>
May 28 01:14:47.247929 np0000001577 nova-compute[98319]: </disk>
May 28 01:14:47.247929 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:14:47.295055 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78222e75-5ee3-4478-8f29-391c88192956/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:14:47.295415 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78222e75-5ee3-4478-8f29-391c88192956/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:14:47.377468 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78222e75-5ee3-4478-8f29-391c88192956/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:14:47.378572 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:14:47.382679 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:14:47.385411 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0e996d3-b051-421c-b00c-1dbc6971f8e6/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:14:47.470142 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0e996d3-b051-421c-b00c-1dbc6971f8e6/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:14:47.470824 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0e996d3-b051-421c-b00c-1dbc6971f8e6/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:14:47.556452 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0e996d3-b051-421c-b00c-1dbc6971f8e6/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:14:47.560918 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:14:47.562512 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26af0b2c-7e35-4e53-85eb-71ddca16fbfa/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:14:47.650174 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26af0b2c-7e35-4e53-85eb-71ddca16fbfa/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:14:47.650790 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26af0b2c-7e35-4e53-85eb-71ddca16fbfa/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:14:47.738654 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26af0b2c-7e35-4e53-85eb-71ddca16fbfa/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:14:47.739469 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-11 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:14:47.743151 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:14:47.744611 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:14:47.745575 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:14:47.775969 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:14:47.781996 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:14:47.792762 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "env LANG=C uptime" returned: 0 in 0.046s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Hypervisor/Node resource view: name=np0000001577 free_ram=11247MB free_disk=72.5854263305664GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:47.792762 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:14:47.800965 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:14:47.800965 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:47.802671 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:47.813610 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:47.822701 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:47.822701 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:47.822701 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:47.822701 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:47.822701 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:47.822701 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:47.822701 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:47.822701 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:47.822701 np0000001577 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:47.822701 np0000001577 nova-compute[98319]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:47.822701 np0000001577 nova-compute[98319]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:47.822701 np0000001577 nova-compute[98319]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329 (non-flash)
May 28 01:14:47.822701 np0000001577 nova-compute[98319]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329 (non-flash)
May 28 01:14:47.822701 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:47.823476 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:47.823476 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:47.823476 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:47.823476 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:47.823476 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:47.823476 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:47.823476 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:47.823476 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:47.823476 np0000001577 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:47.823476 np0000001577 nova-compute[98319]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:47.823476 np0000001577 nova-compute[98319]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:47.823476 np0000001577 nova-compute[98319]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329 (non-flash)
May 28 01:14:47.823476 np0000001577 nova-compute[98319]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329 (non-flash)
May 28 01:14:47.823476 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:47.833345 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:47.833345 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:47.833345 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:47.833345 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:47.833345 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:47.833345 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:47.833345 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:47.833345 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:47.833345 np0000001577 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:47.833345 np0000001577 nova-compute[98319]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:47.833345 np0000001577 nova-compute[98319]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:47.833345 np0000001577 nova-compute[98319]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329 (non-flash)
May 28 01:14:47.833345 np0000001577 nova-compute[98319]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329 (non-flash)
May 28 01:14:47.833345 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:47.833595 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:47.833595 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:47.833595 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:47.833595 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:47.833595 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:47.833595 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:47.833595 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:47.833595 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:47.833595 np0000001577 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:47.833595 np0000001577 nova-compute[98319]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:47.833595 np0000001577 nova-compute[98319]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:47.833595 np0000001577 nova-compute[98319]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329 (non-flash)
May 28 01:14:47.833595 np0000001577 nova-compute[98319]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329 (non-flash)
May 28 01:14:47.833595 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:47.836791 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:47.837087 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:47.875702 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69, portal: 192.168.40.100,3260]
May 28 01:14:47.875702 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69, portal: 192.168.40.100,3260] successful.
May 28 01:14:47.875702 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:47.887024 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69, portal: 192.168.50.100,3260]
May 28 01:14:47.887024 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69, portal: 192.168.50.100,3260] successful.
May 28 01:14:47.887024 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:47.887723 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:47.899218 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:47.920491 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:47.920491 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:47.920491 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:47.920491 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:47.920491 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:47.920491 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:47.920491 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:47.920491 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:47.920491 np0000001577 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:47.920491 np0000001577 nova-compute[98319]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:47.920491 np0000001577 nova-compute[98319]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:47.920491 np0000001577 nova-compute[98319]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329 (non-flash)
May 28 01:14:47.920491 np0000001577 nova-compute[98319]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329 (non-flash)
May 28 01:14:47.920491 np0000001577 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69 (non-flash)
May 28 01:14:47.920491 np0000001577 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69 (non-flash)
May 28 01:14:47.920491 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:47.920810 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:47.920810 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:47.920810 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:47.920810 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:47.920810 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:47.920810 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:47.920810 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:47.920810 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:47.920810 np0000001577 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:47.920810 np0000001577 nova-compute[98319]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:47.920810 np0000001577 nova-compute[98319]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:47.920810 np0000001577 nova-compute[98319]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329 (non-flash)
May 28 01:14:47.920810 np0000001577 nova-compute[98319]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329 (non-flash)
May 28 01:14:47.920810 np0000001577 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69 (non-flash)
May 28 01:14:47.920810 np0000001577 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69 (non-flash)
May 28 01:14:47.920810 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:47.921131 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:14:47.921245 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:14:47.922527 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] HCTL ('20', '-', '-', 0) found on session 205 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:14:47.922667 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:14:47.923021 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:47.923021 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:47.923021 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:47.923021 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:47.923021 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:47.923021 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:47.923021 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:47.923021 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:47.923021 np0000001577 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:47.923021 np0000001577 nova-compute[98319]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:47.923021 np0000001577 nova-compute[98319]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:47.923021 np0000001577 nova-compute[98319]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329 (non-flash)
May 28 01:14:47.923021 np0000001577 nova-compute[98319]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329 (non-flash)
May 28 01:14:47.923021 np0000001577 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69 (non-flash)
May 28 01:14:47.923021 np0000001577 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69 (non-flash)
May 28 01:14:47.923021 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:47.923313 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:47.923313 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:47.923313 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:47.923313 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:47.923313 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:47.923313 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:47.923313 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:47.923313 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:47.923313 np0000001577 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:47.923313 np0000001577 nova-compute[98319]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:47.923313 np0000001577 nova-compute[98319]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:47.923313 np0000001577 nova-compute[98319]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329 (non-flash)
May 28 01:14:47.923313 np0000001577 nova-compute[98319]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329 (non-flash)
May 28 01:14:47.923313 np0000001577 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69 (non-flash)
May 28 01:14:47.923313 np0000001577 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69 (non-flash)
May 28 01:14:47.923313 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:47.923589 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:14:47.923589 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:14:47.924974 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] HCTL ('21', '-', '-', 0) found on session 206 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:14:47.925086 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:14:47.936605 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Searching for a device in session 205 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:14:47.936792 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70e29303-b357-4265-9f2e-a45ae87b9f69', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:14:47.943187 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Searching for a device in session 206 and hctl ['21', '*', '*', 0] yield: sdp {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:14:47.943187 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '70e29303-b357-4265-9f2e-a45ae87b9f69', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:14:48.344542 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Detaching volume e72eb595-519d-4f4b-a00a-2ce208c0ecef
May 28 01:14:48.383950 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Attempting to driver detach volume e72eb595-519d-4f4b-a00a-2ce208c0ecef from mountpoint /dev/vdb
May 28 01:14:48.391066 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Found disk vdb by alias ua-e72eb595-519d-4f4b-a00a-2ce208c0ecef {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:14:48.392045 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Found disk vdb by alias ua-e72eb595-519d-4f4b-a00a-2ce208c0ecef {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:14:48.392152 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Attempting to detach device vdb from instance 26af0b2c-7e35-4e53-85eb-71ddca16fbfa from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:14:48.392382 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:14:48.392382 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:14:48.392382 np0000001577 nova-compute[98319]:   <alias name="ua-e72eb595-519d-4f4b-a00a-2ce208c0ecef"/>
May 28 01:14:48.392382 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-11"/>
May 28 01:14:48.392382 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:14:48.392382 np0000001577 nova-compute[98319]:   <serial>e72eb595-519d-4f4b-a00a-2ce208c0ecef</serial>
May 28 01:14:48.392382 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:14:48.392382 np0000001577 nova-compute[98319]: </disk>
May 28 01:14:48.392382 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:14:48.399335 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Successfully detached device vdb from instance 26af0b2c-7e35-4e53-85eb-71ddca16fbfa from the persistent domain config.
May 28 01:14:48.399442 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] (1/8): Attempting to detach device vdb with device alias ua-e72eb595-519d-4f4b-a00a-2ce208c0ecef from instance 26af0b2c-7e35-4e53-85eb-71ddca16fbfa from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:14:48.399689 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:14:48.399689 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:14:48.399689 np0000001577 nova-compute[98319]:   <alias name="ua-e72eb595-519d-4f4b-a00a-2ce208c0ecef"/>
May 28 01:14:48.399689 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-11"/>
May 28 01:14:48.399689 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:14:48.399689 np0000001577 nova-compute[98319]:   <serial>e72eb595-519d-4f4b-a00a-2ce208c0ecef</serial>
May 28 01:14:48.399689 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:14:48.399689 np0000001577 nova-compute[98319]: </disk>
May 28 01:14:48.399689 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:14:48.756500 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:14:48.863970 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:14:48.864090 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 26af0b2c-7e35-4e53-85eb-71ddca16fbfa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:14:48.864254 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 14694771-0e2d-420f-8b96-7bd28ffcf4c2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:14:48.864395 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 78222e75-5ee3-4478-8f29-391c88192956 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:14:48.864493 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance f0e996d3-b051-421c-b00c-1dbc6971f8e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:14:48.864641 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:14:48.864756 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 622fc3c0-e8bc-408d-89da-ce248c8c007a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:14:48.864958 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 01:14:48.865110 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Final resource view: name=np0000001577 phys_ram=24030MB used_ram=1856MB phys_disk=95GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:14:47 up 46 min,  2 users,  load average: 4.49, 4.57, 4.17\n', 'num_instances': '7', 'num_vm_active': '7', 'num_task_None': '7', 'num_os_type_None': '7', 'num_proj_1880a27e1ad0432f914e086d7fffdeb4': '3', 'io_workload': '0', 'num_proj_0e5e86340fc8435f8e3c83322ba82560': '1', 'num_proj_fb2f65d208f44146903c7dcf0b143a8e': '1', 'num_proj_1d6ee814419446dcb5025c68fb0f4ce9': '1', 'num_proj_07f3bdd3aef04045aac40e4b851915e1': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 01:14:48.881290 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930888.8809576, 26af0b2c-7e35-4e53-85eb-71ddca16fbfa => ua-e72eb595-519d-4f4b-a00a-2ce208c0ecef> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:14:48.881787 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e72eb595-519d-4f4b-a00a-2ce208c0ecef for instance 26af0b2c-7e35-4e53-85eb-71ddca16fbfa {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:14:48.884100 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Successfully detached device vdb from instance 26af0b2c-7e35-4e53-85eb-71ddca16fbfa from the live domain config.
May 28 01:14:48.885158 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:14:48.885558 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef', 'iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e72eb595-519d-4f4b-a00a-2ce208c0ecef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:14:48.885787 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:14:48.910410 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:14:48.910524 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:14:48.910647 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:14:48.910747 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] No VIF found with MAC fa:16:3e:05:9d:82, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:14:49.191838 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:14:49.192035 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:14:49.694330 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:14:49.770936 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Found WWN 33000000019727a9a for multipath device dm-13 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:14:49.771345 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:14:49.771426 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] <== connect_volume: return (4245ms) {'type': 'block', 'scsi_wwn': '33000000019727a9a', 'path': '/dev/dm-13', 'multipath_id': '33000000019727a9a'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:14:49.771590 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000019727a9a', 'path': '/dev/dm-13', 'multipath_id': '33000000019727a9a'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:14:49.771968 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.886s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:14:49.772355 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef', 'iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e72eb595-519d-4f4b-a00a-2ce208c0ecef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:14:49.772527 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:14:49.774299 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lazy-loading 'flavor' on Instance uuid f0e996d3-b051-421c-b00c-1dbc6971f8e6 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:14:49.806365 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:49.806365 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:49.806365 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:49.806365 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:49.806365 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:49.806365 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:49.806365 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:49.806365 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:49.806365 np0000001577 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:49.806365 np0000001577 nova-compute[98319]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:49.806365 np0000001577 nova-compute[98319]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:49.806365 np0000001577 nova-compute[98319]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329 (non-flash)
May 28 01:14:49.806365 np0000001577 nova-compute[98319]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329 (non-flash)
May 28 01:14:49.806365 np0000001577 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69 (non-flash)
May 28 01:14:49.806365 np0000001577 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69 (non-flash)
May 28 01:14:49.806365 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:49.806811 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:49.806811 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:49.806811 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:49.806811 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:49.806811 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:49.806811 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:49.806811 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:49.806811 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:49.806811 np0000001577 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:49.806811 np0000001577 nova-compute[98319]: tcp: [201] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:49.806811 np0000001577 nova-compute[98319]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef (non-flash)
May 28 01:14:49.806811 np0000001577 nova-compute[98319]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329 (non-flash)
May 28 01:14:49.806811 np0000001577 nova-compute[98319]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329 (non-flash)
May 28 01:14:49.806811 np0000001577 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69 (non-flash)
May 28 01:14:49.806811 np0000001577 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69 (non-flash)
May 28 01:14:49.806811 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:49.806811 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', '185'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c', '193'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599', '198'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637', '200'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef', '201'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef', '202'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329', '203'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329', '204'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69', '205'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69', '206')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:14:49.806811 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef', '202')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:14:49.807828 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef', '201')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:14:49.808739 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c988f98cb80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef'): ({'sdi'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:14:49.808907 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Removing multipathed devices sdl, sdi {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:14:49.809113 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Flush multipath device 330000000699793cb {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:14:49.838605 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:14:49.885956 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:14:49.927477 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Checking to see if SCSI volumes sdl, sdi have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:14:49.927477 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] SCSI volumes sdl, sdi have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:14:49.927477 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Checking to see if device paths {'sdl', 'sdi'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:14:49.940197 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Device paths {'sdl', 'sdi'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:14:49.940406 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:14:49.954098 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:49.990395 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 202, target: iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef, portal: 192.168.40.100,3260]
May 28 01:14:49.990395 np0000001577 nova-compute[98319]: Logout of [sid: 202, target: iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef, portal: 192.168.40.100,3260] successful.
May 28 01:14:49.990395 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:50.011895 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:50.023116 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:50.060237 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 201, target: iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef, portal: 192.168.50.100,3260]
May 28 01:14:50.060237 np0000001577 nova-compute[98319]: Logout of [sid: 201, target: iqn.2023-03.storpool.com:os--volume-e72eb595-519d-4f4b-a00a-2ce208c0ecef, portal: 192.168.50.100,3260] successful.
May 28 01:14:50.060237 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:50.080154 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:50.080377 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:14:50.080510 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] <== disconnect_volume: return (1194ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:14:50.080661 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:14:50.199806 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Compute_service record updated for np0000001577:np0000001577 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 01:14:50.199963 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.407s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:50.200285 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:14:50.277069 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Attempting to attach volume 70e29303-b357-4265-9f2e-a45ae87b9f69 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:14:50.278496 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:14:50.278496 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:14:50.278496 np0000001577 nova-compute[98319]:   <alias name="ua-70e29303-b357-4265-9f2e-a45ae87b9f69"/>
May 28 01:14:50.278496 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-13"/>
May 28 01:14:50.278496 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:14:50.278496 np0000001577 nova-compute[98319]:   <serial>70e29303-b357-4265-9f2e-a45ae87b9f69</serial>
May 28 01:14:50.278496 np0000001577 nova-compute[98319]: </disk>
May 28 01:14:50.278496 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:14:50.457241 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e6801c65-751a-40b5-9215-1b081bc1e472 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.433s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:50.625252 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lazy-loading 'flavor' on Instance uuid 26af0b2c-7e35-4e53-85eb-71ddca16fbfa {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:14:50.697159 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:14:50.697473 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:14:50.697729 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:14:50.697955 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:14:50.698116 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 01:14:50.698392 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.28 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:14:50.974711 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:14:50.975123 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:14:50.977645 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:14:50.977876 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:14:50.979920 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:50.980073 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:51.223942 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:51.482882 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Detaching volume cb80b92d-0753-43c9-8e21-57c6f1f84329
May 28 01:14:51.522442 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Attempting to driver detach volume cb80b92d-0753-43c9-8e21-57c6f1f84329 from mountpoint /dev/vdb
May 28 01:14:51.532134 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Found disk vdb by alias ua-cb80b92d-0753-43c9-8e21-57c6f1f84329 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:14:51.533722 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Found disk vdb by alias ua-cb80b92d-0753-43c9-8e21-57c6f1f84329 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:14:51.533832 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Attempting to detach device vdb from instance a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:14:51.534026 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:14:51.534026 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:14:51.534026 np0000001577 nova-compute[98319]:   <alias name="ua-cb80b92d-0753-43c9-8e21-57c6f1f84329"/>
May 28 01:14:51.534026 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-12"/>
May 28 01:14:51.534026 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:14:51.534026 np0000001577 nova-compute[98319]:   <serial>cb80b92d-0753-43c9-8e21-57c6f1f84329</serial>
May 28 01:14:51.534026 np0000001577 nova-compute[98319]:   <shareable/>
May 28 01:14:51.534026 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:14:51.534026 np0000001577 nova-compute[98319]: </disk>
May 28 01:14:51.534026 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:14:51.539400 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Successfully detached device vdb from instance a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705 from the persistent domain config.
May 28 01:14:51.539512 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] (1/8): Attempting to detach device vdb with device alias ua-cb80b92d-0753-43c9-8e21-57c6f1f84329 from instance a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:14:51.539740 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:14:51.539740 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:14:51.539740 np0000001577 nova-compute[98319]:   <alias name="ua-cb80b92d-0753-43c9-8e21-57c6f1f84329"/>
May 28 01:14:51.539740 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-12"/>
May 28 01:14:51.539740 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:14:51.539740 np0000001577 nova-compute[98319]:   <serial>cb80b92d-0753-43c9-8e21-57c6f1f84329</serial>
May 28 01:14:51.539740 np0000001577 nova-compute[98319]:   <shareable/>
May 28 01:14:51.539740 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:14:51.539740 np0000001577 nova-compute[98319]: </disk>
May 28 01:14:51.539740 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:14:51.629724 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9cb87cb2-d05c-4cf2-9046-1a23b2ef6136 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.793s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:51.640818 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:51.949137 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:14:51.949137 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:14:51.949137 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:14:51.949137 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] No VIF found with MAC fa:16:3e:cc:2a:78, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:14:52.039740 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930892.0394096, a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705 => ua-cb80b92d-0753-43c9-8e21-57c6f1f84329> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:14:52.040106 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-cb80b92d-0753-43c9-8e21-57c6f1f84329 for instance a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:14:52.042165 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Successfully detached device vdb from instance a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705 from the live domain config.
May 28 01:14:52.069193 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:14:52.069439 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329', 'iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cb80b92d-0753-43c9-8e21-57c6f1f84329', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:14:52.069585 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:14:52.069852 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:14:52.070080 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329', 'iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cb80b92d-0753-43c9-8e21-57c6f1f84329', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:14:52.070189 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:14:52.098877 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:52.098877 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:52.098877 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:52.098877 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:52.098877 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:52.098877 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:52.098877 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:52.098877 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:52.098877 np0000001577 nova-compute[98319]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329 (non-flash)
May 28 01:14:52.098877 np0000001577 nova-compute[98319]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329 (non-flash)
May 28 01:14:52.098877 np0000001577 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69 (non-flash)
May 28 01:14:52.098877 np0000001577 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69 (non-flash)
May 28 01:14:52.098877 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:52.099202 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:52.099202 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:52.099202 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:52.099202 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:52.099202 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:52.099202 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:52.099202 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:52.099202 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:52.099202 np0000001577 nova-compute[98319]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329 (non-flash)
May 28 01:14:52.099202 np0000001577 nova-compute[98319]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329 (non-flash)
May 28 01:14:52.099202 np0000001577 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69 (non-flash)
May 28 01:14:52.099202 np0000001577 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69 (non-flash)
May 28 01:14:52.099202 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:52.099202 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', '185'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c', '193'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599', '198'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599', '199'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329', '203'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329', '204'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69', '205'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69', '206')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:14:52.099202 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329', '204')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:14:52.100179 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329', '203')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:14:52.101146 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c984c7740e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329'): ({'sdm'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:14:52.101328 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Removing multipathed devices sdm, sdn {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:14:52.101556 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Flush multipath device 3300000003f161fb7 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:14:52.133737 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:14:52.174913 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:14:52.224003 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Checking to see if SCSI volumes sdm, sdn have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:14:52.224139 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] SCSI volumes sdm, sdn have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:14:52.225312 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Checking to see if device paths {'sdm', 'sdn'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:14:52.236711 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Device paths {'sdm', 'sdn'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:14:52.236899 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:14:52.252673 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:52.282242 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 204, target: iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329, portal: 192.168.40.100,3260]
May 28 01:14:52.282242 np0000001577 nova-compute[98319]: Logout of [sid: 204, target: iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329, portal: 192.168.40.100,3260] successful.
May 28 01:14:52.282242 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:52.308016 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:52.322589 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:52.362621 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 203, target: iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329, portal: 192.168.50.100,3260]
May 28 01:14:52.362621 np0000001577 nova-compute[98319]: Logout of [sid: 203, target: iqn.2023-03.storpool.com:os--volume-cb80b92d-0753-43c9-8e21-57c6f1f84329, portal: 192.168.50.100,3260] successful.
May 28 01:14:52.362621 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:52.384227 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:52.384422 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:14:52.384528 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] <== disconnect_volume: return (314ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:14:52.384654 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:14:52.932443 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lazy-loading 'flavor' on Instance uuid a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:14:52.978051 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:14:52.979005 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:14:53.487934 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3c12d7bf-d915-4989-ad3a-b43ea6e38864 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "f0e996d3-b051-421c-b00c-1dbc6971f8e6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.702s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:53.747950 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "f0e996d3-b051-421c-b00c-1dbc6971f8e6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:53.748129 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "f0e996d3-b051-421c-b00c-1dbc6971f8e6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:53.937145 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a982fdf1-c1ab-496b-bab6-776b70eff137 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.957s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:53.977824 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:14:53.978050 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:14:54.250105 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Detaching volume 70e29303-b357-4265-9f2e-a45ae87b9f69
May 28 01:14:54.289931 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Attempting to driver detach volume 70e29303-b357-4265-9f2e-a45ae87b9f69 from mountpoint /dev/vdb
May 28 01:14:54.296876 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Found disk vdb by alias ua-70e29303-b357-4265-9f2e-a45ae87b9f69 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:14:54.298044 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Found disk vdb by alias ua-70e29303-b357-4265-9f2e-a45ae87b9f69 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:14:54.298168 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Attempting to detach device vdb from instance f0e996d3-b051-421c-b00c-1dbc6971f8e6 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:14:54.298391 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:14:54.298391 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:14:54.298391 np0000001577 nova-compute[98319]:   <alias name="ua-70e29303-b357-4265-9f2e-a45ae87b9f69"/>
May 28 01:14:54.298391 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-13"/>
May 28 01:14:54.298391 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:14:54.298391 np0000001577 nova-compute[98319]:   <serial>70e29303-b357-4265-9f2e-a45ae87b9f69</serial>
May 28 01:14:54.298391 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:14:54.298391 np0000001577 nova-compute[98319]: </disk>
May 28 01:14:54.298391 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:14:54.303519 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Successfully detached device vdb from instance f0e996d3-b051-421c-b00c-1dbc6971f8e6 from the persistent domain config.
May 28 01:14:54.303635 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] (1/8): Attempting to detach device vdb with device alias ua-70e29303-b357-4265-9f2e-a45ae87b9f69 from instance f0e996d3-b051-421c-b00c-1dbc6971f8e6 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:14:54.303781 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:14:54.303781 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:14:54.303781 np0000001577 nova-compute[98319]:   <alias name="ua-70e29303-b357-4265-9f2e-a45ae87b9f69"/>
May 28 01:14:54.303781 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-13"/>
May 28 01:14:54.303781 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:14:54.303781 np0000001577 nova-compute[98319]:   <serial>70e29303-b357-4265-9f2e-a45ae87b9f69</serial>
May 28 01:14:54.303781 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:14:54.303781 np0000001577 nova-compute[98319]: </disk>
May 28 01:14:54.303781 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:14:54.774096 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930894.773752, f0e996d3-b051-421c-b00c-1dbc6971f8e6 => ua-70e29303-b357-4265-9f2e-a45ae87b9f69> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:14:54.775450 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-70e29303-b357-4265-9f2e-a45ae87b9f69 for instance f0e996d3-b051-421c-b00c-1dbc6971f8e6 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:14:54.777580 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Successfully detached device vdb from instance f0e996d3-b051-421c-b00c-1dbc6971f8e6 from the live domain config.
May 28 01:14:54.778652 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:14:54.778957 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69', 'iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70e29303-b357-4265-9f2e-a45ae87b9f69', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-13'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:14:54.779129 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:14:55.141570 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.362s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:14:55.141570 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69', 'iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70e29303-b357-4265-9f2e-a45ae87b9f69', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-13'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:14:55.141570 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:14:55.178163 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:55.178163 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:55.178163 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:55.178163 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:55.178163 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:55.178163 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:55.178163 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:55.178163 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:55.178163 np0000001577 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69 (non-flash)
May 28 01:14:55.178163 np0000001577 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69 (non-flash)
May 28 01:14:55.178163 np0000001577 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:55.178163 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:55.179141 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:55.179141 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:55.179141 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:55.179141 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:55.179141 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:55.179141 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:55.179141 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:55.179141 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:55.179141 np0000001577 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69 (non-flash)
May 28 01:14:55.179141 np0000001577 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69 (non-flash)
May 28 01:14:55.179141 np0000001577 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:55.179141 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:55.179141 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', '185'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c', '193'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599', '198'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69', '205'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69', '206'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637', '207')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:14:55.179141 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69', '205')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:14:55.179690 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69', '206')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:14:55.180359 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c988f98cb80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69'): ({'sdo'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69'): ({'sdp'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:14:55.180540 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Removing multipathed devices sdo, sdp {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:14:55.180767 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Flush multipath device 33000000019727a9a {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:14:55.223803 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:14:55.271112 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:14:55.306075 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Checking to see if SCSI volumes sdo, sdp have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:14:55.306243 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] SCSI volumes sdo, sdp have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:14:55.307931 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Checking to see if device paths {'sdo', 'sdp'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:14:55.318948 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Device paths {'sdo', 'sdp'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:14:55.319206 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:14:55.334520 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:55.364897 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0b88a327-4f92-4705-8bff-f6b40db69215 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:55.365968 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0b88a327-4f92-4705-8bff-f6b40db69215 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:55.365968 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0b88a327-4f92-4705-8bff-f6b40db69215 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:55.365968 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0b88a327-4f92-4705-8bff-f6b40db69215 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:55.365968 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0b88a327-4f92-4705-8bff-f6b40db69215 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:55.367817 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-0b88a327-4f92-4705-8bff-f6b40db69215 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Terminating instance
May 28 01:14:55.376154 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 205, target: iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69, portal: 192.168.40.100,3260]
May 28 01:14:55.376154 np0000001577 nova-compute[98319]: Logout of [sid: 205, target: iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69, portal: 192.168.40.100,3260] successful.
May 28 01:14:55.376154 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:55.400957 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:55.415901 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:55.458610 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 206, target: iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69, portal: 192.168.50.100,3260]
May 28 01:14:55.458610 np0000001577 nova-compute[98319]: Logout of [sid: 206, target: iqn.2023-03.storpool.com:os--volume-70e29303-b357-4265-9f2e-a45ae87b9f69, portal: 192.168.50.100,3260] successful.
May 28 01:14:55.458610 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:55.475966 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:55.476179 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:14:55.476337 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] <== disconnect_volume: return (697ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:14:55.476482 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:14:55.871843 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0b88a327-4f92-4705-8bff-f6b40db69215 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:14:55.889357 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:55.893026 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:55.911176 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:55.951078 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:56.028329 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lazy-loading 'flavor' on Instance uuid f0e996d3-b051-421c-b00c-1dbc6971f8e6 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:14:56.066336 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-39057e37-55ae-4e4f-8991-e26d20a4208c req-752575fe-2c1c-4346-a15c-7cd3d1520486 service nova] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Received event network-vif-unplugged-6ee40c30-d6de-4c91-b393-c66a3f3709e9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:14:56.067489 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-39057e37-55ae-4e4f-8991-e26d20a4208c req-752575fe-2c1c-4346-a15c-7cd3d1520486 service nova] Acquiring lock "a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:56.067718 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-39057e37-55ae-4e4f-8991-e26d20a4208c req-752575fe-2c1c-4346-a15c-7cd3d1520486 service nova] Lock "a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:56.067891 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-39057e37-55ae-4e4f-8991-e26d20a4208c req-752575fe-2c1c-4346-a15c-7cd3d1520486 service nova] Lock "a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:56.068034 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-39057e37-55ae-4e4f-8991-e26d20a4208c req-752575fe-2c1c-4346-a15c-7cd3d1520486 service nova] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] No waiting events found dispatching network-vif-unplugged-6ee40c30-d6de-4c91-b393-c66a3f3709e9 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:14:56.068188 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-39057e37-55ae-4e4f-8991-e26d20a4208c req-752575fe-2c1c-4346-a15c-7cd3d1520486 service nova] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Received event network-vif-unplugged-6ee40c30-d6de-4c91-b393-c66a3f3709e9 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:14:56.170522 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:56.177743 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:56.187562 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.49 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:14:56.197978 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999729315999957 future=<Future at 0x7c98706a4140 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:14:56.199292 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.998858678000033 future=<Future at 0x7c98706a4140 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:14:56.199430 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.998267107999709 future=<Future at 0x7c98706a4140 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:14:56.200290 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Instance destroyed successfully.
May 28 01:14:56.200696 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-0b88a327-4f92-4705-8bff-f6b40db69215 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lazy-loading 'resources' on Instance uuid a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:14:56.224931 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:56.295360 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-429829d5-ba44-4db1-8519-ec4ccad41518 req-21ea5cbc-57d7-430c-8b6a-67c69a8b9b3b service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Received event network-changed-d2012ded-4851-468b-9f75-d2adb6cca344 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:14:56.295754 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-429829d5-ba44-4db1-8519-ec4ccad41518 req-21ea5cbc-57d7-430c-8b6a-67c69a8b9b3b service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Refreshing instance network info cache due to event network-changed-d2012ded-4851-468b-9f75-d2adb6cca344. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:14:56.295933 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-429829d5-ba44-4db1-8519-ec4ccad41518 req-21ea5cbc-57d7-430c-8b6a-67c69a8b9b3b service nova] Acquiring lock "refresh_cache-78222e75-5ee3-4478-8f29-391c88192956" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:14:56.296045 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-429829d5-ba44-4db1-8519-ec4ccad41518 req-21ea5cbc-57d7-430c-8b6a-67c69a8b9b3b service nova] Acquired lock "refresh_cache-78222e75-5ee3-4478-8f29-391c88192956" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:14:56.296188 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-429829d5-ba44-4db1-8519-ec4ccad41518 req-21ea5cbc-57d7-430c-8b6a-67c69a8b9b3b service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Refreshing network info cache for port d2012ded-4851-468b-9f75-d2adb6cca344 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:14:56.642443 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:56.703623 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-0b88a327-4f92-4705-8bff-f6b40db69215 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:14:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-2100651502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-volumemultiattachtests-server-2100651502',id=76,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoRI/XlCY6dTJ3dCiu4Fr/JD4ry6gCL7jlTSBAo2aVwp7g7LcNpcI1C5p4V64ZCYYOBK5uCzCLJIAL6qt1+bPTgZuMpeB7A6e0GgWtfeHZ/T45eoDupm2A+X2TLLF+QOQ==',key_name='tempest-keypair-657526159',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:14:15Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07f3bdd3aef04045aac40e4b851915e1',ramdisk_id='',reservation_id='r-60626355',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-1632400240',owner_user_name='tempest-VolumeMultiattachTests-1632400240-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:14:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ae6af3cf5df464bbc9da74d825ddb4e',uuid=a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ee40c30-d6de-4c91-b393-c66a3f3709e9", "address": "fa:16:3e:05:9d:82", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee40c30-d6", "ovs_interfaceid": "6ee40c30-d6de-4c91-b393-c66a3f3709e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:14:56.703836 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0b88a327-4f92-4705-8bff-f6b40db69215 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Converting VIF {"id": "6ee40c30-d6de-4c91-b393-c66a3f3709e9", "address": "fa:16:3e:05:9d:82", "network": {"id": "7357480b-2ba7-465c-88fe-aaf2e8f7a673", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-2052301454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07f3bdd3aef04045aac40e4b851915e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee40c30-d6", "ovs_interfaceid": "6ee40c30-d6de-4c91-b393-c66a3f3709e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:14:56.704494 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0b88a327-4f92-4705-8bff-f6b40db69215 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:9d:82,bridge_name='br-int',has_traffic_filtering=True,id=6ee40c30-d6de-4c91-b393-c66a3f3709e9,network=Network(7357480b-2ba7-465c-88fe-aaf2e8f7a673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee40c30-d6') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:14:56.704745 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-0b88a327-4f92-4705-8bff-f6b40db69215 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:9d:82,bridge_name='br-int',has_traffic_filtering=True,id=6ee40c30-d6de-4c91-b393-c66a3f3709e9,network=Network(7357480b-2ba7-465c-88fe-aaf2e8f7a673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee40c30-d6') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:14:56.706053 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:56.706302 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ee40c30-d6, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:14:56.708439 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:14:56.709170 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:56.709317 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bab26324-03f4-4992-a8bb-9c78e4c4822f) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:14:56.709762 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:56.710332 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:14:56.710646 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:56.712168 np0000001577 nova-compute[98319]: INFO os_vif [None req-0b88a327-4f92-4705-8bff-f6b40db69215 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:9d:82,bridge_name='br-int',has_traffic_filtering=True,id=6ee40c30-d6de-4c91-b393-c66a3f3709e9,network=Network(7357480b-2ba7-465c-88fe-aaf2e8f7a673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee40c30-d6')
May 28 01:14:56.712463 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0b88a327-4f92-4705-8bff-f6b40db69215 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Deleting instance files /opt/stack/data/nova/instances/a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705_del
May 28 01:14:56.713190 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0b88a327-4f92-4705-8bff-f6b40db69215 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Deletion of /opt/stack/data/nova/instances/a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705_del complete
May 28 01:14:56.800565 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-429829d5-ba44-4db1-8519-ec4ccad41518 req-21ea5cbc-57d7-430c-8b6a-67c69a8b9b3b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:14:57.036587 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a8e8dcd-073d-42b3-af5f-ba6d0b9a320c tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "f0e996d3-b051-421c-b00c-1dbc6971f8e6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.288s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:57.073825 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-429829d5-ba44-4db1-8519-ec4ccad41518 req-21ea5cbc-57d7-430c-8b6a-67c69a8b9b3b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:14:57.199119 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-429829d5-ba44-4db1-8519-ec4ccad41518 req-21ea5cbc-57d7-430c-8b6a-67c69a8b9b3b service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Updated VIF entry in instance network info cache for port d2012ded-4851-468b-9f75-d2adb6cca344. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:14:57.199404 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-429829d5-ba44-4db1-8519-ec4ccad41518 req-21ea5cbc-57d7-430c-8b6a-67c69a8b9b3b service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Updating instance_info_cache with network_info: [{"id": "d2012ded-4851-468b-9f75-d2adb6cca344", "address": "fa:16:3e:04:74:31", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2012ded-48", "ovs_interfaceid": "d2012ded-4851-468b-9f75-d2adb6cca344", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:14:57.222986 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-0b88a327-4f92-4705-8bff-f6b40db69215 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Took 1.35 seconds to destroy the instance on the hypervisor.
May 28 01:14:57.223533 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-0b88a327-4f92-4705-8bff-f6b40db69215 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:14:57.224614 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:14:57.224614 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:14:57.224614 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:14:57.283265 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:14:57.319152 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "78222e75-5ee3-4478-8f29-391c88192956" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:57.319362 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "78222e75-5ee3-4478-8f29-391c88192956" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:57.701959 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-429829d5-ba44-4db1-8519-ec4ccad41518 req-21ea5cbc-57d7-430c-8b6a-67c69a8b9b3b service nova] Releasing lock "refresh_cache-78222e75-5ee3-4478-8f29-391c88192956" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:14:57.821309 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Detaching volume df4d5d8b-5acd-4732-924d-127e9d6dc11c
May 28 01:14:57.862659 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Attempting to driver detach volume df4d5d8b-5acd-4732-924d-127e9d6dc11c from mountpoint /dev/vdb
May 28 01:14:57.866891 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Found disk vdb by alias ua-df4d5d8b-5acd-4732-924d-127e9d6dc11c {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:14:57.867981 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Found disk vdb by alias ua-df4d5d8b-5acd-4732-924d-127e9d6dc11c {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:14:57.868132 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Attempting to detach device vdb from instance 78222e75-5ee3-4478-8f29-391c88192956 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:14:57.868409 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:14:57.868409 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:14:57.868409 np0000001577 nova-compute[98319]:   <alias name="ua-df4d5d8b-5acd-4732-924d-127e9d6dc11c"/>
May 28 01:14:57.868409 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-3"/>
May 28 01:14:57.868409 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:14:57.868409 np0000001577 nova-compute[98319]:   <serial>df4d5d8b-5acd-4732-924d-127e9d6dc11c</serial>
May 28 01:14:57.868409 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:14:57.868409 np0000001577 nova-compute[98319]: </disk>
May 28 01:14:57.868409 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:14:57.873770 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Successfully detached device vdb from instance 78222e75-5ee3-4478-8f29-391c88192956 from the persistent domain config.
May 28 01:14:57.873884 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] (1/8): Attempting to detach device vdb with device alias ua-df4d5d8b-5acd-4732-924d-127e9d6dc11c from instance 78222e75-5ee3-4478-8f29-391c88192956 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:14:57.874087 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:14:57.874087 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:14:57.874087 np0000001577 nova-compute[98319]:   <alias name="ua-df4d5d8b-5acd-4732-924d-127e9d6dc11c"/>
May 28 01:14:57.874087 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-3"/>
May 28 01:14:57.874087 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:14:57.874087 np0000001577 nova-compute[98319]:   <serial>df4d5d8b-5acd-4732-924d-127e9d6dc11c</serial>
May 28 01:14:57.874087 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:14:57.874087 np0000001577 nova-compute[98319]: </disk>
May 28 01:14:57.874087 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:14:57.978126 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:14:57.978126 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Cleaning up deleted instances {{(pid=98319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 28 01:14:58.076894 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5808ffa6-874f-495d-923e-7c28e74d523a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "f0e996d3-b051-421c-b00c-1dbc6971f8e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:58.077328 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5808ffa6-874f-495d-923e-7c28e74d523a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "f0e996d3-b051-421c-b00c-1dbc6971f8e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:58.077328 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5808ffa6-874f-495d-923e-7c28e74d523a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "f0e996d3-b051-421c-b00c-1dbc6971f8e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:58.077328 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5808ffa6-874f-495d-923e-7c28e74d523a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "f0e996d3-b051-421c-b00c-1dbc6971f8e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:58.077467 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5808ffa6-874f-495d-923e-7c28e74d523a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "f0e996d3-b051-421c-b00c-1dbc6971f8e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:58.082670 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-5808ffa6-874f-495d-923e-7c28e74d523a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Terminating instance
May 28 01:14:58.123208 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5adfbfae-e6cb-4bf5-a5dc-300ac7e73195 req-fb37826a-8b48-47ad-b009-d4d40114ef15 service nova] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Received event network-vif-unplugged-6ee40c30-d6de-4c91-b393-c66a3f3709e9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:14:58.123410 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5adfbfae-e6cb-4bf5-a5dc-300ac7e73195 req-fb37826a-8b48-47ad-b009-d4d40114ef15 service nova] Acquiring lock "a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:58.123829 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5adfbfae-e6cb-4bf5-a5dc-300ac7e73195 req-fb37826a-8b48-47ad-b009-d4d40114ef15 service nova] Lock "a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:58.123829 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5adfbfae-e6cb-4bf5-a5dc-300ac7e73195 req-fb37826a-8b48-47ad-b009-d4d40114ef15 service nova] Lock "a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:58.123952 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5adfbfae-e6cb-4bf5-a5dc-300ac7e73195 req-fb37826a-8b48-47ad-b009-d4d40114ef15 service nova] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] No waiting events found dispatching network-vif-unplugged-6ee40c30-d6de-4c91-b393-c66a3f3709e9 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:14:58.123987 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5adfbfae-e6cb-4bf5-a5dc-300ac7e73195 req-fb37826a-8b48-47ad-b009-d4d40114ef15 service nova] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Received event network-vif-unplugged-6ee40c30-d6de-4c91-b393-c66a3f3709e9 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:14:58.160941 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:14:58.361060 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-85484655-6518-41c5-a5c4-2d211bb6f3dd req-96ec1f83-4aaf-40d0-860c-aeaff6d6128b service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Received event network-changed-d2012ded-4851-468b-9f75-d2adb6cca344 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:14:58.361147 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-85484655-6518-41c5-a5c4-2d211bb6f3dd req-96ec1f83-4aaf-40d0-860c-aeaff6d6128b service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Refreshing instance network info cache due to event network-changed-d2012ded-4851-468b-9f75-d2adb6cca344. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:14:58.361736 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-85484655-6518-41c5-a5c4-2d211bb6f3dd req-96ec1f83-4aaf-40d0-860c-aeaff6d6128b service nova] Acquiring lock "refresh_cache-78222e75-5ee3-4478-8f29-391c88192956" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:14:58.362915 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-85484655-6518-41c5-a5c4-2d211bb6f3dd req-96ec1f83-4aaf-40d0-860c-aeaff6d6128b service nova] Acquired lock "refresh_cache-78222e75-5ee3-4478-8f29-391c88192956" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:14:58.362915 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-85484655-6518-41c5-a5c4-2d211bb6f3dd req-96ec1f83-4aaf-40d0-860c-aeaff6d6128b service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Refreshing network info cache for port d2012ded-4851-468b-9f75-d2adb6cca344 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:14:58.407155 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930898.4066987, 78222e75-5ee3-4478-8f29-391c88192956 => ua-df4d5d8b-5acd-4732-924d-127e9d6dc11c> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:14:58.407897 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-df4d5d8b-5acd-4732-924d-127e9d6dc11c for instance 78222e75-5ee3-4478-8f29-391c88192956 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:14:58.409978 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Successfully detached device vdb from instance 78222e75-5ee3-4478-8f29-391c88192956 from the live domain config.
May 28 01:14:58.410988 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:14:58.411268 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c', 'iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df4d5d8b-5acd-4732-924d-127e9d6dc11c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:14:58.411438 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:14:58.411764 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:14:58.412042 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c', 'iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'df4d5d8b-5acd-4732-924d-127e9d6dc11c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:14:58.412194 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:14:58.444651 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:58.444651 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:58.444651 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:58.444651 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:58.444651 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:58.444651 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:58.444651 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:58.444651 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:58.444651 np0000001577 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:58.444651 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:14:58.444929 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:58.444929 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:14:58.444929 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:58.444929 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:14:58.444929 np0000001577 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:58.444929 np0000001577 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c (non-flash)
May 28 01:14:58.444929 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:58.444929 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:14:58.444929 np0000001577 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637 (non-flash)
May 28 01:14:58.444929 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:14:58.445113 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', '185'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c', '193'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599', '198'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3062d16-64ae-4263-9bd3-9c71df87a637', '207')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:14:58.445113 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c', '193')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:14:58.446291 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c', '194')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:14:58.447353 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c987056f380>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c'): ({'sdh'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:14:58.447575 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Removing multipathed devices sdg, sdh {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:14:58.447834 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Flush multipath device 330000000e7aef9a8 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:14:58.480878 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] There are 0 instances to clean {{(pid=98319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 28 01:14:58.481075 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 28.67 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:14:58.496018 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:14:58.550093 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:14:58.587025 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-5808ffa6-874f-495d-923e-7c28e74d523a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:14:58.600195 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Checking to see if SCSI volumes sdg, sdh have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:14:58.600195 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] SCSI volumes sdg, sdh have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:14:58.601174 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Checking to see if device paths {'sdg', 'sdh'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:14:58.613060 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Device paths {'sdg', 'sdh'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:14:58.613146 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:14:58.614992 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:58.628430 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:58.635416 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:58.637204 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:58.663967 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Took 1.44 seconds to deallocate network for instance.
May 28 01:14:58.666275 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:58.668143 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 193, target: iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c, portal: 192.168.40.100,3260]
May 28 01:14:58.668143 np0000001577 nova-compute[98319]: Logout of [sid: 193, target: iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c, portal: 192.168.40.100,3260] successful.
May 28 01:14:58.668143 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:58.688132 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:58.699665 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:58.753432 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 194, target: iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c, portal: 192.168.50.100,3260]
May 28 01:14:58.753432 np0000001577 nova-compute[98319]: Logout of [sid: 194, target: iqn.2023-03.storpool.com:os--volume-df4d5d8b-5acd-4732-924d-127e9d6dc11c, portal: 192.168.50.100,3260] successful.
May 28 01:14:58.753432 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:58.762858 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e07c11c2-3e99-4f61-8e10-22d1e5710536 req-7a84db56-36b1-4e08-bb59-9fa633a5a5f6 service nova] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Received event network-vif-unplugged-1718f886-da55-4687-b4b4-7874a8099d6f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:14:58.763200 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e07c11c2-3e99-4f61-8e10-22d1e5710536 req-7a84db56-36b1-4e08-bb59-9fa633a5a5f6 service nova] Acquiring lock "f0e996d3-b051-421c-b00c-1dbc6971f8e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:58.763390 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e07c11c2-3e99-4f61-8e10-22d1e5710536 req-7a84db56-36b1-4e08-bb59-9fa633a5a5f6 service nova] Lock "f0e996d3-b051-421c-b00c-1dbc6971f8e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:58.763581 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e07c11c2-3e99-4f61-8e10-22d1e5710536 req-7a84db56-36b1-4e08-bb59-9fa633a5a5f6 service nova] Lock "f0e996d3-b051-421c-b00c-1dbc6971f8e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:58.763730 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e07c11c2-3e99-4f61-8e10-22d1e5710536 req-7a84db56-36b1-4e08-bb59-9fa633a5a5f6 service nova] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] No waiting events found dispatching network-vif-unplugged-1718f886-da55-4687-b4b4-7874a8099d6f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:14:58.763868 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e07c11c2-3e99-4f61-8e10-22d1e5710536 req-7a84db56-36b1-4e08-bb59-9fa633a5a5f6 service nova] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Received event network-vif-unplugged-1718f886-da55-4687-b4b4-7874a8099d6f for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:14:58.769397 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:14:58.769583 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:14:58.769768 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] <== disconnect_volume: return (358ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:14:58.769829 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:14:58.866037 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-85484655-6518-41c5-a5c4-2d211bb6f3dd req-96ec1f83-4aaf-40d0-860c-aeaff6d6128b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:14:58.880384 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:58.887431 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:58.933524 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999734064999757 future=<Future at 0x7c98705cd010 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:14:58.936258 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Instance destroyed successfully.
May 28 01:14:58.936616 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-5808ffa6-874f-495d-923e-7c28e74d523a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lazy-loading 'resources' on Instance uuid f0e996d3-b051-421c-b00c-1dbc6971f8e6 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:14:59.151958 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-85484655-6518-41c5-a5c4-2d211bb6f3dd req-96ec1f83-4aaf-40d0-860c-aeaff6d6128b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:14:59.173394 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0b88a327-4f92-4705-8bff-f6b40db69215 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:59.173394 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0b88a327-4f92-4705-8bff-f6b40db69215 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:59.249844 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-0b88a327-4f92-4705-8bff-f6b40db69215 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Refreshing inventories for resource provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 28 01:14:59.276483 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-85484655-6518-41c5-a5c4-2d211bb6f3dd req-96ec1f83-4aaf-40d0-860c-aeaff6d6128b service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Updated VIF entry in instance network info cache for port d2012ded-4851-468b-9f75-d2adb6cca344. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:14:59.276727 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-85484655-6518-41c5-a5c4-2d211bb6f3dd req-96ec1f83-4aaf-40d0-860c-aeaff6d6128b service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Updating instance_info_cache with network_info: [{"id": "d2012ded-4851-468b-9f75-d2adb6cca344", "address": "fa:16:3e:04:74:31", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2012ded-48", "ovs_interfaceid": "d2012ded-4851-468b-9f75-d2adb6cca344", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:14:59.292448 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-0b88a327-4f92-4705-8bff-f6b40db69215 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Updating ProviderTree inventory for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 28 01:14:59.292708 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-0b88a327-4f92-4705-8bff-f6b40db69215 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Updating inventory in ProviderTree for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 01:14:59.324150 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lazy-loading 'flavor' on Instance uuid 78222e75-5ee3-4478-8f29-391c88192956 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:14:59.337395 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-0b88a327-4f92-4705-8bff-f6b40db69215 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Refreshing aggregate associations for resource provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2, aggregates: None {{(pid=98319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 28 01:14:59.390522 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-0b88a327-4f92-4705-8bff-f6b40db69215 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Refreshing trait associations for resource provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ARCH_PPC64LE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,HW_ARCH_X86_64,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOUND_MODEL_AC97,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ARCH_X86_64,COMPUTE_ARCH_S390X,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_SOUND_MODEL_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ARCH_MIPSEL,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOUND_MODEL_SB16,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ARCH_RISCV64,HW_CPU_X86_SSE2,COMPUTE_ARCH_AARCH64,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_IGB {{(pid=98319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 28 01:14:59.439033 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-5808ffa6-874f-495d-923e-7c28e74d523a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:13:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1359249260',display_name='tempest-AttachVolumeNegativeTest-server-1359249260',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumenegativetest-server-1359249260',id=75,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOS2twTc2sfNktE0xgfhJeI/MkqLEDH/2QEe1EkGYxHjXkouK7+f7QVy26njpXZ3OV/jZtF1TQXBOf817BIqWZJj/yTvUoR6lyiPUf9nmr18zsBjbUeXCu86Qu8rscvANA==',key_name='tempest-keypair-21329551',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:14:03Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d6ee814419446dcb5025c68fb0f4ce9',ramdisk_id='',reservation_id='r-xrzdqj04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1272396699',owner_user_name='tempest-AttachVolumeNegativeTest-1272396699-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:14:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f4ee9375c440d6abf68f2aa230b0c5',uuid=f0e996d3-b051-421c-b00c-1dbc6971f8e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1718f886-da55-4687-b4b4-7874a8099d6f", "address": "fa:16:3e:cc:2a:78", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1718f886-da", "ovs_interfaceid": "1718f886-da55-4687-b4b4-7874a8099d6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:14:59.439237 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5808ffa6-874f-495d-923e-7c28e74d523a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Converting VIF {"id": "1718f886-da55-4687-b4b4-7874a8099d6f", "address": "fa:16:3e:cc:2a:78", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1718f886-da", "ovs_interfaceid": "1718f886-da55-4687-b4b4-7874a8099d6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:14:59.439634 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5808ffa6-874f-495d-923e-7c28e74d523a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:2a:78,bridge_name='br-int',has_traffic_filtering=True,id=1718f886-da55-4687-b4b4-7874a8099d6f,network=Network(f8ce4f22-7484-451c-b0df-2e7318e070f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1718f886-da') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:14:59.439817 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-5808ffa6-874f-495d-923e-7c28e74d523a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:2a:78,bridge_name='br-int',has_traffic_filtering=True,id=1718f886-da55-4687-b4b4-7874a8099d6f,network=Network(f8ce4f22-7484-451c-b0df-2e7318e070f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1718f886-da') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:14:59.440524 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:59.440746 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1718f886-da, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:14:59.442961 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:14:59.443677 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:59.444388 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:14:59.444494 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7004d99e-e68c-434d-ad5c-ce51ae3e76a0) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:14:59.447641 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:14:59.449693 np0000001577 nova-compute[98319]: INFO os_vif [None req-5808ffa6-874f-495d-923e-7c28e74d523a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:2a:78,bridge_name='br-int',has_traffic_filtering=True,id=1718f886-da55-4687-b4b4-7874a8099d6f,network=Network(f8ce4f22-7484-451c-b0df-2e7318e070f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1718f886-da')
May 28 01:14:59.449998 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5808ffa6-874f-495d-923e-7c28e74d523a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Deleting instance files /opt/stack/data/nova/instances/f0e996d3-b051-421c-b00c-1dbc6971f8e6_del
May 28 01:14:59.450933 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5808ffa6-874f-495d-923e-7c28e74d523a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Deletion of /opt/stack/data/nova/instances/f0e996d3-b051-421c-b00c-1dbc6971f8e6_del complete
May 28 01:14:59.694572 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0b88a327-4f92-4705-8bff-f6b40db69215 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:14:59.694768 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-0b88a327-4f92-4705-8bff-f6b40db69215 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:14:59.779964 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-85484655-6518-41c5-a5c4-2d211bb6f3dd req-96ec1f83-4aaf-40d0-860c-aeaff6d6128b service nova] Releasing lock "refresh_cache-78222e75-5ee3-4478-8f29-391c88192956" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:14:59.780075 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-85484655-6518-41c5-a5c4-2d211bb6f3dd req-96ec1f83-4aaf-40d0-860c-aeaff6d6128b service nova] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Received event network-vif-deleted-6ee40c30-d6de-4c91-b393-c66a3f3709e9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:14:59.858630 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e64bd871-c0ee-47ec-b378-990b69be4282 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:59.858851 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e64bd871-c0ee-47ec-b378-990b69be4282 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:59.859008 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e64bd871-c0ee-47ec-b378-990b69be4282 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:14:59.859123 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e64bd871-c0ee-47ec-b378-990b69be4282 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:14:59.859262 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e64bd871-c0ee-47ec-b378-990b69be4282 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:14:59.860996 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e64bd871-c0ee-47ec-b378-990b69be4282 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Terminating instance
May 28 01:14:59.957533 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-5808ffa6-874f-495d-923e-7c28e74d523a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Took 1.37 seconds to destroy the instance on the hypervisor.
May 28 01:14:59.958313 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-5808ffa6-874f-495d-923e-7c28e74d523a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:14:59.958926 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:14:59.958996 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:14:59.959250 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:15:00.014651 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:15:00.197028 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-0b88a327-4f92-4705-8bff-f6b40db69215 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:15:00.328839 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4bc59b95-cce0-46f8-a946-5c245db9e6cd tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "78222e75-5ee3-4478-8f29-391c88192956" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.009s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:00.363399 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e64bd871-c0ee-47ec-b378-990b69be4282 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:15:00.380939 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:00.384358 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:00.402624 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:00.403382 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:00.426619 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:00.426619 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:00.448984 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5714bdea-6fb7-45c5-bd9b-3d406c2ce2a5 req-2fd93dc2-3a3a-4f82-a579-7e72e7e6e87b service nova] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Received event network-vif-deleted-1718f886-da55-4687-b4b4-7874a8099d6f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:15:00.449293 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-5714bdea-6fb7-45c5-bd9b-3d406c2ce2a5 req-2fd93dc2-3a3a-4f82-a579-7e72e7e6e87b service nova] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Neutron deleted interface 1718f886-da55-4687-b4b4-7874a8099d6f; detaching it from the instance and deleting it from the info cache
May 28 01:15:00.451391 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5714bdea-6fb7-45c5-bd9b-3d406c2ce2a5 req-2fd93dc2-3a3a-4f82-a579-7e72e7e6e87b service nova] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Detach interface failed, port_id=1718f886-da55-4687-b4b4-7874a8099d6f, reason: Instance f0e996d3-b051-421c-b00c-1dbc6971f8e6 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:15:00.674214 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999757128000056 future=<Future at 0x7c984c6b7b00 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:15:00.675345 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Instance destroyed successfully.
May 28 01:15:00.675871 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-e64bd871-c0ee-47ec-b378-990b69be4282 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lazy-loading 'resources' on Instance uuid 26af0b2c-7e35-4e53-85eb-71ddca16fbfa {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:15:00.702544 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0b88a327-4f92-4705-8bff-f6b40db69215 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.530s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:00.753425 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-0b88a327-4f92-4705-8bff-f6b40db69215 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Deleted allocations for instance a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705
May 28 01:15:00.819681 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c16a088a-22c3-4790-83d7-500d98f954e3 req-0d7199e4-7afa-44f7-bcb0-a6e4f09f442c service nova] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Received event network-vif-unplugged-1718f886-da55-4687-b4b4-7874a8099d6f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:15:00.820111 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c16a088a-22c3-4790-83d7-500d98f954e3 req-0d7199e4-7afa-44f7-bcb0-a6e4f09f442c service nova] Acquiring lock "f0e996d3-b051-421c-b00c-1dbc6971f8e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:00.820267 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c16a088a-22c3-4790-83d7-500d98f954e3 req-0d7199e4-7afa-44f7-bcb0-a6e4f09f442c service nova] Lock "f0e996d3-b051-421c-b00c-1dbc6971f8e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:00.820371 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c16a088a-22c3-4790-83d7-500d98f954e3 req-0d7199e4-7afa-44f7-bcb0-a6e4f09f442c service nova] Lock "f0e996d3-b051-421c-b00c-1dbc6971f8e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:00.820473 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c16a088a-22c3-4790-83d7-500d98f954e3 req-0d7199e4-7afa-44f7-bcb0-a6e4f09f442c service nova] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] No waiting events found dispatching network-vif-unplugged-1718f886-da55-4687-b4b4-7874a8099d6f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:15:00.820620 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c16a088a-22c3-4790-83d7-500d98f954e3 req-0d7199e4-7afa-44f7-bcb0-a6e4f09f442c service nova] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Received event network-vif-unplugged-1718f886-da55-4687-b4b4-7874a8099d6f for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:15:00.820696 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c16a088a-22c3-4790-83d7-500d98f954e3 req-0d7199e4-7afa-44f7-bcb0-a6e4f09f442c service nova] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Received event network-vif-unplugged-803c8519-51b8-4b25-8cee-11cf816398fa {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:15:00.820842 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c16a088a-22c3-4790-83d7-500d98f954e3 req-0d7199e4-7afa-44f7-bcb0-a6e4f09f442c service nova] Acquiring lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:00.820936 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c16a088a-22c3-4790-83d7-500d98f954e3 req-0d7199e4-7afa-44f7-bcb0-a6e4f09f442c service nova] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:00.821000 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c16a088a-22c3-4790-83d7-500d98f954e3 req-0d7199e4-7afa-44f7-bcb0-a6e4f09f442c service nova] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:00.821076 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c16a088a-22c3-4790-83d7-500d98f954e3 req-0d7199e4-7afa-44f7-bcb0-a6e4f09f442c service nova] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] No waiting events found dispatching network-vif-unplugged-803c8519-51b8-4b25-8cee-11cf816398fa {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:15:00.821176 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c16a088a-22c3-4790-83d7-500d98f954e3 req-0d7199e4-7afa-44f7-bcb0-a6e4f09f442c service nova] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Received event network-vif-unplugged-803c8519-51b8-4b25-8cee-11cf816398fa for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:15:00.821296 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c16a088a-22c3-4790-83d7-500d98f954e3 req-0d7199e4-7afa-44f7-bcb0-a6e4f09f442c service nova] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Received event network-vif-unplugged-803c8519-51b8-4b25-8cee-11cf816398fa {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:15:00.821410 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c16a088a-22c3-4790-83d7-500d98f954e3 req-0d7199e4-7afa-44f7-bcb0-a6e4f09f442c service nova] Acquiring lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:00.821513 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c16a088a-22c3-4790-83d7-500d98f954e3 req-0d7199e4-7afa-44f7-bcb0-a6e4f09f442c service nova] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:00.821626 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c16a088a-22c3-4790-83d7-500d98f954e3 req-0d7199e4-7afa-44f7-bcb0-a6e4f09f442c service nova] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:00.821723 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c16a088a-22c3-4790-83d7-500d98f954e3 req-0d7199e4-7afa-44f7-bcb0-a6e4f09f442c service nova] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] No waiting events found dispatching network-vif-unplugged-803c8519-51b8-4b25-8cee-11cf816398fa {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:15:00.821823 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c16a088a-22c3-4790-83d7-500d98f954e3 req-0d7199e4-7afa-44f7-bcb0-a6e4f09f442c service nova] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Received event network-vif-unplugged-803c8519-51b8-4b25-8cee-11cf816398fa for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:15:00.898400 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:15:01.178517 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-e64bd871-c0ee-47ec-b378-990b69be4282 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:12:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-496775262',display_name='tempest-SnapshotDataIntegrityTests-server-496775262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-snapshotdataintegritytests-server-496775262',id=71,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGIclZBBgyW4qbcHhvzXUpNIEaZYL+gCHX0SCXTH/XCEXN7WldYmM2jTlcJTHOOZr+56lmTi54khabWnAOLEOEicXnBt/cwT7s56sQvd2t7fd/XGWhAq2fEN0hKO7odFw==',key_name='tempest-keypair-598473641',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:12:24Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e5e86340fc8435f8e3c83322ba82560',ramdisk_id='',reservation_id='r-t08nzvnx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1488880081',owner_user_name='tempest-SnapshotDataIntegrityTests-1488880081-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:12:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18f4a9334b864b4b9104a4fe74f90c8c',uuid=26af0b2c-7e35-4e53-85eb-71ddca16fbfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "803c8519-51b8-4b25-8cee-11cf816398fa", "address": "fa:16:3e:4a:3d:bf", "network": {"id": "c28bd5cb-6fe6-4196-89e2-40b572ab0547", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-985170360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0e5e86340fc8435f8e3c83322ba82560", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap803c8519-51", "ovs_interfaceid": "803c8519-51b8-4b25-8cee-11cf816398fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:15:01.178797 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-e64bd871-c0ee-47ec-b378-990b69be4282 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Converting VIF {"id": "803c8519-51b8-4b25-8cee-11cf816398fa", "address": "fa:16:3e:4a:3d:bf", "network": {"id": "c28bd5cb-6fe6-4196-89e2-40b572ab0547", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-985170360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0e5e86340fc8435f8e3c83322ba82560", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap803c8519-51", "ovs_interfaceid": "803c8519-51b8-4b25-8cee-11cf816398fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:15:01.179445 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-e64bd871-c0ee-47ec-b378-990b69be4282 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:3d:bf,bridge_name='br-int',has_traffic_filtering=True,id=803c8519-51b8-4b25-8cee-11cf816398fa,network=Network(c28bd5cb-6fe6-4196-89e2-40b572ab0547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap803c8519-51') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:15:01.179739 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-e64bd871-c0ee-47ec-b378-990b69be4282 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:3d:bf,bridge_name='br-int',has_traffic_filtering=True,id=803c8519-51b8-4b25-8cee-11cf816398fa,network=Network(c28bd5cb-6fe6-4196-89e2-40b572ab0547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap803c8519-51') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:15:01.180768 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:01.180961 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap803c8519-51, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:15:01.181952 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:01.183128 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:15:01.183128 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:01.183811 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:01.183968 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=353ca3b0-39ef-4c64-9e0a-3d6e949f6bf1) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:15:01.184454 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:01.185128 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:15:01.186882 np0000001577 nova-compute[98319]: INFO os_vif [None req-e64bd871-c0ee-47ec-b378-990b69be4282 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:3d:bf,bridge_name='br-int',has_traffic_filtering=True,id=803c8519-51b8-4b25-8cee-11cf816398fa,network=Network(c28bd5cb-6fe6-4196-89e2-40b572ab0547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap803c8519-51')
May 28 01:15:01.187074 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-e64bd871-c0ee-47ec-b378-990b69be4282 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Deleting instance files /opt/stack/data/nova/instances/26af0b2c-7e35-4e53-85eb-71ddca16fbfa_del
May 28 01:15:01.187740 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-e64bd871-c0ee-47ec-b378-990b69be4282 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Deletion of /opt/stack/data/nova/instances/26af0b2c-7e35-4e53-85eb-71ddca16fbfa_del complete
May 28 01:15:01.399965 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Took 1.44 seconds to deallocate network for instance.
May 28 01:15:01.625607 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e3677ebb-9f8e-4a13-a32a-2e2c8834630e tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "78222e75-5ee3-4478-8f29-391c88192956" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:01.625761 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e3677ebb-9f8e-4a13-a32a-2e2c8834630e tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "78222e75-5ee3-4478-8f29-391c88192956" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:01.625910 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e3677ebb-9f8e-4a13-a32a-2e2c8834630e tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "78222e75-5ee3-4478-8f29-391c88192956-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:01.626017 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e3677ebb-9f8e-4a13-a32a-2e2c8834630e tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "78222e75-5ee3-4478-8f29-391c88192956-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:01.626117 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e3677ebb-9f8e-4a13-a32a-2e2c8834630e tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "78222e75-5ee3-4478-8f29-391c88192956-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:01.627589 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e3677ebb-9f8e-4a13-a32a-2e2c8834630e tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Terminating instance
May 28 01:15:01.643394 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:01.692884 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e64bd871-c0ee-47ec-b378-990b69be4282 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Took 1.33 seconds to destroy the instance on the hypervisor.
May 28 01:15:01.693332 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-e64bd871-c0ee-47ec-b378-990b69be4282 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:15:01.693538 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:15:01.693704 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:15:01.693879 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:15:01.754010 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:15:01.761814 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0b88a327-4f92-4705-8bff-f6b40db69215 tempest-VolumeMultiattachTests-1632400240 tempest-VolumeMultiattachTests-1632400240-project-member] Lock "a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.397s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:01.904117 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5808ffa6-874f-495d-923e-7c28e74d523a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:01.904307 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5808ffa6-874f-495d-923e-7c28e74d523a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:02.130198 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e3677ebb-9f8e-4a13-a32a-2e2c8834630e tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:15:02.149419 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:02.152217 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:02.166073 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:03.076585 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:03.076585 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:03.076585 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:03.076585 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5808ffa6-874f-495d-923e-7c28e74d523a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:15:03.076585 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-5808ffa6-874f-495d-923e-7c28e74d523a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:15:03.076585 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.9997144390004 future=<Future at 0x7c98705aa780 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:15:03.076585 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Instance destroyed successfully.
May 28 01:15:03.076585 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-e3677ebb-9f8e-4a13-a32a-2e2c8834630e tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lazy-loading 'resources' on Instance uuid 78222e75-5ee3-4478-8f29-391c88192956 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:15:03.076585 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:15:03.076585 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-5808ffa6-874f-495d-923e-7c28e74d523a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:15:03.076585 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0c113654-7b5d-4720-9954-97e6ad724e63 req-2b77c3fe-a832-46cd-a62a-f65432d44447 service nova] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Received event network-vif-deleted-803c8519-51b8-4b25-8cee-11cf816398fa {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:15:03.076585 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0c113654-7b5d-4720-9954-97e6ad724e63 req-2b77c3fe-a832-46cd-a62a-f65432d44447 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Received event network-vif-unplugged-d2012ded-4851-468b-9f75-d2adb6cca344 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:15:03.076585 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0c113654-7b5d-4720-9954-97e6ad724e63 req-2b77c3fe-a832-46cd-a62a-f65432d44447 service nova] Acquiring lock "78222e75-5ee3-4478-8f29-391c88192956-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:03.076585 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0c113654-7b5d-4720-9954-97e6ad724e63 req-2b77c3fe-a832-46cd-a62a-f65432d44447 service nova] Lock "78222e75-5ee3-4478-8f29-391c88192956-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:03.076585 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0c113654-7b5d-4720-9954-97e6ad724e63 req-2b77c3fe-a832-46cd-a62a-f65432d44447 service nova] Lock "78222e75-5ee3-4478-8f29-391c88192956-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:03.076585 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0c113654-7b5d-4720-9954-97e6ad724e63 req-2b77c3fe-a832-46cd-a62a-f65432d44447 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] No waiting events found dispatching network-vif-unplugged-d2012ded-4851-468b-9f75-d2adb6cca344 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:15:03.076585 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0c113654-7b5d-4720-9954-97e6ad724e63 req-2b77c3fe-a832-46cd-a62a-f65432d44447 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Received event network-vif-unplugged-d2012ded-4851-468b-9f75-d2adb6cca344 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:15:03.076585 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0c113654-7b5d-4720-9954-97e6ad724e63 req-2b77c3fe-a832-46cd-a62a-f65432d44447 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Received event network-vif-unplugged-d2012ded-4851-468b-9f75-d2adb6cca344 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:15:03.076585 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0c113654-7b5d-4720-9954-97e6ad724e63 req-2b77c3fe-a832-46cd-a62a-f65432d44447 service nova] Acquiring lock "78222e75-5ee3-4478-8f29-391c88192956-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:03.076585 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0c113654-7b5d-4720-9954-97e6ad724e63 req-2b77c3fe-a832-46cd-a62a-f65432d44447 service nova] Lock "78222e75-5ee3-4478-8f29-391c88192956-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:03.076585 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0c113654-7b5d-4720-9954-97e6ad724e63 req-2b77c3fe-a832-46cd-a62a-f65432d44447 service nova] Lock "78222e75-5ee3-4478-8f29-391c88192956-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:03.076585 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0c113654-7b5d-4720-9954-97e6ad724e63 req-2b77c3fe-a832-46cd-a62a-f65432d44447 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] No waiting events found dispatching network-vif-unplugged-d2012ded-4851-468b-9f75-d2adb6cca344 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:15:03.076585 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0c113654-7b5d-4720-9954-97e6ad724e63 req-2b77c3fe-a832-46cd-a62a-f65432d44447 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Received event network-vif-unplugged-d2012ded-4851-468b-9f75-d2adb6cca344 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:15:03.076585 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-e3677ebb-9f8e-4a13-a32a-2e2c8834630e tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:13:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-31442484',display_name='tempest-TestMinimumBasicScenario-server-31442484',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testminimumbasicscenario-server-31442484',id=74,image_ref='f9481693-46f4-404f-9366-9056d8343587',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHH6vLtnRBTetrR7YVT1x2n8DmihILEefk0Iy29RavOvxpRjx6tNxMsYGHg09zAPg7pE+9oRyljcKUmFSH1hDGIQozvsixLn9Pak0BluCn0AVB3Ws1R0gaUu4tntO7uQBQ==',key_name='tempest-TestMinimumBasicScenario-1202106926',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:13:57Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb2f65d208f44146903c7dcf0b143a8e',ramdisk_id='',reservation_id='r-pc3qnw2a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9481693-46f4-404f-9366-9056d8343587',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1681839017',owner_user_name='tempest-TestMinimumBasicScenario-1681839017-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:14:32Z,user_data=None,user_id='0505bf2e15ba44ad881b94106ae054a5',uuid=78222e75-5ee3-4478-8f29-391c88192956,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2012ded-4851-468b-9f75-d2adb6cca344", "address": "fa:16:3e:04:74:31", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2012ded-48", "ovs_interfaceid": "d2012ded-4851-468b-9f75-d2adb6cca344", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:15:03.076585 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-e3677ebb-9f8e-4a13-a32a-2e2c8834630e tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Converting VIF {"id": "d2012ded-4851-468b-9f75-d2adb6cca344", "address": "fa:16:3e:04:74:31", "network": {"id": "d9534aa6-926a-458a-a1d0-8512d11fe6a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1274324865-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fb2f65d208f44146903c7dcf0b143a8e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2012ded-48", "ovs_interfaceid": "d2012ded-4851-468b-9f75-d2adb6cca344", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:15:03.076585 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-e3677ebb-9f8e-4a13-a32a-2e2c8834630e tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:74:31,bridge_name='br-int',has_traffic_filtering=True,id=d2012ded-4851-468b-9f75-d2adb6cca344,network=Network(d9534aa6-926a-458a-a1d0-8512d11fe6a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2012ded-48') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:15:03.079438 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-e3677ebb-9f8e-4a13-a32a-2e2c8834630e tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:74:31,bridge_name='br-int',has_traffic_filtering=True,id=d2012ded-4851-468b-9f75-d2adb6cca344,network=Network(d9534aa6-926a-458a-a1d0-8512d11fe6a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2012ded-48') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:15:03.079438 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:03.079438 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2012ded-48, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:15:03.079438 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:03.079438 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:15:03.079438 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:03.079438 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:03.079438 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9832bb5-0000-4983-9e25-f30c9788af96) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:15:03.079438 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:03.079438 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:15:03.079438 np0000001577 nova-compute[98319]: INFO os_vif [None req-e3677ebb-9f8e-4a13-a32a-2e2c8834630e tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:74:31,bridge_name='br-int',has_traffic_filtering=True,id=d2012ded-4851-468b-9f75-d2adb6cca344,network=Network(d9534aa6-926a-458a-a1d0-8512d11fe6a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2012ded-48')
May 28 01:15:03.079438 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-e3677ebb-9f8e-4a13-a32a-2e2c8834630e tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Deleting instance files /opt/stack/data/nova/instances/78222e75-5ee3-4478-8f29-391c88192956_del
May 28 01:15:03.079438 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-e3677ebb-9f8e-4a13-a32a-2e2c8834630e tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Deletion of /opt/stack/data/nova/instances/78222e75-5ee3-4478-8f29-391c88192956_del complete
May 28 01:15:03.160058 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Took 1.47 seconds to deallocate network for instance.
May 28 01:15:03.210702 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5808ffa6-874f-495d-923e-7c28e74d523a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.306s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:03.252278 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-5808ffa6-874f-495d-923e-7c28e74d523a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Deleted allocations for instance f0e996d3-b051-421c-b00c-1dbc6971f8e6
May 28 01:15:03.477625 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e3677ebb-9f8e-4a13-a32a-2e2c8834630e tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Took 1.35 seconds to destroy the instance on the hypervisor.
May 28 01:15:03.478028 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-e3677ebb-9f8e-4a13-a32a-2e2c8834630e tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:15:03.478296 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:15:03.478389 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 78222e75-5ee3-4478-8f29-391c88192956] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:15:03.478602 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:15:03.540601 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:15:03.665485 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e64bd871-c0ee-47ec-b378-990b69be4282 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:03.665780 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e64bd871-c0ee-47ec-b378-990b69be4282 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:03.757542 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:03.789139 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-93fe96ee-54b4-4e0d-8b13-6ea4cad7325b req-c3aa633d-7c56-4212-bb85-1b84eb450cd1 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Received event network-vif-deleted-d2012ded-4851-468b-9f75-d2adb6cca344 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:15:03.789139 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-93fe96ee-54b4-4e0d-8b13-6ea4cad7325b req-c3aa633d-7c56-4212-bb85-1b84eb450cd1 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Neutron deleted interface d2012ded-4851-468b-9f75-d2adb6cca344; detaching it from the instance and deleting it from the info cache
May 28 01:15:03.790915 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-93fe96ee-54b4-4e0d-8b13-6ea4cad7325b req-c3aa633d-7c56-4212-bb85-1b84eb450cd1 service nova] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Detach interface failed, port_id=d2012ded-4851-468b-9f75-d2adb6cca344, reason: Instance 78222e75-5ee3-4478-8f29-391c88192956 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:15:03.902385 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e64bd871-c0ee-47ec-b378-990b69be4282 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:15:03.902591 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-e64bd871-c0ee-47ec-b378-990b69be4282 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:15:04.248356 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:15:04.263162 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5808ffa6-874f-495d-923e-7c28e74d523a tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "f0e996d3-b051-421c-b00c-1dbc6971f8e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.186s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:04.405611 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-e64bd871-c0ee-47ec-b378-990b69be4282 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:15:04.750403 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Took 1.27 seconds to deallocate network for instance.
May 28 01:15:04.910781 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e64bd871-c0ee-47ec-b378-990b69be4282 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.245s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:04.970580 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-e64bd871-c0ee-47ec-b378-990b69be4282 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Deleted allocations for instance 26af0b2c-7e35-4e53-85eb-71ddca16fbfa
May 28 01:15:05.259099 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e3677ebb-9f8e-4a13-a32a-2e2c8834630e tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:05.259099 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e3677ebb-9f8e-4a13-a32a-2e2c8834630e tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:05.354306 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:05.501135 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e3677ebb-9f8e-4a13-a32a-2e2c8834630e tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:15:05.501371 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-e3677ebb-9f8e-4a13-a32a-2e2c8834630e tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:15:05.982632 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e64bd871-c0ee-47ec-b378-990b69be4282 tempest-SnapshotDataIntegrityTests-1488880081 tempest-SnapshotDataIntegrityTests-1488880081-project-member] Lock "26af0b2c-7e35-4e53-85eb-71ddca16fbfa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.123s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:06.003879 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-e3677ebb-9f8e-4a13-a32a-2e2c8834630e tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:15:06.515138 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e3677ebb-9f8e-4a13-a32a-2e2c8834630e tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.256s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:06.587689 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-e3677ebb-9f8e-4a13-a32a-2e2c8834630e tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Deleted allocations for instance 78222e75-5ee3-4478-8f29-391c88192956
May 28 01:15:06.644778 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:07.335916 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:07.335916 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:07.599729 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e3677ebb-9f8e-4a13-a32a-2e2c8834630e tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Lock "78222e75-5ee3-4478-8f29-391c88192956" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.974s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:07.836802 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:15:07.969328 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:08.350614 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:08.409870 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:08.409870 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:08.413562 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:15:08.413562 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Claim successful on node np0000001577
May 28 01:15:09.644162 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:15:09.644162 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:15:09.843753 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:10.141283 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:10.145427 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:15:10.651854 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.242s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:10.652342 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:15:11.159853 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:15:11.160006 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:15:11.160248 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:15:11.160445 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:15:11.198011 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00031315200021708733 future=<Future at 0x7c98706a4140 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:15:11.198989 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Emitting event <LifecycleEvent: 1779930896.1976197, a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:15:11.198989 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] VM Stopped (Lifecycle Event)
May 28 01:15:11.199332 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:15:11.200394 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=2.732839788000092 future=<Future at 0x7c98705cd010 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:15:11.200559 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=2.732691822000106 future=<Future at 0x7c98705cd010 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:15:11.237784 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96f4ee9375c440d6abf68f2aa230b0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6ee814419446dcb5025c68fb0f4ce9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:15:11.543712 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:11.647591 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:11.662034 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:15:11.691655 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Successfully created port: cbc69d0b-efff-4170-bc4e-729f9a9f52c2 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:15:11.701535 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: a2e1ad91-b8df-4c3b-8af1-41e6bdd6d705] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:15:12.166248 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Successfully updated port: cbc69d0b-efff-4170-bc4e-729f9a9f52c2 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:15:12.167578 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:15:12.215066 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-433f09e1-dec2-4b19-a2dd-da549a87aa5f req-a741b1e8-1f2e-46b7-9189-1a4c63dcbb45 service nova] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Received event network-changed-cbc69d0b-efff-4170-bc4e-729f9a9f52c2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:15:12.215240 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-433f09e1-dec2-4b19-a2dd-da549a87aa5f req-a741b1e8-1f2e-46b7-9189-1a4c63dcbb45 service nova] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Refreshing instance network info cache due to event network-changed-cbc69d0b-efff-4170-bc4e-729f9a9f52c2. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:15:12.215418 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-433f09e1-dec2-4b19-a2dd-da549a87aa5f req-a741b1e8-1f2e-46b7-9189-1a4c63dcbb45 service nova] Acquiring lock "refresh_cache-9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:15:12.215669 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-433f09e1-dec2-4b19-a2dd-da549a87aa5f req-a741b1e8-1f2e-46b7-9189-1a4c63dcbb45 service nova] Acquired lock "refresh_cache-9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:15:12.215838 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-433f09e1-dec2-4b19-a2dd-da549a87aa5f req-a741b1e8-1f2e-46b7-9189-1a4c63dcbb45 service nova] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Refreshing network info cache for port cbc69d0b-efff-4170-bc4e-729f9a9f52c2 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:15:12.671187 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "refresh_cache-9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:15:12.719314 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-433f09e1-dec2-4b19-a2dd-da549a87aa5f req-a741b1e8-1f2e-46b7-9189-1a4c63dcbb45 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:15:12.783627 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-433f09e1-dec2-4b19-a2dd-da549a87aa5f req-a741b1e8-1f2e-46b7-9189-1a4c63dcbb45 service nova] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:15:12.904159 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-433f09e1-dec2-4b19-a2dd-da549a87aa5f req-a741b1e8-1f2e-46b7-9189-1a4c63dcbb45 service nova] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:15:12.976799 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:13.176540 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:15:13.177401 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:15:13.177609 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Creating image(s)
May 28 01:15:13.178023 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "/opt/stack/data/nova/instances/9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:13.178237 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "/opt/stack/data/nova/instances/9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:13.178659 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "/opt/stack/data/nova/instances/9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:13.179074 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:15:13.181643 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:15:13.182528 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:15:13.281589 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.099s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:15:13.282079 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:13.282930 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:13.283572 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:15:13.285987 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:15:13.286305 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:15:13.375827 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:15:13.376299 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:15:13.407344 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-433f09e1-dec2-4b19-a2dd-da549a87aa5f req-a741b1e8-1f2e-46b7-9189-1a4c63dcbb45 service nova] Releasing lock "refresh_cache-9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:15:13.408142 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquired lock "refresh_cache-9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:15:13.408577 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:15:13.433637 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea/disk 1073741824" returned: 0 in 0.057s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:15:13.434042 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.151s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:13.434389 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:15:13.520665 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:15:13.521017 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:15:13.521261 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:15:13.622617 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:15:13.623606 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Cannot resize image /opt/stack/data/nova/instances/9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:15:13.624092 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:15:13.624452 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Ensure instance console log exists: /opt/stack/data/nova/instances/9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:15:13.624822 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:13.625082 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:13.625272 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:13.935966 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0026904609999292006 future=<Future at 0x7c98705cd010 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:15:13.936341 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:15:13.936341 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=1.7377538370001275 future=<Future at 0x7c984c6b7b00 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:15:13.936341 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=1.737672585999917 future=<Future at 0x7c984c6b7b00 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:15:13.936691 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] Emitting event <LifecycleEvent: 1779930898.9331858, f0e996d3-b051-421c-b00c-1dbc6971f8e6 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:15:13.936899 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] VM Stopped (Lifecycle Event)
May 28 01:15:13.942138 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:13.985319 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:15:14.138882 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:15:14.278322 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Updating instance_info_cache with network_info: [{"id": "cbc69d0b-efff-4170-bc4e-729f9a9f52c2", "address": "fa:16:3e:a5:aa:b2", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc69d0b-ef", "ovs_interfaceid": "cbc69d0b-efff-4170-bc4e-729f9a9f52c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:15:14.441305 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-151f87ae-3e0a-419c-bcd3-c2dae97777fa tempest-TestMinimumBasicScenario-1681839017 tempest-TestMinimumBasicScenario-1681839017-project-member] [instance: f0e996d3-b051-421c-b00c-1dbc6971f8e6] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:15:14.780306 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Releasing lock "refresh_cache-9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:15:14.780600 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Instance network_info: |[{"id": "cbc69d0b-efff-4170-bc4e-729f9a9f52c2", "address": "fa:16:3e:a5:aa:b2", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc69d0b-ef", "ovs_interfaceid": "cbc69d0b-efff-4170-bc4e-729f9a9f52c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:15:14.783142 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Start _get_guest_xml network_info=[{"id": "cbc69d0b-efff-4170-bc4e-729f9a9f52c2", "address": "fa:16:3e:a5:aa:b2", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc69d0b-ef", "ovs_interfaceid": "cbc69d0b-efff-4170-bc4e-729f9a9f52c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:15:14.786539 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:15:14.788176 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1610670524', uuid='9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea'), owner=OwnerMeta(userid='96f4ee9375c440d6abf68f2aa230b0c5', username='tempest-AttachVolumeNegativeTest-1272396699-project-member', projectid='1d6ee814419446dcb5025c68fb0f4ce9', projectname='tempest-AttachVolumeNegativeTest-1272396699'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cbc69d0b-efff-4170-bc4e-729f9a9f52c2", "address": "fa:16:3e:a5:aa:b2", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc69d0b-ef", "ovs_interfaceid": "cbc69d0b-efff-4170-bc4e-729f9a9f52c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930914.7877119) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:15:14.789486 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:15:14.789953 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:15:14.791178 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:15:14.791371 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:15:14.792287 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:15:14.792620 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:15:14.792771 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:15:14.792861 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:15:14.793006 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:15:14.793092 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:15:14.793192 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:15:14.793356 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:15:14.793460 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:15:14.793635 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:15:14.793741 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:15:14.793857 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:15:14.804507 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:15:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1610670524',display_name='tempest-AttachVolumeNegativeTest-server-1610670524',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumenegativetest-server-1610670524',id=78,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAyPB0UUtSBkuO+XmIZvCaker0kgJ/GLMlPrHwxz8AYvy6VoxadixGynpWYSq+eWwQtNVQPluo9sLVy/0E4Ti/ISsxIUPTyt7nk5q37Rc4sUh7Ty6QCnU3D6JHdgmSYkw==',key_name='tempest-keypair-145708081',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d6ee814419446dcb5025c68fb0f4ce9',ramdisk_id='',reservation_id='r-dxx3atk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1272396699',owner_user_name='tempest-AttachVolumeNegativeTest-1272396699-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:15:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f4ee9375c440d6abf68f2aa230b0c5',uuid=9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbc69d0b-efff-4170-bc4e-729f9a9f52c2", "address": "fa:16:3e:a5:aa:b2", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc69d0b-ef", "ovs_interfaceid": "cbc69d0b-efff-4170-bc4e-729f9a9f52c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:15:14.804783 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Converting VIF {"id": "cbc69d0b-efff-4170-bc4e-729f9a9f52c2", "address": "fa:16:3e:a5:aa:b2", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc69d0b-ef", "ovs_interfaceid": "cbc69d0b-efff-4170-bc4e-729f9a9f52c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:15:14.805436 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:aa:b2,bridge_name='br-int',has_traffic_filtering=True,id=cbc69d0b-efff-4170-bc4e-729f9a9f52c2,network=Network(f8ce4f22-7484-451c-b0df-2e7318e070f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc69d0b-ef') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:15:14.806132 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lazy-loading 'pci_devices' on Instance uuid 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:15:15.310284 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] End _get_guest_xml xml=<domain type="qemu">
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:   <uuid>9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea</uuid>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:   <name>instance-0000004e</name>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1610670524</nova:name>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:15:14</nova:creationTime>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:         <nova:user uuid="96f4ee9375c440d6abf68f2aa230b0c5">tempest-AttachVolumeNegativeTest-1272396699-project-member</nova:user>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:         <nova:project uuid="1d6ee814419446dcb5025c68fb0f4ce9">tempest-AttachVolumeNegativeTest-1272396699</nova:project>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:         <nova:port uuid="cbc69d0b-efff-4170-bc4e-729f9a9f52c2">
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:     <system>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       <entry name="serial">9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea</entry>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       <entry name="uuid">9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea</entry>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:     </system>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:   <os>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:   </os>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:   <features>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:   </features>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:   <devices>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea/disk"/>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:     </disk>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea/disk.config"/>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:     </disk>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:a5:aa:b2"/>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       <target dev="tapcbc69d0b-ef"/>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:     </interface>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea/console.log" append="off"/>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:     </serial>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:     <video>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:     </video>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:     </rng>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:   </devices>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]: </domain>
May 28 01:15:15.310284 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:15:15.312264 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Preparing to wait for external event network-vif-plugged-cbc69d0b-efff-4170-bc4e-729f9a9f52c2 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:15:15.312264 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:15.312264 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:15.312264 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:15.312264 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:15:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1610670524',display_name='tempest-AttachVolumeNegativeTest-server-1610670524',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumenegativetest-server-1610670524',id=78,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAyPB0UUtSBkuO+XmIZvCaker0kgJ/GLMlPrHwxz8AYvy6VoxadixGynpWYSq+eWwQtNVQPluo9sLVy/0E4Ti/ISsxIUPTyt7nk5q37Rc4sUh7Ty6QCnU3D6JHdgmSYkw==',key_name='tempest-keypair-145708081',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d6ee814419446dcb5025c68fb0f4ce9',ramdisk_id='',reservation_id='r-dxx3atk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1272396699',owner_user_name='tempest-AttachVolumeNegativeTest-1272396699-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:15:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f4ee9375c440d6abf68f2aa230b0c5',uuid=9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbc69d0b-efff-4170-bc4e-729f9a9f52c2", "address": "fa:16:3e:a5:aa:b2", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc69d0b-ef", "ovs_interfaceid": "cbc69d0b-efff-4170-bc4e-729f9a9f52c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:15:15.312264 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Converting VIF {"id": "cbc69d0b-efff-4170-bc4e-729f9a9f52c2", "address": "fa:16:3e:a5:aa:b2", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc69d0b-ef", "ovs_interfaceid": "cbc69d0b-efff-4170-bc4e-729f9a9f52c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:15:15.312264 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:aa:b2,bridge_name='br-int',has_traffic_filtering=True,id=cbc69d0b-efff-4170-bc4e-729f9a9f52c2,network=Network(f8ce4f22-7484-451c-b0df-2e7318e070f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc69d0b-ef') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:15:15.312755 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:aa:b2,bridge_name='br-int',has_traffic_filtering=True,id=cbc69d0b-efff-4170-bc4e-729f9a9f52c2,network=Network(f8ce4f22-7484-451c-b0df-2e7318e070f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc69d0b-ef') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:15:15.312755 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:15.313055 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:15:15.313235 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:15:15.315007 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:15.315007 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '218618bb-a33a-5015-b55b-62b4c19fb5ed', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:15:15.315909 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:15.316535 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:15:15.336285 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:15.338277 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:15.338814 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcbc69d0b-ef, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:15:15.339087 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcbc69d0b-ef, col_values=(('qos', UUID('352904b8-3f93-42d1-8659-3d75744387b7')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:15:15.339263 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcbc69d0b-ef, col_values=(('external_ids', {'iface-id': 'cbc69d0b-efff-4170-bc4e-729f9a9f52c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:aa:b2', 'vm-uuid': '9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:15:15.340505 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:15.341837 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:15:15.345901 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:15.346591 np0000001577 nova-compute[98319]: INFO os_vif [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:aa:b2,bridge_name='br-int',has_traffic_filtering=True,id=cbc69d0b-efff-4170-bc4e-729f9a9f52c2,network=Network(f8ce4f22-7484-451c-b0df-2e7318e070f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc69d0b-ef')
May 28 01:15:15.533771 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:15.674251 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0003067909997298557 future=<Future at 0x7c984c6b7b00 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:15:15.674344 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:15:15.674462 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=1.7825803540004017 future=<Future at 0x7c98705aa780 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:15:15.674585 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=1.7824694170003568 future=<Future at 0x7c98705aa780 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:15:15.674844 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] Emitting event <LifecycleEvent: 1779930900.6738646, 26af0b2c-7e35-4e53-85eb-71ddca16fbfa => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:15:15.675008 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] VM Stopped (Lifecycle Event)
May 28 01:15:16.177759 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b66e1ef4-85b8-4524-83fa-db91b8f018d9 tempest-AttachVolumeShelveTestJSON-1260503814 tempest-AttachVolumeShelveTestJSON-1260503814-project-member] [instance: 26af0b2c-7e35-4e53-85eb-71ddca16fbfa] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:15:16.647229 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:16.861248 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:15:16.861398 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:15:16.861535 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] No VIF found with MAC fa:16:3e:a5:aa:b2, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:15:16.862028 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Using config drive
May 28 01:15:16.904599 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:17.366706 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:15:17.457502 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00033871299956445 future=<Future at 0x7c98705aa780 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:15:17.457502 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:15:17.457811 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Emitting event <LifecycleEvent: 1779930902.456983, 78222e75-5ee3-4478-8f29-391c88192956 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:15:17.458044 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] VM Stopped (Lifecycle Event)
May 28 01:15:17.474182 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Creating config drive at /opt/stack/data/nova/instances/9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea/disk.config
May 28 01:15:17.478437 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptqzrn_zo {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:15:17.534494 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptqzrn_zo" returned: 0 in 0.055s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:15:17.929494 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:17.955732 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:17.956199 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:17.961802 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 78222e75-5ee3-4478-8f29-391c88192956] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:15:18.045897 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:18.115433 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:18.267823 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:18.275791 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:18.293895 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:18.722308 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930918.7219079, 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:15:18.722583 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] VM Started (Lifecycle Event)
May 28 01:15:19.077152 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "622fc3c0-e8bc-408d-89da-ce248c8c007a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:19.077676 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "622fc3c0-e8bc-408d-89da-ce248c8c007a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:19.077676 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "622fc3c0-e8bc-408d-89da-ce248c8c007a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:19.077676 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "622fc3c0-e8bc-408d-89da-ce248c8c007a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:19.079186 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "622fc3c0-e8bc-408d-89da-ce248c8c007a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:19.080696 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Terminating instance
May 28 01:15:19.224920 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:15:19.226764 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930919.2265716, 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:15:19.226906 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] VM Paused (Lifecycle Event)
May 28 01:15:19.585475 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:15:19.638728 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:19.641677 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:19.660773 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:19.729796 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:15:19.734954 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:15:19.824784 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:19.831149 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:19.901691 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:19.924362 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Instance destroyed successfully.
May 28 01:15:19.924890 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lazy-loading 'resources' on Instance uuid 622fc3c0-e8bc-408d-89da-ce248c8c007a {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:15:20.237580 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:15:20.238024 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999824433999947 future=<Future at 0x7c98704d1970 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:15:20.238261 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999529305000124 future=<Future at 0x7c98704d1970 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:15:20.238411 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999336587000016 future=<Future at 0x7c98704d1970 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:15:20.341195 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:20.427304 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:14:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1760217107',display_name='tempest-TestVolumeBootPatternV346-server-1760217107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpatternv346-server-1760217107',id=77,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH02rmsw6pKYutK8wZWIwQWpvB+AJDUQk7lliYqIX4sa4gPxCQsfqVNUtitoRFkRcrdylpjg/Oou2FD7NSsA6BHCL4gLqDcmAr0djGRBQiCd+X0Xokvox8I2NzoZAjwbDQ==',key_name='tempest-keypair-1980091552',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:14:40Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1880a27e1ad0432f914e086d7fffdeb4',ramdisk_id='',reservation_id='r-sp7wewec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-1741753090',owner_user_name='tempest-TestVolumeBootPatternV346-1741753090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:14:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae6c3c6a50b24a58af140f523fb73374',uuid=622fc3c0-e8bc-408d-89da-ce248c8c007a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "428fb87f-367e-4210-8601-37acf6b0e21b", "address": "fa:16:3e:ae:ae:87", "network": {"id": "0be6df83-bfa0-4c90-aed3-88212317cb4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-252451076-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1880a27e1ad0432f914e086d7fffdeb4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap428fb87f-36", "ovs_interfaceid": "428fb87f-367e-4210-8601-37acf6b0e21b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:15:20.427587 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Converting VIF {"id": "428fb87f-367e-4210-8601-37acf6b0e21b", "address": "fa:16:3e:ae:ae:87", "network": {"id": "0be6df83-bfa0-4c90-aed3-88212317cb4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-252451076-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1880a27e1ad0432f914e086d7fffdeb4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap428fb87f-36", "ovs_interfaceid": "428fb87f-367e-4210-8601-37acf6b0e21b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:15:20.428152 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:ae:87,bridge_name='br-int',has_traffic_filtering=True,id=428fb87f-367e-4210-8601-37acf6b0e21b,network=Network(0be6df83-bfa0-4c90-aed3-88212317cb4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap428fb87f-36') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:15:20.428390 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:ae:87,bridge_name='br-int',has_traffic_filtering=True,id=428fb87f-367e-4210-8601-37acf6b0e21b,network=Network(0be6df83-bfa0-4c90-aed3-88212317cb4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap428fb87f-36') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:15:20.430809 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:20.431080 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap428fb87f-36, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:15:20.433695 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:20.434842 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:15:20.435504 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:20.435650 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0318ec53-5dad-408b-aca8-68af21231101) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:15:20.436327 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:20.436747 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:15:20.437472 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:20.439122 np0000001577 nova-compute[98319]: INFO os_vif [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:ae:87,bridge_name='br-int',has_traffic_filtering=True,id=428fb87f-367e-4210-8601-37acf6b0e21b,network=Network(0be6df83-bfa0-4c90-aed3-88212317cb4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap428fb87f-36')
May 28 01:15:20.440739 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:15:20.441124 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599', 'iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '331fac1a-1b95-413e-a99f-a2cb5feae599', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:15:20.441263 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:15:20.441670 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:15:20.442019 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599', 'iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '331fac1a-1b95-413e-a99f-a2cb5feae599', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:15:20.442182 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:15:20.466782 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:15:20.466782 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:15:20.466782 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:15:20.466782 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:15:20.466782 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:15:20.466782 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:15:20.466782 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:15:20.466975 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:15:20.466975 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:15:20.466975 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:15:20.466975 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:15:20.466975 np0000001577 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:15:20.466975 np0000001577 nova-compute[98319]: tcp: [199] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599 (non-flash)
May 28 01:15:20.466975 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:15:20.467103 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', '185'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', '186'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599', '198'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599', '199')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:15:20.467159 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599', '199')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:15:20.468193 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599', '198')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:15:20.468947 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c98704d8e00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599'): ({'sdb'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:15:20.469181 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:15:20.469458 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Flush multipath device 3300000005a861081 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:15:20.519034 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:15:20.562290 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:15:20.614458 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:15:20.614458 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:15:20.615566 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:15:20.625723 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:15:20.625936 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:15:20.639140 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:20.671652 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 199, target: iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599, portal: 192.168.40.100,3260]
May 28 01:15:20.671652 np0000001577 nova-compute[98319]: Logout of [sid: 199, target: iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599, portal: 192.168.40.100,3260] successful.
May 28 01:15:20.671652 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:20.684028 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:20.695082 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:20.723355 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 198, target: iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599, portal: 192.168.50.100,3260]
May 28 01:15:20.723355 np0000001577 nova-compute[98319]: Logout of [sid: 198, target: iqn.2023-03.storpool.com:os--volume-331fac1a-1b95-413e-a99f-a2cb5feae599, portal: 192.168.50.100,3260] successful.
May 28 01:15:20.723355 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:20.736964 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:20.737180 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:15:20.737378 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] <== disconnect_volume: return (295ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:15:20.737495 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:15:20.737763 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Deleting instance files /opt/stack/data/nova/instances/622fc3c0-e8bc-408d-89da-ce248c8c007a_del
May 28 01:15:20.738241 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Deletion of /opt/stack/data/nova/instances/622fc3c0-e8bc-408d-89da-ce248c8c007a_del complete
May 28 01:15:21.240111 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:21.244523 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Took 1.66 seconds to destroy the instance on the hypervisor.
May 28 01:15:21.245225 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:15:21.245489 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:15:21.245648 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:15:21.245897 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:15:21.316933 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:15:21.507797 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:21.648903 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:21.719292 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7e63100e-b3ea-4cc7-b801-39e63470e291 req-a73c1be9-69d4-4288-8021-8ce3baea528c service nova] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Received event network-vif-deleted-428fb87f-367e-4210-8601-37acf6b0e21b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:15:21.719742 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-7e63100e-b3ea-4cc7-b801-39e63470e291 req-a73c1be9-69d4-4288-8021-8ce3baea528c service nova] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Neutron deleted interface 428fb87f-367e-4210-8601-37acf6b0e21b; detaching it from the instance and deleting it from the info cache
May 28 01:15:21.722246 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7e63100e-b3ea-4cc7-b801-39e63470e291 req-a73c1be9-69d4-4288-8021-8ce3baea528c service nova] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Detach interface failed, port_id=428fb87f-367e-4210-8601-37acf6b0e21b, reason: Instance 622fc3c0-e8bc-408d-89da-ce248c8c007a could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:15:22.170280 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:15:22.603856 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-846bfa9e-e8f9-4f64-94ea-3e2e45da410f req-22722708-e46e-4c1f-9d63-4e2593737438 service nova] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Received event network-vif-plugged-cbc69d0b-efff-4170-bc4e-729f9a9f52c2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:15:22.604267 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-846bfa9e-e8f9-4f64-94ea-3e2e45da410f req-22722708-e46e-4c1f-9d63-4e2593737438 service nova] Acquiring lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:22.604437 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-846bfa9e-e8f9-4f64-94ea-3e2e45da410f req-22722708-e46e-4c1f-9d63-4e2593737438 service nova] Lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:22.604612 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-846bfa9e-e8f9-4f64-94ea-3e2e45da410f req-22722708-e46e-4c1f-9d63-4e2593737438 service nova] Lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:22.604873 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-846bfa9e-e8f9-4f64-94ea-3e2e45da410f req-22722708-e46e-4c1f-9d63-4e2593737438 service nova] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Processing event network-vif-plugged-cbc69d0b-efff-4170-bc4e-729f9a9f52c2 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:15:22.605268 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:15:22.608121 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930922.6079183, 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:15:22.608263 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] VM Resumed (Lifecycle Event)
May 28 01:15:22.609314 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:15:22.612114 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Instance spawned successfully.
May 28 01:15:22.612912 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:15:22.671727 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Took 1.43 seconds to deallocate network for instance.
May 28 01:15:23.110617 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:15:23.112838 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:15:23.126295 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:15:23.126432 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:15:23.126787 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:15:23.127029 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:15:23.127289 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:15:23.127584 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:15:23.218776 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Took 0.54 seconds to detach 1 volumes for instance.
May 28 01:15:23.614827 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:15:23.632837 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Took 10.46 seconds to spawn the instance on the hypervisor.
May 28 01:15:23.633048 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:15:23.724745 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:23.724891 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:23.916636 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:15:23.917005 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:15:24.140680 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Took 15.80 seconds to build instance.
May 28 01:15:24.422044 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:15:24.642024 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.307s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:24.668408 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6790646c-b415-4192-92b8-aa60b3bac69c req-6fa64d7d-d895-4cba-b157-088409dcfb85 service nova] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Received event network-vif-plugged-cbc69d0b-efff-4170-bc4e-729f9a9f52c2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:15:24.668613 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6790646c-b415-4192-92b8-aa60b3bac69c req-6fa64d7d-d895-4cba-b157-088409dcfb85 service nova] Acquiring lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:24.668809 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6790646c-b415-4192-92b8-aa60b3bac69c req-6fa64d7d-d895-4cba-b157-088409dcfb85 service nova] Lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:24.668971 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6790646c-b415-4192-92b8-aa60b3bac69c req-6fa64d7d-d895-4cba-b157-088409dcfb85 service nova] Lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:24.669087 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6790646c-b415-4192-92b8-aa60b3bac69c req-6fa64d7d-d895-4cba-b157-088409dcfb85 service nova] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] No waiting events found dispatching network-vif-plugged-cbc69d0b-efff-4170-bc4e-729f9a9f52c2 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:15:24.669244 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-6790646c-b415-4192-92b8-aa60b3bac69c req-6fa64d7d-d895-4cba-b157-088409dcfb85 service nova] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Received unexpected event network-vif-plugged-cbc69d0b-efff-4170-bc4e-729f9a9f52c2 for instance with vm_state active and task_state None.
May 28 01:15:24.928054 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.203s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:24.973264 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Deleted allocations for instance 622fc3c0-e8bc-408d-89da-ce248c8c007a
May 28 01:15:25.436996 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:25.888759 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Acquiring lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:25.889224 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:25.981062 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e78a7a7f-2ba0-4b20-b8a0-934a0e53d5c8 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "622fc3c0-e8bc-408d-89da-ce248c8c007a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.904s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:26.390885 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:15:26.650299 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:26.723179 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0f81c2fd-80ac-4767-877f-24dee8f087d7 req-9e48156a-899a-46fb-9e4b-34e33ea279d0 service nova] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Received event network-changed-cbc69d0b-efff-4170-bc4e-729f9a9f52c2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:15:26.723923 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0f81c2fd-80ac-4767-877f-24dee8f087d7 req-9e48156a-899a-46fb-9e4b-34e33ea279d0 service nova] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Refreshing instance network info cache due to event network-changed-cbc69d0b-efff-4170-bc4e-729f9a9f52c2. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:15:26.723923 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0f81c2fd-80ac-4767-877f-24dee8f087d7 req-9e48156a-899a-46fb-9e4b-34e33ea279d0 service nova] Acquiring lock "refresh_cache-9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:15:26.723923 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0f81c2fd-80ac-4767-877f-24dee8f087d7 req-9e48156a-899a-46fb-9e4b-34e33ea279d0 service nova] Acquired lock "refresh_cache-9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:15:26.724061 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-0f81c2fd-80ac-4767-877f-24dee8f087d7 req-9e48156a-899a-46fb-9e4b-34e33ea279d0 service nova] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Refreshing network info cache for port cbc69d0b-efff-4170-bc4e-729f9a9f52c2 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:15:26.941410 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:26.941732 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:26.944606 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:15:26.944821 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Claim successful on node np0000001577
May 28 01:15:27.154923 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:15:27.225953 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-0f81c2fd-80ac-4767-877f-24dee8f087d7 req-9e48156a-899a-46fb-9e4b-34e33ea279d0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:15:27.477837 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-0f81c2fd-80ac-4767-877f-24dee8f087d7 req-9e48156a-899a-46fb-9e4b-34e33ea279d0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:15:27.598057 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-0f81c2fd-80ac-4767-877f-24dee8f087d7 req-9e48156a-899a-46fb-9e4b-34e33ea279d0 service nova] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Updated VIF entry in instance network info cache for port cbc69d0b-efff-4170-bc4e-729f9a9f52c2. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:15:27.598285 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-0f81c2fd-80ac-4767-877f-24dee8f087d7 req-9e48156a-899a-46fb-9e4b-34e33ea279d0 service nova] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Updating instance_info_cache with network_info: [{"id": "cbc69d0b-efff-4170-bc4e-729f9a9f52c2", "address": "fa:16:3e:a5:aa:b2", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc69d0b-ef", "ovs_interfaceid": "cbc69d0b-efff-4170-bc4e-729f9a9f52c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:15:27.658873 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] While synchronizing instance power states, found 4 instances in the database and 3 instances on the hypervisor.
May 28 01:15:27.659014 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Triggering sync for uuid 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef {{(pid=98319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 01:15:27.659192 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Triggering sync for uuid 14694771-0e2d-420f-8b96-7bd28ffcf4c2 {{(pid=98319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 01:15:27.659340 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Triggering sync for uuid 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea {{(pid=98319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 01:15:27.659474 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Triggering sync for uuid b15ccc22-6ebc-41b2-9286-c27746bb96d3 {{(pid=98319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 01:15:27.660296 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "87f7f5aa-3bd9-49d0-9f75-50f768acb6ef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:27.661513 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "14694771-0e2d-420f-8b96-7bd28ffcf4c2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:27.661891 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:27.662060 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:27.662222 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 18.82 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:15:27.662387 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "87f7f5aa-3bd9-49d0-9f75-50f768acb6ef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:27.662600 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "14694771-0e2d-420f-8b96-7bd28ffcf4c2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:27.662793 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:28.099978 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0f81c2fd-80ac-4767-877f-24dee8f087d7 req-9e48156a-899a-46fb-9e4b-34e33ea279d0 service nova] Releasing lock "refresh_cache-9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:15:28.148663 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:15:28.148927 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:15:28.173837 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "87f7f5aa-3bd9-49d0-9f75-50f768acb6ef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.512s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:28.181601 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.519s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:28.182136 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "14694771-0e2d-420f-8b96-7bd28ffcf4c2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.520s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:28.653158 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:15:29.011075 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "14694771-0e2d-420f-8b96-7bd28ffcf4c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:29.011251 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "14694771-0e2d-420f-8b96-7bd28ffcf4c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:29.011422 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "14694771-0e2d-420f-8b96-7bd28ffcf4c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:29.011598 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "14694771-0e2d-420f-8b96-7bd28ffcf4c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:29.011738 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "14694771-0e2d-420f-8b96-7bd28ffcf4c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:29.014983 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Terminating instance
May 28 01:15:29.159438 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.218s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:29.159941 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:15:29.518191 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:15:29.534898 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:29.536368 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:29.558888 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:29.661807 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8044404d-6ba3-4cc2-8c87-dbb1f3c0199a req-a7dc8a0c-4212-45ca-b9b7-3a691989f2fb service nova] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Received event network-vif-unplugged-26c13825-b801-4d7c-ad2d-62db205cea2d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:15:29.661807 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8044404d-6ba3-4cc2-8c87-dbb1f3c0199a req-a7dc8a0c-4212-45ca-b9b7-3a691989f2fb service nova] Acquiring lock "14694771-0e2d-420f-8b96-7bd28ffcf4c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:29.661807 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8044404d-6ba3-4cc2-8c87-dbb1f3c0199a req-a7dc8a0c-4212-45ca-b9b7-3a691989f2fb service nova] Lock "14694771-0e2d-420f-8b96-7bd28ffcf4c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:29.661807 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8044404d-6ba3-4cc2-8c87-dbb1f3c0199a req-a7dc8a0c-4212-45ca-b9b7-3a691989f2fb service nova] Lock "14694771-0e2d-420f-8b96-7bd28ffcf4c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:29.661807 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8044404d-6ba3-4cc2-8c87-dbb1f3c0199a req-a7dc8a0c-4212-45ca-b9b7-3a691989f2fb service nova] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] No waiting events found dispatching network-vif-unplugged-26c13825-b801-4d7c-ad2d-62db205cea2d {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:15:29.661807 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8044404d-6ba3-4cc2-8c87-dbb1f3c0199a req-a7dc8a0c-4212-45ca-b9b7-3a691989f2fb service nova] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Received event network-vif-unplugged-26c13825-b801-4d7c-ad2d-62db205cea2d for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:15:29.663717 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:15:29.663873 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:15:29.664106 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:15:29.664355 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:15:29.689917 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:29.695455 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:29.777321 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d3446829bb647b5b3804054d4165b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b690857a47340a499184f882e99f512', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:15:29.846633 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999681447000057 future=<Future at 0x7c984c345d90 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:15:29.848763 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Instance destroyed successfully.
May 28 01:15:29.849326 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lazy-loading 'resources' on Instance uuid 14694771-0e2d-420f-8b96-7bd28ffcf4c2 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:15:30.167513 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:15:30.201959 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Successfully created port: 3b980408-16a1-4501-bc77-b75f3ce2f7d6 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:15:30.351952 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:12:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-450528518',display_name='tempest-TestVolumeBootPatternV346-server-450528518',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpatternv346-server-450528518',id=72,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVWY4QoBnaZDYOWaArJ/7QlZgas19ONKFmLBsMYnYVbIzysBHI36jsC/mhPh5mksxpK90KxpnHzrQ+Wzjpk7QaghElQPXWAxvS1jJK+U849tPzycoi0imxOiGvSEHAJHA==',key_name='tempest-keypair-1322410097',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:13:39Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1880a27e1ad0432f914e086d7fffdeb4',ramdisk_id='',reservation_id='r-s0c5roth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-1741753090',owner_user_name='tempest-TestVolumeBootPatternV346-1741753090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:13:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae6c3c6a50b24a58af140f523fb73374',uuid=14694771-0e2d-420f-8b96-7bd28ffcf4c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26c13825-b801-4d7c-ad2d-62db205cea2d", "address": "fa:16:3e:04:7d:17", "network": {"id": "0be6df83-bfa0-4c90-aed3-88212317cb4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-252451076-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1880a27e1ad0432f914e086d7fffdeb4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c13825-b8", "ovs_interfaceid": "26c13825-b801-4d7c-ad2d-62db205cea2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:15:30.352092 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Converting VIF {"id": "26c13825-b801-4d7c-ad2d-62db205cea2d", "address": "fa:16:3e:04:7d:17", "network": {"id": "0be6df83-bfa0-4c90-aed3-88212317cb4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-252451076-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1880a27e1ad0432f914e086d7fffdeb4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c13825-b8", "ovs_interfaceid": "26c13825-b801-4d7c-ad2d-62db205cea2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:15:30.352681 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:7d:17,bridge_name='br-int',has_traffic_filtering=True,id=26c13825-b801-4d7c-ad2d-62db205cea2d,network=Network(0be6df83-bfa0-4c90-aed3-88212317cb4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c13825-b8') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:15:30.352857 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:7d:17,bridge_name='br-int',has_traffic_filtering=True,id=26c13825-b801-4d7c-ad2d-62db205cea2d,network=Network(0be6df83-bfa0-4c90-aed3-88212317cb4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c13825-b8') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:15:30.353750 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:30.353942 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26c13825-b8, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:15:30.354824 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:30.355734 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:15:30.355882 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:30.356560 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:30.356698 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b6a3cb98-48c1-4d31-ab62-adc8a483eb18) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:15:30.357086 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:30.357677 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:15:30.357818 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:30.359852 np0000001577 nova-compute[98319]: INFO os_vif [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:7d:17,bridge_name='br-int',has_traffic_filtering=True,id=26c13825-b801-4d7c-ad2d-62db205cea2d,network=Network(0be6df83-bfa0-4c90-aed3-88212317cb4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c13825-b8')
May 28 01:15:30.361266 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:15:30.361516 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:15:30.361641 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:15:30.361964 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:15:30.362246 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:15:30.362377 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:15:30.388802 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:15:30.388802 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:15:30.388802 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:15:30.388802 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:15:30.388802 np0000001577 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38 (non-flash)
May 28 01:15:30.388802 np0000001577 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38 (non-flash)
May 28 01:15:30.388802 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:15:30.388981 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:15:30.388981 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:15:30.388981 np0000001577 nova-compute[98319]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:15:30.388981 np0000001577 nova-compute[98319]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e (non-flash)
May 28 01:15:30.388981 np0000001577 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38 (non-flash)
May 28 01:15:30.388981 np0000001577 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38 (non-flash)
May 28 01:15:30.388981 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:15:30.389117 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', '185'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38', '209'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38', '210')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:15:30.389117 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', '185')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:15:30.389888 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e', '186')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:15:30.390528 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c984c43ef20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e'): ({'sde'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:15:30.390712 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Removing multipathed devices sde, sdd {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:15:30.390903 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Flush multipath device 330000000807c0322 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:15:30.396037 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:30.444716 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:15:30.494221 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:15:30.547861 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:15:30.548000 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:15:30.548893 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:15:30.559060 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:15:30.559230 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:15:30.571392 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:30.604638 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 185, target: iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e, portal: 192.168.40.100,3260]
May 28 01:15:30.604638 np0000001577 nova-compute[98319]: Logout of [sid: 185, target: iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e, portal: 192.168.40.100,3260] successful.
May 28 01:15:30.604638 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:30.616411 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Successfully updated port: 3b980408-16a1-4501-bc77-b75f3ce2f7d6 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:15:30.618672 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:30.630780 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:30.654386 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 186, target: iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e, portal: 192.168.50.100,3260]
May 28 01:15:30.654386 np0000001577 nova-compute[98319]: Logout of [sid: 186, target: iqn.2023-03.storpool.com:os--volume-9a753a23-1f81-48d4-8c7a-9eada0c1cc1e, portal: 192.168.50.100,3260] successful.
May 28 01:15:30.654386 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:30.665039 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-63010ce0-7828-4ebb-800e-72415c975614 req-641f07ab-ad05-416b-80bc-5302eca5b31c service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Received event network-changed-3b980408-16a1-4501-bc77-b75f3ce2f7d6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:15:30.665709 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-63010ce0-7828-4ebb-800e-72415c975614 req-641f07ab-ad05-416b-80bc-5302eca5b31c service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Refreshing instance network info cache due to event network-changed-3b980408-16a1-4501-bc77-b75f3ce2f7d6. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:15:30.666108 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-63010ce0-7828-4ebb-800e-72415c975614 req-641f07ab-ad05-416b-80bc-5302eca5b31c service nova] Acquiring lock "refresh_cache-b15ccc22-6ebc-41b2-9286-c27746bb96d3" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:15:30.666210 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-63010ce0-7828-4ebb-800e-72415c975614 req-641f07ab-ad05-416b-80bc-5302eca5b31c service nova] Acquired lock "refresh_cache-b15ccc22-6ebc-41b2-9286-c27746bb96d3" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:15:30.666312 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-63010ce0-7828-4ebb-800e-72415c975614 req-641f07ab-ad05-416b-80bc-5302eca5b31c service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Refreshing network info cache for port 3b980408-16a1-4501-bc77-b75f3ce2f7d6 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:15:30.667913 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:30.668123 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:15:30.668265 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] <== disconnect_volume: return (306ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:15:30.668375 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:15:30.668776 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Deleting instance files /opt/stack/data/nova/instances/14694771-0e2d-420f-8b96-7bd28ffcf4c2_del
May 28 01:15:30.669482 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Deletion of /opt/stack/data/nova/instances/14694771-0e2d-420f-8b96-7bd28ffcf4c2_del complete
May 28 01:15:30.671374 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:15:31.120880 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Acquiring lock "refresh_cache-b15ccc22-6ebc-41b2-9286-c27746bb96d3" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:15:31.169438 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-63010ce0-7828-4ebb-800e-72415c975614 req-641f07ab-ad05-416b-80bc-5302eca5b31c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:15:31.181580 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Booting with volume 74e6ec11-d458-4a8a-945e-6df6bbf96723 at /dev/vda
May 28 01:15:31.182997 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Took 1.66 seconds to destroy the instance on the hypervisor.
May 28 01:15:31.183469 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:15:31.183909 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:15:31.183981 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:15:31.184126 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:15:31.225260 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:15:31.235982 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:15:31.244949 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-63010ce0-7828-4ebb-800e-72415c975614 req-641f07ab-ad05-416b-80bc-5302eca5b31c service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:15:31.251162 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:15:31.257419 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:15:31.306567 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:15:31.306567 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:15:31.320001 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:15:31.320001 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:feb6:e662', 'fe80::1cf4:68ff:fe80:cb5', 'fe80::fc16:3eff:fea5:aab2', 'fe80::c813:dcff:fe9e:6381'] 
May 28 01:15:31.320001 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:15:31.320001 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:15:31.320001 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] <== get_connector_properties: return (94ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:15:31.320793 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Updating existing volume attachment record: 5046c60e-c839-48a9-a106-b95e6de4cf2c {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:15:31.397045 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-63010ce0-7828-4ebb-800e-72415c975614 req-641f07ab-ad05-416b-80bc-5302eca5b31c service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:15:31.651811 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:31.697310 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-40b5dc52-8735-444d-9814-a996fe1bcb58 req-bd9cac63-c956-4355-a013-3a50f996b67a service nova] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Received event network-vif-deleted-26c13825-b801-4d7c-ad2d-62db205cea2d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:15:31.697310 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-40b5dc52-8735-444d-9814-a996fe1bcb58 req-bd9cac63-c956-4355-a013-3a50f996b67a service nova] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Neutron deleted interface 26c13825-b801-4d7c-ad2d-62db205cea2d; detaching it from the instance and deleting it from the info cache
May 28 01:15:31.700739 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-40b5dc52-8735-444d-9814-a996fe1bcb58 req-bd9cac63-c956-4355-a013-3a50f996b67a service nova] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Detach interface failed, port_id=26c13825-b801-4d7c-ad2d-62db205cea2d, reason: Instance 14694771-0e2d-420f-8b96-7bd28ffcf4c2 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:15:31.721341 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6a996bcf-3d5a-4fce-9e53-37e3cc743d9e req-6dc16d4f-06e6-4b2d-8b00-1236d00ec88c service nova] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Received event network-vif-unplugged-26c13825-b801-4d7c-ad2d-62db205cea2d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:15:31.722379 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6a996bcf-3d5a-4fce-9e53-37e3cc743d9e req-6dc16d4f-06e6-4b2d-8b00-1236d00ec88c service nova] Acquiring lock "14694771-0e2d-420f-8b96-7bd28ffcf4c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:31.722592 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6a996bcf-3d5a-4fce-9e53-37e3cc743d9e req-6dc16d4f-06e6-4b2d-8b00-1236d00ec88c service nova] Lock "14694771-0e2d-420f-8b96-7bd28ffcf4c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:31.723069 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6a996bcf-3d5a-4fce-9e53-37e3cc743d9e req-6dc16d4f-06e6-4b2d-8b00-1236d00ec88c service nova] Lock "14694771-0e2d-420f-8b96-7bd28ffcf4c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:31.723245 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6a996bcf-3d5a-4fce-9e53-37e3cc743d9e req-6dc16d4f-06e6-4b2d-8b00-1236d00ec88c service nova] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] No waiting events found dispatching network-vif-unplugged-26c13825-b801-4d7c-ad2d-62db205cea2d {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:15:31.723401 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6a996bcf-3d5a-4fce-9e53-37e3cc743d9e req-6dc16d4f-06e6-4b2d-8b00-1236d00ec88c service nova] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Received event network-vif-unplugged-26c13825-b801-4d7c-ad2d-62db205cea2d for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:15:31.899133 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-63010ce0-7828-4ebb-800e-72415c975614 req-641f07ab-ad05-416b-80bc-5302eca5b31c service nova] Releasing lock "refresh_cache-b15ccc22-6ebc-41b2-9286-c27746bb96d3" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:15:31.899658 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Acquired lock "refresh_cache-b15ccc22-6ebc-41b2-9286-c27746bb96d3" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:15:31.899847 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:15:32.153762 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:15:32.463490 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:15:32.608878 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:15:32.657043 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Took 1.47 seconds to deallocate network for instance.
May 28 01:15:32.751169 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Updating instance_info_cache with network_info: [{"id": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "address": "fa:16:3e:03:f9:bf", "network": {"id": "744273d0-4bd0-4935-9d5a-ba0baf747156", "bridge": "br-int", "label": "tempest-TestShelveInstance-1169067650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b690857a47340a499184f882e99f512", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b980408-16", "ovs_interfaceid": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:15:33.211699 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Took 0.55 seconds to detach 1 volumes for instance.
May 28 01:15:33.253012 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Releasing lock "refresh_cache-b15ccc22-6ebc-41b2-9286-c27746bb96d3" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:15:33.253352 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Instance network_info: |[{"id": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "address": "fa:16:3e:03:f9:bf", "network": {"id": "744273d0-4bd0-4935-9d5a-ba0baf747156", "bridge": "br-int", "label": "tempest-TestShelveInstance-1169067650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b690857a47340a499184f882e99f512", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b980408-16", "ovs_interfaceid": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:15:33.430566 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:15:33.430916 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:15:33.431213 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Creating image(s)
May 28 01:15:33.433978 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:15:33.433978 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Ensure instance console log exists: /opt/stack/data/nova/instances/b15ccc22-6ebc-41b2-9286-c27746bb96d3/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:15:33.433978 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:33.433978 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:33.433978 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:33.433978 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Start _get_guest_xml network_info=[{"id": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "address": "fa:16:3e:03:f9:bf", "network": {"id": "744273d0-4bd0-4935-9d5a-ba0baf747156", "bridge": "br-int", "label": "tempest-TestShelveInstance-1169067650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b690857a47340a499184f882e99f512", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b980408-16", "ovs_interfaceid": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74e6ec11-d458-4a8a-945e-6df6bbf96723', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'b15ccc22-6ebc-41b2-9286-c27746bb96d3', 'attached_at': '', 'detached_at': '', 'volume_id': '74e6ec11-d458-4a8a-945e-6df6bbf96723', 'serial': '74e6ec11-d458-4a8a-945e-6df6bbf96723'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '5046c60e-c839-48a9-a106-b95e6de4cf2c', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:15:33.436125 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:15:33.438235 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-1162676334', uuid='b15ccc22-6ebc-41b2-9286-c27746bb96d3'), owner=OwnerMeta(userid='4d3446829bb647b5b3804054d4165b48', username='tempest-TestShelveInstance-494253474-project-member', projectid='1b690857a47340a499184f882e99f512', projectname='tempest-TestShelveInstance-494253474'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "address": "fa:16:3e:03:f9:bf", "network": {"id": "744273d0-4bd0-4935-9d5a-ba0baf747156", "bridge": "br-int", "label": "tempest-TestShelveInstance-1169067650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b690857a47340a499184f882e99f512", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b980408-16", "ovs_interfaceid": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930933.4368768) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:15:33.438343 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:15:33.440205 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:15:33.441413 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:15:33.441592 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:15:33.442949 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:15:33.443211 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:15:33.443344 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:15:33.443436 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:15:33.443561 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:15:33.448519 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:15:33.448519 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:15:33.448519 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:15:33.448519 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:15:33.448519 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:15:33.448519 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:15:33.448519 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:15:33.457127 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:15:33.458311 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74e6ec11-d458-4a8a-945e-6df6bbf96723', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:15:33.458524 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:15:33.458890 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:15:33.459069 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74e6ec11-d458-4a8a-945e-6df6bbf96723', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:15:33.470760 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:15:33.471503 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:15:33.471998 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:15:33.472188 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:15:33.472446 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:15:33.472594 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:15:33.482787 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:15:33.482787 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:33.486844 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:15:33.486844 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:33.493830 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723] added
May 28 01:15:33.493830 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:15:33.493830 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:15:33.493830 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:15:33.493830 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:15:33.493830 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:15:33.493830 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:33.493830 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:15:33.493830 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0215(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:15:33.493830 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:15:33.498692 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723] added
May 28 01:15:33.498692 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:15:33.498692 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:15:33.498692 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:15:33.498692 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:15:33.498692 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:15:33.498692 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:33.498864 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:15:33.498992 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0264(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:15:33.499113 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:15:33.720730 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:33.720879 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:33.939664 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:15:33.939871 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:15:34.444902 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:15:34.494310 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:15:34.499710 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:15:34.509819 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:15:34.509819 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:34.512408 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "837b05a1-9183-4817-88e3-0b21030df297" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:34.512408 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "837b05a1-9183-4817-88e3-0b21030df297" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:15:34.513951 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:15:34.513951 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:34.525727 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:34.530677 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:34.543713 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:15:34.543713 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:15:34.543713 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:15:34.543845 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:15:34.543845 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:15:34.543845 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:15:34.544451 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:15:34.544451 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:15:34.544451 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:15:34.544603 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:15:34.544603 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:15:34.544603 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:15:34.580754 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723, portal: 192.168.40.100,3260]
May 28 01:15:34.580754 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723, portal: 192.168.40.100,3260] successful.
May 28 01:15:34.580754 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:34.589734 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723, portal: 192.168.50.100,3260]
May 28 01:15:34.589734 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723, portal: 192.168.50.100,3260] successful.
May 28 01:15:34.589734 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:34.590119 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:34.599746 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:34.604147 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:15:34.604147 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:15:34.604147 np0000001577 nova-compute[98319]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:15:34.604147 np0000001577 nova-compute[98319]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:15:34.604147 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:15:34.604301 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:15:34.604301 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:15:34.604301 np0000001577 nova-compute[98319]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:15:34.604301 np0000001577 nova-compute[98319]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:15:34.604301 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:15:34.604528 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.133s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:15:34.604706 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:15:34.605262 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] HCTL ('7', '-', '-', 0) found on session 211 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:15:34.605366 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:15:34.612805 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:15:34.612805 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:15:34.612805 np0000001577 nova-compute[98319]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:15:34.612805 np0000001577 nova-compute[98319]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:15:34.612805 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:15:34.612936 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:15:34.612936 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:15:34.612936 np0000001577 nova-compute[98319]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:15:34.612936 np0000001577 nova-compute[98319]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:15:34.612936 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:15:34.613105 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.141s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:15:34.613229 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:15:34.613756 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] HCTL ('8', '-', '-', 0) found on session 212 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:15:34.613939 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:15:34.622978 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Searching for a device in session 211 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:15:34.622978 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74e6ec11-d458-4a8a-945e-6df6bbf96723', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:15:34.630357 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Searching for a device in session 212 and hctl ['8', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:15:34.954529 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.233s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:34.997320 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Deleted allocations for instance 14694771-0e2d-420f-8b96-7bd28ffcf4c2
May 28 01:15:35.012650 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:15:35.238209 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00040061800018520444 future=<Future at 0x7c98704d1970 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:15:35.238496 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Emitting event <LifecycleEvent: 1779930920.2376766, 622fc3c0-e8bc-408d-89da-ce248c8c007a => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:15:35.238642 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:15:35.238805 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] VM Stopped (Lifecycle Event)
May 28 01:15:35.239355 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=9.606917704999887 future=<Future at 0x7c984c345d90 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:15:35.239448 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=9.606811357999959 future=<Future at 0x7c984c345d90 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:15:35.358359 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:35.558085 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:35.558519 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:35.561323 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:15:35.561495 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Claim successful on node np0000001577
May 28 01:15:35.628795 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Searching for a device in session 212 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:15:35.628795 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '74e6ec11-d458-4a8a-945e-6df6bbf96723', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:15:35.741809 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: 622fc3c0-e8bc-408d-89da-ce248c8c007a] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:15:36.005661 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7de4b531-228e-4107-9a9c-4038af9f482e tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "14694771-0e2d-420f-8b96-7bd28ffcf4c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.994s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:36.488957 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Found WWN 33000000001ba69e7 for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:15:36.489246 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:15:36.489387 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '33000000001ba69e7', 'path': '/dev/dm-1', 'multipath_id': '33000000001ba69e7'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:15:36.489495 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000001ba69e7', 'path': '/dev/dm-1', 'multipath_id': '33000000001ba69e7'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:15:36.652989 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:36.786643 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:15:36.787010 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:15:36.994208 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:15:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1162676334',display_name='tempest-TestShelveInstance-server-1162676334',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testshelveinstance-server-1162676334',id=79,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVpI2uzi24NoZNbmLSXu2Y/H4h1zt3NoNcvqtQ2vN6XlrdimuogcTR9gt1SZsa5ptn+SJXyDYkR0bQ+nO5832l7Fp+UxuDvYra777gCIo06w3X0wQCyK8EslVzerIaC0Q==',key_name='tempest-TestShelveInstance-1793766569',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b690857a47340a499184f882e99f512',ramdisk_id='',reservation_id='r-pnwgtwr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-494253474',owner_user_name='tempest-TestShelveInstance-494253474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:15:31Z,user_data=None,user_id='4d3446829bb647b5b3804054d4165b48',uuid=b15ccc22-6ebc-41b2-9286-c27746bb96d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "address": "fa:16:3e:03:f9:bf", "network": {"id": "744273d0-4bd0-4935-9d5a-ba0baf747156", "bridge": "br-int", "label": "tempest-TestShelveInstance-1169067650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b690857a47340a499184f882e99f512", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b980408-16", "ovs_interfaceid": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:15:36.994384 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Converting VIF {"id": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "address": "fa:16:3e:03:f9:bf", "network": {"id": "744273d0-4bd0-4935-9d5a-ba0baf747156", "bridge": "br-int", "label": "tempest-TestShelveInstance-1169067650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b690857a47340a499184f882e99f512", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b980408-16", "ovs_interfaceid": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:15:36.995026 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:f9:bf,bridge_name='br-int',has_traffic_filtering=True,id=3b980408-16a1-4501-bc77-b75f3ce2f7d6,network=Network(744273d0-4bd0-4935-9d5a-ba0baf747156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b980408-16') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:15:36.995614 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lazy-loading 'pci_devices' on Instance uuid b15ccc22-6ebc-41b2-9286-c27746bb96d3 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:15:37.289428 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:15:37.498609 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] End _get_guest_xml xml=<domain type="qemu">
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:   <uuid>b15ccc22-6ebc-41b2-9286-c27746bb96d3</uuid>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:   <name>instance-0000004f</name>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestShelveInstance-server-1162676334</nova:name>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:15:33</nova:creationTime>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       <nova:image uuid="">
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:         <nova:user uuid="4d3446829bb647b5b3804054d4165b48">tempest-TestShelveInstance-494253474-project-member</nova:user>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:         <nova:project uuid="1b690857a47340a499184f882e99f512">tempest-TestShelveInstance-494253474</nova:project>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:         <nova:port uuid="3b980408-16a1-4501-bc77-b75f3ce2f7d6">
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:     <system>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       <entry name="serial">b15ccc22-6ebc-41b2-9286-c27746bb96d3</entry>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       <entry name="uuid">b15ccc22-6ebc-41b2-9286-c27746bb96d3</entry>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:     </system>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:   <os>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:   </os>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:   <features>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:   </features>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:   <devices>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/b15ccc22-6ebc-41b2-9286-c27746bb96d3/disk.config"/>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:     </disk>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       <alias name="ua-74e6ec11-d458-4a8a-945e-6df6bbf96723"/>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-1"/>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       <serial>74e6ec11-d458-4a8a-945e-6df6bbf96723</serial>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:     </disk>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:03:f9:bf"/>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       <target dev="tap3b980408-16"/>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:     </interface>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/b15ccc22-6ebc-41b2-9286-c27746bb96d3/console.log" append="off"/>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:     </serial>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:     <video>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:     </video>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:     </rng>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:   </devices>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]: </domain>
May 28 01:15:37.498609 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:15:37.500462 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Preparing to wait for external event network-vif-plugged-3b980408-16a1-4501-bc77-b75f3ce2f7d6 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:15:37.500462 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Acquiring lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:37.500462 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:37.500462 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:37.500462 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:15:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1162676334',display_name='tempest-TestShelveInstance-server-1162676334',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testshelveinstance-server-1162676334',id=79,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVpI2uzi24NoZNbmLSXu2Y/H4h1zt3NoNcvqtQ2vN6XlrdimuogcTR9gt1SZsa5ptn+SJXyDYkR0bQ+nO5832l7Fp+UxuDvYra777gCIo06w3X0wQCyK8EslVzerIaC0Q==',key_name='tempest-TestShelveInstance-1793766569',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b690857a47340a499184f882e99f512',ramdisk_id='',reservation_id='r-pnwgtwr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-494253474',owner_user_name='tempest-TestShelveInstance-494253474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:15:31Z,user_data=None,user_id='4d3446829bb647b5b3804054d4165b48',uuid=b15ccc22-6ebc-41b2-9286-c27746bb96d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "address": "fa:16:3e:03:f9:bf", "network": {"id": "744273d0-4bd0-4935-9d5a-ba0baf747156", "bridge": "br-int", "label": "tempest-TestShelveInstance-1169067650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b690857a47340a499184f882e99f512", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b980408-16", "ovs_interfaceid": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:15:37.500462 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Converting VIF {"id": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "address": "fa:16:3e:03:f9:bf", "network": {"id": "744273d0-4bd0-4935-9d5a-ba0baf747156", "bridge": "br-int", "label": "tempest-TestShelveInstance-1169067650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b690857a47340a499184f882e99f512", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b980408-16", "ovs_interfaceid": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:15:37.501698 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:f9:bf,bridge_name='br-int',has_traffic_filtering=True,id=3b980408-16a1-4501-bc77-b75f3ce2f7d6,network=Network(744273d0-4bd0-4935-9d5a-ba0baf747156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b980408-16') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:15:37.502180 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:f9:bf,bridge_name='br-int',has_traffic_filtering=True,id=3b980408-16a1-4501-bc77-b75f3ce2f7d6,network=Network(744273d0-4bd0-4935-9d5a-ba0baf747156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b980408-16') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:15:37.502562 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:37.502806 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:15:37.503017 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:15:37.503725 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:37.503851 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6d7007a9-0a01-51f1-9620-f4499f9ef3d0', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:15:37.504577 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:37.505124 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:15:37.505398 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:37.507154 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:37.507283 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b980408-16, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:15:37.507537 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b980408-16, col_values=(('qos', UUID('3bbe9281-7210-424c-b994-b12f10500b68')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:15:37.507700 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b980408-16, col_values=(('external_ids', {'iface-id': '3b980408-16a1-4501-bc77-b75f3ce2f7d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:f9:bf', 'vm-uuid': 'b15ccc22-6ebc-41b2-9286-c27746bb96d3'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:15:37.508268 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:37.509278 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:15:37.513226 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:37.513957 np0000001577 nova-compute[98319]: INFO os_vif [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:f9:bf,bridge_name='br-int',has_traffic_filtering=True,id=3b980408-16a1-4501-bc77-b75f3ce2f7d6,network=Network(744273d0-4bd0-4935-9d5a-ba0baf747156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b980408-16')
May 28 01:15:37.795313 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.237s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:37.795744 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:15:38.300596 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:15:38.302235 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:15:38.302235 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:15:38.302235 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:15:38.374653 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '341caf05b1b8426b9c4ed7ed3cad3ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4d85acc2e447481bb45dd2c61c94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:15:38.754433 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Successfully created port: d274eeef-9c1f-4faf-81bf-152145095c9c {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:15:38.803041 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:15:39.027729 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:15:39.027853 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:15:39.027929 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] No VIF found with MAC fa:16:3e:03:f9:bf, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:15:39.028269 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Using config drive
May 28 01:15:39.185252 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Successfully updated port: d274eeef-9c1f-4faf-81bf-152145095c9c {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:15:39.236166 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a8914805-3273-4f1d-8573-6c21284296b6 req-7624ab9c-2bd5-442e-a6d4-e7053e4452eb service nova] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Received event network-changed-d274eeef-9c1f-4faf-81bf-152145095c9c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:15:39.236280 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a8914805-3273-4f1d-8573-6c21284296b6 req-7624ab9c-2bd5-442e-a6d4-e7053e4452eb service nova] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Refreshing instance network info cache due to event network-changed-d274eeef-9c1f-4faf-81bf-152145095c9c. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:15:39.236422 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a8914805-3273-4f1d-8573-6c21284296b6 req-7624ab9c-2bd5-442e-a6d4-e7053e4452eb service nova] Acquiring lock "refresh_cache-837b05a1-9183-4817-88e3-0b21030df297" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:15:39.236505 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a8914805-3273-4f1d-8573-6c21284296b6 req-7624ab9c-2bd5-442e-a6d4-e7053e4452eb service nova] Acquired lock "refresh_cache-837b05a1-9183-4817-88e3-0b21030df297" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:15:39.236623 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-a8914805-3273-4f1d-8573-6c21284296b6 req-7624ab9c-2bd5-442e-a6d4-e7053e4452eb service nova] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Refreshing network info cache for port d274eeef-9c1f-4faf-81bf-152145095c9c {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:15:39.305839 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:15:39.532488 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:15:39.630213 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Creating config drive at /opt/stack/data/nova/instances/b15ccc22-6ebc-41b2-9286-c27746bb96d3/disk.config
May 28 01:15:39.633107 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b15ccc22-6ebc-41b2-9286-c27746bb96d3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpckqinwt1 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:15:39.684726 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b15ccc22-6ebc-41b2-9286-c27746bb96d3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpckqinwt1" returned: 0 in 0.051s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:15:39.687761 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "refresh_cache-837b05a1-9183-4817-88e3-0b21030df297" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:15:39.705101 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "87f7f5aa-3bd9-49d0-9f75-50f768acb6ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:39.705348 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "87f7f5aa-3bd9-49d0-9f75-50f768acb6ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:39.705707 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "87f7f5aa-3bd9-49d0-9f75-50f768acb6ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:39.705881 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "87f7f5aa-3bd9-49d0-9f75-50f768acb6ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:39.706034 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "87f7f5aa-3bd9-49d0-9f75-50f768acb6ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:39.709726 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Terminating instance
May 28 01:15:39.739203 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-a8914805-3273-4f1d-8573-6c21284296b6 req-7624ab9c-2bd5-442e-a6d4-e7053e4452eb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:15:39.792248 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-a8914805-3273-4f1d-8573-6c21284296b6 req-7624ab9c-2bd5-442e-a6d4-e7053e4452eb service nova] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:15:39.919656 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-a8914805-3273-4f1d-8573-6c21284296b6 req-7624ab9c-2bd5-442e-a6d4-e7053e4452eb service nova] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:15:40.076139 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:40.101647 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:40.190317 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:40.213119 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:15:40.232411 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:40.234111 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:40.238807 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c03cc28b-e0e7-4223-aca1-25b6a4591b62 req-69885905-9873-4af9-ae55-2e848d9a47be service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Received event network-vif-plugged-3b980408-16a1-4501-bc77-b75f3ce2f7d6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:15:40.239003 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c03cc28b-e0e7-4223-aca1-25b6a4591b62 req-69885905-9873-4af9-ae55-2e848d9a47be service nova] Acquiring lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:40.239168 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c03cc28b-e0e7-4223-aca1-25b6a4591b62 req-69885905-9873-4af9-ae55-2e848d9a47be service nova] Lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:40.239342 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c03cc28b-e0e7-4223-aca1-25b6a4591b62 req-69885905-9873-4af9-ae55-2e848d9a47be service nova] Lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:40.239524 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c03cc28b-e0e7-4223-aca1-25b6a4591b62 req-69885905-9873-4af9-ae55-2e848d9a47be service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Processing event network-vif-plugged-3b980408-16a1-4501-bc77-b75f3ce2f7d6 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:15:40.255943 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:40.313701 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:15:40.314912 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:15:40.315113 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Creating image(s)
May 28 01:15:40.315791 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "/opt/stack/data/nova/instances/837b05a1-9183-4817-88e3-0b21030df297/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:40.315960 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "/opt/stack/data/nova/instances/837b05a1-9183-4817-88e3-0b21030df297/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:40.316469 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "/opt/stack/data/nova/instances/837b05a1-9183-4817-88e3-0b21030df297/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:40.317224 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:15:40.321253 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:15:40.322510 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:15:40.374034 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-df924d04-3dac-4c01-8080-76f1d04854ad req-c06121fb-ecd4-4fda-be64-8087bb973e10 service nova] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Received event network-vif-unplugged-94194a84-a05a-4791-a8d6-6c15f99969b2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:15:40.374495 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-df924d04-3dac-4c01-8080-76f1d04854ad req-c06121fb-ecd4-4fda-be64-8087bb973e10 service nova] Acquiring lock "87f7f5aa-3bd9-49d0-9f75-50f768acb6ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:40.374704 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-df924d04-3dac-4c01-8080-76f1d04854ad req-c06121fb-ecd4-4fda-be64-8087bb973e10 service nova] Lock "87f7f5aa-3bd9-49d0-9f75-50f768acb6ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:40.374823 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-df924d04-3dac-4c01-8080-76f1d04854ad req-c06121fb-ecd4-4fda-be64-8087bb973e10 service nova] Lock "87f7f5aa-3bd9-49d0-9f75-50f768acb6ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:40.375018 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-df924d04-3dac-4c01-8080-76f1d04854ad req-c06121fb-ecd4-4fda-be64-8087bb973e10 service nova] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] No waiting events found dispatching network-vif-unplugged-94194a84-a05a-4791-a8d6-6c15f99969b2 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:15:40.375142 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-df924d04-3dac-4c01-8080-76f1d04854ad req-c06121fb-ecd4-4fda-be64-8087bb973e10 service nova] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Received event network-vif-unplugged-94194a84-a05a-4791-a8d6-6c15f99969b2 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:15:40.394034 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:40.400769 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:40.417536 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.095s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:15:40.417856 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:40.418239 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:40.418637 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:15:40.421682 np0000001577 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 01:15:40.421984 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:15:40.422618 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a8914805-3273-4f1d-8573-6c21284296b6 req-7624ab9c-2bd5-442e-a6d4-e7053e4452eb service nova] Releasing lock "refresh_cache-837b05a1-9183-4817-88e3-0b21030df297" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:15:40.423073 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquired lock "refresh_cache-837b05a1-9183-4817-88e3-0b21030df297" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:15:40.443024 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:15:40.452221 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:40.514463 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:15:40.514632 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/837b05a1-9183-4817-88e3-0b21030df297/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:15:40.514937 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:40.526455 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:40.549120 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999216133999653 future=<Future at 0x7c984c5c8aa0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:15:40.550955 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:40.551719 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:40.554857 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Instance destroyed successfully.
May 28 01:15:40.555462 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lazy-loading 'resources' on Instance uuid 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:15:40.578429 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884,backing_fmt=raw /opt/stack/data/nova/instances/837b05a1-9183-4817-88e3-0b21030df297/disk 1073741824" returned: 0 in 0.063s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:15:40.579565 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "dde848db2c2531c0bcb1216ac271cdc8be5f5884" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.161s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:40.579565 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:15:40.669618 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dde848db2c2531c0bcb1216ac271cdc8be5f5884 --force-share --output=json" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:15:40.670063 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Checking if we can resize image /opt/stack/data/nova/instances/837b05a1-9183-4817-88e3-0b21030df297/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 01:15:40.670348 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/837b05a1-9183-4817-88e3-0b21030df297/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:15:40.756150 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/837b05a1-9183-4817-88e3-0b21030df297/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:15:40.756566 np0000001577 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Cannot resize image /opt/stack/data/nova/instances/837b05a1-9183-4817-88e3-0b21030df297/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 01:15:40.756953 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 01:15:40.757164 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Ensure instance console log exists: /opt/stack/data/nova/instances/837b05a1-9183-4817-88e3-0b21030df297/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:15:40.757535 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:40.757797 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:40.757971 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:40.799674 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930940.7993667, b15ccc22-6ebc-41b2-9286-c27746bb96d3 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:15:40.799869 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] VM Started (Lifecycle Event)
May 28 01:15:40.801665 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:15:40.804647 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:15:40.807305 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Instance spawned successfully.
May 28 01:15:40.807919 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:15:41.010105 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:15:41.059486 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:11:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1852089973',display_name='tempest-TestVolumeBootPatternV346-server-1852089973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testvolumebootpatternv346-server-1852089973',id=70,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOHRqXr+Iun2+cmM/863hQ16YEYy7Cqc2hSgV8etGHo/2KUcUM8wgHvVDKOZNw0kdwDAi4VYwwaPgJtZ7awCi3nnRIcpQW7MhW5XLUpfzc/MQTuH9dKzPx8+AWXq5V8eA==',key_name='tempest-keypair-15751798',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:11:56Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1880a27e1ad0432f914e086d7fffdeb4',ramdisk_id='',reservation_id='r-qubh6hui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-1741753090',owner_user_name='tempest-TestVolumeBootPatternV346-1741753090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:11:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae6c3c6a50b24a58af140f523fb73374',uuid=87f7f5aa-3bd9-49d0-9f75-50f768acb6ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94194a84-a05a-4791-a8d6-6c15f99969b2", "address": "fa:16:3e:b6:e6:62", "network": {"id": "0be6df83-bfa0-4c90-aed3-88212317cb4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-252451076-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1880a27e1ad0432f914e086d7fffdeb4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94194a84-a0", "ovs_interfaceid": "94194a84-a05a-4791-a8d6-6c15f99969b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:15:41.059793 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Converting VIF {"id": "94194a84-a05a-4791-a8d6-6c15f99969b2", "address": "fa:16:3e:b6:e6:62", "network": {"id": "0be6df83-bfa0-4c90-aed3-88212317cb4b", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-252451076-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1880a27e1ad0432f914e086d7fffdeb4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94194a84-a0", "ovs_interfaceid": "94194a84-a05a-4791-a8d6-6c15f99969b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:15:41.060503 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:e6:62,bridge_name='br-int',has_traffic_filtering=True,id=94194a84-a05a-4791-a8d6-6c15f99969b2,network=Network(0be6df83-bfa0-4c90-aed3-88212317cb4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94194a84-a0') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:15:41.060858 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:e6:62,bridge_name='br-int',has_traffic_filtering=True,id=94194a84-a05a-4791-a8d6-6c15f99969b2,network=Network(0be6df83-bfa0-4c90-aed3-88212317cb4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94194a84-a0') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:15:41.062338 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:41.062622 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94194a84-a0, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:15:41.065568 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:15:41.065984 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:41.066097 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4524e2e6-2651-43d9-8a0e-37c3316bf44f) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:15:41.067636 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:15:41.068978 np0000001577 nova-compute[98319]: INFO os_vif [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:e6:62,bridge_name='br-int',has_traffic_filtering=True,id=94194a84-a05a-4791-a8d6-6c15f99969b2,network=Network(0be6df83-bfa0-4c90-aed3-88212317cb4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94194a84-a0')
May 28 01:15:41.070631 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:15:41.070964 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '36812bff-3b2c-4990-89a5-c5ab22274fef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:15:41.071202 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:15:41.071560 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:15:41.071987 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '36812bff-3b2c-4990-89a5-c5ab22274fef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:15:41.072138 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:15:41.097126 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:15:41.097126 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:15:41.097126 np0000001577 nova-compute[98319]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:15:41.097126 np0000001577 nova-compute[98319]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:15:41.097126 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:15:41.097369 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:15:41.097369 np0000001577 nova-compute[98319]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef (non-flash)
May 28 01:15:41.097369 np0000001577 nova-compute[98319]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:15:41.097369 np0000001577 nova-compute[98319]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:15:41.097369 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:15:41.097490 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', '211'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', '212')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:15:41.097490 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '179')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:15:41.098487 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef', '180')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:15:41.099124 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c98704d8cc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef'): ({'sdk'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:15:41.099449 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Removing multipathed devices sdj, sdk {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:15:41.100754 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Flush multipath device 33000000086cebf09 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:15:41.158066 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:15:41.160308 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:15:41.218298 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:15:41.278962 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Updating instance_info_cache with network_info: [{"id": "d274eeef-9c1f-4faf-81bf-152145095c9c", "address": "fa:16:3e:ad:08:4e", "network": {"id": "5c0bf35e-413d-4925-b608-d6fcbd8d04db", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1322440036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12e4d85acc2e447481bb45dd2c61c94c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd274eeef-9c", "ovs_interfaceid": "d274eeef-9c1f-4faf-81bf-152145095c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:15:41.284324 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:15:41.284411 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:15:41.285363 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:15:41.297092 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:15:41.297292 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:15:41.304275 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:15:41.311375 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:15:41.312681 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:41.316719 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:15:41.317026 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:15:41.317460 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:15:41.317910 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:15:41.318242 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:15:41.318658 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:15:41.344915 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 179, target: iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef, portal: 192.168.40.100,3260]
May 28 01:15:41.344915 np0000001577 nova-compute[98319]: Logout of [sid: 179, target: iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef, portal: 192.168.40.100,3260] successful.
May 28 01:15:41.344915 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:41.358734 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:41.369454 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:41.399039 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 180, target: iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef, portal: 192.168.50.100,3260]
May 28 01:15:41.399039 np0000001577 nova-compute[98319]: Logout of [sid: 180, target: iqn.2023-03.storpool.com:os--volume-36812bff-3b2c-4990-89a5-c5ab22274fef, portal: 192.168.50.100,3260] successful.
May 28 01:15:41.399039 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:41.410638 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:41.410886 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:15:41.411033 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] <== disconnect_volume: return (340ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:15:41.411350 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:15:41.411682 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Deleting instance files /opt/stack/data/nova/instances/87f7f5aa-3bd9-49d0-9f75-50f768acb6ef_del
May 28 01:15:41.412406 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Deletion of /opt/stack/data/nova/instances/87f7f5aa-3bd9-49d0-9f75-50f768acb6ef_del complete
May 28 01:15:41.655075 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:41.780928 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Releasing lock "refresh_cache-837b05a1-9183-4817-88e3-0b21030df297" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:15:41.781242 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Instance network_info: |[{"id": "d274eeef-9c1f-4faf-81bf-152145095c9c", "address": "fa:16:3e:ad:08:4e", "network": {"id": "5c0bf35e-413d-4925-b608-d6fcbd8d04db", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1322440036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12e4d85acc2e447481bb45dd2c61c94c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd274eeef-9c", "ovs_interfaceid": "d274eeef-9c1f-4faf-81bf-152145095c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:15:41.782876 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Start _get_guest_xml network_info=[{"id": "d274eeef-9c1f-4faf-81bf-152145095c9c", "address": "fa:16:3e:ad:08:4e", "network": {"id": "5c0bf35e-413d-4925-b608-d6fcbd8d04db", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1322440036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12e4d85acc2e447481bb45dd2c61c94c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd274eeef-9c", "ovs_interfaceid": "d274eeef-9c1f-4faf-81bf-152145095c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ddb82a83-20d7-4efa-9145-29669d8920b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:15:41.785472 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:15:41.786513 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ddb82a83-20d7-4efa-9145-29669d8920b6', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-733082449', uuid='837b05a1-9183-4817-88e3-0b21030df297'), owner=OwnerMeta(userid='341caf05b1b8426b9c4ed7ed3cad3ff5', username='tempest-TestEncryptedCinderVolumes-1546758686-project-member', projectid='12e4d85acc2e447481bb45dd2c61c94c', projectname='tempest-TestEncryptedCinderVolumes-1546758686'), image=ImageMeta(id='ddb82a83-20d7-4efa-9145-29669d8920b6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d274eeef-9c1f-4faf-81bf-152145095c9c", "address": "fa:16:3e:ad:08:4e", "network": {"id": "5c0bf35e-413d-4925-b608-d6fcbd8d04db", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1322440036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12e4d85acc2e447481bb45dd2c61c94c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd274eeef-9c", "ovs_interfaceid": "d274eeef-9c1f-4faf-81bf-152145095c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930941.78621) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:15:41.787661 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:15:41.787951 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:15:41.788959 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:15:41.789110 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:15:41.789880 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:15:41.790144 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T00:54:55Z,direct_url=<?>,disk_format='qcow2',id=ddb82a83-20d7-4efa-9145-29669d8920b6,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='93c8070b691d4f708f2391bfb8de6d61',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T00:54:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:15:41.790288 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:15:41.790376 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:15:41.790486 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:15:41.790595 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:15:41.790701 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:15:41.790835 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:15:41.790927 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:15:41.791027 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:15:41.791116 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:15:41.791232 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:15:41.800518 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:15:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-733082449',display_name='tempest-TestEncryptedCinderVolumes-server-733082449',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testencryptedcindervolumes-server-733082449',id=80,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFb0VUMM/yaKoGSEAiCY2LnLvDvDjf6pRNDtI0M0ng/b5mMJ9s9PRIntM8hS1HMQmM7vbSoxEsNREGcLpOVXgQzd072ihHibmd9IDGz2d4OD0cx5QXsxCXBgDSE4ecHMg==',key_name='tempest-keypair-779082595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12e4d85acc2e447481bb45dd2c61c94c',ramdisk_id='',reservation_id='r-clj1wf63',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1546758686',owner_user_name='tempest-TestEncryptedCinderVolumes-1546758686-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:15:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='341caf05b1b8426b9c4ed7ed3cad3ff5',uuid=837b05a1-9183-4817-88e3-0b21030df297,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d274eeef-9c1f-4faf-81bf-152145095c9c", "address": "fa:16:3e:ad:08:4e", "network": {"id": "5c0bf35e-413d-4925-b608-d6fcbd8d04db", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1322440036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12e4d85acc2e447481bb45dd2c61c94c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd274eeef-9c", "ovs_interfaceid": "d274eeef-9c1f-4faf-81bf-152145095c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:15:41.800644 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Converting VIF {"id": "d274eeef-9c1f-4faf-81bf-152145095c9c", "address": "fa:16:3e:ad:08:4e", "network": {"id": "5c0bf35e-413d-4925-b608-d6fcbd8d04db", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1322440036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12e4d85acc2e447481bb45dd2c61c94c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd274eeef-9c", "ovs_interfaceid": "d274eeef-9c1f-4faf-81bf-152145095c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:15:41.801077 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:08:4e,bridge_name='br-int',has_traffic_filtering=True,id=d274eeef-9c1f-4faf-81bf-152145095c9c,network=Network(5c0bf35e-413d-4925-b608-d6fcbd8d04db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd274eeef-9c') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:15:41.801490 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lazy-loading 'pci_devices' on Instance uuid 837b05a1-9183-4817-88e3-0b21030df297 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:15:41.813661 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:15:41.814081 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930941.8139284, b15ccc22-6ebc-41b2-9286-c27746bb96d3 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:15:41.814197 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] VM Paused (Lifecycle Event)
May 28 01:15:41.826675 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Took 8.40 seconds to spawn the instance on the hypervisor.
May 28 01:15:41.826768 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:15:41.920129 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Took 1.71 seconds to destroy the instance on the hypervisor.
May 28 01:15:41.920672 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:15:41.921006 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:15:41.921164 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:15:41.921328 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:15:42.003886 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:15:42.303767 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] End _get_guest_xml xml=<domain type="qemu">
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:   <uuid>837b05a1-9183-4817-88e3-0b21030df297</uuid>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:   <name>instance-00000050</name>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-733082449</nova:name>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:15:41</nova:creationTime>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       <nova:image uuid="ddb82a83-20d7-4efa-9145-29669d8920b6">
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:         <nova:user uuid="341caf05b1b8426b9c4ed7ed3cad3ff5">tempest-TestEncryptedCinderVolumes-1546758686-project-member</nova:user>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:         <nova:project uuid="12e4d85acc2e447481bb45dd2c61c94c">tempest-TestEncryptedCinderVolumes-1546758686</nova:project>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       <nova:root type="image" uuid="ddb82a83-20d7-4efa-9145-29669d8920b6"/>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:         <nova:port uuid="d274eeef-9c1f-4faf-81bf-152145095c9c">
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:     <system>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       <entry name="serial">837b05a1-9183-4817-88e3-0b21030df297</entry>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       <entry name="uuid">837b05a1-9183-4817-88e3-0b21030df297</entry>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:     </system>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:   <os>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:   </os>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:   <features>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:   </features>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:   <devices>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:     <disk type="file" device="disk">
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/837b05a1-9183-4817-88e3-0b21030df297/disk"/>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:     </disk>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/837b05a1-9183-4817-88e3-0b21030df297/disk.config"/>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:     </disk>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:ad:08:4e"/>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       <target dev="tapd274eeef-9c"/>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:     </interface>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/837b05a1-9183-4817-88e3-0b21030df297/console.log" append="off"/>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:     </serial>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:     <video>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:     </video>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:     </rng>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:   </devices>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]: </domain>
May 28 01:15:42.303767 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:15:42.305846 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Preparing to wait for external event network-vif-plugged-d274eeef-9c1f-4faf-81bf-152145095c9c {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:15:42.305846 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "837b05a1-9183-4817-88e3-0b21030df297-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:42.305846 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "837b05a1-9183-4817-88e3-0b21030df297-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:42.305846 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "837b05a1-9183-4817-88e3-0b21030df297-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:42.305846 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:15:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-733082449',display_name='tempest-TestEncryptedCinderVolumes-server-733082449',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testencryptedcindervolumes-server-733082449',id=80,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFb0VUMM/yaKoGSEAiCY2LnLvDvDjf6pRNDtI0M0ng/b5mMJ9s9PRIntM8hS1HMQmM7vbSoxEsNREGcLpOVXgQzd072ihHibmd9IDGz2d4OD0cx5QXsxCXBgDSE4ecHMg==',key_name='tempest-keypair-779082595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12e4d85acc2e447481bb45dd2c61c94c',ramdisk_id='',reservation_id='r-clj1wf63',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1546758686',owner_user_name='tempest-TestEncryptedCinderVolumes-1546758686-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:15:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='341caf05b1b8426b9c4ed7ed3cad3ff5',uuid=837b05a1-9183-4817-88e3-0b21030df297,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d274eeef-9c1f-4faf-81bf-152145095c9c", "address": "fa:16:3e:ad:08:4e", "network": {"id": "5c0bf35e-413d-4925-b608-d6fcbd8d04db", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1322440036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12e4d85acc2e447481bb45dd2c61c94c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd274eeef-9c", "ovs_interfaceid": "d274eeef-9c1f-4faf-81bf-152145095c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:15:42.305846 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Converting VIF {"id": "d274eeef-9c1f-4faf-81bf-152145095c9c", "address": "fa:16:3e:ad:08:4e", "network": {"id": "5c0bf35e-413d-4925-b608-d6fcbd8d04db", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1322440036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12e4d85acc2e447481bb45dd2c61c94c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd274eeef-9c", "ovs_interfaceid": "d274eeef-9c1f-4faf-81bf-152145095c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:15:42.305846 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:08:4e,bridge_name='br-int',has_traffic_filtering=True,id=d274eeef-9c1f-4faf-81bf-152145095c9c,network=Network(5c0bf35e-413d-4925-b608-d6fcbd8d04db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd274eeef-9c') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:15:42.306299 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:08:4e,bridge_name='br-int',has_traffic_filtering=True,id=d274eeef-9c1f-4faf-81bf-152145095c9c,network=Network(5c0bf35e-413d-4925-b608-d6fcbd8d04db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd274eeef-9c') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:15:42.306443 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:42.306592 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:15:42.306835 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:15:42.307649 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:42.307818 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ce5fd176-c706-599e-be0a-dc88183beef9', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:15:42.309801 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:42.310701 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:15:42.320325 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6ec90abc-620f-4176-a66c-0071fe6ab3d8 req-b365cea2-4077-498a-878f-f425777ea144 service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Received event network-vif-plugged-3b980408-16a1-4501-bc77-b75f3ce2f7d6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:15:42.320442 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ec90abc-620f-4176-a66c-0071fe6ab3d8 req-b365cea2-4077-498a-878f-f425777ea144 service nova] Acquiring lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:42.320608 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ec90abc-620f-4176-a66c-0071fe6ab3d8 req-b365cea2-4077-498a-878f-f425777ea144 service nova] Lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:42.322513 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:15:42.322923 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ec90abc-620f-4176-a66c-0071fe6ab3d8 req-b365cea2-4077-498a-878f-f425777ea144 service nova] Lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:42.323127 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:42.323457 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6ec90abc-620f-4176-a66c-0071fe6ab3d8 req-b365cea2-4077-498a-878f-f425777ea144 service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] No waiting events found dispatching network-vif-plugged-3b980408-16a1-4501-bc77-b75f3ce2f7d6 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:15:42.323661 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd274eeef-9c, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:15:42.324202 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-6ec90abc-620f-4176-a66c-0071fe6ab3d8 req-b365cea2-4077-498a-878f-f425777ea144 service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Received unexpected event network-vif-plugged-3b980408-16a1-4501-bc77-b75f3ce2f7d6 for instance with vm_state active and task_state None.
May 28 01:15:42.324668 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd274eeef-9c, col_values=(('qos', UUID('bdb88492-ec09-4dc9-a983-5a036db630de')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:15:42.324851 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd274eeef-9c, col_values=(('external_ids', {'iface-id': 'd274eeef-9c1f-4faf-81bf-152145095c9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:08:4e', 'vm-uuid': '837b05a1-9183-4817-88e3-0b21030df297'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:15:42.326051 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:42.327727 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:15:42.328192 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930942.327955, b15ccc22-6ebc-41b2-9286-c27746bb96d3 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:15:42.328320 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] VM Resumed (Lifecycle Event)
May 28 01:15:42.332015 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:42.333194 np0000001577 nova-compute[98319]: INFO os_vif [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:08:4e,bridge_name='br-int',has_traffic_filtering=True,id=d274eeef-9c1f-4faf-81bf-152145095c9c,network=Network(5c0bf35e-413d-4925-b608-d6fcbd8d04db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd274eeef-9c')
May 28 01:15:42.343771 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Took 15.45 seconds to build instance.
May 28 01:15:42.393796 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0e9f07d3-2199-48f9-90ee-0cea6652454c req-b70061d5-7849-47e5-8dcc-6e3bdbc55c06 service nova] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Received event network-vif-deleted-94194a84-a05a-4791-a8d6-6c15f99969b2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:15:42.393940 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-0e9f07d3-2199-48f9-90ee-0cea6652454c req-b70061d5-7849-47e5-8dcc-6e3bdbc55c06 service nova] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Neutron deleted interface 94194a84-a05a-4791-a8d6-6c15f99969b2; detaching it from the instance and deleting it from the info cache
May 28 01:15:42.395262 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-0e9f07d3-2199-48f9-90ee-0cea6652454c req-b70061d5-7849-47e5-8dcc-6e3bdbc55c06 service nova] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Detach interface failed, port_id=94194a84-a05a-4791-a8d6-6c15f99969b2, reason: Instance 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:15:42.424938 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8212a6a4-bbfc-438f-bb6f-d1fa22c15378 req-1221e2a1-9f23-4adc-813e-8a8d134c1dc8 service nova] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Received event network-vif-unplugged-94194a84-a05a-4791-a8d6-6c15f99969b2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:15:42.424938 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8212a6a4-bbfc-438f-bb6f-d1fa22c15378 req-1221e2a1-9f23-4adc-813e-8a8d134c1dc8 service nova] Acquiring lock "87f7f5aa-3bd9-49d0-9f75-50f768acb6ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:42.424938 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8212a6a4-bbfc-438f-bb6f-d1fa22c15378 req-1221e2a1-9f23-4adc-813e-8a8d134c1dc8 service nova] Lock "87f7f5aa-3bd9-49d0-9f75-50f768acb6ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:42.424938 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8212a6a4-bbfc-438f-bb6f-d1fa22c15378 req-1221e2a1-9f23-4adc-813e-8a8d134c1dc8 service nova] Lock "87f7f5aa-3bd9-49d0-9f75-50f768acb6ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:42.424938 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8212a6a4-bbfc-438f-bb6f-d1fa22c15378 req-1221e2a1-9f23-4adc-813e-8a8d134c1dc8 service nova] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] No waiting events found dispatching network-vif-unplugged-94194a84-a05a-4791-a8d6-6c15f99969b2 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:15:42.424938 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-8212a6a4-bbfc-438f-bb6f-d1fa22c15378 req-1221e2a1-9f23-4adc-813e-8a8d134c1dc8 service nova] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Received event network-vif-unplugged-94194a84-a05a-4791-a8d6-6c15f99969b2 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:15:42.830597 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:15:42.832584 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:15:42.846564 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.957s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:42.849054 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 15.186s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:42.849054 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:15:43.350607 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Took 1.43 seconds to deallocate network for instance.
May 28 01:15:43.354651 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.508s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:43.850832 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:15:43.851015 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:15:43.851166 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] No VIF found with MAC fa:16:3e:ad:08:4e, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:15:43.851664 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Using config drive
May 28 01:15:43.895383 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Took 0.54 seconds to detach 1 volumes for instance.
May 28 01:15:44.361233 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:15:44.376653 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5d5928b3-1cf8-45b2-adb9-b0a1e8e8a70b req-5ec91ea1-64c9-4cb6-9b0d-aff9f0a659c0 service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Received event network-changed-3b980408-16a1-4501-bc77-b75f3ce2f7d6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:15:44.376653 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5d5928b3-1cf8-45b2-adb9-b0a1e8e8a70b req-5ec91ea1-64c9-4cb6-9b0d-aff9f0a659c0 service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Refreshing instance network info cache due to event network-changed-3b980408-16a1-4501-bc77-b75f3ce2f7d6. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:15:44.376653 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5d5928b3-1cf8-45b2-adb9-b0a1e8e8a70b req-5ec91ea1-64c9-4cb6-9b0d-aff9f0a659c0 service nova] Acquiring lock "refresh_cache-b15ccc22-6ebc-41b2-9286-c27746bb96d3" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:15:44.376653 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5d5928b3-1cf8-45b2-adb9-b0a1e8e8a70b req-5ec91ea1-64c9-4cb6-9b0d-aff9f0a659c0 service nova] Acquired lock "refresh_cache-b15ccc22-6ebc-41b2-9286-c27746bb96d3" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:15:44.376653 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-5d5928b3-1cf8-45b2-adb9-b0a1e8e8a70b req-5ec91ea1-64c9-4cb6-9b0d-aff9f0a659c0 service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Refreshing network info cache for port 3b980408-16a1-4501-bc77-b75f3ce2f7d6 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:15:44.400713 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:44.401043 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:44.505973 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Creating config drive at /opt/stack/data/nova/instances/837b05a1-9183-4817-88e3-0b21030df297/disk.config
May 28 01:15:44.510188 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/837b05a1-9183-4817-88e3-0b21030df297/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphvobctdz {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:15:44.565652 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/837b05a1-9183-4817-88e3-0b21030df297/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphvobctdz" returned: 0 in 0.055s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:15:44.659582 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:15:44.659956 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:15:44.847002 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0005615580002995557 future=<Future at 0x7c984c345d90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:15:44.847162 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:15:44.847284 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=10.70088434299987 future=<Future at 0x7c984c5c8aa0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:15:44.847371 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=10.700780930999827 future=<Future at 0x7c984c5c8aa0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:15:44.847671 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Emitting event <LifecycleEvent: 1779930929.8462021, 14694771-0e2d-420f-8b96-7bd28ffcf4c2 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:15:44.848023 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] VM Stopped (Lifecycle Event)
May 28 01:15:44.878462 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-5d5928b3-1cf8-45b2-adb9-b0a1e8e8a70b req-5ec91ea1-64c9-4cb6-9b0d-aff9f0a659c0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:15:44.947570 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:44.974272 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:45.064620 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:45.144001 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-fea4ad3f-c98c-4d1f-bdf3-6f9c5c429328 req-f46e616a-3a4c-4556-9c7b-4fb1fb06ce86 service nova] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Received event network-vif-plugged-d274eeef-9c1f-4faf-81bf-152145095c9c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:15:45.144503 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fea4ad3f-c98c-4d1f-bdf3-6f9c5c429328 req-f46e616a-3a4c-4556-9c7b-4fb1fb06ce86 service nova] Acquiring lock "837b05a1-9183-4817-88e3-0b21030df297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:45.144652 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fea4ad3f-c98c-4d1f-bdf3-6f9c5c429328 req-f46e616a-3a4c-4556-9c7b-4fb1fb06ce86 service nova] Lock "837b05a1-9183-4817-88e3-0b21030df297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:45.144868 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fea4ad3f-c98c-4d1f-bdf3-6f9c5c429328 req-f46e616a-3a4c-4556-9c7b-4fb1fb06ce86 service nova] Lock "837b05a1-9183-4817-88e3-0b21030df297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:45.145053 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-fea4ad3f-c98c-4d1f-bdf3-6f9c5c429328 req-f46e616a-3a4c-4556-9c7b-4fb1fb06ce86 service nova] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Processing event network-vif-plugged-d274eeef-9c1f-4faf-81bf-152145095c9c {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:15:45.163954 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:15:45.211739 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-5d5928b3-1cf8-45b2-adb9-b0a1e8e8a70b req-5ec91ea1-64c9-4cb6-9b0d-aff9f0a659c0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:15:45.304661 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:45.308229 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:45.310231 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:45.311616 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:45.331974 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:45.351480 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 14694771-0e2d-420f-8b96-7bd28ffcf4c2] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:15:45.372980 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-5d5928b3-1cf8-45b2-adb9-b0a1e8e8a70b req-5ec91ea1-64c9-4cb6-9b0d-aff9f0a659c0 service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Updated VIF entry in instance network info cache for port 3b980408-16a1-4501-bc77-b75f3ce2f7d6. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:15:45.373443 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-5d5928b3-1cf8-45b2-adb9-b0a1e8e8a70b req-5ec91ea1-64c9-4cb6-9b0d-aff9f0a659c0 service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Updating instance_info_cache with network_info: [{"id": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "address": "fa:16:3e:03:f9:bf", "network": {"id": "744273d0-4bd0-4935-9d5a-ba0baf747156", "bridge": "br-int", "label": "tempest-TestShelveInstance-1169067650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b690857a47340a499184f882e99f512", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b980408-16", "ovs_interfaceid": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:15:45.674883 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.274s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:45.676562 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930945.6749363, 837b05a1-9183-4817-88e3-0b21030df297 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:15:45.676970 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:15:45.677161 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 837b05a1-9183-4817-88e3-0b21030df297] VM Started (Lifecycle Event)
May 28 01:15:45.683687 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:15:45.685804 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Instance spawned successfully.
May 28 01:15:45.686083 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:15:45.721392 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Deleted allocations for instance 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef
May 28 01:15:45.875846 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5d5928b3-1cf8-45b2-adb9-b0a1e8e8a70b req-5ec91ea1-64c9-4cb6-9b0d-aff9f0a659c0 service nova] Releasing lock "refresh_cache-b15ccc22-6ebc-41b2-9286-c27746bb96d3" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:15:46.183294 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:15:46.185526 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:15:46.193697 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:15:46.193802 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:15:46.194066 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:15:46.194286 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:15:46.194518 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:15:46.194762 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:15:46.485241 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:15:46.485755 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:15:46.657217 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:46.687615 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 837b05a1-9183-4817-88e3-0b21030df297] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:15:46.687852 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930946.6877024, 837b05a1-9183-4817-88e3-0b21030df297 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:15:46.687950 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 837b05a1-9183-4817-88e3-0b21030df297] VM Paused (Lifecycle Event)
May 28 01:15:46.702152 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Took 6.39 seconds to spawn the instance on the hypervisor.
May 28 01:15:46.702294 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:15:46.731292 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fe0cc8cc-38f7-4d42-a85d-3054af3588f0 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Lock "87f7f5aa-3bd9-49d0-9f75-50f768acb6ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.026s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:46.977836 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:15:47.189993 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:15:47.193736 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930947.1934001, 837b05a1-9183-4817-88e3-0b21030df297 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:15:47.193886 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 837b05a1-9183-4817-88e3-0b21030df297] VM Resumed (Lifecycle Event)
May 28 01:15:47.199311 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-75cd010c-8693-4fd3-83fe-2da3b2dc8b6f req-66daed4d-cfdd-4ba3-8e2a-48bcafda30ff service nova] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Received event network-vif-plugged-d274eeef-9c1f-4faf-81bf-152145095c9c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:15:47.199951 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-75cd010c-8693-4fd3-83fe-2da3b2dc8b6f req-66daed4d-cfdd-4ba3-8e2a-48bcafda30ff service nova] Acquiring lock "837b05a1-9183-4817-88e3-0b21030df297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:47.200133 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-75cd010c-8693-4fd3-83fe-2da3b2dc8b6f req-66daed4d-cfdd-4ba3-8e2a-48bcafda30ff service nova] Lock "837b05a1-9183-4817-88e3-0b21030df297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:47.200301 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-75cd010c-8693-4fd3-83fe-2da3b2dc8b6f req-66daed4d-cfdd-4ba3-8e2a-48bcafda30ff service nova] Lock "837b05a1-9183-4817-88e3-0b21030df297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:47.200425 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-75cd010c-8693-4fd3-83fe-2da3b2dc8b6f req-66daed4d-cfdd-4ba3-8e2a-48bcafda30ff service nova] [instance: 837b05a1-9183-4817-88e3-0b21030df297] No waiting events found dispatching network-vif-plugged-d274eeef-9c1f-4faf-81bf-152145095c9c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:15:47.200598 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-75cd010c-8693-4fd3-83fe-2da3b2dc8b6f req-66daed4d-cfdd-4ba3-8e2a-48bcafda30ff service nova] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Received unexpected event network-vif-plugged-d274eeef-9c1f-4faf-81bf-152145095c9c for instance with vm_state active and task_state None.
May 28 01:15:47.209592 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Took 11.69 seconds to build instance.
May 28 01:15:47.327707 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:47.481703 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:47.482835 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:47.483435 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:47.483435 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Auditing locally available compute resources for np0000001577 (node: np0000001577) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 01:15:47.701714 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:15:47.703626 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:15:47.714345 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "837b05a1-9183-4817-88e3-0b21030df297" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.201s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:48.428069 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-41d87a8d-da05-4147-af96-1766a2fbc5f5 req-15139955-1ee4-4d33-8845-801d9b15a704 service nova] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Received event network-changed-d274eeef-9c1f-4faf-81bf-152145095c9c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:15:48.428492 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-41d87a8d-da05-4147-af96-1766a2fbc5f5 req-15139955-1ee4-4d33-8845-801d9b15a704 service nova] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Refreshing instance network info cache due to event network-changed-d274eeef-9c1f-4faf-81bf-152145095c9c. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:15:48.428557 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-41d87a8d-da05-4147-af96-1766a2fbc5f5 req-15139955-1ee4-4d33-8845-801d9b15a704 service nova] Acquiring lock "refresh_cache-837b05a1-9183-4817-88e3-0b21030df297" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:15:48.428647 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-41d87a8d-da05-4147-af96-1766a2fbc5f5 req-15139955-1ee4-4d33-8845-801d9b15a704 service nova] Acquired lock "refresh_cache-837b05a1-9183-4817-88e3-0b21030df297" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:15:48.428739 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-41d87a8d-da05-4147-af96-1766a2fbc5f5 req-15139955-1ee4-4d33-8845-801d9b15a704 service nova] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Refreshing network info cache for port d274eeef-9c1f-4faf-81bf-152145095c9c {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:15:48.508842 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:15:48.509744 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/837b05a1-9183-4817-88e3-0b21030df297/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:15:48.595452 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/837b05a1-9183-4817-88e3-0b21030df297/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:15:48.598650 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/837b05a1-9183-4817-88e3-0b21030df297/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:15:48.687946 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/837b05a1-9183-4817-88e3-0b21030df297/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:15:48.695372 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:15:48.762210 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:48.762735 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:48.789152 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:15:48.789630 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:15:48.874052 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:15:48.878359 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:15:48.879587 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:15:48.924833 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:15:48.925387 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Hypervisor/Node resource view: name=np0000001577 free_ram=13081MB free_disk=72.6618423461914GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 01:15:48.925849 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:48.926882 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:48.930956 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-41d87a8d-da05-4147-af96-1766a2fbc5f5 req-15139955-1ee4-4d33-8845-801d9b15a704 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:15:49.254354 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-41d87a8d-da05-4147-af96-1766a2fbc5f5 req-15139955-1ee4-4d33-8845-801d9b15a704 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:15:49.269338 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lazy-loading 'flavor' on Instance uuid 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:15:49.379807 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-41d87a8d-da05-4147-af96-1766a2fbc5f5 req-15139955-1ee4-4d33-8845-801d9b15a704 service nova] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Updated VIF entry in instance network info cache for port d274eeef-9c1f-4faf-81bf-152145095c9c. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:15:49.380018 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-41d87a8d-da05-4147-af96-1766a2fbc5f5 req-15139955-1ee4-4d33-8845-801d9b15a704 service nova] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Updating instance_info_cache with network_info: [{"id": "d274eeef-9c1f-4faf-81bf-152145095c9c", "address": "fa:16:3e:ad:08:4e", "network": {"id": "5c0bf35e-413d-4925-b608-d6fcbd8d04db", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1322440036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12e4d85acc2e447481bb45dd2c61c94c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd274eeef-9c", "ovs_interfaceid": "d274eeef-9c1f-4faf-81bf-152145095c9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:15:49.881962 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-41d87a8d-da05-4147-af96-1766a2fbc5f5 req-15139955-1ee4-4d33-8845-801d9b15a704 service nova] Releasing lock "refresh_cache-837b05a1-9183-4817-88e3-0b21030df297" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:15:49.995833 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:15:49.995956 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance b15ccc22-6ebc-41b2-9286-c27746bb96d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:15:49.996079 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance 837b05a1-9183-4817-88e3-0b21030df297 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:15:49.996257 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 01:15:49.996403 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Final resource view: name=np0000001577 phys_ram=24030MB used_ram=1088MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:15:48 up 47 min,  2 users,  load average: 4.87, 4.61, 4.21\n', 'num_instances': '3', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '3', 'num_proj_1d6ee814419446dcb5025c68fb0f4ce9': '1', 'io_workload': '0', 'num_proj_1b690857a47340a499184f882e99f512': '1', 'num_proj_12e4d85acc2e447481bb45dd2c61c94c': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 01:15:50.097461 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:50.200133 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:15:50.200480 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:15:50.278048 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:50.703990 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:15:51.215300 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Compute_service record updated for np0000001577:np0000001577 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 01:15:51.215694 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.289s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:51.215733 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:15:51.355565 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:51.355565 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:51.355565 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Attaching volume 26afed0d-59e1-49d6-a276-66d52291cc90 to /dev/vdb
May 28 01:15:51.394784 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:15:51.407280 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:15:51.431571 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:15:51.472384 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:15:51.473496 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:15:51.490570 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:15:51.490570 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fea5:aab2', 'fe80::c813:dcff:fe9e:6381', 'fe80::fc16:3eff:fe03:f9bf', 'fe80::1cba:eff:fef9:b475', 'fe80::fc16:3eff:fead:84e', 'fe80::c458:12ff:fe3a:6282'] 
May 28 01:15:51.490570 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:15:51.490570 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:15:51.490570 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] <== get_connector_properties: return (93ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:15:51.490570 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Updating existing volume attachment record: 2ba3d531-f057-4bc3-a7e6-24ae205e129b {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:15:51.658289 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:51.782601 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:52.051669 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:15:52.051958 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90', 'iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '26afed0d-59e1-49d6-a276-66d52291cc90', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:15:52.052096 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:15:52.052875 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:15:52.053001 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90', 'iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '26afed0d-59e1-49d6-a276-66d52291cc90', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:15:52.067155 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:15:52.067658 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:15:52.068216 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:15:52.068485 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:15:52.068864 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:15:52.069109 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:15:52.080072 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:15:52.080072 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:52.086349 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:15:52.086349 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:52.096592 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90] added
May 28 01:15:52.096592 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:15:52.096592 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:15:52.096592 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:15:52.096592 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:15:52.096592 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:15:52.096592 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:52.097042 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:15:52.097126 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0286(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:15:52.097371 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:15:52.102077 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90] added
May 28 01:15:52.102077 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:15:52.102077 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:15:52.102077 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:15:52.102077 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:15:52.102077 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:15:52.102077 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:52.102324 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:15:52.103255 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0334(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:15:52.103255 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:15:52.328434 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:53.097797 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:15:53.103653 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:15:53.111577 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:15:53.111577 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:15:53.116677 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:15:53.116677 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:53.123393 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:53.133861 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:53.138507 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:15:53.138507 np0000001577 nova-compute[98319]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:15:53.138507 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:15:53.138684 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsi session list stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:15:53.138684 np0000001577 nova-compute[98319]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:15:53.138684 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:15:53.144968 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:15:53.144968 np0000001577 nova-compute[98319]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:15:53.144968 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:15:53.145087 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsi session list stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:15:53.145087 np0000001577 nova-compute[98319]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:15:53.145087 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:15:53.175630 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90, portal: 192.168.50.100,3260]
May 28 01:15:53.175630 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90, portal: 192.168.50.100,3260] successful.
May 28 01:15:53.175630 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:53.175873 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90, portal: 192.168.40.100,3260]
May 28 01:15:53.175873 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90, portal: 192.168.40.100,3260] successful.
May 28 01:15:53.175873 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:53.186803 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:53.196886 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:15:53.200932 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:15:53.200932 np0000001577 nova-compute[98319]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:15:53.200932 np0000001577 nova-compute[98319]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90 (non-flash)
May 28 01:15:53.200932 np0000001577 nova-compute[98319]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90 (non-flash)
May 28 01:15:53.200932 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:15:53.201102 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsi session list stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:15:53.201102 np0000001577 nova-compute[98319]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:15:53.201102 np0000001577 nova-compute[98319]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90 (non-flash)
May 28 01:15:53.201102 np0000001577 nova-compute[98319]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90 (non-flash)
May 28 01:15:53.201102 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:15:53.201400 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.133s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:15:53.201578 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:15:53.202186 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] HCTL ('9', '-', '-', 0) found on session 213 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:15:53.202317 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:15:53.209262 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:15:53.209262 np0000001577 nova-compute[98319]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:15:53.209262 np0000001577 nova-compute[98319]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90 (non-flash)
May 28 01:15:53.209262 np0000001577 nova-compute[98319]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90 (non-flash)
May 28 01:15:53.209262 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:15:53.209849 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsi session list stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:15:53.209849 np0000001577 nova-compute[98319]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:15:53.209849 np0000001577 nova-compute[98319]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90 (non-flash)
May 28 01:15:53.209849 np0000001577 nova-compute[98319]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90 (non-flash)
May 28 01:15:53.209849 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:15:53.209849 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.141s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:15:53.209849 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:15:53.210321 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] HCTL ('10', '-', '-', 0) found on session 214 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:15:53.210436 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:15:53.218509 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:15:53.218509 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:15:53.218509 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:15:53.218509 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Searching for a device in session 213 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:15:53.218509 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '26afed0d-59e1-49d6-a276-66d52291cc90', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:15:53.218509 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:15:53.218509 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 01:15:53.218509 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.76 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:15:53.225908 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Searching for a device in session 214 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:15:53.225908 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '26afed0d-59e1-49d6-a276-66d52291cc90', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:15:53.979499 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:15:53.979872 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:15:54.068913 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:15:55.085032 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Found WWN 330000000ecafd3ab for multipath device dm-4 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:15:55.085032 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:15:55.085032 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '330000000ecafd3ab', 'path': '/dev/dm-4', 'multipath_id': '330000000ecafd3ab'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:15:55.085032 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ecafd3ab', 'path': '/dev/dm-4', 'multipath_id': '330000000ecafd3ab'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:15:55.088282 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lazy-loading 'flavor' on Instance uuid 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:15:55.548624 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00041177600041919504 future=<Future at 0x7c984c5c8aa0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:15:55.549363 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Emitting event <LifecycleEvent: 1779930940.5480402, 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:15:55.549590 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:15:55.549766 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] VM Stopped (Lifecycle Event)
May 28 01:15:55.591854 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Attempting to attach volume 26afed0d-59e1-49d6-a276-66d52291cc90 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:15:55.593231 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:15:55.593231 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:15:55.593231 np0000001577 nova-compute[98319]:   <alias name="ua-26afed0d-59e1-49d6-a276-66d52291cc90"/>
May 28 01:15:55.593231 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-4"/>
May 28 01:15:55.593231 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:15:55.593231 np0000001577 nova-compute[98319]:   <serial>26afed0d-59e1-49d6-a276-66d52291cc90</serial>
May 28 01:15:55.593231 np0000001577 nova-compute[98319]: </disk>
May 28 01:15:55.593231 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:15:55.977876 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:15:55.978107 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:15:56.052339 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-0b0535a0-0cd9-4305-b17a-abc91c940ac5 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: 87f7f5aa-3bd9-49d0-9f75-50f768acb6ef] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:15:56.660198 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:57.236723 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:15:57.236723 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:15:57.236723 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:15:57.236723 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] No VIF found with MAC fa:16:3e:a5:aa:b2, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:15:57.330006 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:15:58.786499 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3b6a912f-f4b0-4119-a653-0e11ec48a4ac tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.433s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:15:59.206099 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:15:59.206269 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:15:59.708268 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Detaching volume 26afed0d-59e1-49d6-a276-66d52291cc90
May 28 01:15:59.743828 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Attempting to driver detach volume 26afed0d-59e1-49d6-a276-66d52291cc90 from mountpoint /dev/vdb
May 28 01:15:59.747863 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Found disk vdb by alias ua-26afed0d-59e1-49d6-a276-66d52291cc90 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:15:59.748837 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Found disk vdb by alias ua-26afed0d-59e1-49d6-a276-66d52291cc90 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:15:59.748948 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Attempting to detach device vdb from instance 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:15:59.749140 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:15:59.749140 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:15:59.749140 np0000001577 nova-compute[98319]:   <alias name="ua-26afed0d-59e1-49d6-a276-66d52291cc90"/>
May 28 01:15:59.749140 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-4"/>
May 28 01:15:59.749140 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:15:59.749140 np0000001577 nova-compute[98319]:   <serial>26afed0d-59e1-49d6-a276-66d52291cc90</serial>
May 28 01:15:59.749140 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:15:59.749140 np0000001577 nova-compute[98319]: </disk>
May 28 01:15:59.749140 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:15:59.753789 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Successfully detached device vdb from instance 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea from the persistent domain config.
May 28 01:15:59.753934 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] (1/8): Attempting to detach device vdb with device alias ua-26afed0d-59e1-49d6-a276-66d52291cc90 from instance 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:15:59.754220 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:15:59.754220 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:15:59.754220 np0000001577 nova-compute[98319]:   <alias name="ua-26afed0d-59e1-49d6-a276-66d52291cc90"/>
May 28 01:15:59.754220 np0000001577 nova-compute[98319]:   <source dev="/dev/dm-4"/>
May 28 01:15:59.754220 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:15:59.754220 np0000001577 nova-compute[98319]:   <serial>26afed0d-59e1-49d6-a276-66d52291cc90</serial>
May 28 01:15:59.754220 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:15:59.754220 np0000001577 nova-compute[98319]: </disk>
May 28 01:15:59.754220 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:16:00.193412 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930960.1930227, 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea => ua-26afed0d-59e1-49d6-a276-66d52291cc90> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:16:00.194324 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-26afed0d-59e1-49d6-a276-66d52291cc90 for instance 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:16:00.196393 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Successfully detached device vdb from instance 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea from the live domain config.
May 28 01:16:00.197337 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:16:00.197629 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90', 'iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '26afed0d-59e1-49d6-a276-66d52291cc90', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:16:00.197774 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:16:01.250025 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.052s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:16:01.250325 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90', 'iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '26afed0d-59e1-49d6-a276-66d52291cc90', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:16:01.250433 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:16:01.272536 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:16:01.272536 np0000001577 nova-compute[98319]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:16:01.272536 np0000001577 nova-compute[98319]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90 (non-flash)
May 28 01:16:01.272536 np0000001577 nova-compute[98319]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90 (non-flash)
May 28 01:16:01.272536 np0000001577 nova-compute[98319]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d8d46e2b-3109-4892-ae24-9c096adc5bb0 (non-flash)
May 28 01:16:01.272536 np0000001577 nova-compute[98319]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d8d46e2b-3109-4892-ae24-9c096adc5bb0 (non-flash)
May 28 01:16:01.272536 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:16:01.272827 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsi session list stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:16:01.272827 np0000001577 nova-compute[98319]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:16:01.272827 np0000001577 nova-compute[98319]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90 (non-flash)
May 28 01:16:01.272827 np0000001577 nova-compute[98319]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90 (non-flash)
May 28 01:16:01.272827 np0000001577 nova-compute[98319]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d8d46e2b-3109-4892-ae24-9c096adc5bb0 (non-flash)
May 28 01:16:01.272827 np0000001577 nova-compute[98319]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d8d46e2b-3109-4892-ae24-9c096adc5bb0 (non-flash)
May 28 01:16:01.272827 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:16:01.272827 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', '211'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', '212'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90', '213'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90', '214'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d8d46e2b-3109-4892-ae24-9c096adc5bb0', '215'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d8d46e2b-3109-4892-ae24-9c096adc5bb0', '216')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:16:01.273101 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90', '214')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:16:01.273644 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90', '213')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:16:01.274317 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c9870421620>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90'): ({'sdd'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:16:01.274483 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Removing multipathed devices sde, sdd {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:16:01.274754 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Flush multipath device 330000000ecafd3ab {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:16:01.304076 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:16:01.355864 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:16:01.395887 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:16:01.396034 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:16:01.397391 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:16:01.407713 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:16:01.407871 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:16:01.417686 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:01.451254 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 214, target: iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90, portal: 192.168.40.100,3260]
May 28 01:16:01.451254 np0000001577 nova-compute[98319]: Logout of [sid: 214, target: iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90, portal: 192.168.40.100,3260] successful.
May 28 01:16:01.451254 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:01.465425 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:01.476871 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:01.503571 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 213, target: iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90, portal: 192.168.50.100,3260]
May 28 01:16:01.503571 np0000001577 nova-compute[98319]: Logout of [sid: 213, target: iqn.2023-03.storpool.com:os--volume-26afed0d-59e1-49d6-a276-66d52291cc90, portal: 192.168.50.100,3260] successful.
May 28 01:16:01.503571 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:01.518238 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:01.518417 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:16:01.518520 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] <== disconnect_volume: return (1320ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:16:01.518671 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:16:01.661669 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:02.062607 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lazy-loading 'flavor' on Instance uuid 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:16:02.331612 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:03.067159 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c6bd9b0a-1495-4232-95bd-c3d6bfb58712 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.861s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:16:03.447921 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-682af45b-fdd0-4595-b36a-7d7044566a88 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:16:03.448332 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-682af45b-fdd0-4595-b36a-7d7044566a88 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:16:03.448332 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-682af45b-fdd0-4595-b36a-7d7044566a88 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:16:03.448467 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-682af45b-fdd0-4595-b36a-7d7044566a88 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:16:03.448588 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-682af45b-fdd0-4595-b36a-7d7044566a88 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:16:03.450415 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-682af45b-fdd0-4595-b36a-7d7044566a88 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Terminating instance
May 28 01:16:03.952958 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-682af45b-fdd0-4595-b36a-7d7044566a88 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:16:03.976520 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:03.992238 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:03.997463 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:04.012521 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:04.016506 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:04.110797 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e9dd26ed-8cef-4a31-af68-55b3983b8383 req-79804cab-b911-43c1-a6b0-a74371f127aa service nova] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Received event network-vif-unplugged-cbc69d0b-efff-4170-bc4e-729f9a9f52c2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:16:04.111732 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e9dd26ed-8cef-4a31-af68-55b3983b8383 req-79804cab-b911-43c1-a6b0-a74371f127aa service nova] Acquiring lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:16:04.111940 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e9dd26ed-8cef-4a31-af68-55b3983b8383 req-79804cab-b911-43c1-a6b0-a74371f127aa service nova] Lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:16:04.112101 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e9dd26ed-8cef-4a31-af68-55b3983b8383 req-79804cab-b911-43c1-a6b0-a74371f127aa service nova] Lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:16:04.112265 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e9dd26ed-8cef-4a31-af68-55b3983b8383 req-79804cab-b911-43c1-a6b0-a74371f127aa service nova] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] No waiting events found dispatching network-vif-unplugged-cbc69d0b-efff-4170-bc4e-729f9a9f52c2 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:16:04.112412 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-e9dd26ed-8cef-4a31-af68-55b3983b8383 req-79804cab-b911-43c1-a6b0-a74371f127aa service nova] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Received event network-vif-unplugged-cbc69d0b-efff-4170-bc4e-729f9a9f52c2 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:16:04.252333 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:04.272228 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999729616999957 future=<Future at 0x7c984c66a150 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:16:04.272522 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999374966999767 future=<Future at 0x7c984c66a150 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:16:04.272627 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.99923089999993 future=<Future at 0x7c984c66a150 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:16:04.277004 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Instance destroyed successfully.
May 28 01:16:04.277506 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-682af45b-fdd0-4595-b36a-7d7044566a88 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lazy-loading 'resources' on Instance uuid 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:16:04.286435 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:04.302056 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:04.593084 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:04.600184 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:04.621097 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:04.706931 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:04.728213 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:04.779833 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-682af45b-fdd0-4595-b36a-7d7044566a88 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:15:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1610670524',display_name='tempest-AttachVolumeNegativeTest-server-1610670524',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-attachvolumenegativetest-server-1610670524',id=78,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAyPB0UUtSBkuO+XmIZvCaker0kgJ/GLMlPrHwxz8AYvy6VoxadixGynpWYSq+eWwQtNVQPluo9sLVy/0E4Ti/ISsxIUPTyt7nk5q37Rc4sUh7Ty6QCnU3D6JHdgmSYkw==',key_name='tempest-keypair-145708081',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:15:23Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d6ee814419446dcb5025c68fb0f4ce9',ramdisk_id='',reservation_id='r-dxx3atk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1272396699',owner_user_name='tempest-AttachVolumeNegativeTest-1272396699-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:15:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96f4ee9375c440d6abf68f2aa230b0c5',uuid=9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cbc69d0b-efff-4170-bc4e-729f9a9f52c2", "address": "fa:16:3e:a5:aa:b2", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc69d0b-ef", "ovs_interfaceid": "cbc69d0b-efff-4170-bc4e-729f9a9f52c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:16:04.780015 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-682af45b-fdd0-4595-b36a-7d7044566a88 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Converting VIF {"id": "cbc69d0b-efff-4170-bc4e-729f9a9f52c2", "address": "fa:16:3e:a5:aa:b2", "network": {"id": "f8ce4f22-7484-451c-b0df-2e7318e070f7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-508397786-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1d6ee814419446dcb5025c68fb0f4ce9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc69d0b-ef", "ovs_interfaceid": "cbc69d0b-efff-4170-bc4e-729f9a9f52c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:16:04.780565 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-682af45b-fdd0-4595-b36a-7d7044566a88 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:aa:b2,bridge_name='br-int',has_traffic_filtering=True,id=cbc69d0b-efff-4170-bc4e-729f9a9f52c2,network=Network(f8ce4f22-7484-451c-b0df-2e7318e070f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc69d0b-ef') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:16:04.780817 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-682af45b-fdd0-4595-b36a-7d7044566a88 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:aa:b2,bridge_name='br-int',has_traffic_filtering=True,id=cbc69d0b-efff-4170-bc4e-729f9a9f52c2,network=Network(f8ce4f22-7484-451c-b0df-2e7318e070f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc69d0b-ef') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:16:04.782024 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:04.782267 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcbc69d0b-ef, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:16:04.783173 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:04.785287 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:16:04.785820 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:04.785949 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=352904b8-3f93-42d1-8659-3d75744387b7) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:16:04.786323 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:04.787193 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:16:04.788590 np0000001577 nova-compute[98319]: INFO os_vif [None req-682af45b-fdd0-4595-b36a-7d7044566a88 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:aa:b2,bridge_name='br-int',has_traffic_filtering=True,id=cbc69d0b-efff-4170-bc4e-729f9a9f52c2,network=Network(f8ce4f22-7484-451c-b0df-2e7318e070f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc69d0b-ef')
May 28 01:16:04.788847 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-682af45b-fdd0-4595-b36a-7d7044566a88 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Deleting instance files /opt/stack/data/nova/instances/9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea_del
May 28 01:16:04.789542 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-682af45b-fdd0-4595-b36a-7d7044566a88 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Deletion of /opt/stack/data/nova/instances/9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea_del complete
May 28 01:16:05.296571 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-682af45b-fdd0-4595-b36a-7d7044566a88 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Took 1.34 seconds to destroy the instance on the hypervisor.
May 28 01:16:05.297203 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-682af45b-fdd0-4595-b36a-7d7044566a88 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:16:05.297439 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:16:05.297600 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:16:05.297915 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:16:05.403980 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:16:05.762526 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7874b947-36fa-42ac-9ba4-b2cfdd304f62 req-9bf72ea4-f82c-4c80-852c-97ac967c1781 service nova] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Received event network-vif-deleted-cbc69d0b-efff-4170-bc4e-729f9a9f52c2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:16:05.763200 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-7874b947-36fa-42ac-9ba4-b2cfdd304f62 req-9bf72ea4-f82c-4c80-852c-97ac967c1781 service nova] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Neutron deleted interface cbc69d0b-efff-4170-bc4e-729f9a9f52c2; detaching it from the instance and deleting it from the info cache
May 28 01:16:05.764892 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7874b947-36fa-42ac-9ba4-b2cfdd304f62 req-9bf72ea4-f82c-4c80-852c-97ac967c1781 service nova] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Detach interface failed, port_id=cbc69d0b-efff-4170-bc4e-729f9a9f52c2, reason: Instance 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:16:06.160519 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c1677073-8c61-42cb-bfc9-f7a0e40733d6 req-31864f6c-9358-452b-8b14-cd0a1a79376e service nova] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Received event network-vif-unplugged-cbc69d0b-efff-4170-bc4e-729f9a9f52c2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:16:06.160895 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c1677073-8c61-42cb-bfc9-f7a0e40733d6 req-31864f6c-9358-452b-8b14-cd0a1a79376e service nova] Acquiring lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:16:06.161047 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c1677073-8c61-42cb-bfc9-f7a0e40733d6 req-31864f6c-9358-452b-8b14-cd0a1a79376e service nova] Lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:16:06.161174 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c1677073-8c61-42cb-bfc9-f7a0e40733d6 req-31864f6c-9358-452b-8b14-cd0a1a79376e service nova] Lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:16:06.161277 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c1677073-8c61-42cb-bfc9-f7a0e40733d6 req-31864f6c-9358-452b-8b14-cd0a1a79376e service nova] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] No waiting events found dispatching network-vif-unplugged-cbc69d0b-efff-4170-bc4e-729f9a9f52c2 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:16:06.161400 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-c1677073-8c61-42cb-bfc9-f7a0e40733d6 req-31864f6c-9358-452b-8b14-cd0a1a79376e service nova] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Received event network-vif-unplugged-cbc69d0b-efff-4170-bc4e-729f9a9f52c2 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:16:06.222448 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:16:06.663063 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:06.724474 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Took 1.43 seconds to deallocate network for instance.
May 28 01:16:07.229519 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-682af45b-fdd0-4595-b36a-7d7044566a88 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:16:07.229968 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-682af45b-fdd0-4595-b36a-7d7044566a88 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:16:07.395982 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-682af45b-fdd0-4595-b36a-7d7044566a88 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:16:07.396194 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-682af45b-fdd0-4595-b36a-7d7044566a88 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:16:07.898864 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-682af45b-fdd0-4595-b36a-7d7044566a88 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:16:08.094446 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Acquiring lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:16:08.094619 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:16:08.094738 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Shelve offloading
May 28 01:16:08.408045 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-682af45b-fdd0-4595-b36a-7d7044566a88 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.178s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:16:08.451331 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-682af45b-fdd0-4595-b36a-7d7044566a88 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Deleted allocations for instance 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea
May 28 01:16:09.120030 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:09.143157 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:09.143157 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:09.165527 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:09.260637 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7d19367c-043e-41a2-9a17-22a13d69898d req-dadaa82b-bb0e-4a99-92e1-461664bb77e1 service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Received event network-vif-unplugged-3b980408-16a1-4501-bc77-b75f3ce2f7d6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:16:09.260893 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7d19367c-043e-41a2-9a17-22a13d69898d req-dadaa82b-bb0e-4a99-92e1-461664bb77e1 service nova] Acquiring lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:16:09.260893 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7d19367c-043e-41a2-9a17-22a13d69898d req-dadaa82b-bb0e-4a99-92e1-461664bb77e1 service nova] Lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:16:09.261395 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7d19367c-043e-41a2-9a17-22a13d69898d req-dadaa82b-bb0e-4a99-92e1-461664bb77e1 service nova] Lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:16:09.261395 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7d19367c-043e-41a2-9a17-22a13d69898d req-dadaa82b-bb0e-4a99-92e1-461664bb77e1 service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] No waiting events found dispatching network-vif-unplugged-3b980408-16a1-4501-bc77-b75f3ce2f7d6 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:16:09.261395 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-7d19367c-043e-41a2-9a17-22a13d69898d req-dadaa82b-bb0e-4a99-92e1-461664bb77e1 service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Received unexpected event network-vif-unplugged-3b980408-16a1-4501-bc77-b75f3ce2f7d6 for instance with vm_state active and task_state shelving.
May 28 01:16:09.405450 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.9997720260003 future=<Future at 0x7c984c433f80 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:16:09.407734 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Instance destroyed successfully.
May 28 01:16:09.408081 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lazy-loading 'numa_topology' on Instance uuid b15ccc22-6ebc-41b2-9286-c27746bb96d3 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:16:09.459812 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-682af45b-fdd0-4595-b36a-7d7044566a88 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Lock "9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.012s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:16:09.787133 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:09.912070 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:16:09.913786 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Acquiring lock "refresh_cache-b15ccc22-6ebc-41b2-9286-c27746bb96d3" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:16:09.913893 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Acquired lock "refresh_cache-b15ccc22-6ebc-41b2-9286-c27746bb96d3" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:16:09.913980 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:16:10.415692 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:16:10.692966 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:16:10.800811 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Updating instance_info_cache with network_info: [{"id": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "address": "fa:16:3e:03:f9:bf", "network": {"id": "744273d0-4bd0-4935-9d5a-ba0baf747156", "bridge": "br-int", "label": "tempest-TestShelveInstance-1169067650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b690857a47340a499184f882e99f512", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b980408-16", "ovs_interfaceid": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:16:11.302608 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Releasing lock "refresh_cache-b15ccc22-6ebc-41b2-9286-c27746bb96d3" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:16:11.302852 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:16:11.303137 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:16:11.330827 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-70473bee-209f-4135-90d7-3b39b864b4f0 req-4f4836cc-25d3-4fbc-8d5a-a62449fc5e6e service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Received event network-vif-unplugged-3b980408-16a1-4501-bc77-b75f3ce2f7d6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:16:11.331175 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-70473bee-209f-4135-90d7-3b39b864b4f0 req-4f4836cc-25d3-4fbc-8d5a-a62449fc5e6e service nova] Acquiring lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:16:11.331340 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-70473bee-209f-4135-90d7-3b39b864b4f0 req-4f4836cc-25d3-4fbc-8d5a-a62449fc5e6e service nova] Lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:16:11.331459 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-70473bee-209f-4135-90d7-3b39b864b4f0 req-4f4836cc-25d3-4fbc-8d5a-a62449fc5e6e service nova] Lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:16:11.331584 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-70473bee-209f-4135-90d7-3b39b864b4f0 req-4f4836cc-25d3-4fbc-8d5a-a62449fc5e6e service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] No waiting events found dispatching network-vif-unplugged-3b980408-16a1-4501-bc77-b75f3ce2f7d6 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:16:11.331691 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-70473bee-209f-4135-90d7-3b39b864b4f0 req-4f4836cc-25d3-4fbc-8d5a-a62449fc5e6e service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Received unexpected event network-vif-unplugged-3b980408-16a1-4501-bc77-b75f3ce2f7d6 for instance with vm_state active and task_state shelving.
May 28 01:16:11.664540 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:11.685319 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Instance destroyed successfully.
May 28 01:16:11.685893 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lazy-loading 'resources' on Instance uuid b15ccc22-6ebc-41b2-9286-c27746bb96d3 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:16:11.721608 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1b98a541-1db5-406e-8ab9-42df6f1aa3e8 req-ac3c6fc8-d4dd-4950-9824-a88f7baa90e8 service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Received event network-changed-3b980408-16a1-4501-bc77-b75f3ce2f7d6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:16:11.721779 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1b98a541-1db5-406e-8ab9-42df6f1aa3e8 req-ac3c6fc8-d4dd-4950-9824-a88f7baa90e8 service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Refreshing instance network info cache due to event network-changed-3b980408-16a1-4501-bc77-b75f3ce2f7d6. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:16:11.721955 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1b98a541-1db5-406e-8ab9-42df6f1aa3e8 req-ac3c6fc8-d4dd-4950-9824-a88f7baa90e8 service nova] Acquiring lock "refresh_cache-b15ccc22-6ebc-41b2-9286-c27746bb96d3" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:16:11.722066 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1b98a541-1db5-406e-8ab9-42df6f1aa3e8 req-ac3c6fc8-d4dd-4950-9824-a88f7baa90e8 service nova] Acquired lock "refresh_cache-b15ccc22-6ebc-41b2-9286-c27746bb96d3" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:16:11.722205 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-1b98a541-1db5-406e-8ab9-42df6f1aa3e8 req-ac3c6fc8-d4dd-4950-9824-a88f7baa90e8 service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Refreshing network info cache for port 3b980408-16a1-4501-bc77-b75f3ce2f7d6 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:16:12.189619 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Object Instance<b15ccc22-6ebc-41b2-9286-c27746bb96d3> lazy-loaded attributes: numa_topology,resources {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:16:12.189619 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:15:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1162676334',display_name='tempest-TestShelveInstance-server-1162676334',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testshelveinstance-server-1162676334',id=79,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVpI2uzi24NoZNbmLSXu2Y/H4h1zt3NoNcvqtQ2vN6XlrdimuogcTR9gt1SZsa5ptn+SJXyDYkR0bQ+nO5832l7Fp+UxuDvYra777gCIo06w3X0wQCyK8EslVzerIaC0Q==',key_name='tempest-TestShelveInstance-1793766569',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:15:41Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b690857a47340a499184f882e99f512',ramdisk_id='',reservation_id='r-pnwgtwr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-494253474',owner_user_name='tempest-TestShelveInstance-494253474-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:15:42Z,user_data=None,user_id='4d3446829bb647b5b3804054d4165b48',uuid=b15ccc22-6ebc-41b2-9286-c27746bb96d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "address": "fa:16:3e:03:f9:bf", "network": {"id": "744273d0-4bd0-4935-9d5a-ba0baf747156", "bridge": "br-int", "label": "tempest-TestShelveInstance-1169067650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b690857a47340a499184f882e99f512", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b980408-16", "ovs_interfaceid": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:16:12.189619 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Converting VIF {"id": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "address": "fa:16:3e:03:f9:bf", "network": {"id": "744273d0-4bd0-4935-9d5a-ba0baf747156", "bridge": "br-int", "label": "tempest-TestShelveInstance-1169067650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b690857a47340a499184f882e99f512", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b980408-16", "ovs_interfaceid": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:16:12.189619 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:f9:bf,bridge_name='br-int',has_traffic_filtering=True,id=3b980408-16a1-4501-bc77-b75f3ce2f7d6,network=Network(744273d0-4bd0-4935-9d5a-ba0baf747156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b980408-16') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:16:12.189619 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:f9:bf,bridge_name='br-int',has_traffic_filtering=True,id=3b980408-16a1-4501-bc77-b75f3ce2f7d6,network=Network(744273d0-4bd0-4935-9d5a-ba0baf747156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b980408-16') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:16:12.190140 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:12.190389 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b980408-16, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:16:12.191273 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:12.192725 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:16:12.193455 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:12.193455 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3bbe9281-7210-424c-b994-b12f10500b68) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:16:12.194437 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:12.194437 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:16:12.194818 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:12.196012 np0000001577 nova-compute[98319]: INFO os_vif [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:f9:bf,bridge_name='br-int',has_traffic_filtering=True,id=3b980408-16a1-4501-bc77-b75f3ce2f7d6,network=Network(744273d0-4bd0-4935-9d5a-ba0baf747156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b980408-16')
May 28 01:16:12.197434 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:16:12.197766 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74e6ec11-d458-4a8a-945e-6df6bbf96723', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:16:12.197975 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:16:12.198307 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:16:12.198637 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74e6ec11-d458-4a8a-945e-6df6bbf96723', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:16:12.198845 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:16:12.220023 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:16:12.220023 np0000001577 nova-compute[98319]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:16:12.220023 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:16:12.220334 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsi session list stdout=tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:16:12.220334 np0000001577 nova-compute[98319]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:16:12.220334 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:16:12.220575 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', '211'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', '212')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:16:12.220772 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', '211')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:16:12.221464 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', '212')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:16:12.222120 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c984c50b920>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723'): ({'sdc'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:16:12.222413 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:16:12.222753 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Flush multipath device 33000000001ba69e7 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:16:12.223955 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-1b98a541-1db5-406e-8ab9-42df6f1aa3e8 req-ac3c6fc8-d4dd-4950-9824-a88f7baa90e8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:16:12.288338 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:16:12.336004 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:16:12.381126 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:16:12.382113 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:16:12.382229 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:16:12.394689 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:16:12.394868 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:16:12.406621 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:12.440726 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 211, target: iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723, portal: 192.168.40.100,3260]
May 28 01:16:12.440726 np0000001577 nova-compute[98319]: Logout of [sid: 211, target: iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723, portal: 192.168.40.100,3260] successful.
May 28 01:16:12.440726 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:12.452607 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:12.465223 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:12.502221 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 212, target: iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723, portal: 192.168.50.100,3260]
May 28 01:16:12.502221 np0000001577 nova-compute[98319]: Logout of [sid: 212, target: iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723, portal: 192.168.50.100,3260] successful.
May 28 01:16:12.502221 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:12.514411 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:12.514411 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:16:12.514411 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] <== disconnect_volume: return (315ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:16:12.514411 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:16:12.514411 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Deleting instance files /opt/stack/data/nova/instances/b15ccc22-6ebc-41b2-9286-c27746bb96d3_del
May 28 01:16:12.514707 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Deletion of /opt/stack/data/nova/instances/b15ccc22-6ebc-41b2-9286-c27746bb96d3_del complete
May 28 01:16:12.554666 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-1b98a541-1db5-406e-8ab9-42df6f1aa3e8 req-ac3c6fc8-d4dd-4950-9824-a88f7baa90e8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:16:12.695793 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-1b98a541-1db5-406e-8ab9-42df6f1aa3e8 req-ac3c6fc8-d4dd-4950-9824-a88f7baa90e8 service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Updated VIF entry in instance network info cache for port 3b980408-16a1-4501-bc77-b75f3ce2f7d6. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:16:12.696411 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-1b98a541-1db5-406e-8ab9-42df6f1aa3e8 req-ac3c6fc8-d4dd-4950-9824-a88f7baa90e8 service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Updating instance_info_cache with network_info: [{"id": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "address": "fa:16:3e:03:f9:bf", "network": {"id": "744273d0-4bd0-4935-9d5a-ba0baf747156", "bridge": null, "label": "tempest-TestShelveInstance-1169067650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b690857a47340a499184f882e99f512", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap3b980408-16", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:16:13.198063 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1b98a541-1db5-406e-8ab9-42df6f1aa3e8 req-ac3c6fc8-d4dd-4950-9824-a88f7baa90e8 service nova] Releasing lock "refresh_cache-b15ccc22-6ebc-41b2-9286-c27746bb96d3" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:16:14.180776 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Deleted allocations for instance b15ccc22-6ebc-41b2-9286-c27746bb96d3
May 28 01:16:14.313112 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "837b05a1-9183-4817-88e3-0b21030df297" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:16:14.313685 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "837b05a1-9183-4817-88e3-0b21030df297" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:16:14.684967 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:16:14.685220 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:16:14.787569 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:16:14.787569 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:16:14.816375 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lazy-loading 'flavor' on Instance uuid 837b05a1-9183-4817-88e3-0b21030df297 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:16:15.023237 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:15.289904 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:16:15.798261 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.113s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:16:15.821074 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "837b05a1-9183-4817-88e3-0b21030df297" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.507s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:16:16.300757 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Acquiring lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:16:16.304016 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-65189a81-83dc-4a40-bd98-5ebf40a83469 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 8.209s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:16:16.304890 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.004s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:16:16.305046 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Unshelving
May 28 01:16:16.665133 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:16.883675 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "837b05a1-9183-4817-88e3-0b21030df297" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:16:16.883821 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "837b05a1-9183-4817-88e3-0b21030df297" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:16:16.883990 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Attaching volume 0411a854-cde5-4dca-bfa8-d7d36260bc38 to /dev/vdb
May 28 01:16:16.918836 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:16:16.930506 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:16:16.953657 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:16:16.997529 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:16:16.997764 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:16:17.007366 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:16:17.008267 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fead:84e', 'fe80::c458:12ff:fe3a:6282'] 
May 28 01:16:17.008397 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:16:17.008494 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:16:17.008733 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:16:17.008977 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Updating existing volume attachment record: ff094d97-aa62-4dbf-b4d7-e81d512f5642 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:16:17.194046 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:17.313979 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Booting with volume 74e6ec11-d458-4a8a-945e-6df6bbf96723 at /dev/vda
May 28 01:16:17.354878 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:16:17.364745 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:16:17.383632 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:16:17.425500 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:16:17.425945 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:16:17.433614 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:16:17.434674 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fead:84e', 'fe80::c458:12ff:fe3a:6282'] 
May 28 01:16:17.434808 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:16:17.435015 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:16:17.435404 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] <== get_connector_properties: return (80ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:16:17.435644 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Updating existing volume attachment record: d0e665d3-cc15-4eff-ad41-b8adc2d84d25 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:16:17.576617 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38', 'iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0411a854-cde5-4dca-bfa8-d7d36260bc38', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '837b05a1-9183-4817-88e3-0b21030df297', 'attached_at': '', 'detached_at': '', 'volume_id': '0411a854-cde5-4dca-bfa8-d7d36260bc38', 'serial': '0411a854-cde5-4dca-bfa8-d7d36260bc38'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 01:16:17.580408 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:16:17.580863 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38', 'iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0411a854-cde5-4dca-bfa8-d7d36260bc38', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:16:17.581060 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:16:17.581618 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:16:17.581884 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38', 'iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0411a854-cde5-4dca-bfa8-d7d36260bc38', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:16:17.593213 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:16:17.593728 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:16:17.594166 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:16:17.594366 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:16:17.594696 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:16:17.594898 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:16:17.606355 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:16:17.606355 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:17.611622 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:16:17.611622 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:17.618224 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38] added
May 28 01:16:17.618224 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:16:17.618224 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:16:17.618224 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:16:17.618224 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:16:17.618224 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:16:17.618224 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:17.618724 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:16:17.618798 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0243(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:16:17.619057 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:16:17.621348 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38] added
May 28 01:16:17.621348 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:16:17.621348 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:16:17.621348 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:16:17.621348 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:16:17.621348 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:16:17.621348 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:17.621514 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:16:17.621642 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0267(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:16:17.621763 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:16:18.619506 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:16:18.622144 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:16:18.631973 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:16:18.631973 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:16:18.637400 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:16:18.637400 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:18.642862 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:18.647810 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:18.653555 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 01:16:18.653555 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:16:18.653743 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 01:16:18.653743 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:16:18.653804 np0000001577 nova-compute[98319]: WARNING os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 01:16:18.653804 np0000001577 nova-compute[98319]: 
May 28 01:16:18.658476 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 01:16:18.658476 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:16:18.658603 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 01:16:18.658603 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:16:18.658696 np0000001577 nova-compute[98319]: WARNING os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 01:16:18.658696 np0000001577 nova-compute[98319]: 
May 28 01:16:18.679563 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38, portal: 192.168.40.100,3260]
May 28 01:16:18.679563 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38, portal: 192.168.40.100,3260] successful.
May 28 01:16:18.679563 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:18.689500 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:18.694584 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38, portal: 192.168.50.100,3260]
May 28 01:16:18.694584 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38, portal: 192.168.50.100,3260] successful.
May 28 01:16:18.694584 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:18.702446 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38 (non-flash)
May 28 01:16:18.702446 np0000001577 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38 (non-flash)
May 28 01:16:18.702446 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:16:18.702678 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsi session list stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38 (non-flash)
May 28 01:16:18.702678 np0000001577 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38 (non-flash)
May 28 01:16:18.702678 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:16:18.702834 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.109s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:16:18.702928 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:16:18.703400 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] HCTL ('7', '-', '-', 0) found on session 217 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:16:18.703503 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:16:18.708602 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:18.717731 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Searching for a device in session 217 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:16:18.717731 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0411a854-cde5-4dca-bfa8-d7d36260bc38', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:16:18.720862 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38 (non-flash)
May 28 01:16:18.720862 np0000001577 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38 (non-flash)
May 28 01:16:18.720862 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:16:18.721049 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsi session list stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38 (non-flash)
May 28 01:16:18.721049 np0000001577 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38 (non-flash)
May 28 01:16:18.721049 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:16:18.721387 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.127s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:16:18.721541 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:16:18.722140 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] HCTL ('8', '-', '-', 0) found on session 218 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:16:18.722333 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:16:18.739629 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Searching for a device in session 218 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:16:18.739872 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0411a854-cde5-4dca-bfa8-d7d36260bc38', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:16:19.061908 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:16:19.062164 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:16:19.063853 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lazy-loading 'pci_requests' on Instance uuid b15ccc22-6ebc-41b2-9286-c27746bb96d3 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:16:19.272336 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00043603099993561045 future=<Future at 0x7c984c66a150 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:16:19.272413 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:16:19.272510 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=5.132687767000334 future=<Future at 0x7c984c433f80 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:16:19.272606 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=5.132614090000061 future=<Future at 0x7c984c433f80 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:16:19.272865 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Emitting event <LifecycleEvent: 1779930964.2718003, 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:16:19.272990 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] VM Stopped (Lifecycle Event)
May 28 01:16:19.567526 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lazy-loading 'numa_topology' on Instance uuid b15ccc22-6ebc-41b2-9286-c27746bb96d3 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:16:19.594809 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:16:19.775397 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: 9cd9f7a7-b894-4f9e-aea9-9d6a882b38ea] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:16:20.070373 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:16:20.070475 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Claim successful on node np0000001577
May 28 01:16:20.610402 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Found WWN 330000000ed2138d9 for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:16:20.610870 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:16:20.611978 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '330000000ed2138d9', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '330000000ed2138d9'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:16:20.612061 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ed2138d9', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '330000000ed2138d9'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:16:20.613984 np0000001577 nova-compute[98319]: WARNING stevedore.named [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 01:16:20.614209 np0000001577 nova-compute[98319]: WARNING castellan.key_manager [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:16:20.614368 np0000001577 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:16:20.630566 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 01:16:20.630566 np0000001577 nova-compute[98319]:   <usage type="volume">
May 28 01:16:20.630566 np0000001577 nova-compute[98319]:     <volume>0411a854-cde5-4dca-bfa8-d7d36260bc38</volume>
May 28 01:16:20.630566 np0000001577 nova-compute[98319]:   </usage>
May 28 01:16:20.630566 np0000001577 nova-compute[98319]: </secret>
May 28 01:16:20.630566 np0000001577 nova-compute[98319]:  {{(pid=98319) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 01:16:20.636014 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lazy-loading 'flavor' on Instance uuid 837b05a1-9183-4817-88e3-0b21030df297 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:16:21.139317 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Attempting to attach volume 0411a854-cde5-4dca-bfa8-d7d36260bc38 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 01:16:21.141016 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] attach device xml: <disk type="block" device="disk">
May 28 01:16:21.141016 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:16:21.141016 np0000001577 nova-compute[98319]:   <alias name="ua-0411a854-cde5-4dca-bfa8-d7d36260bc38"/>
May 28 01:16:21.141016 np0000001577 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 28 01:16:21.141016 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:16:21.141016 np0000001577 nova-compute[98319]:   <serial>0411a854-cde5-4dca-bfa8-d7d36260bc38</serial>
May 28 01:16:21.141016 np0000001577 nova-compute[98319]:   <encryption format="luks">
May 28 01:16:21.141016 np0000001577 nova-compute[98319]:     <secret type="passphrase" uuid="112fdfd7-a2b9-4251-99fe-61677f2f6a04"/>
May 28 01:16:21.141016 np0000001577 nova-compute[98319]:   </encryption>
May 28 01:16:21.141016 np0000001577 nova-compute[98319]: </disk>
May 28 01:16:21.141016 np0000001577 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 01:16:21.212553 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:16:21.212750 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:16:21.717567 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:16:22.196703 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:22.221192 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.159s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:16:22.221367 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:16:22.271376 np0000001577 nova-compute[98319]: INFO nova.network.neutron [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Updating port 3b980408-16a1-4501-bc77-b75f3ce2f7d6 with attributes {'binding:host_id': 'np0000001577', 'device_owner': 'compute:nova'}
May 28 01:16:22.723918 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Acquiring lock "refresh_cache-b15ccc22-6ebc-41b2-9286-c27746bb96d3" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:16:22.724015 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Acquired lock "refresh_cache-b15ccc22-6ebc-41b2-9286-c27746bb96d3" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:16:22.724149 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:16:22.765009 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a2a2e835-84ee-4cd9-8b3e-b54eda3d3db1 req-9331d8f0-0533-4d32-a55d-063d7f85b8ab service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Received event network-changed-3b980408-16a1-4501-bc77-b75f3ce2f7d6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:16:22.765321 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-a2a2e835-84ee-4cd9-8b3e-b54eda3d3db1 req-9331d8f0-0533-4d32-a55d-063d7f85b8ab service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Refreshing instance network info cache due to event network-changed-3b980408-16a1-4501-bc77-b75f3ce2f7d6. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:16:22.765435 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a2a2e835-84ee-4cd9-8b3e-b54eda3d3db1 req-9331d8f0-0533-4d32-a55d-063d7f85b8ab service nova] Acquiring lock "refresh_cache-b15ccc22-6ebc-41b2-9286-c27746bb96d3" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:16:23.226040 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:16:23.477365 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:16:23.586385 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Updating instance_info_cache with network_info: [{"id": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "address": "fa:16:3e:03:f9:bf", "network": {"id": "744273d0-4bd0-4935-9d5a-ba0baf747156", "bridge": "br-int", "label": "tempest-TestShelveInstance-1169067650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b690857a47340a499184f882e99f512", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b980408-16", "ovs_interfaceid": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:16:23.743485 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:16:23.743630 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:16:23.743722 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:16:23.743816 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] No VIF found with MAC fa:16:3e:ad:08:4e, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:16:24.088205 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Releasing lock "refresh_cache-b15ccc22-6ebc-41b2-9286-c27746bb96d3" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:16:24.089246 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:16:24.089465 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a2a2e835-84ee-4cd9-8b3e-b54eda3d3db1 req-9331d8f0-0533-4d32-a55d-063d7f85b8ab service nova] Acquired lock "refresh_cache-b15ccc22-6ebc-41b2-9286-c27746bb96d3" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:16:24.089724 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Creating image(s)
May 28 01:16:24.090128 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-a2a2e835-84ee-4cd9-8b3e-b54eda3d3db1 req-9331d8f0-0533-4d32-a55d-063d7f85b8ab service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Refreshing network info cache for port 3b980408-16a1-4501-bc77-b75f3ce2f7d6 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:16:24.091034 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:16:24.091194 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Ensure instance console log exists: /opt/stack/data/nova/instances/b15ccc22-6ebc-41b2-9286-c27746bb96d3/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:16:24.091516 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:16:24.091671 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:16:24.091809 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:16:24.092367 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Start _get_guest_xml network_info=[{"id": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "address": "fa:16:3e:03:f9:bf", "network": {"id": "744273d0-4bd0-4935-9d5a-ba0baf747156", "bridge": "br-int", "label": "tempest-TestShelveInstance-1169067650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b690857a47340a499184f882e99f512", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b980408-16", "ovs_interfaceid": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74e6ec11-d458-4a8a-945e-6df6bbf96723', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'b15ccc22-6ebc-41b2-9286-c27746bb96d3', 'attached_at': '', 'detached_at': '', 'volume_id': '74e6ec11-d458-4a8a-945e-6df6bbf96723', 'serial': '74e6ec11-d458-4a8a-945e-6df6bbf96723'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'd0e665d3-cc15-4eff-ad41-b8adc2d84d25', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:16:24.094653 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:16:24.095527 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-1162676334', uuid='b15ccc22-6ebc-41b2-9286-c27746bb96d3'), owner=OwnerMeta(userid='4d3446829bb647b5b3804054d4165b48', username='tempest-TestShelveInstance-494253474-project-member', projectid='1b690857a47340a499184f882e99f512', projectname='tempest-TestShelveInstance-494253474'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "address": "fa:16:3e:03:f9:bf", "network": {"id": "744273d0-4bd0-4935-9d5a-ba0baf747156", "bridge": "br-int", "label": "tempest-TestShelveInstance-1169067650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b690857a47340a499184f882e99f512", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b980408-16", "ovs_interfaceid": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779930984.0952654) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:16:24.096740 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:16:24.097259 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:16:24.098119 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:16:24.098288 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:16:24.099147 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:16:24.099411 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:16:24.099695 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:16:24.099786 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:16:24.099899 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:16:24.099979 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:16:24.100071 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:16:24.100222 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:16:24.100309 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:16:24.100429 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:16:24.100530 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:16:24.100683 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:16:24.100808 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lazy-loading 'vcpu_model' on Instance uuid b15ccc22-6ebc-41b2-9286-c27746bb96d3 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:16:24.405529 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0003100499998254236 future=<Future at 0x7c984c433f80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:16:24.405807 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:16:24.406028 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Emitting event <LifecycleEvent: 1779930969.4051418, b15ccc22-6ebc-41b2-9286-c27746bb96d3 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:16:24.406231 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] VM Stopped (Lifecycle Event)
May 28 01:16:24.592683 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-a2a2e835-84ee-4cd9-8b3e-b54eda3d3db1 req-9331d8f0-0533-4d32-a55d-063d7f85b8ab service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:16:24.602666 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Object Instance<b15ccc22-6ebc-41b2-9286-c27746bb96d3> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:16:24.611738 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:16:24.611970 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74e6ec11-d458-4a8a-945e-6df6bbf96723', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:16:24.612119 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:16:24.612434 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:16:24.612611 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74e6ec11-d458-4a8a-945e-6df6bbf96723', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:16:24.625532 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:16:24.626301 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:16:24.626301 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:16:24.626397 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:16:24.626556 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:16:24.626692 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:16:24.638611 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:16:24.638611 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:24.642573 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:16:24.642573 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:24.650783 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723] added
May 28 01:16:24.650783 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:16:24.650783 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:16:24.650783 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:16:24.650783 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:16:24.650783 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:16:24.650783 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:24.651112 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:16:24.651112 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0243(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:16:24.651199 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:16:24.652962 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723] added
May 28 01:16:24.652962 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:16:24.652962 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:16:24.652962 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:16:24.652962 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:16:24.652962 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:16:24.652962 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:24.653240 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:16:24.653240 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0269(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:16:24.653324 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:16:24.858593 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-a2a2e835-84ee-4cd9-8b3e-b54eda3d3db1 req-9331d8f0-0533-4d32-a55d-063d7f85b8ab service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:16:24.908348 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:16:24.964628 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-a2a2e835-84ee-4cd9-8b3e-b54eda3d3db1 req-9331d8f0-0533-4d32-a55d-063d7f85b8ab service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Updated VIF entry in instance network info cache for port 3b980408-16a1-4501-bc77-b75f3ce2f7d6. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:16:24.964855 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-a2a2e835-84ee-4cd9-8b3e-b54eda3d3db1 req-9331d8f0-0533-4d32-a55d-063d7f85b8ab service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Updating instance_info_cache with network_info: [{"id": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "address": "fa:16:3e:03:f9:bf", "network": {"id": "744273d0-4bd0-4935-9d5a-ba0baf747156", "bridge": "br-int", "label": "tempest-TestShelveInstance-1169067650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b690857a47340a499184f882e99f512", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b980408-16", "ovs_interfaceid": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:16:25.295134 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ce87b993-907e-4696-b2ce-832251cdce00 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "837b05a1-9183-4817-88e3-0b21030df297" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.411s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:16:25.466793 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a2a2e835-84ee-4cd9-8b3e-b54eda3d3db1 req-9331d8f0-0533-4d32-a55d-063d7f85b8ab service nova] Releasing lock "refresh_cache-b15ccc22-6ebc-41b2-9286-c27746bb96d3" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:16:25.651518 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:16:25.653664 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:16:25.666792 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:16:25.666792 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:16:25.675219 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:16:25.675219 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:25.683288 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:25.692987 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:25.698421 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "837b05a1-9183-4817-88e3-0b21030df297" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:16:25.698768 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "837b05a1-9183-4817-88e3-0b21030df297" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:16:25.702950 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38 (non-flash)
May 28 01:16:25.702950 np0000001577 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38 (non-flash)
May 28 01:16:25.702950 np0000001577 nova-compute[98319]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-729cf69c-4cdb-449a-9427-62a55d31fadd (non-flash)
May 28 01:16:25.702950 np0000001577 nova-compute[98319]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-729cf69c-4cdb-449a-9427-62a55d31fadd (non-flash)
May 28 01:16:25.702950 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:16:25.703094 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsi session list stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38 (non-flash)
May 28 01:16:25.703094 np0000001577 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38 (non-flash)
May 28 01:16:25.703094 np0000001577 nova-compute[98319]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-729cf69c-4cdb-449a-9427-62a55d31fadd (non-flash)
May 28 01:16:25.703094 np0000001577 nova-compute[98319]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-729cf69c-4cdb-449a-9427-62a55d31fadd (non-flash)
May 28 01:16:25.703094 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:16:25.707912 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38 (non-flash)
May 28 01:16:25.707912 np0000001577 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38 (non-flash)
May 28 01:16:25.707912 np0000001577 nova-compute[98319]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-729cf69c-4cdb-449a-9427-62a55d31fadd (non-flash)
May 28 01:16:25.707912 np0000001577 nova-compute[98319]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-729cf69c-4cdb-449a-9427-62a55d31fadd (non-flash)
May 28 01:16:25.707912 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:16:25.708127 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsi session list stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38 (non-flash)
May 28 01:16:25.708127 np0000001577 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38 (non-flash)
May 28 01:16:25.708127 np0000001577 nova-compute[98319]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-729cf69c-4cdb-449a-9427-62a55d31fadd (non-flash)
May 28 01:16:25.708127 np0000001577 nova-compute[98319]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-729cf69c-4cdb-449a-9427-62a55d31fadd (non-flash)
May 28 01:16:25.708127 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:16:25.741267 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723, portal: 192.168.50.100,3260]
May 28 01:16:25.741267 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723, portal: 192.168.50.100,3260] successful.
May 28 01:16:25.741267 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:25.752867 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:25.758414 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723, portal: 192.168.40.100,3260]
May 28 01:16:25.758414 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723, portal: 192.168.40.100,3260] successful.
May 28 01:16:25.758414 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:25.770359 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38 (non-flash)
May 28 01:16:25.770359 np0000001577 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38 (non-flash)
May 28 01:16:25.770359 np0000001577 nova-compute[98319]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-729cf69c-4cdb-449a-9427-62a55d31fadd (non-flash)
May 28 01:16:25.770359 np0000001577 nova-compute[98319]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-729cf69c-4cdb-449a-9427-62a55d31fadd (non-flash)
May 28 01:16:25.770359 np0000001577 nova-compute[98319]: tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:16:25.770359 np0000001577 nova-compute[98319]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:16:25.770359 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:16:25.770789 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsi session list stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38 (non-flash)
May 28 01:16:25.770789 np0000001577 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38 (non-flash)
May 28 01:16:25.770789 np0000001577 nova-compute[98319]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-729cf69c-4cdb-449a-9427-62a55d31fadd (non-flash)
May 28 01:16:25.770789 np0000001577 nova-compute[98319]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-729cf69c-4cdb-449a-9427-62a55d31fadd (non-flash)
May 28 01:16:25.770789 np0000001577 nova-compute[98319]: tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:16:25.770789 np0000001577 nova-compute[98319]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:16:25.770789 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:16:25.771367 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.144s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:16:25.771367 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:16:25.771900 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] HCTL ('11', '-', '-', 0) found on session 221 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:16:25.771900 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:16:25.772714 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:25.789099 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Searching for a device in session 221 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:16:25.789099 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '74e6ec11-d458-4a8a-945e-6df6bbf96723', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:16:25.796047 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38 (non-flash)
May 28 01:16:25.796047 np0000001577 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38 (non-flash)
May 28 01:16:25.796047 np0000001577 nova-compute[98319]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-729cf69c-4cdb-449a-9427-62a55d31fadd (non-flash)
May 28 01:16:25.796047 np0000001577 nova-compute[98319]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-729cf69c-4cdb-449a-9427-62a55d31fadd (non-flash)
May 28 01:16:25.796047 np0000001577 nova-compute[98319]: tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:16:25.796047 np0000001577 nova-compute[98319]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:16:25.796047 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:16:25.796047 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsi session list stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38 (non-flash)
May 28 01:16:25.796047 np0000001577 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38 (non-flash)
May 28 01:16:25.796047 np0000001577 nova-compute[98319]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-729cf69c-4cdb-449a-9427-62a55d31fadd (non-flash)
May 28 01:16:25.796047 np0000001577 nova-compute[98319]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-729cf69c-4cdb-449a-9427-62a55d31fadd (non-flash)
May 28 01:16:25.796047 np0000001577 nova-compute[98319]: tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:16:25.796047 np0000001577 nova-compute[98319]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:16:25.796047 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:16:25.796047 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:16:25.796047 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:16:25.797435 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] HCTL ('12', '-', '-', 0) found on session 222 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:16:25.797435 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:16:25.812481 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Searching for a device in session 222 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:16:25.812481 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74e6ec11-d458-4a8a-945e-6df6bbf96723', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:16:26.200719 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Detaching volume 0411a854-cde5-4dca-bfa8-d7d36260bc38
May 28 01:16:26.235560 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Attempting to driver detach volume 0411a854-cde5-4dca-bfa8-d7d36260bc38 from mountpoint /dev/vdb
May 28 01:16:26.260768 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38', 'iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0411a854-cde5-4dca-bfa8-d7d36260bc38', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': '837b05a1-9183-4817-88e3-0b21030df297', 'attached_at': '', 'detached_at': '', 'volume_id': '0411a854-cde5-4dca-bfa8-d7d36260bc38', 'serial': '0411a854-cde5-4dca-bfa8-d7d36260bc38'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 01:16:26.264250 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Found disk vdb by alias ua-0411a854-cde5-4dca-bfa8-d7d36260bc38 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:16:26.265421 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Found disk vdb by alias ua-0411a854-cde5-4dca-bfa8-d7d36260bc38 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 01:16:26.265555 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Attempting to detach device vdb from instance 837b05a1-9183-4817-88e3-0b21030df297 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 01:16:26.265778 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:16:26.265778 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:16:26.265778 np0000001577 nova-compute[98319]:   <alias name="ua-0411a854-cde5-4dca-bfa8-d7d36260bc38"/>
May 28 01:16:26.265778 np0000001577 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 28 01:16:26.265778 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:16:26.265778 np0000001577 nova-compute[98319]:   <serial>0411a854-cde5-4dca-bfa8-d7d36260bc38</serial>
May 28 01:16:26.265778 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:16:26.265778 np0000001577 nova-compute[98319]:   <encryption format="luks">
May 28 01:16:26.265778 np0000001577 nova-compute[98319]:     <secret type="passphrase" uuid="112fdfd7-a2b9-4251-99fe-61677f2f6a04"/>
May 28 01:16:26.265778 np0000001577 nova-compute[98319]:   </encryption>
May 28 01:16:26.265778 np0000001577 nova-compute[98319]: </disk>
May 28 01:16:26.265778 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:16:26.270742 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Successfully detached device vdb from instance 837b05a1-9183-4817-88e3-0b21030df297 from the persistent domain config.
May 28 01:16:26.270933 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] (1/8): Attempting to detach device vdb with device alias ua-0411a854-cde5-4dca-bfa8-d7d36260bc38 from instance 837b05a1-9183-4817-88e3-0b21030df297 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 01:16:26.271197 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] detach device xml: <disk type="block" device="disk">
May 28 01:16:26.271197 np0000001577 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:16:26.271197 np0000001577 nova-compute[98319]:   <alias name="ua-0411a854-cde5-4dca-bfa8-d7d36260bc38"/>
May 28 01:16:26.271197 np0000001577 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 28 01:16:26.271197 np0000001577 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 28 01:16:26.271197 np0000001577 nova-compute[98319]:   <serial>0411a854-cde5-4dca-bfa8-d7d36260bc38</serial>
May 28 01:16:26.271197 np0000001577 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 01:16:26.271197 np0000001577 nova-compute[98319]:   <encryption format="luks">
May 28 01:16:26.271197 np0000001577 nova-compute[98319]:     <secret type="passphrase" uuid="112fdfd7-a2b9-4251-99fe-61677f2f6a04"/>
May 28 01:16:26.271197 np0000001577 nova-compute[98319]:   </encryption>
May 28 01:16:26.271197 np0000001577 nova-compute[98319]: </disk>
May 28 01:16:26.271197 np0000001577 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 01:16:26.627053 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:16:26.726984 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Received event <DeviceRemovedEvent: 1779930986.72668, 837b05a1-9183-4817-88e3-0b21030df297 => ua-0411a854-cde5-4dca-bfa8-d7d36260bc38> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 01:16:26.727782 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-0411a854-cde5-4dca-bfa8-d7d36260bc38 for instance 837b05a1-9183-4817-88e3-0b21030df297 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 01:16:26.729798 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Successfully detached device vdb from instance 837b05a1-9183-4817-88e3-0b21030df297 from the live domain config.
May 28 01:16:26.731852 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:16:26.732101 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38', 'iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0411a854-cde5-4dca-bfa8-d7d36260bc38', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:16:26.732234 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:16:27.198604 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:27.641557 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Found WWN 33000000001ba69e7 for multipath device dm-3 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:16:27.641840 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:16:27.641949 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '33000000001ba69e7', 'path': '/dev/dm-3', 'multipath_id': '33000000001ba69e7'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:16:27.642071 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000001ba69e7', 'path': '/dev/dm-3', 'multipath_id': '33000000001ba69e7'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:16:27.642508 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.910s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:16:27.642847 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38', 'iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0411a854-cde5-4dca-bfa8-d7d36260bc38', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:16:27.643091 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:16:27.666173 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38 (non-flash)
May 28 01:16:27.666173 np0000001577 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38 (non-flash)
May 28 01:16:27.666173 np0000001577 nova-compute[98319]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-729cf69c-4cdb-449a-9427-62a55d31fadd (non-flash)
May 28 01:16:27.666173 np0000001577 nova-compute[98319]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-729cf69c-4cdb-449a-9427-62a55d31fadd (non-flash)
May 28 01:16:27.666173 np0000001577 nova-compute[98319]: tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:16:27.666173 np0000001577 nova-compute[98319]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:16:27.666173 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:16:27.666442 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsi session list stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38 (non-flash)
May 28 01:16:27.666442 np0000001577 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38 (non-flash)
May 28 01:16:27.666442 np0000001577 nova-compute[98319]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-729cf69c-4cdb-449a-9427-62a55d31fadd (non-flash)
May 28 01:16:27.666442 np0000001577 nova-compute[98319]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-729cf69c-4cdb-449a-9427-62a55d31fadd (non-flash)
May 28 01:16:27.666442 np0000001577 nova-compute[98319]: tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:16:27.666442 np0000001577 nova-compute[98319]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:16:27.666442 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:16:27.666442 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38', '217'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38', '218'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-729cf69c-4cdb-449a-9427-62a55d31fadd', '219'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-729cf69c-4cdb-449a-9427-62a55d31fadd', '220'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', '221'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', '222')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:16:27.666642 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38', '217')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:16:27.667219 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38', '218')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:16:27.667874 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c984c56ede0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38'): ({'sdc'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:16:27.668034 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:16:27.668243 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Flush multipath device 330000000ed2138d9 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:16:27.695338 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:16:27.744773 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:16:27.777904 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:16:27.778127 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:16:27.779016 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:16:27.792459 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:16:27.792646 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:16:27.805896 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:27.836344 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 217, target: iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38, portal: 192.168.40.100,3260]
May 28 01:16:27.836344 np0000001577 nova-compute[98319]: Logout of [sid: 217, target: iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38, portal: 192.168.40.100,3260] successful.
May 28 01:16:27.836344 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:27.851359 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:27.861422 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:27.891307 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 218, target: iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38, portal: 192.168.50.100,3260]
May 28 01:16:27.891307 np0000001577 nova-compute[98319]: Logout of [sid: 218, target: iqn.2023-03.storpool.com:os--volume-0411a854-cde5-4dca-bfa8-d7d36260bc38, portal: 192.168.50.100,3260] successful.
May 28 01:16:27.891307 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:27.904198 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:16:27.905130 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:16:27.905280 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] <== disconnect_volume: return (1172ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:16:27.905392 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:16:28.147567 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T01:15:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1162676334',display_name='tempest-TestShelveInstance-server-1162676334',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testshelveinstance-server-1162676334',id=79,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1793766569',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:15:41Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1b690857a47340a499184f882e99f512',ramdisk_id='',reservation_id='r-pnwgtwr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-494253474',owner_user_name='tempest-TestShelveInstance-494253474-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:16:17Z,user_data=None,user_id='4d3446829bb647b5b3804054d4165b48',uuid=b15ccc22-6ebc-41b2-9286-c27746bb96d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "address": "fa:16:3e:03:f9:bf", "network": {"id": "744273d0-4bd0-4935-9d5a-ba0baf747156", "bridge": "br-int", "label": "tempest-TestShelveInstance-1169067650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b690857a47340a499184f882e99f512", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b980408-16", "ovs_interfaceid": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:16:28.147873 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Converting VIF {"id": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "address": "fa:16:3e:03:f9:bf", "network": {"id": "744273d0-4bd0-4935-9d5a-ba0baf747156", "bridge": "br-int", "label": "tempest-TestShelveInstance-1169067650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b690857a47340a499184f882e99f512", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b980408-16", "ovs_interfaceid": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:16:28.148533 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:f9:bf,bridge_name='br-int',has_traffic_filtering=True,id=3b980408-16a1-4501-bc77-b75f3ce2f7d6,network=Network(744273d0-4bd0-4935-9d5a-ba0baf747156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b980408-16') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:16:28.149410 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lazy-loading 'pci_devices' on Instance uuid b15ccc22-6ebc-41b2-9286-c27746bb96d3 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:16:28.449094 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lazy-loading 'flavor' on Instance uuid 837b05a1-9183-4817-88e3-0b21030df297 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:16:28.651811 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Object Instance<b15ccc22-6ebc-41b2-9286-c27746bb96d3> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:16:28.652882 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] End _get_guest_xml xml=<domain type="qemu">
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:   <uuid>b15ccc22-6ebc-41b2-9286-c27746bb96d3</uuid>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:   <name>instance-0000004f</name>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestShelveInstance-server-1162676334</nova:name>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:16:24</nova:creationTime>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       <nova:image uuid="">
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:         <nova:user uuid="4d3446829bb647b5b3804054d4165b48">tempest-TestShelveInstance-494253474-project-member</nova:user>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:         <nova:project uuid="1b690857a47340a499184f882e99f512">tempest-TestShelveInstance-494253474</nova:project>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:         <nova:port uuid="3b980408-16a1-4501-bc77-b75f3ce2f7d6">
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:     <system>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       <entry name="serial">b15ccc22-6ebc-41b2-9286-c27746bb96d3</entry>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       <entry name="uuid">b15ccc22-6ebc-41b2-9286-c27746bb96d3</entry>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:     </system>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:   <os>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:   </os>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:   <features>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:   </features>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:   <devices>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/b15ccc22-6ebc-41b2-9286-c27746bb96d3/disk.config"/>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:     </disk>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       <alias name="ua-74e6ec11-d458-4a8a-945e-6df6bbf96723"/>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       <source dev="/dev/dm-3"/>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       <serial>74e6ec11-d458-4a8a-945e-6df6bbf96723</serial>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:     </disk>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:03:f9:bf"/>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       <target dev="tap3b980408-16"/>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:     </interface>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/b15ccc22-6ebc-41b2-9286-c27746bb96d3/console.log" append="off"/>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:     </serial>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:     <video>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:     </video>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:     </rng>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:   </devices>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]: </domain>
May 28 01:16:28.652882 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:16:28.656164 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Preparing to wait for external event network-vif-plugged-3b980408-16a1-4501-bc77-b75f3ce2f7d6 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:16:28.656164 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Acquiring lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:16:28.656164 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:16:28.656164 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:16:28.656164 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T01:15:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1162676334',display_name='tempest-TestShelveInstance-server-1162676334',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testshelveinstance-server-1162676334',id=79,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1793766569',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:15:41Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1b690857a47340a499184f882e99f512',ramdisk_id='',reservation_id='r-pnwgtwr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-494253474',owner_user_name='tempest-TestShelveInstance-494253474-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:16:17Z,user_data=None,user_id='4d3446829bb647b5b3804054d4165b48',uuid=b15ccc22-6ebc-41b2-9286-c27746bb96d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "address": "fa:16:3e:03:f9:bf", "network": {"id": "744273d0-4bd0-4935-9d5a-ba0baf747156", "bridge": "br-int", "label": "tempest-TestShelveInstance-1169067650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b690857a47340a499184f882e99f512", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b980408-16", "ovs_interfaceid": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:16:28.656164 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Converting VIF {"id": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "address": "fa:16:3e:03:f9:bf", "network": {"id": "744273d0-4bd0-4935-9d5a-ba0baf747156", "bridge": "br-int", "label": "tempest-TestShelveInstance-1169067650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b690857a47340a499184f882e99f512", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b980408-16", "ovs_interfaceid": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:16:28.656164 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:f9:bf,bridge_name='br-int',has_traffic_filtering=True,id=3b980408-16a1-4501-bc77-b75f3ce2f7d6,network=Network(744273d0-4bd0-4935-9d5a-ba0baf747156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b980408-16') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:16:28.656164 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:f9:bf,bridge_name='br-int',has_traffic_filtering=True,id=3b980408-16a1-4501-bc77-b75f3ce2f7d6,network=Network(744273d0-4bd0-4935-9d5a-ba0baf747156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b980408-16') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:16:28.656164 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:28.656164 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:16:28.656666 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:16:28.656943 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:28.657054 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6d7007a9-0a01-51f1-9620-f4499f9ef3d0', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:16:28.657940 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:28.658955 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:16:28.660697 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:28.660812 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b980408-16, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:16:28.661088 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b980408-16, col_values=(('qos', UUID('c30ef06e-bd5e-460e-89f3-59c841d0e186')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:16:28.661231 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b980408-16, col_values=(('external_ids', {'iface-id': '3b980408-16a1-4501-bc77-b75f3ce2f7d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:f9:bf', 'vm-uuid': 'b15ccc22-6ebc-41b2-9286-c27746bb96d3'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:16:28.663345 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:16:28.668160 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:28.668945 np0000001577 nova-compute[98319]: INFO os_vif [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:f9:bf,bridge_name='br-int',has_traffic_filtering=True,id=3b980408-16a1-4501-bc77-b75f3ce2f7d6,network=Network(744273d0-4bd0-4935-9d5a-ba0baf747156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b980408-16')
May 28 01:16:29.453740 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-00a4712d-d5c0-432c-b2fb-096dbe960385 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "837b05a1-9183-4817-88e3-0b21030df297" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.755s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:16:29.970794 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c7ea257-71dc-41ce-a4fc-7fbb9de1dc81 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "837b05a1-9183-4817-88e3-0b21030df297" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:16:29.971135 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c7ea257-71dc-41ce-a4fc-7fbb9de1dc81 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "837b05a1-9183-4817-88e3-0b21030df297" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:16:29.971135 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c7ea257-71dc-41ce-a4fc-7fbb9de1dc81 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "837b05a1-9183-4817-88e3-0b21030df297-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:16:29.971135 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c7ea257-71dc-41ce-a4fc-7fbb9de1dc81 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "837b05a1-9183-4817-88e3-0b21030df297-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:16:29.971254 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c7ea257-71dc-41ce-a4fc-7fbb9de1dc81 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "837b05a1-9183-4817-88e3-0b21030df297-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:16:29.972987 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-8c7ea257-71dc-41ce-a4fc-7fbb9de1dc81 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Terminating instance
May 28 01:16:30.182242 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:16:30.182349 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:16:30.182417 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] No VIF found with MAC fa:16:3e:03:f9:bf, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:16:30.182778 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Using config drive
May 28 01:16:30.475861 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-8c7ea257-71dc-41ce-a4fc-7fbb9de1dc81 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:16:30.493948 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:30.495338 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:30.508831 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:30.512612 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:30.528661 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:30.536919 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:30.608866 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d0dab218-1f24-4c2c-b121-12b56d3311f0 req-ce9f6d93-4074-4b0f-b87e-a5e164dd5d1c service nova] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Received event network-vif-unplugged-d274eeef-9c1f-4faf-81bf-152145095c9c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:16:30.609268 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d0dab218-1f24-4c2c-b121-12b56d3311f0 req-ce9f6d93-4074-4b0f-b87e-a5e164dd5d1c service nova] Acquiring lock "837b05a1-9183-4817-88e3-0b21030df297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:16:30.609500 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d0dab218-1f24-4c2c-b121-12b56d3311f0 req-ce9f6d93-4074-4b0f-b87e-a5e164dd5d1c service nova] Lock "837b05a1-9183-4817-88e3-0b21030df297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:16:30.609658 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d0dab218-1f24-4c2c-b121-12b56d3311f0 req-ce9f6d93-4074-4b0f-b87e-a5e164dd5d1c service nova] Lock "837b05a1-9183-4817-88e3-0b21030df297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:16:30.609769 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d0dab218-1f24-4c2c-b121-12b56d3311f0 req-ce9f6d93-4074-4b0f-b87e-a5e164dd5d1c service nova] [instance: 837b05a1-9183-4817-88e3-0b21030df297] No waiting events found dispatching network-vif-unplugged-d274eeef-9c1f-4faf-81bf-152145095c9c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:16:30.609922 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d0dab218-1f24-4c2c-b121-12b56d3311f0 req-ce9f6d93-4074-4b0f-b87e-a5e164dd5d1c service nova] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Received event network-vif-unplugged-d274eeef-9c1f-4faf-81bf-152145095c9c for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:16:30.684914 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lazy-loading 'ec2_ids' on Instance uuid b15ccc22-6ebc-41b2-9286-c27746bb96d3 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:16:30.785247 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999130924999918 future=<Future at 0x7c984c60e6c0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:16:30.785650 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.998729959999764 future=<Future at 0x7c984c60e6c0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:16:30.785732 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.99861463499974 future=<Future at 0x7c984c60e6c0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:16:30.787245 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Instance destroyed successfully.
May 28 01:16:30.788106 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-8c7ea257-71dc-41ce-a4fc-7fbb9de1dc81 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lazy-loading 'resources' on Instance uuid 837b05a1-9183-4817-88e3-0b21030df297 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:16:31.187886 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Object Instance<b15ccc22-6ebc-41b2-9286-c27746bb96d3> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:16:31.188225 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lazy-loading 'keypairs' on Instance uuid b15ccc22-6ebc-41b2-9286-c27746bb96d3 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:16:31.290250 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-8c7ea257-71dc-41ce-a4fc-7fbb9de1dc81 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:15:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-733082449',display_name='tempest-TestEncryptedCinderVolumes-server-733082449',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testencryptedcindervolumes-server-733082449',id=80,image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFb0VUMM/yaKoGSEAiCY2LnLvDvDjf6pRNDtI0M0ng/b5mMJ9s9PRIntM8hS1HMQmM7vbSoxEsNREGcLpOVXgQzd072ihHibmd9IDGz2d4OD0cx5QXsxCXBgDSE4ecHMg==',key_name='tempest-keypair-779082595',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:15:46Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12e4d85acc2e447481bb45dd2c61c94c',ramdisk_id='',reservation_id='r-clj1wf63',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ddb82a83-20d7-4efa-9145-29669d8920b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-1546758686',owner_user_name='tempest-TestEncryptedCinderVolumes-1546758686-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:15:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='341caf05b1b8426b9c4ed7ed3cad3ff5',uuid=837b05a1-9183-4817-88e3-0b21030df297,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d274eeef-9c1f-4faf-81bf-152145095c9c", "address": "fa:16:3e:ad:08:4e", "network": {"id": "5c0bf35e-413d-4925-b608-d6fcbd8d04db", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1322440036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12e4d85acc2e447481bb45dd2c61c94c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd274eeef-9c", "ovs_interfaceid": "d274eeef-9c1f-4faf-81bf-152145095c9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:16:31.290391 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8c7ea257-71dc-41ce-a4fc-7fbb9de1dc81 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Converting VIF {"id": "d274eeef-9c1f-4faf-81bf-152145095c9c", "address": "fa:16:3e:ad:08:4e", "network": {"id": "5c0bf35e-413d-4925-b608-d6fcbd8d04db", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1322440036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12e4d85acc2e447481bb45dd2c61c94c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd274eeef-9c", "ovs_interfaceid": "d274eeef-9c1f-4faf-81bf-152145095c9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:16:31.290868 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8c7ea257-71dc-41ce-a4fc-7fbb9de1dc81 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:08:4e,bridge_name='br-int',has_traffic_filtering=True,id=d274eeef-9c1f-4faf-81bf-152145095c9c,network=Network(5c0bf35e-413d-4925-b608-d6fcbd8d04db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd274eeef-9c') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:16:31.291068 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-8c7ea257-71dc-41ce-a4fc-7fbb9de1dc81 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:08:4e,bridge_name='br-int',has_traffic_filtering=True,id=d274eeef-9c1f-4faf-81bf-152145095c9c,network=Network(5c0bf35e-413d-4925-b608-d6fcbd8d04db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd274eeef-9c') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:16:31.292172 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:31.292366 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd274eeef-9c, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:16:31.293920 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:31.294817 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:16:31.298959 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:31.299707 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:31.299888 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bdb88492-ec09-4dc9-a983-5a036db630de) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:16:31.300769 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:31.301226 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:16:31.305309 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:31.306780 np0000001577 nova-compute[98319]: INFO os_vif [None req-8c7ea257-71dc-41ce-a4fc-7fbb9de1dc81 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:08:4e,bridge_name='br-int',has_traffic_filtering=True,id=d274eeef-9c1f-4faf-81bf-152145095c9c,network=Network(5c0bf35e-413d-4925-b608-d6fcbd8d04db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd274eeef-9c')
May 28 01:16:31.307029 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8c7ea257-71dc-41ce-a4fc-7fbb9de1dc81 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Deleting instance files /opt/stack/data/nova/instances/837b05a1-9183-4817-88e3-0b21030df297_del
May 28 01:16:31.307783 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8c7ea257-71dc-41ce-a4fc-7fbb9de1dc81 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Deletion of /opt/stack/data/nova/instances/837b05a1-9183-4817-88e3-0b21030df297_del complete
May 28 01:16:31.690236 np0000001577 nova-compute[98319]: DEBUG nova.objects.base [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Object Instance<b15ccc22-6ebc-41b2-9286-c27746bb96d3> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 01:16:31.692713 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:16:31.791722 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Creating config drive at /opt/stack/data/nova/instances/b15ccc22-6ebc-41b2-9286-c27746bb96d3/disk.config
May 28 01:16:31.794567 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b15ccc22-6ebc-41b2-9286-c27746bb96d3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpddt86dz1 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:16:31.820863 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-8c7ea257-71dc-41ce-a4fc-7fbb9de1dc81 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Took 1.34 seconds to destroy the instance on the hypervisor.
May 28 01:16:31.822098 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-8c7ea257-71dc-41ce-a4fc-7fbb9de1dc81 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:16:31.822559 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:16:31.822870 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 837b05a1-9183-4817-88e3-0b21030df297] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:16:31.823483 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:16:31.849908 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b15ccc22-6ebc-41b2-9286-c27746bb96d3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpddt86dz1" returned: 0 in 0.055s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:16:31.885557 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:16:32.164657 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:32.221257 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:32.240609 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:32.243329 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:32.252145 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5e76b801-dba6-4f86-a9f1-d371c622f5cc req-d8328cbb-d07e-4e77-957e-b27f0acd1842 service nova] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Received event network-vif-deleted-d274eeef-9c1f-4faf-81bf-152145095c9c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:16:32.252276 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-5e76b801-dba6-4f86-a9f1-d371c622f5cc req-d8328cbb-d07e-4e77-957e-b27f0acd1842 service nova] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Neutron deleted interface d274eeef-9c1f-4faf-81bf-152145095c9c; detaching it from the instance and deleting it from the info cache
May 28 01:16:32.255429 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-5e76b801-dba6-4f86-a9f1-d371c622f5cc req-d8328cbb-d07e-4e77-957e-b27f0acd1842 service nova] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Detach interface failed, port_id=d274eeef-9c1f-4faf-81bf-152145095c9c, reason: Instance 837b05a1-9183-4817-88e3-0b21030df297 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:16:32.325772 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:32.332766 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:32.575884 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:32.577356 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:32.579077 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:32.597326 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:32.670194 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9134c36e-3cd3-45a4-85e1-0f91dc5a414d req-d6bceb72-0f82-427c-9b4e-d74013d99e2a service nova] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Received event network-vif-unplugged-d274eeef-9c1f-4faf-81bf-152145095c9c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:16:32.670841 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9134c36e-3cd3-45a4-85e1-0f91dc5a414d req-d6bceb72-0f82-427c-9b4e-d74013d99e2a service nova] Acquiring lock "837b05a1-9183-4817-88e3-0b21030df297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:16:32.671185 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9134c36e-3cd3-45a4-85e1-0f91dc5a414d req-d6bceb72-0f82-427c-9b4e-d74013d99e2a service nova] Lock "837b05a1-9183-4817-88e3-0b21030df297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:16:32.671657 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9134c36e-3cd3-45a4-85e1-0f91dc5a414d req-d6bceb72-0f82-427c-9b4e-d74013d99e2a service nova] Lock "837b05a1-9183-4817-88e3-0b21030df297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:16:32.671657 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9134c36e-3cd3-45a4-85e1-0f91dc5a414d req-d6bceb72-0f82-427c-9b4e-d74013d99e2a service nova] [instance: 837b05a1-9183-4817-88e3-0b21030df297] No waiting events found dispatching network-vif-unplugged-d274eeef-9c1f-4faf-81bf-152145095c9c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:16:32.672220 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-9134c36e-3cd3-45a4-85e1-0f91dc5a414d req-d6bceb72-0f82-427c-9b4e-d74013d99e2a service nova] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Received event network-vif-unplugged-d274eeef-9c1f-4faf-81bf-152145095c9c for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:16:32.699717 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:16:32.956979 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930992.956632, b15ccc22-6ebc-41b2-9286-c27746bb96d3 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:16:32.957223 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] VM Started (Lifecycle Event)
May 28 01:16:33.204521 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Took 1.38 seconds to deallocate network for instance.
May 28 01:16:33.459446 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:16:33.461378 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930993.4612088, b15ccc22-6ebc-41b2-9286-c27746bb96d3 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:16:33.461515 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] VM Paused (Lifecycle Event)
May 28 01:16:33.710100 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c7ea257-71dc-41ce-a4fc-7fbb9de1dc81 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:16:33.710272 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c7ea257-71dc-41ce-a4fc-7fbb9de1dc81 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:16:33.828361 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c7ea257-71dc-41ce-a4fc-7fbb9de1dc81 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:16:33.828652 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-8c7ea257-71dc-41ce-a4fc-7fbb9de1dc81 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:16:33.963525 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:16:33.965366 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 3 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:16:34.298835 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-709adb52-02cc-49eb-aebd-3a858174e11b req-0d232851-a283-4ea2-98ee-f641f93b4337 service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Received event network-vif-plugged-3b980408-16a1-4501-bc77-b75f3ce2f7d6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:16:34.298915 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-709adb52-02cc-49eb-aebd-3a858174e11b req-0d232851-a283-4ea2-98ee-f641f93b4337 service nova] Acquiring lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:16:34.299123 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-709adb52-02cc-49eb-aebd-3a858174e11b req-0d232851-a283-4ea2-98ee-f641f93b4337 service nova] Lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:16:34.299288 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-709adb52-02cc-49eb-aebd-3a858174e11b req-0d232851-a283-4ea2-98ee-f641f93b4337 service nova] Lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:16:34.299463 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-709adb52-02cc-49eb-aebd-3a858174e11b req-0d232851-a283-4ea2-98ee-f641f93b4337 service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Processing event network-vif-plugged-3b980408-16a1-4501-bc77-b75f3ce2f7d6 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:16:34.299647 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-709adb52-02cc-49eb-aebd-3a858174e11b req-0d232851-a283-4ea2-98ee-f641f93b4337 service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Received event network-vif-plugged-3b980408-16a1-4501-bc77-b75f3ce2f7d6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:16:34.299913 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-709adb52-02cc-49eb-aebd-3a858174e11b req-0d232851-a283-4ea2-98ee-f641f93b4337 service nova] Acquiring lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:16:34.300622 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:16:34.300622 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-709adb52-02cc-49eb-aebd-3a858174e11b req-0d232851-a283-4ea2-98ee-f641f93b4337 service nova] Lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:16:34.300720 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-709adb52-02cc-49eb-aebd-3a858174e11b req-0d232851-a283-4ea2-98ee-f641f93b4337 service nova] Lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:16:34.300829 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-709adb52-02cc-49eb-aebd-3a858174e11b req-0d232851-a283-4ea2-98ee-f641f93b4337 service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] No waiting events found dispatching network-vif-plugged-3b980408-16a1-4501-bc77-b75f3ce2f7d6 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:16:34.301320 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-709adb52-02cc-49eb-aebd-3a858174e11b req-0d232851-a283-4ea2-98ee-f641f93b4337 service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Received unexpected event network-vif-plugged-3b980408-16a1-4501-bc77-b75f3ce2f7d6 for instance with vm_state shelved_offloaded and task_state spawning.
May 28 01:16:34.303280 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:16:34.305182 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Instance spawned successfully.
May 28 01:16:34.305773 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:16:34.331496 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-8c7ea257-71dc-41ce-a4fc-7fbb9de1dc81 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:16:34.467286 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:16:34.467595 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779930994.4673595, b15ccc22-6ebc-41b2-9286-c27746bb96d3 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:16:34.467628 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] VM Resumed (Lifecycle Event)
May 28 01:16:34.812935 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-11b3ea65-df2d-43c8-be26-8386298e36dc tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.509s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:16:34.839773 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c7ea257-71dc-41ce-a4fc-7fbb9de1dc81 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.129s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:16:34.889013 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-8c7ea257-71dc-41ce-a4fc-7fbb9de1dc81 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Deleted allocations for instance 837b05a1-9183-4817-88e3-0b21030df297
May 28 01:16:34.969599 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:16:34.971269 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:16:35.896408 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c7ea257-71dc-41ce-a4fc-7fbb9de1dc81 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "837b05a1-9183-4817-88e3-0b21030df297" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.925s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:16:36.302994 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:36.667636 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:41.305069 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:41.671120 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:45.784809 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00043706600035875454 future=<Future at 0x7c984c60e6c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:16:45.785193 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:16:45.786537 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Emitting event <LifecycleEvent: 1779930990.7842884, 837b05a1-9183-4817-88e3-0b21030df297 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:16:45.786686 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] VM Stopped (Lifecycle Event)
May 28 01:16:46.289066 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-ef98df7e-0214-4ad3-840a-7b290fe0a02b tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: 837b05a1-9183-4817-88e3-0b21030df297] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:16:46.307719 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:46.686391 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:46.978291 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:16:46.978918 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:16:47.977991 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:16:48.482096 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:16:48.482566 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:16:48.482566 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:16:48.483710 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Auditing locally available compute resources for np0000001577 (node: np0000001577) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 01:16:49.502269 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:16:49.506877 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:16:49.508037 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:16:49.564650 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "env LANG=C uptime" returned: 0 in 0.056s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:16:49.566570 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Hypervisor/Node resource view: name=np0000001577 free_ram=13482MB free_disk=72.64246368408203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 01:16:49.566570 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:16:49.566570 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:16:50.616832 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance b15ccc22-6ebc-41b2-9286-c27746bb96d3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:16:50.617153 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 01:16:50.617153 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Final resource view: name=np0000001577 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:16:49 up 48 min,  2 users,  load average: 3.60, 4.31, 4.13\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_1b690857a47340a499184f882e99f512': '1', 'io_workload': '0'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 01:16:50.697628 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:16:50.698078 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:16:51.200532 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:16:51.310948 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:51.698956 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:51.706207 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Compute_service record updated for np0000001577:np0000001577 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 01:16:51.706339 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.141s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:16:51.706651 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:16:52.706721 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:16:52.707139 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:16:52.707139 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:16:52.707313 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:16:52.707533 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:16:52.707706 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 01:16:52.707912 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.27 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:16:53.978508 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:16:53.979028 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:16:54.821360 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "f11e0854-70eb-4a30-aacf-93f5a7d35754" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:16:54.821864 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "f11e0854-70eb-4a30-aacf-93f5a7d35754" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:16:55.324371 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:16:55.879780 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:16:55.879952 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:16:55.883227 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:16:55.883370 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Claim successful on node np0000001577
May 28 01:16:55.977816 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:16:55.978086 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 53.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:16:56.179863 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:16:56.313700 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:56.707970 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:16:57.008482 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:16:57.008683 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:16:57.510942 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:16:58.016760 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.137s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:16:58.017152 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:16:58.522607 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:16:58.524558 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:16:58.524558 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:16:58.524558 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:16:58.585482 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '341caf05b1b8426b9c4ed7ed3cad3ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4d85acc2e447481bb45dd2c61c94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:16:58.967820 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Successfully created port: 8f90753b-359f-4e36-a065-292955c3a01f {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:16:59.025450 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:16:59.405689 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Successfully updated port: 8f90753b-359f-4e36-a065-292955c3a01f {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:16:59.449228 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6c2ee97c-63d4-4ae9-bf01-d356444ff69d req-b82b265f-a3b5-4bd8-aa8d-941cbb823f25 service nova] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Received event network-changed-8f90753b-359f-4e36-a065-292955c3a01f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:16:59.449374 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6c2ee97c-63d4-4ae9-bf01-d356444ff69d req-b82b265f-a3b5-4bd8-aa8d-941cbb823f25 service nova] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Refreshing instance network info cache due to event network-changed-8f90753b-359f-4e36-a065-292955c3a01f. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:16:59.449515 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6c2ee97c-63d4-4ae9-bf01-d356444ff69d req-b82b265f-a3b5-4bd8-aa8d-941cbb823f25 service nova] Acquiring lock "refresh_cache-f11e0854-70eb-4a30-aacf-93f5a7d35754" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:16:59.449851 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6c2ee97c-63d4-4ae9-bf01-d356444ff69d req-b82b265f-a3b5-4bd8-aa8d-941cbb823f25 service nova] Acquired lock "refresh_cache-f11e0854-70eb-4a30-aacf-93f5a7d35754" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:16:59.449981 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-6c2ee97c-63d4-4ae9-bf01-d356444ff69d req-b82b265f-a3b5-4bd8-aa8d-941cbb823f25 service nova] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Refreshing network info cache for port 8f90753b-359f-4e36-a065-292955c3a01f {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:16:59.528433 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:16:59.907322 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "refresh_cache-f11e0854-70eb-4a30-aacf-93f5a7d35754" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:16:59.951574 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-6c2ee97c-63d4-4ae9-bf01-d356444ff69d req-b82b265f-a3b5-4bd8-aa8d-941cbb823f25 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:17:00.002768 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-6c2ee97c-63d4-4ae9-bf01-d356444ff69d req-b82b265f-a3b5-4bd8-aa8d-941cbb823f25 service nova] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:17:00.032245 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Booting with volume ebca893d-34a4-4442-b85a-41284b10dd0b at /dev/vda
May 28 01:17:00.069280 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:17:00.080207 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:17:00.098621 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:17:00.143658 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:17:00.143936 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:17:00.153797 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-6c2ee97c-63d4-4ae9-bf01-d356444ff69d req-b82b265f-a3b5-4bd8-aa8d-941cbb823f25 service nova] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:17:00.155704 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:17:00.156498 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a', 'fe80::fc16:3eff:fe03:f9bf', 'fe80::1cba:eff:fef9:b475'] 
May 28 01:17:00.156622 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:17:00.156746 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:17:00.157150 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:17:00.157330 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Updating existing volume attachment record: 6aca3cfc-6c7c-4917-9646-23ed45a827a8 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:17:00.657614 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6c2ee97c-63d4-4ae9-bf01-d356444ff69d req-b82b265f-a3b5-4bd8-aa8d-941cbb823f25 service nova] Releasing lock "refresh_cache-f11e0854-70eb-4a30-aacf-93f5a7d35754" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:17:00.658000 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquired lock "refresh_cache-f11e0854-70eb-4a30-aacf-93f5a7d35754" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:17:00.658152 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:17:01.225081 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:17:01.316832 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:01.353266 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:17:01.461403 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Updating instance_info_cache with network_info: [{"id": "8f90753b-359f-4e36-a065-292955c3a01f", "address": "fa:16:3e:f9:02:15", "network": {"id": "5c0bf35e-413d-4925-b608-d6fcbd8d04db", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1322440036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12e4d85acc2e447481bb45dd2c61c94c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f90753b-35", "ovs_interfaceid": "8f90753b-359f-4e36-a065-292955c3a01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:17:01.708985 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:01.962470 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Releasing lock "refresh_cache-f11e0854-70eb-4a30-aacf-93f5a7d35754" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:17:01.962837 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Instance network_info: |[{"id": "8f90753b-359f-4e36-a065-292955c3a01f", "address": "fa:16:3e:f9:02:15", "network": {"id": "5c0bf35e-413d-4925-b608-d6fcbd8d04db", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1322440036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12e4d85acc2e447481bb45dd2c61c94c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f90753b-35", "ovs_interfaceid": "8f90753b-359f-4e36-a065-292955c3a01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:17:02.238865 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:17:02.239996 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:17:02.240228 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Creating image(s)
May 28 01:17:02.240488 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:17:02.240644 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Ensure instance console log exists: /opt/stack/data/nova/instances/f11e0854-70eb-4a30-aacf-93f5a7d35754/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:17:02.240860 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:17:02.241056 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:17:02.241169 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:17:02.241647 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Start _get_guest_xml network_info=[{"id": "8f90753b-359f-4e36-a065-292955c3a01f", "address": "fa:16:3e:f9:02:15", "network": {"id": "5c0bf35e-413d-4925-b608-d6fcbd8d04db", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1322440036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12e4d85acc2e447481bb45dd2c61c94c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f90753b-35", "ovs_interfaceid": "8f90753b-359f-4e36-a065-292955c3a01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b', 'iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ebca893d-34a4-4442-b85a-41284b10dd0b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'f11e0854-70eb-4a30-aacf-93f5a7d35754', 'attached_at': '', 'detached_at': '', 'volume_id': 'ebca893d-34a4-4442-b85a-41284b10dd0b', 'serial': 'ebca893d-34a4-4442-b85a-41284b10dd0b'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '6aca3cfc-6c7c-4917-9646-23ed45a827a8', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:17:02.245714 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:17:02.246711 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-503300161', uuid='f11e0854-70eb-4a30-aacf-93f5a7d35754'), owner=OwnerMeta(userid='341caf05b1b8426b9c4ed7ed3cad3ff5', username='tempest-TestEncryptedCinderVolumes-1546758686-project-member', projectid='12e4d85acc2e447481bb45dd2c61c94c', projectname='tempest-TestEncryptedCinderVolumes-1546758686'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8f90753b-359f-4e36-a065-292955c3a01f", "address": "fa:16:3e:f9:02:15", "network": {"id": "5c0bf35e-413d-4925-b608-d6fcbd8d04db", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1322440036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12e4d85acc2e447481bb45dd2c61c94c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f90753b-35", "ovs_interfaceid": "8f90753b-359f-4e36-a065-292955c3a01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779931022.2463973) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:17:02.247780 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:17:02.248067 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:17:02.248936 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:17:02.249109 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:17:02.249913 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:17:02.250261 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:17:02.250412 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:17:02.250500 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:17:02.250639 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:17:02.250717 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:17:02.250835 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:17:02.250978 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:17:02.251079 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:17:02.251183 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:17:02.251273 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:17:02.251386 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:17:02.260971 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:17:02.261276 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b', 'iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ebca893d-34a4-4442-b85a-41284b10dd0b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:17:02.261383 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:17:02.261740 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:17:02.261906 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b', 'iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ebca893d-34a4-4442-b85a-41284b10dd0b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:17:02.275996 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:17:02.276742 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:17:02.277222 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:17:02.277442 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:17:02.278198 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:17:02.278446 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:17:02.289561 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:17:02.289561 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:17:02.294082 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:17:02.294082 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:17:02.300422 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b] added
May 28 01:17:02.300422 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:17:02.300422 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:17:02.300422 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:17:02.300422 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:17:02.300422 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:17:02.300422 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:17:02.300660 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:17:02.300782 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0233(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:17:02.300916 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:17:02.304916 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b] added
May 28 01:17:02.304916 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:17:02.304916 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:17:02.304916 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:17:02.304916 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:17:02.304916 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:17:02.304916 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:17:02.305102 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:17:02.305325 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0269(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:17:02.305482 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:17:03.301269 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:17:03.305841 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:17:03.312625 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:17:03.312625 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:17:03.318397 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:17:03.318397 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:17:03.325318 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:17:03.333122 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:17:03.338438 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:17:03.338438 np0000001577 nova-compute[98319]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:17:03.338438 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:17:03.338438 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsi session list stdout=tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:17:03.338438 np0000001577 nova-compute[98319]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:17:03.338438 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:17:03.345506 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:17:03.345506 np0000001577 nova-compute[98319]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:17:03.345506 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:17:03.345699 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsi session list stdout=tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:17:03.345699 np0000001577 nova-compute[98319]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:17:03.345699 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:17:03.375916 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b, portal: 192.168.40.100,3260]
May 28 01:17:03.375916 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b, portal: 192.168.40.100,3260] successful.
May 28 01:17:03.375916 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:17:03.387103 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:17:03.394088 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b, portal: 192.168.50.100,3260]
May 28 01:17:03.394088 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b, portal: 192.168.50.100,3260] successful.
May 28 01:17:03.394088 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:17:03.402285 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:17:03.402285 np0000001577 nova-compute[98319]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:17:03.402285 np0000001577 nova-compute[98319]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b (non-flash)
May 28 01:17:03.402285 np0000001577 nova-compute[98319]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b (non-flash)
May 28 01:17:03.402285 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:17:03.402459 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsi session list stdout=tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:17:03.402459 np0000001577 nova-compute[98319]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:17:03.402459 np0000001577 nova-compute[98319]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b (non-flash)
May 28 01:17:03.402459 np0000001577 nova-compute[98319]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b (non-flash)
May 28 01:17:03.402459 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:17:03.402697 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.126s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:17:03.402865 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:17:03.403708 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:17:03.404243 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] HCTL ('7', '-', '-', 0) found on session 229 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:17:03.404667 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:17:03.420327 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Searching for a device in session 229 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:17:03.420327 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ebca893d-34a4-4442-b85a-41284b10dd0b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:17:03.420327 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:17:03.420327 np0000001577 nova-compute[98319]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:17:03.420327 np0000001577 nova-compute[98319]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b (non-flash)
May 28 01:17:03.420327 np0000001577 nova-compute[98319]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b (non-flash)
May 28 01:17:03.420327 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:17:03.420595 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsi session list stdout=tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:17:03.420595 np0000001577 nova-compute[98319]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:17:03.420595 np0000001577 nova-compute[98319]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b (non-flash)
May 28 01:17:03.420595 np0000001577 nova-compute[98319]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b (non-flash)
May 28 01:17:03.420595 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:17:03.420690 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:17:03.420792 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:17:03.421333 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] HCTL ('8', '-', '-', 0) found on session 230 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:17:03.421425 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:17:03.434042 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Searching for a device in session 230 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:17:03.434042 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ebca893d-34a4-4442-b85a-41284b10dd0b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:17:04.278069 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:17:05.293384 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Found WWN 3300000004746caa5 for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:17:05.293684 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:17:05.294705 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '3300000004746caa5', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '3300000004746caa5'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:17:05.294823 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004746caa5', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '3300000004746caa5'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:17:05.329161 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b', 'iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ebca893d-34a4-4442-b85a-41284b10dd0b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': 'f11e0854-70eb-4a30-aacf-93f5a7d35754', 'attached_at': '', 'detached_at': '', 'volume_id': 'ebca893d-34a4-4442-b85a-41284b10dd0b', 'serial': 'ebca893d-34a4-4442-b85a-41284b10dd0b'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 01:17:05.329658 np0000001577 nova-compute[98319]: WARNING stevedore.named [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 01:17:05.329848 np0000001577 nova-compute[98319]: WARNING castellan.key_manager [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:17:05.329981 np0000001577 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:17:05.342584 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 01:17:05.342584 np0000001577 nova-compute[98319]:   <usage type="volume">
May 28 01:17:05.342584 np0000001577 nova-compute[98319]:     <volume>ebca893d-34a4-4442-b85a-41284b10dd0b</volume>
May 28 01:17:05.342584 np0000001577 nova-compute[98319]:   </usage>
May 28 01:17:05.342584 np0000001577 nova-compute[98319]: </secret>
May 28 01:17:05.342584 np0000001577 nova-compute[98319]:  {{(pid=98319) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 01:17:05.850813 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:16:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-503300161',display_name='tempest-TestEncryptedCinderVolumes-server-503300161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testencryptedcindervolumes-server-503300161',id=81,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKcqf1b1kHkgk7CP6iDz9tjswzkyL9AC3QXTIPy7r+3u8IN+xrtIdpC549FyH7JqPppdhFbZgwo7ZLsJWN8qAt+ouJ7wMZEJpdA0Ad1yFZeNezOR6dJxymzyVn7g3tKuw==',key_name='tempest-TestEncryptedCinderVolumes-912118481',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12e4d85acc2e447481bb45dd2c61c94c',ramdisk_id='',reservation_id='r-ch34l280',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1546758686',owner_user_name='tempest-TestEncryptedCinderVolumes-1546758686-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:17:00Z,user_data=None,user_id='341caf05b1b8426b9c4ed7ed3cad3ff5',uuid=f11e0854-70eb-4a30-aacf-93f5a7d35754,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f90753b-359f-4e36-a065-292955c3a01f", "address": "fa:16:3e:f9:02:15", "network": {"id": "5c0bf35e-413d-4925-b608-d6fcbd8d04db", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1322440036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12e4d85acc2e447481bb45dd2c61c94c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f90753b-35", "ovs_interfaceid": "8f90753b-359f-4e36-a065-292955c3a01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:17:05.850983 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Converting VIF {"id": "8f90753b-359f-4e36-a065-292955c3a01f", "address": "fa:16:3e:f9:02:15", "network": {"id": "5c0bf35e-413d-4925-b608-d6fcbd8d04db", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1322440036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12e4d85acc2e447481bb45dd2c61c94c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f90753b-35", "ovs_interfaceid": "8f90753b-359f-4e36-a065-292955c3a01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:17:05.851621 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:02:15,bridge_name='br-int',has_traffic_filtering=True,id=8f90753b-359f-4e36-a065-292955c3a01f,network=Network(5c0bf35e-413d-4925-b608-d6fcbd8d04db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f90753b-35') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:17:05.852446 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lazy-loading 'pci_devices' on Instance uuid f11e0854-70eb-4a30-aacf-93f5a7d35754 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:17:06.319971 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:06.355093 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] End _get_guest_xml xml=<domain type="qemu">
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:   <uuid>f11e0854-70eb-4a30-aacf-93f5a7d35754</uuid>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:   <name>instance-00000051</name>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-503300161</nova:name>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:17:02</nova:creationTime>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       <nova:image uuid="">
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:         <nova:user uuid="341caf05b1b8426b9c4ed7ed3cad3ff5">tempest-TestEncryptedCinderVolumes-1546758686-project-member</nova:user>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:         <nova:project uuid="12e4d85acc2e447481bb45dd2c61c94c">tempest-TestEncryptedCinderVolumes-1546758686</nova:project>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:         <nova:port uuid="8f90753b-359f-4e36-a065-292955c3a01f">
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:     <system>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       <entry name="serial">f11e0854-70eb-4a30-aacf-93f5a7d35754</entry>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       <entry name="uuid">f11e0854-70eb-4a30-aacf-93f5a7d35754</entry>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:     </system>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:   <os>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:   </os>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:   <features>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:   </features>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:   <devices>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/f11e0854-70eb-4a30-aacf-93f5a7d35754/disk.config"/>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:     </disk>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       <alias name="ua-ebca893d-34a4-4442-b85a-41284b10dd0b"/>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       <serial>ebca893d-34a4-4442-b85a-41284b10dd0b</serial>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       <encryption format="luks">
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:         <secret type="passphrase" uuid="f7f17103-837f-44f4-a183-9108da19c5c5"/>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       </encryption>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:     </disk>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:f9:02:15"/>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       <target dev="tap8f90753b-35"/>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:     </interface>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/f11e0854-70eb-4a30-aacf-93f5a7d35754/console.log" append="off"/>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:     </serial>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:     <video>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:     </video>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:     </rng>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:   </devices>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]: </domain>
May 28 01:17:06.355093 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:17:06.357307 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Preparing to wait for external event network-vif-plugged-8f90753b-359f-4e36-a065-292955c3a01f {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:17:06.357307 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "f11e0854-70eb-4a30-aacf-93f5a7d35754-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:17:06.357307 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "f11e0854-70eb-4a30-aacf-93f5a7d35754-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:17:06.357307 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "f11e0854-70eb-4a30-aacf-93f5a7d35754-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:17:06.357307 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:16:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-503300161',display_name='tempest-TestEncryptedCinderVolumes-server-503300161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testencryptedcindervolumes-server-503300161',id=81,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKcqf1b1kHkgk7CP6iDz9tjswzkyL9AC3QXTIPy7r+3u8IN+xrtIdpC549FyH7JqPppdhFbZgwo7ZLsJWN8qAt+ouJ7wMZEJpdA0Ad1yFZeNezOR6dJxymzyVn7g3tKuw==',key_name='tempest-TestEncryptedCinderVolumes-912118481',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12e4d85acc2e447481bb45dd2c61c94c',ramdisk_id='',reservation_id='r-ch34l280',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1546758686',owner_user_name='tempest-TestEncryptedCinderVolumes-1546758686-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:17:00Z,user_data=None,user_id='341caf05b1b8426b9c4ed7ed3cad3ff5',uuid=f11e0854-70eb-4a30-aacf-93f5a7d35754,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f90753b-359f-4e36-a065-292955c3a01f", "address": "fa:16:3e:f9:02:15", "network": {"id": "5c0bf35e-413d-4925-b608-d6fcbd8d04db", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1322440036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12e4d85acc2e447481bb45dd2c61c94c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f90753b-35", "ovs_interfaceid": "8f90753b-359f-4e36-a065-292955c3a01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:17:06.357307 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Converting VIF {"id": "8f90753b-359f-4e36-a065-292955c3a01f", "address": "fa:16:3e:f9:02:15", "network": {"id": "5c0bf35e-413d-4925-b608-d6fcbd8d04db", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1322440036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12e4d85acc2e447481bb45dd2c61c94c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f90753b-35", "ovs_interfaceid": "8f90753b-359f-4e36-a065-292955c3a01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:17:06.357307 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:02:15,bridge_name='br-int',has_traffic_filtering=True,id=8f90753b-359f-4e36-a065-292955c3a01f,network=Network(5c0bf35e-413d-4925-b608-d6fcbd8d04db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f90753b-35') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:17:06.357307 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:02:15,bridge_name='br-int',has_traffic_filtering=True,id=8f90753b-359f-4e36-a065-292955c3a01f,network=Network(5c0bf35e-413d-4925-b608-d6fcbd8d04db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f90753b-35') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:17:06.357679 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:06.357862 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:17:06.358093 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:17:06.358731 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:06.358862 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '753ffcd5-44e2-5c9d-86c1-63e64ba9c690', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:17:06.360060 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:06.360630 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:17:06.361996 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:06.362182 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f90753b-35, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:17:06.362360 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f90753b-35, col_values=(('qos', UUID('5097fd9e-928d-46e6-b609-caca8c696367')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:17:06.362501 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f90753b-35, col_values=(('external_ids', {'iface-id': '8f90753b-359f-4e36-a065-292955c3a01f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:02:15', 'vm-uuid': 'f11e0854-70eb-4a30-aacf-93f5a7d35754'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:17:06.364927 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:17:06.367934 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:06.368555 np0000001577 nova-compute[98319]: INFO os_vif [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:02:15,bridge_name='br-int',has_traffic_filtering=True,id=8f90753b-359f-4e36-a065-292955c3a01f,network=Network(5c0bf35e-413d-4925-b608-d6fcbd8d04db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f90753b-35')
May 28 01:17:06.710658 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:07.881806 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:17:07.882161 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:17:07.882161 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] No VIF found with MAC fa:16:3e:f9:02:15, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:17:07.882428 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Using config drive
May 28 01:17:08.387674 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:17:08.492592 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Creating config drive at /opt/stack/data/nova/instances/f11e0854-70eb-4a30-aacf-93f5a7d35754/disk.config
May 28 01:17:08.495810 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f11e0854-70eb-4a30-aacf-93f5a7d35754/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpja7ky7h5 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:17:08.550434 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f11e0854-70eb-4a30-aacf-93f5a7d35754/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpja7ky7h5" returned: 0 in 0.054s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:17:08.913235 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:08.933264 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:08.934936 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:09.017829 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:09.066240 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-dc68e38d-d6ac-48cc-b6f5-1afbfaca1c93 req-eea838a8-bf7c-4bf2-b56a-06ab0e853f0b service nova] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Received event network-vif-plugged-8f90753b-359f-4e36-a065-292955c3a01f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:17:09.066522 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dc68e38d-d6ac-48cc-b6f5-1afbfaca1c93 req-eea838a8-bf7c-4bf2-b56a-06ab0e853f0b service nova] Acquiring lock "f11e0854-70eb-4a30-aacf-93f5a7d35754-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:17:09.066726 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dc68e38d-d6ac-48cc-b6f5-1afbfaca1c93 req-eea838a8-bf7c-4bf2-b56a-06ab0e853f0b service nova] Lock "f11e0854-70eb-4a30-aacf-93f5a7d35754-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:17:09.066863 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dc68e38d-d6ac-48cc-b6f5-1afbfaca1c93 req-eea838a8-bf7c-4bf2-b56a-06ab0e853f0b service nova] Lock "f11e0854-70eb-4a30-aacf-93f5a7d35754-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:17:09.066979 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-dc68e38d-d6ac-48cc-b6f5-1afbfaca1c93 req-eea838a8-bf7c-4bf2-b56a-06ab0e853f0b service nova] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Processing event network-vif-plugged-8f90753b-359f-4e36-a065-292955c3a01f {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:17:09.360579 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:09.363430 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:09.381448 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:10.604688 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779931030.60427, f11e0854-70eb-4a30-aacf-93f5a7d35754 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:17:10.605221 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:17:10.605605 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] VM Started (Lifecycle Event)
May 28 01:17:10.607415 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:17:10.610080 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Instance spawned successfully.
May 28 01:17:10.610382 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:17:11.108583 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:17:11.110447 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:17:11.116271 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:17:11.116332 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:17:11.116518 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:17:11.116721 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:17:11.116925 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:17:11.117156 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:17:11.123775 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2f88ac04-1b5a-4fdc-b8db-2fd8479dc665 req-4af8b62e-ba10-46d0-b589-88d83e889080 service nova] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Received event network-vif-plugged-8f90753b-359f-4e36-a065-292955c3a01f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:17:11.124227 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2f88ac04-1b5a-4fdc-b8db-2fd8479dc665 req-4af8b62e-ba10-46d0-b589-88d83e889080 service nova] Acquiring lock "f11e0854-70eb-4a30-aacf-93f5a7d35754-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:17:11.124444 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2f88ac04-1b5a-4fdc-b8db-2fd8479dc665 req-4af8b62e-ba10-46d0-b589-88d83e889080 service nova] Lock "f11e0854-70eb-4a30-aacf-93f5a7d35754-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:17:11.124754 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2f88ac04-1b5a-4fdc-b8db-2fd8479dc665 req-4af8b62e-ba10-46d0-b589-88d83e889080 service nova] Lock "f11e0854-70eb-4a30-aacf-93f5a7d35754-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:17:11.124875 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-2f88ac04-1b5a-4fdc-b8db-2fd8479dc665 req-4af8b62e-ba10-46d0-b589-88d83e889080 service nova] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] No waiting events found dispatching network-vif-plugged-8f90753b-359f-4e36-a065-292955c3a01f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:17:11.125000 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-2f88ac04-1b5a-4fdc-b8db-2fd8479dc665 req-4af8b62e-ba10-46d0-b589-88d83e889080 service nova] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Received unexpected event network-vif-plugged-8f90753b-359f-4e36-a065-292955c3a01f for instance with vm_state building and task_state spawning.
May 28 01:17:11.365376 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:11.614227 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:17:11.614665 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779931031.6142952, f11e0854-70eb-4a30-aacf-93f5a7d35754 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:17:11.614665 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] VM Paused (Lifecycle Event)
May 28 01:17:11.623064 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Took 9.38 seconds to spawn the instance on the hypervisor.
May 28 01:17:11.623064 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:17:11.732379 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:12.077843 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d5702231-0e32-49e2-8d4b-888c7769d677 req-acd5d587-84f9-4c26-bd26-45478a914031 service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Received event network-changed-3b980408-16a1-4501-bc77-b75f3ce2f7d6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:17:12.077843 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-d5702231-0e32-49e2-8d4b-888c7769d677 req-acd5d587-84f9-4c26-bd26-45478a914031 service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Refreshing instance network info cache due to event network-changed-3b980408-16a1-4501-bc77-b75f3ce2f7d6. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:17:12.077843 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d5702231-0e32-49e2-8d4b-888c7769d677 req-acd5d587-84f9-4c26-bd26-45478a914031 service nova] Acquiring lock "refresh_cache-b15ccc22-6ebc-41b2-9286-c27746bb96d3" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:17:12.077843 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d5702231-0e32-49e2-8d4b-888c7769d677 req-acd5d587-84f9-4c26-bd26-45478a914031 service nova] Acquired lock "refresh_cache-b15ccc22-6ebc-41b2-9286-c27746bb96d3" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:17:12.077843 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-d5702231-0e32-49e2-8d4b-888c7769d677 req-acd5d587-84f9-4c26-bd26-45478a914031 service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Refreshing network info cache for port 3b980408-16a1-4501-bc77-b75f3ce2f7d6 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:17:12.116832 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:17:12.119162 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779931032.118925, f11e0854-70eb-4a30-aacf-93f5a7d35754 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:17:12.119316 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] VM Resumed (Lifecycle Event)
May 28 01:17:12.130906 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Took 16.30 seconds to build instance.
May 28 01:17:12.581566 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-d5702231-0e32-49e2-8d4b-888c7769d677 req-acd5d587-84f9-4c26-bd26-45478a914031 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:17:12.590207 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Acquiring lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:17:12.590361 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:17:12.590575 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Acquiring lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:17:12.590711 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:17:12.590815 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:17:12.593007 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Terminating instance
May 28 01:17:12.621626 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:17:12.624378 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:17:12.632426 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-00f96853-0f2e-449d-abd6-de2433e00480 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "f11e0854-70eb-4a30-aacf-93f5a7d35754" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.810s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:17:12.865302 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-d5702231-0e32-49e2-8d4b-888c7769d677 req-acd5d587-84f9-4c26-bd26-45478a914031 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:17:13.028339 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-d5702231-0e32-49e2-8d4b-888c7769d677 req-acd5d587-84f9-4c26-bd26-45478a914031 service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Updated VIF entry in instance network info cache for port 3b980408-16a1-4501-bc77-b75f3ce2f7d6. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:17:13.028339 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-d5702231-0e32-49e2-8d4b-888c7769d677 req-acd5d587-84f9-4c26-bd26-45478a914031 service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Updating instance_info_cache with network_info: [{"id": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "address": "fa:16:3e:03:f9:bf", "network": {"id": "744273d0-4bd0-4935-9d5a-ba0baf747156", "bridge": "br-int", "label": "tempest-TestShelveInstance-1169067650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b690857a47340a499184f882e99f512", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b980408-16", "ovs_interfaceid": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:17:13.095734 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:17:13.112763 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:13.115816 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:13.135067 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:13.140092 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:13.163213 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:13.405404 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:13.413512 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:13.459113 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Instance destroyed successfully.
May 28 01:17:13.459113 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lazy-loading 'resources' on Instance uuid b15ccc22-6ebc-41b2-9286-c27746bb96d3 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:17:13.459113 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999643868000021 future=<Future at 0x7c984c364c80 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:17:13.459797 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.998735630000283 future=<Future at 0x7c984c364c80 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:17:13.459944 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.998568269000316 future=<Future at 0x7c984c364c80 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:17:13.529620 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d5702231-0e32-49e2-8d4b-888c7769d677 req-acd5d587-84f9-4c26-bd26-45478a914031 service nova] Releasing lock "refresh_cache-b15ccc22-6ebc-41b2-9286-c27746bb96d3" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:17:13.960054 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T01:15:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1162676334',display_name='tempest-TestShelveInstance-server-1162676334',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testshelveinstance-server-1162676334',id=79,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVpI2uzi24NoZNbmLSXu2Y/H4h1zt3NoNcvqtQ2vN6XlrdimuogcTR9gt1SZsa5ptn+SJXyDYkR0bQ+nO5832l7Fp+UxuDvYra777gCIo06w3X0wQCyK8EslVzerIaC0Q==',key_name='tempest-TestShelveInstance-1793766569',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:16:34Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b690857a47340a499184f882e99f512',ramdisk_id='',reservation_id='r-pnwgtwr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-494253474',owner_user_name='tempest-TestShelveInstance-494253474-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:16:34Z,user_data=None,user_id='4d3446829bb647b5b3804054d4165b48',uuid=b15ccc22-6ebc-41b2-9286-c27746bb96d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "address": "fa:16:3e:03:f9:bf", "network": {"id": "744273d0-4bd0-4935-9d5a-ba0baf747156", "bridge": "br-int", "label": "tempest-TestShelveInstance-1169067650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b690857a47340a499184f882e99f512", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b980408-16", "ovs_interfaceid": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:17:13.960477 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Converting VIF {"id": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "address": "fa:16:3e:03:f9:bf", "network": {"id": "744273d0-4bd0-4935-9d5a-ba0baf747156", "bridge": "br-int", "label": "tempest-TestShelveInstance-1169067650-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b690857a47340a499184f882e99f512", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b980408-16", "ovs_interfaceid": "3b980408-16a1-4501-bc77-b75f3ce2f7d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:17:13.960857 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:f9:bf,bridge_name='br-int',has_traffic_filtering=True,id=3b980408-16a1-4501-bc77-b75f3ce2f7d6,network=Network(744273d0-4bd0-4935-9d5a-ba0baf747156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b980408-16') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:17:13.961102 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:f9:bf,bridge_name='br-int',has_traffic_filtering=True,id=3b980408-16a1-4501-bc77-b75f3ce2f7d6,network=Network(744273d0-4bd0-4935-9d5a-ba0baf747156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b980408-16') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:17:13.962960 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:13.963196 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b980408-16, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:17:13.964522 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:13.966086 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:17:13.966526 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:13.966706 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c30ef06e-bd5e-460e-89f3-59c841d0e186) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:17:13.967487 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:13.967669 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:17:13.967813 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:13.969525 np0000001577 nova-compute[98319]: INFO os_vif [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:f9:bf,bridge_name='br-int',has_traffic_filtering=True,id=3b980408-16a1-4501-bc77-b75f3ce2f7d6,network=Network(744273d0-4bd0-4935-9d5a-ba0baf747156),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b980408-16')
May 28 01:17:13.973539 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:17:13.973845 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74e6ec11-d458-4a8a-945e-6df6bbf96723', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:17:13.974063 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:17:13.974509 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:17:13.975124 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '74e6ec11-d458-4a8a-945e-6df6bbf96723', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:17:13.975124 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:17:14.002218 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:17:14.002218 np0000001577 nova-compute[98319]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:17:14.002218 np0000001577 nova-compute[98319]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b (non-flash)
May 28 01:17:14.002218 np0000001577 nova-compute[98319]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b (non-flash)
May 28 01:17:14.002218 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:17:14.002412 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsi session list stdout=tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:17:14.002412 np0000001577 nova-compute[98319]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723 (non-flash)
May 28 01:17:14.002412 np0000001577 nova-compute[98319]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b (non-flash)
May 28 01:17:14.002412 np0000001577 nova-compute[98319]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b (non-flash)
May 28 01:17:14.002412 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:17:14.002589 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', '221'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', '222'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b', '229'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b', '230')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:17:14.002726 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', '222')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:17:14.003821 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723', '221')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:17:14.004845 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c984c5091c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723'): ({'sdf'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:17:14.005101 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Removing multipathed devices sdf, sdg {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:17:14.005361 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Flush multipath device 33000000001ba69e7 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:17:14.059841 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:17:14.063473 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-426a08bf-39e9-4be5-9c0f-e7a24e68229f req-e7447d24-edd3-4087-8841-676f72a630ab service nova] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Received event network-changed-8f90753b-359f-4e36-a065-292955c3a01f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:17:14.063854 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-426a08bf-39e9-4be5-9c0f-e7a24e68229f req-e7447d24-edd3-4087-8841-676f72a630ab service nova] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Refreshing instance network info cache due to event network-changed-8f90753b-359f-4e36-a065-292955c3a01f. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:17:14.063993 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-426a08bf-39e9-4be5-9c0f-e7a24e68229f req-e7447d24-edd3-4087-8841-676f72a630ab service nova] Acquiring lock "refresh_cache-f11e0854-70eb-4a30-aacf-93f5a7d35754" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:17:14.064121 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-426a08bf-39e9-4be5-9c0f-e7a24e68229f req-e7447d24-edd3-4087-8841-676f72a630ab service nova] Acquired lock "refresh_cache-f11e0854-70eb-4a30-aacf-93f5a7d35754" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:17:14.064207 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-426a08bf-39e9-4be5-9c0f-e7a24e68229f req-e7447d24-edd3-4087-8841-676f72a630ab service nova] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Refreshing network info cache for port 8f90753b-359f-4e36-a065-292955c3a01f {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:17:14.116973 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:17:14.130609 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7bdc7a47-6085-4dec-9d25-f9c0ed0f436c req-890fcaeb-5942-4dcb-813a-2fd8d6a7184c service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Received event network-vif-unplugged-3b980408-16a1-4501-bc77-b75f3ce2f7d6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:17:14.130962 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7bdc7a47-6085-4dec-9d25-f9c0ed0f436c req-890fcaeb-5942-4dcb-813a-2fd8d6a7184c service nova] Acquiring lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:17:14.131163 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7bdc7a47-6085-4dec-9d25-f9c0ed0f436c req-890fcaeb-5942-4dcb-813a-2fd8d6a7184c service nova] Lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:17:14.131294 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7bdc7a47-6085-4dec-9d25-f9c0ed0f436c req-890fcaeb-5942-4dcb-813a-2fd8d6a7184c service nova] Lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:17:14.131409 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7bdc7a47-6085-4dec-9d25-f9c0ed0f436c req-890fcaeb-5942-4dcb-813a-2fd8d6a7184c service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] No waiting events found dispatching network-vif-unplugged-3b980408-16a1-4501-bc77-b75f3ce2f7d6 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:17:14.131512 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7bdc7a47-6085-4dec-9d25-f9c0ed0f436c req-890fcaeb-5942-4dcb-813a-2fd8d6a7184c service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Received event network-vif-unplugged-3b980408-16a1-4501-bc77-b75f3ce2f7d6 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:17:14.131673 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7bdc7a47-6085-4dec-9d25-f9c0ed0f436c req-890fcaeb-5942-4dcb-813a-2fd8d6a7184c service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Received event network-vif-unplugged-3b980408-16a1-4501-bc77-b75f3ce2f7d6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:17:14.131733 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7bdc7a47-6085-4dec-9d25-f9c0ed0f436c req-890fcaeb-5942-4dcb-813a-2fd8d6a7184c service nova] Acquiring lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:17:14.131871 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7bdc7a47-6085-4dec-9d25-f9c0ed0f436c req-890fcaeb-5942-4dcb-813a-2fd8d6a7184c service nova] Lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:17:14.131926 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7bdc7a47-6085-4dec-9d25-f9c0ed0f436c req-890fcaeb-5942-4dcb-813a-2fd8d6a7184c service nova] Lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:17:14.132060 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7bdc7a47-6085-4dec-9d25-f9c0ed0f436c req-890fcaeb-5942-4dcb-813a-2fd8d6a7184c service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] No waiting events found dispatching network-vif-unplugged-3b980408-16a1-4501-bc77-b75f3ce2f7d6 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:17:14.132183 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-7bdc7a47-6085-4dec-9d25-f9c0ed0f436c req-890fcaeb-5942-4dcb-813a-2fd8d6a7184c service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Received event network-vif-unplugged-3b980408-16a1-4501-bc77-b75f3ce2f7d6 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:17:14.159361 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:17:14.159529 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:17:14.160323 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:17:14.170858 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:17:14.171070 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:17:14.181752 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:17:14.208270 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 222, target: iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723, portal: 192.168.40.100,3260]
May 28 01:17:14.208270 np0000001577 nova-compute[98319]: Logout of [sid: 222, target: iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723, portal: 192.168.40.100,3260] successful.
May 28 01:17:14.208270 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:17:14.224107 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:17:14.250376 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:17:14.278743 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 221, target: iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723, portal: 192.168.50.100,3260]
May 28 01:17:14.278743 np0000001577 nova-compute[98319]: Logout of [sid: 221, target: iqn.2023-03.storpool.com:os--volume-74e6ec11-d458-4a8a-945e-6df6bbf96723, portal: 192.168.50.100,3260] successful.
May 28 01:17:14.278743 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:17:14.290784 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:17:14.290989 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:17:14.291118 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] <== disconnect_volume: return (317ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:17:14.291230 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:17:14.291456 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Deleting instance files /opt/stack/data/nova/instances/b15ccc22-6ebc-41b2-9286-c27746bb96d3_del
May 28 01:17:14.291898 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Deletion of /opt/stack/data/nova/instances/b15ccc22-6ebc-41b2-9286-c27746bb96d3_del complete
May 28 01:17:14.565854 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-426a08bf-39e9-4be5-9c0f-e7a24e68229f req-e7447d24-edd3-4087-8841-676f72a630ab service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:17:14.798148 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Took 1.70 seconds to destroy the instance on the hypervisor.
May 28 01:17:14.798807 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:17:14.799157 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:17:14.799269 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:17:14.799489 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:17:14.915602 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:17:14.976110 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-426a08bf-39e9-4be5-9c0f-e7a24e68229f req-e7447d24-edd3-4087-8841-676f72a630ab service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:17:15.135182 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-426a08bf-39e9-4be5-9c0f-e7a24e68229f req-e7447d24-edd3-4087-8841-676f72a630ab service nova] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Updated VIF entry in instance network info cache for port 8f90753b-359f-4e36-a065-292955c3a01f. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:17:15.135399 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-426a08bf-39e9-4be5-9c0f-e7a24e68229f req-e7447d24-edd3-4087-8841-676f72a630ab service nova] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Updating instance_info_cache with network_info: [{"id": "8f90753b-359f-4e36-a065-292955c3a01f", "address": "fa:16:3e:f9:02:15", "network": {"id": "5c0bf35e-413d-4925-b608-d6fcbd8d04db", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1322440036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12e4d85acc2e447481bb45dd2c61c94c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f90753b-35", "ovs_interfaceid": "8f90753b-359f-4e36-a065-292955c3a01f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:17:15.156419 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-055c8443-3b4c-49b3-85e8-de76ab17d584 req-08ec29e1-8022-49e5-b7e7-584a8b9fe102 service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Received event network-vif-deleted-3b980408-16a1-4501-bc77-b75f3ce2f7d6 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:17:15.156592 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-055c8443-3b4c-49b3-85e8-de76ab17d584 req-08ec29e1-8022-49e5-b7e7-584a8b9fe102 service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Neutron deleted interface 3b980408-16a1-4501-bc77-b75f3ce2f7d6; detaching it from the instance and deleting it from the info cache
May 28 01:17:15.158202 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-055c8443-3b4c-49b3-85e8-de76ab17d584 req-08ec29e1-8022-49e5-b7e7-584a8b9fe102 service nova] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Detach interface failed, port_id=3b980408-16a1-4501-bc77-b75f3ce2f7d6, reason: Instance b15ccc22-6ebc-41b2-9286-c27746bb96d3 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:17:15.605906 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:17:15.636858 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-426a08bf-39e9-4be5-9c0f-e7a24e68229f req-e7447d24-edd3-4087-8841-676f72a630ab service nova] Releasing lock "refresh_cache-f11e0854-70eb-4a30-aacf-93f5a7d35754" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:17:16.107477 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Took 1.31 seconds to deallocate network for instance.
May 28 01:17:16.651312 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Took 0.54 seconds to detach 1 volumes for instance.
May 28 01:17:16.653255 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Deleting volume: 74e6ec11-d458-4a8a-945e-6df6bbf96723 {{(pid=98319) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 01:17:16.747130 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:17.188786 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:17:17.189209 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:17:17.309717 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:17:17.309895 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:17:17.812313 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:17:18.318911 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.130s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:17:18.378259 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Deleted allocations for instance b15ccc22-6ebc-41b2-9286-c27746bb96d3
May 28 01:17:18.968089 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:19.385508 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e91b9044-5010-463a-a68a-920f6685e261 tempest-TestShelveInstance-494253474 tempest-TestShelveInstance-494253474-project-member] Lock "b15ccc22-6ebc-41b2-9286-c27746bb96d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.795s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:17:20.594257 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:21.748912 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:22.163344 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:23.977594 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:25.469870 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:26.750348 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:27.563651 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:28.458965 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00039609099985682406 future=<Future at 0x7c984c364c80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:17:28.459564 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Emitting event <LifecycleEvent: 1779931033.4584353, b15ccc22-6ebc-41b2-9286-c27746bb96d3 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:17:28.459739 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:17:28.459873 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] VM Stopped (Lifecycle Event)
May 28 01:17:28.962285 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-da0202f7-8419-440e-a9a7-0c547690ae4b tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: b15ccc22-6ebc-41b2-9286-c27746bb96d3] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:17:28.979160 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:29.792918 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:31.341366 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:31.751870 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:33.980062 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:36.771936 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:38.981263 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:39.698050 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:39.754438 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:41.229380 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:41.786156 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:42.064957 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "f11e0854-70eb-4a30-aacf-93f5a7d35754" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:17:42.065171 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "f11e0854-70eb-4a30-aacf-93f5a7d35754" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:17:42.065326 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "f11e0854-70eb-4a30-aacf-93f5a7d35754-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:17:42.065445 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "f11e0854-70eb-4a30-aacf-93f5a7d35754-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:17:42.065557 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "f11e0854-70eb-4a30-aacf-93f5a7d35754-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:17:42.067211 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Terminating instance
May 28 01:17:42.569631 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:17:42.583251 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:42.585449 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:42.597828 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:42.599581 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:42.612944 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:42.617331 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:42.617873 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:42.696757 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-13be62a4-8f8c-429b-85b2-a9bd4363f4f7 req-833cdd5a-4f73-4085-abad-4bfa9910545d service nova] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Received event network-vif-unplugged-8f90753b-359f-4e36-a065-292955c3a01f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:17:42.697100 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-13be62a4-8f8c-429b-85b2-a9bd4363f4f7 req-833cdd5a-4f73-4085-abad-4bfa9910545d service nova] Acquiring lock "f11e0854-70eb-4a30-aacf-93f5a7d35754-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:17:42.697254 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-13be62a4-8f8c-429b-85b2-a9bd4363f4f7 req-833cdd5a-4f73-4085-abad-4bfa9910545d service nova] Lock "f11e0854-70eb-4a30-aacf-93f5a7d35754-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:17:42.697374 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-13be62a4-8f8c-429b-85b2-a9bd4363f4f7 req-833cdd5a-4f73-4085-abad-4bfa9910545d service nova] Lock "f11e0854-70eb-4a30-aacf-93f5a7d35754-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:17:42.697517 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-13be62a4-8f8c-429b-85b2-a9bd4363f4f7 req-833cdd5a-4f73-4085-abad-4bfa9910545d service nova] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] No waiting events found dispatching network-vif-unplugged-8f90753b-359f-4e36-a065-292955c3a01f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:17:42.697652 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-13be62a4-8f8c-429b-85b2-a9bd4363f4f7 req-833cdd5a-4f73-4085-abad-4bfa9910545d service nova] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Received event network-vif-unplugged-8f90753b-359f-4e36-a065-292955c3a01f for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:17:42.870375 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999724297000284 future=<Future at 0x7c984c7d03b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:17:42.871407 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.99890670700006 future=<Future at 0x7c984c7d03b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:17:42.871407 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.998764714000117 future=<Future at 0x7c984c7d03b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:17:42.872474 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Instance destroyed successfully.
May 28 01:17:42.873018 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lazy-loading 'resources' on Instance uuid f11e0854-70eb-4a30-aacf-93f5a7d35754 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:17:43.375441 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:16:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-503300161',display_name='tempest-TestEncryptedCinderVolumes-server-503300161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testencryptedcindervolumes-server-503300161',id=81,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKcqf1b1kHkgk7CP6iDz9tjswzkyL9AC3QXTIPy7r+3u8IN+xrtIdpC549FyH7JqPppdhFbZgwo7ZLsJWN8qAt+ouJ7wMZEJpdA0Ad1yFZeNezOR6dJxymzyVn7g3tKuw==',key_name='tempest-TestEncryptedCinderVolumes-912118481',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:17:11Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12e4d85acc2e447481bb45dd2c61c94c',ramdisk_id='',reservation_id='r-ch34l280',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestEncryptedCinderVolumes-1546758686',owner_user_name='tempest-TestEncryptedCinderVolumes-1546758686-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:17:12Z,user_data=None,user_id='341caf05b1b8426b9c4ed7ed3cad3ff5',uuid=f11e0854-70eb-4a30-aacf-93f5a7d35754,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f90753b-359f-4e36-a065-292955c3a01f", "address": "fa:16:3e:f9:02:15", "network": {"id": "5c0bf35e-413d-4925-b608-d6fcbd8d04db", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1322440036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12e4d85acc2e447481bb45dd2c61c94c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f90753b-35", "ovs_interfaceid": "8f90753b-359f-4e36-a065-292955c3a01f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:17:43.375717 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Converting VIF {"id": "8f90753b-359f-4e36-a065-292955c3a01f", "address": "fa:16:3e:f9:02:15", "network": {"id": "5c0bf35e-413d-4925-b608-d6fcbd8d04db", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1322440036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12e4d85acc2e447481bb45dd2c61c94c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f90753b-35", "ovs_interfaceid": "8f90753b-359f-4e36-a065-292955c3a01f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:17:43.376078 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:02:15,bridge_name='br-int',has_traffic_filtering=True,id=8f90753b-359f-4e36-a065-292955c3a01f,network=Network(5c0bf35e-413d-4925-b608-d6fcbd8d04db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f90753b-35') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:17:43.376257 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:02:15,bridge_name='br-int',has_traffic_filtering=True,id=8f90753b-359f-4e36-a065-292955c3a01f,network=Network(5c0bf35e-413d-4925-b608-d6fcbd8d04db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f90753b-35') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:17:43.376986 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:43.377146 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f90753b-35, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:17:43.378036 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:43.378851 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:17:43.379356 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:43.379465 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5097fd9e-928d-46e6-b609-caca8c696367) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:17:43.379842 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:43.380355 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:17:43.381810 np0000001577 nova-compute[98319]: INFO os_vif [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:02:15,bridge_name='br-int',has_traffic_filtering=True,id=8f90753b-359f-4e36-a065-292955c3a01f,network=Network(5c0bf35e-413d-4925-b608-d6fcbd8d04db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f90753b-35')
May 28 01:17:43.384434 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:17:43.384701 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b', 'iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ebca893d-34a4-4442-b85a-41284b10dd0b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:17:43.384817 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:17:43.385108 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:17:43.385336 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b', 'iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ebca893d-34a4-4442-b85a-41284b10dd0b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:17:43.385451 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:17:43.406926 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b (non-flash)
May 28 01:17:43.406926 np0000001577 nova-compute[98319]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b (non-flash)
May 28 01:17:43.406926 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:17:43.407088 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsi session list stdout=tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b (non-flash)
May 28 01:17:43.407088 np0000001577 nova-compute[98319]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b (non-flash)
May 28 01:17:43.407088 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:17:43.407195 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b', '229'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b', '230')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:17:43.407262 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b', '229')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:17:43.407895 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b', '230')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:17:43.408441 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c9870529ee0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b'): ({'sdc'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:17:43.408613 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:17:43.408806 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Flush multipath device 3300000004746caa5 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:17:43.441755 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:17:43.483863 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:17:43.525696 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:17:43.525832 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:17:43.526450 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:17:43.536043 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:17:43.536235 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:17:43.546203 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:17:43.573142 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 229, target: iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b, portal: 192.168.40.100,3260]
May 28 01:17:43.573142 np0000001577 nova-compute[98319]: Logout of [sid: 229, target: iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b, portal: 192.168.40.100,3260] successful.
May 28 01:17:43.573142 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:17:43.583432 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:17:43.592492 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:17:43.616083 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 230, target: iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b, portal: 192.168.50.100,3260]
May 28 01:17:43.616083 np0000001577 nova-compute[98319]: Logout of [sid: 230, target: iqn.2023-03.storpool.com:os--volume-ebca893d-34a4-4442-b85a-41284b10dd0b, portal: 192.168.50.100,3260] successful.
May 28 01:17:43.616083 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:17:43.625666 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:17:43.626436 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.241s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:17:43.626578 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] <== disconnect_volume: return (241ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:17:43.626695 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:17:43.626896 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Deleting instance files /opt/stack/data/nova/instances/f11e0854-70eb-4a30-aacf-93f5a7d35754_del
May 28 01:17:43.627421 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Deletion of /opt/stack/data/nova/instances/f11e0854-70eb-4a30-aacf-93f5a7d35754_del complete
May 28 01:17:44.132562 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Took 1.56 seconds to destroy the instance on the hypervisor.
May 28 01:17:44.133067 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:17:44.133356 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:17:44.133465 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:17:44.133697 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:17:44.216308 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:17:44.748077 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1390e56a-f1c2-435c-8b86-6d10d9b26017 req-99c6b6aa-1627-4c32-a324-26e8c4122245 service nova] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Received event network-vif-unplugged-8f90753b-359f-4e36-a065-292955c3a01f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:17:44.748463 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1390e56a-f1c2-435c-8b86-6d10d9b26017 req-99c6b6aa-1627-4c32-a324-26e8c4122245 service nova] Acquiring lock "f11e0854-70eb-4a30-aacf-93f5a7d35754-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:17:44.748597 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1390e56a-f1c2-435c-8b86-6d10d9b26017 req-99c6b6aa-1627-4c32-a324-26e8c4122245 service nova] Lock "f11e0854-70eb-4a30-aacf-93f5a7d35754-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:17:44.749094 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1390e56a-f1c2-435c-8b86-6d10d9b26017 req-99c6b6aa-1627-4c32-a324-26e8c4122245 service nova] Lock "f11e0854-70eb-4a30-aacf-93f5a7d35754-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:17:44.749338 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1390e56a-f1c2-435c-8b86-6d10d9b26017 req-99c6b6aa-1627-4c32-a324-26e8c4122245 service nova] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] No waiting events found dispatching network-vif-unplugged-8f90753b-359f-4e36-a065-292955c3a01f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:17:44.749480 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1390e56a-f1c2-435c-8b86-6d10d9b26017 req-99c6b6aa-1627-4c32-a324-26e8c4122245 service nova] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Received event network-vif-unplugged-8f90753b-359f-4e36-a065-292955c3a01f for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:17:44.749623 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1390e56a-f1c2-435c-8b86-6d10d9b26017 req-99c6b6aa-1627-4c32-a324-26e8c4122245 service nova] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Received event network-vif-deleted-8f90753b-359f-4e36-a065-292955c3a01f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:17:44.749752 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-1390e56a-f1c2-435c-8b86-6d10d9b26017 req-99c6b6aa-1627-4c32-a324-26e8c4122245 service nova] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Neutron deleted interface 8f90753b-359f-4e36-a065-292955c3a01f; detaching it from the instance and deleting it from the info cache
May 28 01:17:44.751543 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-1390e56a-f1c2-435c-8b86-6d10d9b26017 req-99c6b6aa-1627-4c32-a324-26e8c4122245 service nova] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Detach interface failed, port_id=8f90753b-359f-4e36-a065-292955c3a01f, reason: Instance f11e0854-70eb-4a30-aacf-93f5a7d35754 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:17:45.050206 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:17:45.551989 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Took 1.42 seconds to deallocate network for instance.
May 28 01:17:46.093839 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Took 0.54 seconds to detach 1 volumes for instance.
May 28 01:17:46.599568 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:17:46.599817 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:17:46.694070 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:17:46.694262 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:17:47.196527 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:17:47.702367 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.103s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:17:47.742559 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Deleted allocations for instance f11e0854-70eb-4a30-aacf-93f5a7d35754
May 28 01:17:48.382139 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:48.749251 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b1f77fbd-7637-412c-af77-62f22d08315f tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "f11e0854-70eb-4a30-aacf-93f5a7d35754" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.684s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:17:48.977985 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:17:48.978331 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:17:49.482146 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:17:49.482584 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:17:49.482584 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:17:49.482584 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Auditing locally available compute resources for np0000001577 (node: np0000001577) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 01:17:49.492746 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:17:49.493449 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:17:49.539331 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "env LANG=C uptime" returned: 0 in 0.046s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:17:49.539877 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Hypervisor/Node resource view: name=np0000001577 free_ram=14045MB free_disk=72.63587188720703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 01:17:49.540033 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:17:49.540352 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:17:50.601995 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 01:17:50.602336 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Final resource view: name=np0000001577 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:17:49 up 49 min,  2 users,  load average: 2.73, 3.93, 4.01\n'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 01:17:50.658821 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:17:50.659081 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:17:51.161803 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:17:51.668920 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Compute_service record updated for np0000001577:np0000001577 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 01:17:51.669379 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.129s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:17:51.669445 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:17:53.383081 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:17:53.668949 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:17:53.669250 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:17:53.669483 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:17:53.669848 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:17:53.669976 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 01:17:53.670181 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.31 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:17:53.978680 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:17:53.979048 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:17:57.870605 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.0004493019996516523 future=<Future at 0x7c984c7d03b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:17:57.871239 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] Emitting event <LifecycleEvent: 1779931062.8700216, f11e0854-70eb-4a30-aacf-93f5a7d35754 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:17:57.871388 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:17:57.871535 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] VM Stopped (Lifecycle Event)
May 28 01:17:57.977960 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:17:57.978308 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:17:58.374093 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-f2cb1946-dc1f-4568-8d60-ffd133186483 tempest-AttachVolumeNegativeTest-1272396699 tempest-AttachVolumeNegativeTest-1272396699-project-member] [instance: f11e0854-70eb-4a30-aacf-93f5a7d35754] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:17:58.383760 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:02.228985 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "e568a279-0fd0-4578-bcc9-bc41354730ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:18:02.229408 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "e568a279-0fd0-4578-bcc9-bc41354730ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:18:02.730644 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 01:18:03.273709 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:18:03.274017 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:18:03.276961 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 01:18:03.277137 np0000001577 nova-compute[98319]: INFO nova.compute.claims [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Claim successful on node np0000001577
May 28 01:18:03.385488 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:04.368261 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:18:04.368581 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:18:04.871146 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:18:05.377846 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.104s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:18:05.378319 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 01:18:05.883523 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 01:18:05.883944 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 01:18:05.884224 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:18:05.885148 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:18:05.943181 np0000001577 nova-compute[98319]: DEBUG nova.policy [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '341caf05b1b8426b9c4ed7ed3cad3ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e4d85acc2e447481bb45dd2c61c94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 01:18:06.369707 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Successfully created port: e3901bbb-d27a-4b51-a55c-71d88b7bd197 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 01:18:06.384600 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 01:18:06.796421 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Successfully updated port: e3901bbb-d27a-4b51-a55c-71d88b7bd197 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 01:18:06.864014 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-30587259-10c8-435d-b4fb-a4ffa98d3614 req-91db855d-f545-4458-b665-ad60f77f9d8a service nova] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Received event network-changed-e3901bbb-d27a-4b51-a55c-71d88b7bd197 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:18:06.864171 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-30587259-10c8-435d-b4fb-a4ffa98d3614 req-91db855d-f545-4458-b665-ad60f77f9d8a service nova] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Refreshing instance network info cache due to event network-changed-e3901bbb-d27a-4b51-a55c-71d88b7bd197. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:18:06.864307 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-30587259-10c8-435d-b4fb-a4ffa98d3614 req-91db855d-f545-4458-b665-ad60f77f9d8a service nova] Acquiring lock "refresh_cache-e568a279-0fd0-4578-bcc9-bc41354730ed" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:18:06.864538 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-30587259-10c8-435d-b4fb-a4ffa98d3614 req-91db855d-f545-4458-b665-ad60f77f9d8a service nova] Acquired lock "refresh_cache-e568a279-0fd0-4578-bcc9-bc41354730ed" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:18:06.864690 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-30587259-10c8-435d-b4fb-a4ffa98d3614 req-91db855d-f545-4458-b665-ad60f77f9d8a service nova] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Refreshing network info cache for port e3901bbb-d27a-4b51-a55c-71d88b7bd197 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:18:06.887052 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 01:18:07.298294 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "refresh_cache-e568a279-0fd0-4578-bcc9-bc41354730ed" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:18:07.366783 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-30587259-10c8-435d-b4fb-a4ffa98d3614 req-91db855d-f545-4458-b665-ad60f77f9d8a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:18:07.390876 np0000001577 nova-compute[98319]: INFO nova.virt.block_device [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Booting with volume e066114e-113d-4f8d-81ad-add9cdea1398 at /dev/vda
May 28 01:18:07.423757 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-30587259-10c8-435d-b4fb-a4ffa98d3614 req-91db855d-f545-4458-b665-ad60f77f9d8a service nova] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:18:07.426681 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.88', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001577', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:18:07.438622 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 01:18:07.458960 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:18:07.506466 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 01:18:07.507088 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 01:18:07.517084 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 01:18:07.518129 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Current host hostNQN  and IP(s) are ['10.4.3.88', 'fe80::f816:3eff:fe10:a82', '192.168.40.6', 'fe80::f816:3eff:fe9e:d0c4', '192.168.50.6', 'fe80::f816:3eff:fe93:dd49', '192.168.10.6', 'fe80::f816:3eff:fed4:96f1', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::5c98:d1ff:fe29:984a'] 
May 28 01:18:07.518293 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 01:18:07.518480 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 01:18:07.518977 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.88', 'host': 'np0000001577', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:39bb2796bf7e', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'ad940602-9daf-4235-b826-3c8c653263e3', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:18:07.519259 np0000001577 nova-compute[98319]: DEBUG nova.virt.block_device [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Updating existing volume attachment record: 4e0a5223-67fd-4155-8aeb-c20ab049a58a {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 01:18:07.571115 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-30587259-10c8-435d-b4fb-a4ffa98d3614 req-91db855d-f545-4458-b665-ad60f77f9d8a service nova] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:18:08.073970 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-30587259-10c8-435d-b4fb-a4ffa98d3614 req-91db855d-f545-4458-b665-ad60f77f9d8a service nova] Releasing lock "refresh_cache-e568a279-0fd0-4578-bcc9-bc41354730ed" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:18:08.074398 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquired lock "refresh_cache-e568a279-0fd0-4578-bcc9-bc41354730ed" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:18:08.074583 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 01:18:08.387177 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:08.634285 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 01:18:08.760363 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:18:08.869321 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Updating instance_info_cache with network_info: [{"id": "e3901bbb-d27a-4b51-a55c-71d88b7bd197", "address": "fa:16:3e:5a:2f:d4", "network": {"id": "5c0bf35e-413d-4925-b608-d6fcbd8d04db", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1322440036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12e4d85acc2e447481bb45dd2c61c94c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3901bbb-d2", "ovs_interfaceid": "e3901bbb-d27a-4b51-a55c-71d88b7bd197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:18:09.382270 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Releasing lock "refresh_cache-e568a279-0fd0-4578-bcc9-bc41354730ed" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:18:09.382270 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Instance network_info: |[{"id": "e3901bbb-d27a-4b51-a55c-71d88b7bd197", "address": "fa:16:3e:5a:2f:d4", "network": {"id": "5c0bf35e-413d-4925-b608-d6fcbd8d04db", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1322440036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12e4d85acc2e447481bb45dd2c61c94c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3901bbb-d2", "ovs_interfaceid": "e3901bbb-d27a-4b51-a55c-71d88b7bd197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 01:18:09.605824 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 01:18:09.606870 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 01:18:09.607117 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Creating image(s)
May 28 01:18:09.607467 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 01:18:09.607658 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Ensure instance console log exists: /opt/stack/data/nova/instances/e568a279-0fd0-4578-bcc9-bc41354730ed/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 01:18:09.607914 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:18:09.608127 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:18:09.608279 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:18:09.608755 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Start _get_guest_xml network_info=[{"id": "e3901bbb-d27a-4b51-a55c-71d88b7bd197", "address": "fa:16:3e:5a:2f:d4", "network": {"id": "5c0bf35e-413d-4925-b608-d6fcbd8d04db", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1322440036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12e4d85acc2e447481bb45dd2c61c94c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3901bbb-d2", "ovs_interfaceid": "e3901bbb-d27a-4b51-a55c-71d88b7bd197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398', 'iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e066114e-113d-4f8d-81ad-add9cdea1398', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'e568a279-0fd0-4578-bcc9-bc41354730ed', 'attached_at': '', 'detached_at': '', 'volume_id': 'e066114e-113d-4f8d-81ad-add9cdea1398', 'serial': 'e066114e-113d-4f8d-81ad-add9cdea1398'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '4e0a5223-67fd-4155-8aeb-c20ab049a58a', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 01:18:09.612776 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:18:09.613728 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1065971933', uuid='e568a279-0fd0-4578-bcc9-bc41354730ed'), owner=OwnerMeta(userid='341caf05b1b8426b9c4ed7ed3cad3ff5', username='tempest-TestEncryptedCinderVolumes-1546758686-project-member', projectid='12e4d85acc2e447481bb45dd2c61c94c', projectname='tempest-TestEncryptedCinderVolumes-1546758686'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e3901bbb-d27a-4b51-a55c-71d88b7bd197", "address": "fa:16:3e:5a:2f:d4", "network": {"id": "5c0bf35e-413d-4925-b608-d6fcbd8d04db", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1322440036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12e4d85acc2e447481bb45dd2c61c94c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3901bbb-d2", "ovs_interfaceid": "e3901bbb-d27a-4b51-a55c-71d88b7bd197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779931089.6134481) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 01:18:09.614861 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 01:18:09.615159 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 01:18:09.616096 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Searching host: 'np0000001577' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 01:18:09.616253 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 01:18:09.617168 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 01:18:09.617406 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T00:55:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 01:18:09.617529 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 01:18:09.617631 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 01:18:09.617740 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 01:18:09.617816 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 01:18:09.617909 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 01:18:09.618072 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 01:18:09.618164 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 01:18:09.618291 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 01:18:09.618396 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 01:18:09.618507 np0000001577 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 01:18:09.627603 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 01:18:09.627893 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398', 'iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e066114e-113d-4f8d-81ad-add9cdea1398', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:18:09.628024 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:18:09.628320 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:18:09.628480 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398', 'iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e066114e-113d-4f8d-81ad-add9cdea1398', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 01:18:09.639671 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:18:09.640156 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:18:09.640301 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:18:09.641013 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:18:09.641285 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:18:09.641426 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:18:09.651574 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:18:09.651574 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:18:09.655644 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 01:18:09.655644 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:18:09.661412 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398] added
May 28 01:18:09.661412 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:18:09.661412 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:18:09.661412 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:18:09.661412 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:18:09.661412 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:18:09.661412 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:18:09.661636 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:18:09.661693 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0202(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:18:09.661819 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:18:09.665751 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398] added
May 28 01:18:09.665751 np0000001577 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 01:18:09.665751 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:18:09.665751 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:18:09.665751 np0000001577 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 28 01:18:09.665751 np0000001577 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 01:18:09.665751 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:18:09.665903 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 01:18:09.665983 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.025(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 01:18:09.666096 np0000001577 nova-compute[98319]: DEBUG os_brick.utils [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 01:18:10.662284 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 01:18:10.666371 np0000001577 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:18:10.674679 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:18:10.674679 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.tpgt = -1
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.startup = manual
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.leading_login = No
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.iscsi_ifacename = default
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.net_ifacename = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.ipaddress = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.prefix_len = 0
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.hwaddress = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.transport_name = tcp
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.initiatorname = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.state = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.vlan_id = 0
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.vlan_priority = 0
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.vlan_state = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.iface_num = 0
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.mtu = 0
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.port = 0
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.bootproto = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.subnet_mask = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.gateway = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.dhcp_dns = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.fragmentation = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.tos_state = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.tos = 0
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.ttl = 0
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.delayed_ack = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.tcp_nagle = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.tcp_wsf = 0
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.tcp_timer_scale = 0
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.redirect = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.header_digest = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.data_digest = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.immediate_data = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.initial_r2t = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.erl = 0
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.max_receive_data_len = 0
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.first_burst_len = 0
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.max_burst_len = 0
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.chap_auth = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.bidi_chap = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.discovery_auth = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: iface.discovery_logout = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.discovery_address = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.discovery_port = 0
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.discovery_type = fw
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.session.initial_cmdsn = 0
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.session.cmds_max = 128
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.session.queue_depth = 32
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.session.nr_sessions = 1
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.session.auth.authmethod = None
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.session.auth.username = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.session.auth.password = ***
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.session.auth.username_in = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.session.auth.password_in = <empty>
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.session.iscsi.ERL = 0
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.session.scan = auto
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.session.reopen_max = 0
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.conn[0].port = 3260
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.conn[0].startup = manual
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 28 01:18:10.679935 np0000001577 nova-compute[98319]: # END RECORD
May 28 01:18:10.679935 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:18:10.685323 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:18:10.690366 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:18:10.695249 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 01:18:10.695249 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:18:10.695380 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 01:18:10.695380 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:18:10.695464 np0000001577 nova-compute[98319]: WARNING os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 01:18:10.695464 np0000001577 nova-compute[98319]: 
May 28 01:18:10.700954 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 01:18:10.700954 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:18:10.701087 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 01:18:10.701087 np0000001577 nova-compute[98319]:  {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:18:10.701189 np0000001577 nova-compute[98319]: WARNING os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 01:18:10.701189 np0000001577 nova-compute[98319]: 
May 28 01:18:11.728648 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398, portal: 192.168.40.100,3260]
May 28 01:18:11.728648 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398, portal: 192.168.40.100,3260] successful.
May 28 01:18:11.728648 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:18:11.729176 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398, portal: 192.168.50.100,3260]
May 28 01:18:11.729176 np0000001577 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398, portal: 192.168.50.100,3260] successful.
May 28 01:18:11.729176 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:18:11.740540 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:18:11.741072 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:18:11.755076 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [233] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398 (non-flash)
May 28 01:18:11.755076 np0000001577 nova-compute[98319]: tcp: [234] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398 (non-flash)
May 28 01:18:11.755076 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:18:11.755230 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsi session list stdout=tcp: [233] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398 (non-flash)
May 28 01:18:11.755230 np0000001577 nova-compute[98319]: tcp: [234] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398 (non-flash)
May 28 01:18:11.755230 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:18:11.755527 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.114s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:18:11.755699 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:18:11.756430 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] HCTL ('7', '-', '-', 0) found on session 233 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:18:11.756510 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:18:11.756960 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [233] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398 (non-flash)
May 28 01:18:11.756960 np0000001577 nova-compute[98319]: tcp: [234] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398 (non-flash)
May 28 01:18:11.756960 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:18:11.757079 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsi session list stdout=tcp: [233] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398 (non-flash)
May 28 01:18:11.757079 np0000001577 nova-compute[98319]: tcp: [234] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398 (non-flash)
May 28 01:18:11.757079 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:18:11.757435 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.117s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:18:11.757623 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 01:18:11.758090 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] HCTL ('8', '-', '-', 0) found on session 234 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 01:18:11.758202 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 01:18:11.768628 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Searching for a device in session 233 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:18:11.768785 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e066114e-113d-4f8d-81ad-add9cdea1398', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:18:11.774247 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Searching for a device in session 234 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 01:18:11.774247 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e066114e-113d-4f8d-81ad-add9cdea1398', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 01:18:12.641143 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 01:18:13.389115 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:13.655578 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Found WWN 330000000babe0f9a for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 01:18:13.655719 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.027s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:18:13.656518 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] <== connect_volume: return (4028ms) {'type': 'block', 'scsi_wwn': '330000000babe0f9a', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '330000000babe0f9a'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:18:13.656672 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000babe0f9a', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '330000000babe0f9a'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 01:18:13.681568 np0000001577 nova-compute[98319]: DEBUG os_brick.encryptors [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398', 'iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e066114e-113d-4f8d-81ad-add9cdea1398', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': 'e568a279-0fd0-4578-bcc9-bc41354730ed', 'attached_at': '', 'detached_at': '', 'volume_id': 'e066114e-113d-4f8d-81ad-add9cdea1398', 'serial': 'e066114e-113d-4f8d-81ad-add9cdea1398'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 01:18:13.682006 np0000001577 nova-compute[98319]: WARNING stevedore.named [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 01:18:13.682180 np0000001577 nova-compute[98319]: WARNING castellan.key_manager [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:18:13.682310 np0000001577 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 01:18:13.695398 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 01:18:13.695398 np0000001577 nova-compute[98319]:   <usage type="volume">
May 28 01:18:13.695398 np0000001577 nova-compute[98319]:     <volume>e066114e-113d-4f8d-81ad-add9cdea1398</volume>
May 28 01:18:13.695398 np0000001577 nova-compute[98319]:   </usage>
May 28 01:18:13.695398 np0000001577 nova-compute[98319]: </secret>
May 28 01:18:13.695398 np0000001577 nova-compute[98319]:  {{(pid=98319) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 01:18:14.202860 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:18:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1065971933',display_name='tempest-TestEncryptedCinderVolumes-server-1065971933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testencryptedcindervolumes-server-1065971933',id=82,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKcqf1b1kHkgk7CP6iDz9tjswzkyL9AC3QXTIPy7r+3u8IN+xrtIdpC549FyH7JqPppdhFbZgwo7ZLsJWN8qAt+ouJ7wMZEJpdA0Ad1yFZeNezOR6dJxymzyVn7g3tKuw==',key_name='tempest-TestEncryptedCinderVolumes-912118481',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12e4d85acc2e447481bb45dd2c61c94c',ramdisk_id='',reservation_id='r-wjjrqthi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1546758686',owner_user_name='tempest-TestEncryptedCinderVolumes-1546758686-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:18:07Z,user_data=None,user_id='341caf05b1b8426b9c4ed7ed3cad3ff5',uuid=e568a279-0fd0-4578-bcc9-bc41354730ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3901bbb-d27a-4b51-a55c-71d88b7bd197", "address": "fa:16:3e:5a:2f:d4", "network": {"id": "5c0bf35e-413d-4925-b608-d6fcbd8d04db", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1322440036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12e4d85acc2e447481bb45dd2c61c94c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3901bbb-d2", "ovs_interfaceid": "e3901bbb-d27a-4b51-a55c-71d88b7bd197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 01:18:14.203143 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Converting VIF {"id": "e3901bbb-d27a-4b51-a55c-71d88b7bd197", "address": "fa:16:3e:5a:2f:d4", "network": {"id": "5c0bf35e-413d-4925-b608-d6fcbd8d04db", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1322440036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12e4d85acc2e447481bb45dd2c61c94c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3901bbb-d2", "ovs_interfaceid": "e3901bbb-d27a-4b51-a55c-71d88b7bd197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:18:14.203889 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:2f:d4,bridge_name='br-int',has_traffic_filtering=True,id=e3901bbb-d27a-4b51-a55c-71d88b7bd197,network=Network(5c0bf35e-413d-4925-b608-d6fcbd8d04db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3901bbb-d2') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:18:14.205061 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lazy-loading 'pci_devices' on Instance uuid e568a279-0fd0-4578-bcc9-bc41354730ed {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:18:14.708495 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] End _get_guest_xml xml=<domain type="qemu">
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:   <uuid>e568a279-0fd0-4578-bcc9-bc41354730ed</uuid>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:   <name>instance-00000052</name>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:   <memory>196608</memory>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:   <vcpu>1</vcpu>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:   <metadata>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1065971933</nova:name>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       <nova:creationTime>2026-05-28 01:18:09</nova:creationTime>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:         <nova:extraSpecs>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:         </nova:extraSpecs>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       </nova:flavor>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       <nova:image uuid="">
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:         <nova:properties>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:         </nova:properties>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       </nova:image>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       <nova:owner>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:         <nova:user uuid="341caf05b1b8426b9c4ed7ed3cad3ff5">tempest-TestEncryptedCinderVolumes-1546758686-project-member</nova:user>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:         <nova:project uuid="12e4d85acc2e447481bb45dd2c61c94c">tempest-TestEncryptedCinderVolumes-1546758686</nova:project>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       </nova:owner>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       <nova:ports>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:         <nova:port uuid="e3901bbb-d27a-4b51-a55c-71d88b7bd197">
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:         </nova:port>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       </nova:ports>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:     </nova:instance>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:   </metadata>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:   <sysinfo type="smbios">
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:     <system>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       <entry name="serial">e568a279-0fd0-4578-bcc9-bc41354730ed</entry>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       <entry name="uuid">e568a279-0fd0-4578-bcc9-bc41354730ed</entry>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:     </system>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:   </sysinfo>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:   <os>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:     <boot dev="hd"/>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:   </os>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:   <features>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:     <acpi/>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:     <tcg>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:     </tcg>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:     <vmcoreinfo/>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:   </features>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:   <iothreads>1</iothreads>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:   <clock offset="utc"/>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:     <model>Nehalem</model>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:   </cpu>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:   <devices>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:     <disk type="file" device="cdrom">
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/e568a279-0fd0-4578-bcc9-bc41354730ed/disk.config"/>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:     </disk>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:     <disk type="block" device="disk">
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       <alias name="ua-e066114e-113d-4f8d-81ad-add9cdea1398"/>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       <serial>e066114e-113d-4f8d-81ad-add9cdea1398</serial>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       <encryption format="luks">
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:         <secret type="passphrase" uuid="68ec257f-acfb-4380-b295-8c5798dbf0fd"/>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       </encryption>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:     </disk>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:     <interface type="ethernet">
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       <mac address="fa:16:3e:5a:2f:d4"/>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       <driver name="qemu"/>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       <mtu size="1372"/>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       <target dev="tape3901bbb-d2"/>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:     </interface>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:     <serial type="pty">
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/e568a279-0fd0-4578-bcc9-bc41354730ed/console.log" append="off"/>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:     </serial>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:     <video>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       <model type="virtio"/>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:     </video>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:     <rng model="virtio">
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:     </rng>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:       <stats period="10"/>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:     </memballoon>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:   </devices>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]: </domain>
May 28 01:18:14.708495 np0000001577 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 01:18:14.711207 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Preparing to wait for external event network-vif-plugged-e3901bbb-d27a-4b51-a55c-71d88b7bd197 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 01:18:14.711207 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "e568a279-0fd0-4578-bcc9-bc41354730ed-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:18:14.711207 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "e568a279-0fd0-4578-bcc9-bc41354730ed-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:18:14.711207 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "e568a279-0fd0-4578-bcc9-bc41354730ed-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:18:14.711207 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T01:18:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1065971933',display_name='tempest-TestEncryptedCinderVolumes-server-1065971933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testencryptedcindervolumes-server-1065971933',id=82,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKcqf1b1kHkgk7CP6iDz9tjswzkyL9AC3QXTIPy7r+3u8IN+xrtIdpC549FyH7JqPppdhFbZgwo7ZLsJWN8qAt+ouJ7wMZEJpdA0Ad1yFZeNezOR6dJxymzyVn7g3tKuw==',key_name='tempest-TestEncryptedCinderVolumes-912118481',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12e4d85acc2e447481bb45dd2c61c94c',ramdisk_id='',reservation_id='r-wjjrqthi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1546758686',owner_user_name='tempest-TestEncryptedCinderVolumes-1546758686-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T01:18:07Z,user_data=None,user_id='341caf05b1b8426b9c4ed7ed3cad3ff5',uuid=e568a279-0fd0-4578-bcc9-bc41354730ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3901bbb-d27a-4b51-a55c-71d88b7bd197", "address": "fa:16:3e:5a:2f:d4", "network": {"id": "5c0bf35e-413d-4925-b608-d6fcbd8d04db", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1322440036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12e4d85acc2e447481bb45dd2c61c94c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3901bbb-d2", "ovs_interfaceid": "e3901bbb-d27a-4b51-a55c-71d88b7bd197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 01:18:14.711207 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Converting VIF {"id": "e3901bbb-d27a-4b51-a55c-71d88b7bd197", "address": "fa:16:3e:5a:2f:d4", "network": {"id": "5c0bf35e-413d-4925-b608-d6fcbd8d04db", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1322440036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12e4d85acc2e447481bb45dd2c61c94c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3901bbb-d2", "ovs_interfaceid": "e3901bbb-d27a-4b51-a55c-71d88b7bd197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:18:14.711207 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:2f:d4,bridge_name='br-int',has_traffic_filtering=True,id=e3901bbb-d27a-4b51-a55c-71d88b7bd197,network=Network(5c0bf35e-413d-4925-b608-d6fcbd8d04db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3901bbb-d2') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:18:14.711207 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:2f:d4,bridge_name='br-int',has_traffic_filtering=True,id=e3901bbb-d27a-4b51-a55c-71d88b7bd197,network=Network(5c0bf35e-413d-4925-b608-d6fcbd8d04db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3901bbb-d2') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 01:18:14.711530 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:14.711713 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:18:14.711827 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 01:18:14.712378 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:14.712517 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c6cdb463-4b9b-571a-9042-57d6022e8cd2', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:18:14.713346 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:14.713892 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:18:14.714200 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:14.716026 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:14.716154 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3901bbb-d2, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:18:14.716424 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape3901bbb-d2, col_values=(('qos', UUID('101ef988-3177-4685-806f-d13f95b44f9a')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:18:14.716584 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape3901bbb-d2, col_values=(('external_ids', {'iface-id': 'e3901bbb-d27a-4b51-a55c-71d88b7bd197', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:2f:d4', 'vm-uuid': 'e568a279-0fd0-4578-bcc9-bc41354730ed'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:18:14.717232 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:14.718201 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:18:14.722159 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:14.722799 np0000001577 nova-compute[98319]: INFO os_vif [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:2f:d4,bridge_name='br-int',has_traffic_filtering=True,id=e3901bbb-d27a-4b51-a55c-71d88b7bd197,network=Network(5c0bf35e-413d-4925-b608-d6fcbd8d04db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3901bbb-d2')
May 28 01:18:16.236181 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:18:16.236639 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 01:18:16.236639 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] No VIF found with MAC fa:16:3e:5a:2f:d4, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 01:18:16.236764 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Using config drive
May 28 01:18:16.741966 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:18:16.839064 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Creating config drive at /opt/stack/data/nova/instances/e568a279-0fd0-4578-bcc9-bc41354730ed/disk.config
May 28 01:18:16.841978 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e568a279-0fd0-4578-bcc9-bc41354730ed/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8py23w1m {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:18:16.893425 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e568a279-0fd0-4578-bcc9-bc41354730ed/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8py23w1m" returned: 0 in 0.051s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:18:17.244159 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:17.262425 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:17.263301 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:17.352178 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:17.356043 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:17.411816 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6375216b-8b27-4577-8eeb-7b18890faf2f req-46814686-8c47-42de-a05a-0ceaa8785492 service nova] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Received event network-vif-plugged-e3901bbb-d27a-4b51-a55c-71d88b7bd197 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:18:17.412362 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6375216b-8b27-4577-8eeb-7b18890faf2f req-46814686-8c47-42de-a05a-0ceaa8785492 service nova] Acquiring lock "e568a279-0fd0-4578-bcc9-bc41354730ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:18:17.412627 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6375216b-8b27-4577-8eeb-7b18890faf2f req-46814686-8c47-42de-a05a-0ceaa8785492 service nova] Lock "e568a279-0fd0-4578-bcc9-bc41354730ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:18:17.412860 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6375216b-8b27-4577-8eeb-7b18890faf2f req-46814686-8c47-42de-a05a-0ceaa8785492 service nova] Lock "e568a279-0fd0-4578-bcc9-bc41354730ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:18:17.413026 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6375216b-8b27-4577-8eeb-7b18890faf2f req-46814686-8c47-42de-a05a-0ceaa8785492 service nova] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Processing event network-vif-plugged-e3901bbb-d27a-4b51-a55c-71d88b7bd197 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 01:18:17.520749 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:17.521879 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:17.525799 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:17.526870 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:17.540768 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:18.855921 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779931098.8554816, e568a279-0fd0-4578-bcc9-bc41354730ed => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:18:18.856512 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 01:18:18.856783 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] VM Started (Lifecycle Event)
May 28 01:18:18.859801 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 01:18:18.862711 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Instance spawned successfully.
May 28 01:18:18.863075 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 01:18:19.359592 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:18:19.361523 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:18:19.369924 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:18:19.370095 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:18:19.370426 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:18:19.370670 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:18:19.370951 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:18:19.371221 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 01:18:19.572787 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-29a87ee6-05f8-4254-87eb-2002a99d9800 req-64966264-dfba-47d2-ae66-82e6f4e19e2e service nova] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Received event network-vif-plugged-e3901bbb-d27a-4b51-a55c-71d88b7bd197 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:18:19.572952 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-29a87ee6-05f8-4254-87eb-2002a99d9800 req-64966264-dfba-47d2-ae66-82e6f4e19e2e service nova] Acquiring lock "e568a279-0fd0-4578-bcc9-bc41354730ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:18:19.573034 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-29a87ee6-05f8-4254-87eb-2002a99d9800 req-64966264-dfba-47d2-ae66-82e6f4e19e2e service nova] Lock "e568a279-0fd0-4578-bcc9-bc41354730ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:18:19.573159 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-29a87ee6-05f8-4254-87eb-2002a99d9800 req-64966264-dfba-47d2-ae66-82e6f4e19e2e service nova] Lock "e568a279-0fd0-4578-bcc9-bc41354730ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:18:19.573290 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-29a87ee6-05f8-4254-87eb-2002a99d9800 req-64966264-dfba-47d2-ae66-82e6f4e19e2e service nova] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] No waiting events found dispatching network-vif-plugged-e3901bbb-d27a-4b51-a55c-71d88b7bd197 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:18:19.573412 np0000001577 nova-compute[98319]: WARNING nova.compute.manager [req-29a87ee6-05f8-4254-87eb-2002a99d9800 req-64966264-dfba-47d2-ae66-82e6f4e19e2e service nova] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Received unexpected event network-vif-plugged-e3901bbb-d27a-4b51-a55c-71d88b7bd197 for instance with vm_state building and task_state spawning.
May 28 01:18:19.717962 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:19.863583 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 01:18:19.864025 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779931099.8635948, e568a279-0fd0-4578-bcc9-bc41354730ed => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:18:19.864025 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] VM Paused (Lifecycle Event)
May 28 01:18:19.876378 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Took 10.27 seconds to spawn the instance on the hypervisor.
May 28 01:18:19.876524 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:18:20.366136 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:18:20.367993 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Emitting event <LifecycleEvent: 1779931100.3677897, e568a279-0fd0-4578-bcc9-bc41354730ed => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:18:20.368088 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] VM Resumed (Lifecycle Event)
May 28 01:18:20.385294 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Took 17.15 seconds to build instance.
May 28 01:18:20.870294 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:18:20.872278 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 01:18:20.886714 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b74af1e6-8c44-440c-8e59-2404a682ba72 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "e568a279-0fd0-4578-bcc9-bc41354730ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.658s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:18:21.704833 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:21.788739 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:22.439842 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-72cda9b9-4b98-41da-b4c0-549eb728220d req-64a0f5ea-1423-462f-b92e-99c0cdf2580c service nova] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Received event network-changed-e3901bbb-d27a-4b51-a55c-71d88b7bd197 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:18:22.440178 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-72cda9b9-4b98-41da-b4c0-549eb728220d req-64a0f5ea-1423-462f-b92e-99c0cdf2580c service nova] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Refreshing instance network info cache due to event network-changed-e3901bbb-d27a-4b51-a55c-71d88b7bd197. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 01:18:22.440178 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-72cda9b9-4b98-41da-b4c0-549eb728220d req-64a0f5ea-1423-462f-b92e-99c0cdf2580c service nova] Acquiring lock "refresh_cache-e568a279-0fd0-4578-bcc9-bc41354730ed" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 01:18:22.440315 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-72cda9b9-4b98-41da-b4c0-549eb728220d req-64a0f5ea-1423-462f-b92e-99c0cdf2580c service nova] Acquired lock "refresh_cache-e568a279-0fd0-4578-bcc9-bc41354730ed" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 01:18:22.440398 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-72cda9b9-4b98-41da-b4c0-549eb728220d req-64a0f5ea-1423-462f-b92e-99c0cdf2580c service nova] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Refreshing network info cache for port e3901bbb-d27a-4b51-a55c-71d88b7bd197 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 01:18:22.942090 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-72cda9b9-4b98-41da-b4c0-549eb728220d req-64a0f5ea-1423-462f-b92e-99c0cdf2580c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:18:23.197295 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-72cda9b9-4b98-41da-b4c0-549eb728220d req-64a0f5ea-1423-462f-b92e-99c0cdf2580c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:18:23.310784 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-72cda9b9-4b98-41da-b4c0-549eb728220d req-64a0f5ea-1423-462f-b92e-99c0cdf2580c service nova] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Updated VIF entry in instance network info cache for port e3901bbb-d27a-4b51-a55c-71d88b7bd197. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 01:18:23.311014 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [req-72cda9b9-4b98-41da-b4c0-549eb728220d req-64a0f5ea-1423-462f-b92e-99c0cdf2580c service nova] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Updating instance_info_cache with network_info: [{"id": "e3901bbb-d27a-4b51-a55c-71d88b7bd197", "address": "fa:16:3e:5a:2f:d4", "network": {"id": "5c0bf35e-413d-4925-b608-d6fcbd8d04db", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1322440036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12e4d85acc2e447481bb45dd2c61c94c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3901bbb-d2", "ovs_interfaceid": "e3901bbb-d27a-4b51-a55c-71d88b7bd197", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:18:23.812744 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-72cda9b9-4b98-41da-b4c0-549eb728220d req-64a0f5ea-1423-462f-b92e-99c0cdf2580c service nova] Releasing lock "refresh_cache-e568a279-0fd0-4578-bcc9-bc41354730ed" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 01:18:24.719170 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:26.789131 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:29.720063 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:31.790040 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:34.722083 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:36.791883 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:39.722819 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:41.793584 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:44.723773 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:46.795437 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:48.978374 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:18:48.978954 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:18:49.724944 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:50.978028 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:18:50.978349 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:18:50.978528 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 01:18:50.978705 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:18:51.482974 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:18:51.483126 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:18:51.483242 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:18:51.483358 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Auditing locally available compute resources for np0000001577 (node: np0000001577) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 01:18:52.500815 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-1 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 01:18:52.502494 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:18:52.503215 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:18:52.547451 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "env LANG=C uptime" returned: 0 in 0.044s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:18:52.547988 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Hypervisor/Node resource view: name=np0000001577 free_ram=13724MB free_disk=72.63306045532227GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 01:18:52.548163 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:18:52.548401 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:18:53.600173 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Instance e568a279-0fd0-4578-bcc9-bc41354730ed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 01:18:53.600504 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 01:18:53.600504 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Final resource view: name=np0000001577 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:18:52 up 50 min,  2 users,  load average: 1.54, 3.33, 3.79\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_12e4d85acc2e447481bb45dd2c61c94c': '1', 'io_workload': '0'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 01:18:53.677580 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:18:53.677795 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:18:54.180252 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:18:54.687304 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Compute_service record updated for np0000001577:np0000001577 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 01:18:54.687753 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.139s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:18:54.687753 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:18:54.725974 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:55.683580 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:18:55.683867 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:18:55.684045 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:18:55.684248 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:18:55.684499 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.29 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:18:56.182265 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:18:56.795023 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:59.301697 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "e568a279-0fd0-4578-bcc9-bc41354730ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:18:59.302241 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "e568a279-0fd0-4578-bcc9-bc41354730ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:18:59.302241 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "e568a279-0fd0-4578-bcc9-bc41354730ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:18:59.302241 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "e568a279-0fd0-4578-bcc9-bc41354730ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:18:59.302241 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "e568a279-0fd0-4578-bcc9-bc41354730ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:18:59.304380 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Terminating instance
May 28 01:18:59.726873 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:59.807196 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 01:18:59.821525 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:59.823321 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:59.838120 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:59.838665 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:59.855323 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:18:59.953334 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6ea417e5-ceae-454a-8147-c26e895807b2 req-4cc92aca-88ee-42d5-9399-0bd268885df0 service nova] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Received event network-vif-unplugged-e3901bbb-d27a-4b51-a55c-71d88b7bd197 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:18:59.954107 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ea417e5-ceae-454a-8147-c26e895807b2 req-4cc92aca-88ee-42d5-9399-0bd268885df0 service nova] Acquiring lock "e568a279-0fd0-4578-bcc9-bc41354730ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:18:59.954250 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ea417e5-ceae-454a-8147-c26e895807b2 req-4cc92aca-88ee-42d5-9399-0bd268885df0 service nova] Lock "e568a279-0fd0-4578-bcc9-bc41354730ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:18:59.954355 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ea417e5-ceae-454a-8147-c26e895807b2 req-4cc92aca-88ee-42d5-9399-0bd268885df0 service nova] Lock "e568a279-0fd0-4578-bcc9-bc41354730ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:18:59.954460 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6ea417e5-ceae-454a-8147-c26e895807b2 req-4cc92aca-88ee-42d5-9399-0bd268885df0 service nova] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] No waiting events found dispatching network-vif-unplugged-e3901bbb-d27a-4b51-a55c-71d88b7bd197 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:18:59.954595 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-6ea417e5-ceae-454a-8147-c26e895807b2 req-4cc92aca-88ee-42d5-9399-0bd268885df0 service nova] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Received event network-vif-unplugged-e3901bbb-d27a-4b51-a55c-71d88b7bd197 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:18:59.977815 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:18:59.978111 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 32.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:19:00.096215 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:19:00.112372 np0000001577 nova-compute[98319]: DEBUG nova.utils [None req-e632c327-981d-43a1-8925-58c9e5cddc14 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999605685000006 future=<Future at 0x7c984c568170 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:19:00.112372 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999203665000095 future=<Future at 0x7c984c568170 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:19:00.112372 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=14.999097016000178 future=<Future at 0x7c984c568170 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:19:00.114399 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Instance destroyed successfully.
May 28 01:19:00.114937 np0000001577 nova-compute[98319]: DEBUG nova.objects.instance [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lazy-loading 'resources' on Instance uuid e568a279-0fd0-4578-bcc9-bc41354730ed {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 01:19:00.617169 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T01:18:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1065971933',display_name='tempest-TestEncryptedCinderVolumes-server-1065971933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001577',hostname='tempest-testencryptedcindervolumes-server-1065971933',id=82,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKcqf1b1kHkgk7CP6iDz9tjswzkyL9AC3QXTIPy7r+3u8IN+xrtIdpC549FyH7JqPppdhFbZgwo7ZLsJWN8qAt+ouJ7wMZEJpdA0Ad1yFZeNezOR6dJxymzyVn7g3tKuw==',key_name='tempest-TestEncryptedCinderVolumes-912118481',keypairs=<?>,launch_index=0,launched_at=2026-05-28T01:18:19Z,launched_on='np0000001577',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001577',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12e4d85acc2e447481bb45dd2c61c94c',ramdisk_id='',reservation_id='r-wjjrqthi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestEncryptedCinderVolumes-1546758686',owner_user_name='tempest-TestEncryptedCinderVolumes-1546758686-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T01:18:20Z,user_data=None,user_id='341caf05b1b8426b9c4ed7ed3cad3ff5',uuid=e568a279-0fd0-4578-bcc9-bc41354730ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3901bbb-d27a-4b51-a55c-71d88b7bd197", "address": "fa:16:3e:5a:2f:d4", "network": {"id": "5c0bf35e-413d-4925-b608-d6fcbd8d04db", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1322440036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12e4d85acc2e447481bb45dd2c61c94c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3901bbb-d2", "ovs_interfaceid": "e3901bbb-d27a-4b51-a55c-71d88b7bd197", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 01:19:00.617782 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Converting VIF {"id": "e3901bbb-d27a-4b51-a55c-71d88b7bd197", "address": "fa:16:3e:5a:2f:d4", "network": {"id": "5c0bf35e-413d-4925-b608-d6fcbd8d04db", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1322440036-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "12e4d85acc2e447481bb45dd2c61c94c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape3901bbb-d2", "ovs_interfaceid": "e3901bbb-d27a-4b51-a55c-71d88b7bd197", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 01:19:00.617993 np0000001577 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:2f:d4,bridge_name='br-int',has_traffic_filtering=True,id=e3901bbb-d27a-4b51-a55c-71d88b7bd197,network=Network(5c0bf35e-413d-4925-b608-d6fcbd8d04db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3901bbb-d2') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 01:19:00.618210 np0000001577 nova-compute[98319]: DEBUG os_vif [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:2f:d4,bridge_name='br-int',has_traffic_filtering=True,id=e3901bbb-d27a-4b51-a55c-71d88b7bd197,network=Network(5c0bf35e-413d-4925-b608-d6fcbd8d04db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3901bbb-d2') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 01:19:00.619462 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:19:00.619768 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3901bbb-d2, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:19:00.637536 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:19:00.638580 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:19:00.639093 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:19:00.639240 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=101ef988-3177-4685-806f-d13f95b44f9a) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 01:19:00.639695 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:19:00.640152 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:19:00.640357 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:19:00.641951 np0000001577 nova-compute[98319]: INFO os_vif [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:2f:d4,bridge_name='br-int',has_traffic_filtering=True,id=e3901bbb-d27a-4b51-a55c-71d88b7bd197,network=Network(5c0bf35e-413d-4925-b608-d6fcbd8d04db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3901bbb-d2')
May 28 01:19:00.645174 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 01:19:00.645459 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7c98704afb90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398', 'iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e066114e-113d-4f8d-81ad-add9cdea1398', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 01:19:00.645679 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 01:19:00.646129 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 01:19:00.646538 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398', 'iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e066114e-113d-4f8d-81ad-add9cdea1398', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 01:19:00.646764 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 01:19:00.667317 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [233] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398 (non-flash)
May 28 01:19:00.667317 np0000001577 nova-compute[98319]: tcp: [234] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398 (non-flash)
May 28 01:19:00.667317 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 01:19:00.667492 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsi session list stdout=tcp: [233] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398 (non-flash)
May 28 01:19:00.667492 np0000001577 nova-compute[98319]: tcp: [234] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398 (non-flash)
May 28 01:19:00.667492 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 01:19:00.667603 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398', '233'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398', '234')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 01:19:00.667603 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398', '233')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:19:00.668329 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398', '234')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 01:19:00.668906 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7c984c7751c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398'): ({'sdc'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 01:19:00.669073 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 01:19:00.669271 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Flush multipath device 330000000babe0f9a {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 01:19:00.693212 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:19:00.744995 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 01:19:00.780905 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 01:19:00.781074 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 01:19:00.781766 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 01:19:00.796140 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 01:19:00.796335 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 01:19:00.809657 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:19:00.833621 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 233, target: iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398, portal: 192.168.40.100,3260]
May 28 01:19:00.833621 np0000001577 nova-compute[98319]: Logout of [sid: 233, target: iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398, portal: 192.168.40.100,3260] successful.
May 28 01:19:00.833621 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:19:00.844470 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:19:00.854486 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:19:00.878409 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 234, target: iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398, portal: 192.168.50.100,3260]
May 28 01:19:00.878409 np0000001577 nova-compute[98319]: Logout of [sid: 234, target: iqn.2023-03.storpool.com:os--volume-e066114e-113d-4f8d-81ad-add9cdea1398, portal: 192.168.50.100,3260] successful.
May 28 01:19:00.878409 np0000001577 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:19:00.888663 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 01:19:00.889951 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.244s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 01:19:00.890074 np0000001577 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] <== disconnect_volume: return (244ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 01:19:00.890189 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 01:19:00.890434 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Deleting instance files /opt/stack/data/nova/instances/e568a279-0fd0-4578-bcc9-bc41354730ed_del
May 28 01:19:00.890936 np0000001577 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Deletion of /opt/stack/data/nova/instances/e568a279-0fd0-4578-bcc9-bc41354730ed_del complete
May 28 01:19:01.396379 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Took 1.59 seconds to destroy the instance on the hypervisor.
May 28 01:19:01.396838 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 01:19:01.397122 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 01:19:01.397244 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 01:19:01.397416 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:19:01.461284 np0000001577 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 01:19:01.797807 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:19:01.861659 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-102e4141-7cdc-498b-aafc-c68f17021072 req-4884ce73-f69b-4b32-8c61-434f548e72ad service nova] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Received event network-vif-deleted-e3901bbb-d27a-4b51-a55c-71d88b7bd197 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:19:01.862007 np0000001577 nova-compute[98319]: INFO nova.compute.manager [req-102e4141-7cdc-498b-aafc-c68f17021072 req-4884ce73-f69b-4b32-8c61-434f548e72ad service nova] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Neutron deleted interface e3901bbb-d27a-4b51-a55c-71d88b7bd197; detaching it from the instance and deleting it from the info cache
May 28 01:19:01.864151 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-102e4141-7cdc-498b-aafc-c68f17021072 req-4884ce73-f69b-4b32-8c61-434f548e72ad service nova] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Detach interface failed, port_id=e3901bbb-d27a-4b51-a55c-71d88b7bd197, reason: Instance e568a279-0fd0-4578-bcc9-bc41354730ed could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 01:19:02.004246 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-78a567f0-9834-4fa1-bd14-7bccf8608bcc req-366721ad-59c1-4349-bb5c-44ebbde9844d service nova] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Received event network-vif-unplugged-e3901bbb-d27a-4b51-a55c-71d88b7bd197 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 01:19:02.004518 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-78a567f0-9834-4fa1-bd14-7bccf8608bcc req-366721ad-59c1-4349-bb5c-44ebbde9844d service nova] Acquiring lock "e568a279-0fd0-4578-bcc9-bc41354730ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:19:02.004729 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-78a567f0-9834-4fa1-bd14-7bccf8608bcc req-366721ad-59c1-4349-bb5c-44ebbde9844d service nova] Lock "e568a279-0fd0-4578-bcc9-bc41354730ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:19:02.004902 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-78a567f0-9834-4fa1-bd14-7bccf8608bcc req-366721ad-59c1-4349-bb5c-44ebbde9844d service nova] Lock "e568a279-0fd0-4578-bcc9-bc41354730ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:19:02.005066 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-78a567f0-9834-4fa1-bd14-7bccf8608bcc req-366721ad-59c1-4349-bb5c-44ebbde9844d service nova] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] No waiting events found dispatching network-vif-unplugged-e3901bbb-d27a-4b51-a55c-71d88b7bd197 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 01:19:02.005214 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [req-78a567f0-9834-4fa1-bd14-7bccf8608bcc req-366721ad-59c1-4349-bb5c-44ebbde9844d service nova] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Received event network-vif-unplugged-e3901bbb-d27a-4b51-a55c-71d88b7bd197 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 01:19:02.299899 np0000001577 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 01:19:02.801894 np0000001577 nova-compute[98319]: INFO nova.compute.manager [-] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Took 1.40 seconds to deallocate network for instance.
May 28 01:19:03.342616 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Took 0.54 seconds to detach 1 volumes for instance.
May 28 01:19:03.848400 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:19:03.848910 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:19:03.934919 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:19:03.935091 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:19:04.437268 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:19:04.943177 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.095s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:19:04.985215 np0000001577 nova-compute[98319]: INFO nova.scheduler.client.report [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Deleted allocations for instance e568a279-0fd0-4578-bcc9-bc41354730ed
May 28 01:19:05.645361 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:19:05.992095 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d67b495c-1869-4262-99c3-a037dd6ec9d7 tempest-TestEncryptedCinderVolumes-1546758686 tempest-TestEncryptedCinderVolumes-1546758686-project-member] Lock "e568a279-0fd0-4578-bcc9-bc41354730ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.690s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:19:07.121313 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:19:09.589516 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:19:10.660355 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:19:11.067661 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:19:15.111562 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7c988f95f800>>, remaining_delay=-0.00034707599979810766 future=<Future at 0x7c984c568170 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7c988de5a810> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:19:15.112042 np0000001577 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 01:19:15.112185 np0000001577 nova-compute[98319]: DEBUG nova.virt.driver [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] Emitting event <LifecycleEvent: 1779931140.1110635, e568a279-0fd0-4578-bcc9-bc41354730ed => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 01:19:15.112374 np0000001577 nova-compute[98319]: INFO nova.compute.manager [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] VM Stopped (Lifecycle Event)
May 28 01:19:15.615086 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-294d3ce6-2eb7-4837-a4fd-3e77e848f384 tempest-TestVolumeBootPatternV346-1741753090 tempest-TestVolumeBootPatternV346-1741753090-project-member] [instance: e568a279-0fd0-4578-bcc9-bc41354730ed] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 01:19:15.669482 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:19:20.672212 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:19:20.672595 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:19:20.672595 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=98319) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 01:19:20.672595 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98319) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 01:19:20.685448 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:19:20.685697 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98319) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 01:19:25.690956 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:19:25.691457 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:19:25.691457 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98319) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 01:19:25.691457 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98319) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 01:19:25.701468 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:19:25.701676 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98319) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 01:19:30.707256 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:19:30.707256 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:19:30.707256 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98319) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 01:19:30.707256 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98319) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 01:19:30.714308 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:19:30.714564 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98319) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 01:19:31.978616 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:19:31.978616 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98319) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 28 01:19:32.480169 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 11.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:19:35.724363 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:19:40.725412 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:19:43.978239 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:19:44.480029 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 7.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:19:45.737728 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:19:45.738211 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:19:45.738211 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98319) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 01:19:45.738211 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98319) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 01:19:45.741387 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:19:45.741560 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98319) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 01:19:50.742725 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:19:50.743155 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:19:50.743155 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=98319) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 01:19:50.743155 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98319) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 01:19:50.752385 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:19:50.752575 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98319) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 01:19:51.479787 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:19:51.480063 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:19:51.984734 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:19:51.985210 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:19:51.985210 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:19:51.985210 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Auditing locally available compute resources for np0000001577 (node: np0000001577) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 01:19:51.996716 np0000001577 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 01:19:51.997474 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 01:19:52.051056 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CMD "env LANG=C uptime" returned: 0 in 0.053s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 01:19:52.051504 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Hypervisor/Node resource view: name=np0000001577 free_ram=14239MB free_disk=72.6324348449707GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 01:19:52.051672 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 01:19:52.051858 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 01:19:53.099720 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 01:19:53.100018 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Final resource view: name=np0000001577 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:19:52 up 51 min,  1 user,  load average: 0.75, 2.79, 3.58\n'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 01:19:53.139129 np0000001577 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 01:19:53.139358 np0000001577 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed in ProviderTree for provider: 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 01:19:53.642321 np0000001577 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Inventory has not changed for provider 78eed366-a2f0-4ead-b3a1-1ceb637e76c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 01:19:54.148127 np0000001577 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Compute_service record updated for np0000001577:np0000001577 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 01:19:54.148598 np0000001577 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.096s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 01:19:54.148598 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:19:54.646428 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:19:54.646722 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:19:54.646892 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 01:19:54.647167 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.33 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:19:54.974488 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:19:54.974814 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:19:54.977727 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:19:54.977923 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:19:54.978178 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 7.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:19:55.753215 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:19:55.753715 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:19:55.753715 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=98319) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 01:19:55.753715 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98319) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 01:19:55.759375 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:19:55.759566 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98319) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 01:20:00.762570 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:20:00.762987 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:20:00.762987 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=98319) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 01:20:00.762987 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98319) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 01:20:00.782667 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:20:00.782889 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98319) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 01:20:01.978068 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:20:01.978524 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 7.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:20:05.791694 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:20:08.978402 np0000001577 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 01:20:08.978402 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Cleaning up deleted instances {{(pid=98319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 28 01:20:09.480364 np0000001577 nova-compute[98319]: DEBUG nova.compute.manager [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] There are 0 instances to clean {{(pid=98319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 28 01:20:09.480623 np0000001577 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-4135946d-8e27-4331-9502-1a110d42e125 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 42.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 01:20:10.803505 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:20:10.804005 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:20:10.804005 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5011 ms, sending inactivity probe {{(pid=98319) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 01:20:10.804005 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98319) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 01:20:10.804257 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98319) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 01:20:10.804257 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:20:15.806918 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:20:15.807341 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:20:15.807341 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=98319) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 01:20:15.807341 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98319) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 01:20:15.811606 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:20:15.811806 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98319) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 01:20:20.812289 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:20:25.817740 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:20:25.818119 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:20:25.818119 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98319) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 01:20:25.818119 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98319) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 01:20:25.827674 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:20:25.827904 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98319) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 01:20:30.833114 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:20:30.833513 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 01:20:30.833513 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98319) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 01:20:30.833513 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98319) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 01:20:30.836627 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 01:20:30.836767 np0000001577 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98319) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}